A Space to Remember Our Losses