When Approximations Fail