Empirical Study of Policy Evaluation