Looking Back to Plan Ahead