Too Greedy and Too Deep