Treasure chests spawn often in the between. ( replaced in 1.3 )

The Ziggurat is a large "structure" that extends to world height.