The starting house is a structure that spawns at world creation, made primarily of cobblestone, with a top floor and a hidden basement, there is no special loot in the starter house, or any special creature spawns.

An empty basement (the hole is from me)

Nothing is in the basement other than 3 ladders and some moss carpet.