Edinburgh is SMALL.  A 1 mile radius from the castle covers everything so anywhere in either new town or old town is fine.