Semiclassical Gravity from the Inside Out