Callow Croft was probably built in the late 16th and early 17th centuries of stone with timber frame, there is evidence of a large hall but little is known of its early history. The west part has been dated at late 16th century and the east part at the 17th. It was possibly used by the Bishop as a hunting lodge and later it was owned by Withers Farm.