Earlier writings about the house state that it was built in 1845, but this has not yet been documented. Joel Partridge was a carpenter, builder, and lumber dealer, so it is possible that he built the house about 1845 as he was living in the neighborhood at that time. From physical evidence in the older part of the house, the structure was there by the 1860s and included the part that is now behind the front two-story porch. The Village of Jamestown assessor records in 1865 indicate that Joel Partridge owned two lots and houses on the west side of Prospect Street.

 Porter Sheldon purchased the house and 2 ½ acres from Joel Partridge on January 2, 1871. The 1871 assessment on the house and lot on Prospect Street was $2,100. In November 1873, the assessed value was $2,500, indicating something was done to the house. Physical evidence bears this out; it appears that the front door, hallways, staircase, and stained glass windows at the north end of the house were added at that time. In 1881, the assessed value was $3,000, and in 1882, it was $4,000, indicating some major changes to the structure: the addition to the north end of the house, including the two rooms and porches on the first floor and the bedrooms and bathrooms on the second floor. At this time, the mansard roof was added, as well as the woodwork to some of the rooms.

Other changes to the house are seen in the porches that were changed to two-story porches with columns, most likely around the turn of the century during the Greek Revival. The fireplaces in the two-story bay on the southeast corner were added later.

 In 2000, the Partridge-Sheldon House was added to the National Historic Registry.