Looking at the foundation that remains, it is difficult to see a family of four (or possibly 6) living in such a small structure. Of course, that would have been the cellar, and the living quarters above could have extended over the land next to the foundation, creating more space. On the other hand, one wall of the foundation is open, possibly indicating it was a shed or other outbuilding, rather than a house.
On the opposite side of the former road, a larger, roughly square indentation in the forest floor might be the remains of a second, larger structure. A small hole next to it could possibly be the site of a privy. The LIDAR (terrain elevation) image below shows Pond St. (yellow dots), the trail (green dots), and the road on the adjacent Egan property (blue dots). In the center are two depressions on either side of the trail. The one below the trail is the identified cellar hole. The other one may be the possible second foundation.
A line of stones crossing the path at the site previously continued into the woods on a faint path (now obliterated by the new construction). That path led from this larger hole, further indicating that there might have been a structure there.
Harry Cheney's description of the house site does not mention a second structure. However he says that the house at the existing foundation was gone long before any of his old neighbors could remember, so any evidence of a second house may have been long gone as well.
Answers might be found via a formal archaeological investigation of the site, and/or consultation with an expert on colonial era buildings, who might be able to say if the existing foundation would have supported a family of four.