Vespacian Miller was the oldest son of Isaac Miller, who in 1767 moved to Dummerston to survey the town for its proprietors. Reportedly a sea captain, Vespacian moved here before the Revolution and built a one-room, plank-sided house where his son Joseph was born. In 1792, he built a more conventional half Cape, retaining the original house at its rear for farm use. About this time he also built a multipurpose English barn with gunstock posts and clear girts. Joseph's son, Joseph Jr., continued operating the one-hundred-and-thirty-five-acre farm. About the time of his second marriage, to Sophia Arms in 1843, Joseph Jr. added a Greek Revival I-house onto the front of the 1792 dwelling and an ell with segmental-arched wagon bays at its rear. After 1849, he made room in this building for the town offices, serving as town clerk until 1884. He also recycled the c. 1790 barn into a larger, two-story hay barn, added sheds onto each end of the 1792 house, and roofed it in slate. Next he built a gabled bank barn with a stylish cupola for stock. With one hundred apple trees in 1884, Joseph Jr. was a local pioneer in orcharding. His son J. Arms succeeded to the one-hundred-acre Reed farm up the road, while his younger son Adin F. took over this farm. J. Arms's son Dwight sold his dairy herd in the 1920s to put more land into orchards, eventually acquiring his uncle Adin's farm. Today, Dwight's descendants continue to grow apples on both farms, and their orchards are well known throughout area.