The Smith-Montgomery House located at 103 South Penn Street is a historic home within Blacksburg's original sixteen squares. It was built by Adam Croy, whose family owned many lots on the blocks between Jackson and Lee during the 1800s. According to local tradition, the home was moved across the street from its original location after its purchase by a Dr. Philips. Neither the date nor the reason for the relocation are known.
During the 1800s, the Croy family owned many lots on the blocks between Jackson and Lee. The family ran a number of businesses within the town. Adam Croy, the original owner of the home at 103 South Penn Street, was the sexton of the Blacksburg Methodist Church. As sexton, he blew a horn that alerted people when it was time for
church services to begin. Croy built the two-story, single-pen log house sometime in the early nineteenth century on lots 37 and 38, which he bought from the trustees of the town of Blacksburg. According to local tradition, a Dr. Philips bought the home and moved it across the street where it stands today. Philips had the home dismantled, after which the numbered logs were rolled across the street and reassembled. During the process, the home received an L-shaped addition and a brick chimney. In the 1900s, the central door was filled in to serve as a bookcase and the entryway was relocated to the northwest bay of the formerly-symmetrical three-bay facade.