The house changed hands multiple times over the years until it was acquired by Reverend Dr. W. A. R. Goodwin in 1926. Goodwin is considered to be the the Father of the Restoration of Colonial Williamsburg due to his preservation efforts. Colonial Williamsburg would come into possession of the property in 1938. Today, the house is listed on the National Register of Historic Places as part of the Williamsburg Historic District.
The Wythe House has not changed much structurally since it was first constructed. It is a two-story red brick house built in the early Georgian style, based off of examples found in Palladio Londinensis, a 1734 book by architect William Salmon. The house has undergone two restorations, one from 1927-1931 and the other from 1939-1940, the latter of which saw the interior furnishings replaced with those more appropriate for the 18th century.