Little was done with the building until 1908, when it was entrusted to the Drummondtown Branch of the Association for the Preservation of Virginia Antiquities. A partial restoration of the building was done in 1911 as they converted it into a library. A full restoration would occur in 1953, nearly twenty years after the library was closed.
At the time of its construction, the building was part of a larger jail complex, occupying the southeast corner of the 70 foot courtyard. The structure itself is a one-story, three-bay red brick building, approximately 18 feet by 30 feet, with a pair of chimneys on either side of the building. Following the 1953 restoration, the interior was refurbished to resemble a typical 18th century home and turned into a museum. It was added to the National Register of Historic Places in 1976 as one of only three debtors' prisons on the list.