Elias Baker passed away in 1864 while Betty remained in the home until her death in 1900. Their son Sylvester Baker and their daughter Anna remained in the mansion until Anna passed away in 1914. After Anna’s death, the mansion remained closed until 1922, when Blair County Historical Society leased the building. The society used the building to operate a museum, and in 1941, the society was able to purchase the building due to donations from a variety of community members . In 2001, major exterior rehabilitation to the building was completed. Tours through the mansion are available by appointment.