Once he learned the trade of being a barber, he did very well. He worked at the Mills House Hotel, which was a prestigious establishment. He married a woman named Susan and they had three children.
Joseph Rainey was drafted by the state to help build Confederate fortifications. Soon after him and his wife escaped to Bermuda. In Bermuda he continued his Barber work as well as sought more education. They returned back to South Carolina in 1866. Two years later he was elected to the state senate. Two years after that he was selected to replace Benjamin Whittemore's, a white man, position as Congressman.
The home was renovated in the 1970s. Regardless of it being renovated it still holds some of the originality such as the panel floors, cypress paneling, as well as wainscotting. You can also find more history on Joseph Rainey at the Georgetown Rice Museum. The museum has a huge exhibit dedicated to Rainey and his connection to the town.