The house passed on to his son Wilbur, who switched properties with the prominent businessman Samuel R. Ewing in October 1905. This was called one of the largest real estate deals made in Owensboro for some time by The Owensboro Messenger. Ewing immediately began extensive remodeling of the residence, which included adding the front porch. In 1945, the building was bought by Haley-McGinnis & Owensboro Funeral Home, and has since remained with them.
The original building had a four story square tower, the fourth story being a widow's walk, and a large central hall with a staircase leading up to the six bedrooms. The parlor and library, the main places of entertaining, had 14 foot ceilings. There was also a metal spiral staircase & a wrought iron fence, both of which were taken down and donated to war effort during WWII. The fourth level of the tower was removed in 1920, and few original details of the ﬁrst ﬂoor remain.
The building's original architect, Thomas J. Blanchard, was the great-grandfather of Allen W. Haley, former president of the Haley-McGinnis Funeral Home. According to her obituary in 1899, Rachel Stirman designed the house herself and drew the plans by hand. The house has been the subject of local lore, including the different stories behind the nickname, and an uncorroborated story of a visit by Clara Barton.