The Ashley-Willis House is a unique example of Greek Revival architecture in South Carolina, as it features a wide-gable front porch which was an uncommon element for residences built in this style. It was probably built by a member of the Ashley family in 1833 and later owned by the Willis family, for whom the town is named. Added to the National Register of Historic Places in 2004, the house is owned by a descendent of the Willis family who is in the process of renovating it.
The house has some military significance as well. During General Tecumseh Sherman's March to the Sea campaign in 1865, the Confederate commander in area, General Judson Kilpatrick, used the home as his headquarters before burning the town and retreating to Aiken and Columbia. The house was also located at a strategic location between two railroads, which Sherman wanted to destroy. After the war the Hollis family lived at the house until 1917. Two other families resided here until 1993.