James A. David bought the house on a 35-acre lot in 1856. When he died in the 1880s, his son, Charles A. David, inherited the home. Charles A., a merchant, resided in the home until 1922. When he was a young man, Charles A. worked at Stradley & Barr's Dry Goods Store on Main Street. An essayist and artist as a hobby, his cartoons were published in Harpers Weekly in 1885. He began writing a column for the local newspaper, the Greenville News, in 1926, called Greenville of Old. Charles A. lived until 1934.
Albert Drane Oliphant purchased the Earle Town House in 1927. He had married Mary Chevillette Simms in 1917 and the couple resided in Columbia, where Mr. Oliphant worked for the state's board of charities. In 1920 the couple and their children moved to Greenville. Mrs. Oliphant, a historian and author, was a granddaughter of the poet and novelist William Gilmore Simms. Like her grandfather, Mrs. Oliphant penned a history of South Carolina for schoolchildren. One version, A Simms History of South Carolina, was in use in its 9th edition until the mid-1980's. She hired an architect named Willie Ward who renovated the house to a Georgian style, removing a wing and a colonnaded porch. Three rooms were added to the second floor and a staircase was moved. Mrs. Oliphant was active in local historical organizations including the Upper Carolina Society and the Historical Records Committee.
Mr. Oliphant died in 1935. The home continued to be occupied by Mrs. Oliphant, her three children, and two of her sisters with their children (no wonder they needed extra rooms upstairs!). In 1937, Mrs. Oliphant began publishing the papers of her grandfather to prepare to write his biography. Mrs. Oliphant and her daughter, Mary Simms Oliphant, authored a state history text for third graders in 1947. From 1956 to 1958, Mrs. Oliphant was the director of the South Carolina State Public Library Association.
The Earle Town House was one of the first National Register of Historic Places listings in Greenville and was added in 1969, when the house's name may have been invented by Mrs. Oliphant. The house has been part of the Colonel Elias Earle Historic District since 1982. The two-story, white frame structure with a piazza on its west side is surrounded by decorative gardens and currently hidden from the road behind tall hedges. The iron grillwork gate is present in a gap in the hedges. Fine interior details remaining from the nineteenth century include hand-carved mantels and paneled doors. Mrs. Oliphant still owned the Earle Town House when she passed away in 1988 at age 97. The privately-owned residence is not open to the public.