Rose Hill was built in 1852 for Emory Low, a Louisville dry goods merchant born in Leominster, Massachusetts in 1808. At one time he owned an entire block of Louisville's Main Street. While Rose Hill was still under construction, Low was killed when an outhouse wall collapsed on him.