Brigham Young planned the construction of a mansion that stood at this location until 1921 and was home to several leaders of the Church of Jesus Christ of Latter-Day Saints. Construction began in 1873 and occurred in phases while the home was occupied by Young's widows. The property was completed a decade later and the center of many events in the early history of the LDS Church from important decisions to a federal raid. The name Gardo was a reference to a novel that Brigham Young read and followed Joseph Smith's idea to have an official residence that would accommodate travelers who came to speak with church leaders. Church presidents John Taylor and Wilford Woodruff lived in the home. The property was later purchased by Edward Holmes who expanded the structure and hired designers from Marshall Fields to furnish the interior. The home fell into disrepair and was demolished in 1921.
Church of Jesus Christ of Latter-Day Saints leader Brigham Young led efforts to construct a vast estate at this location in 1873. Construction was guided by Joseph Ridged and William Harrison Folsom, two notable designers of the area at the time.
Construction for the home was slow, with delays caused in by the time it took to receive building materials. Due to these setbacks, Brigham Young never witnessed the completion of the home. John Taylor took Young's place as the leader of the church, and he moved into the home in 1879. Young had an office in the home that was the location of many meetings attended by church leaders.
One of the leading concerns at this time was the Edmunds Act, an 1882 law that made polygamy a felony punishable by a fine or prison time. The Edmunds-Tucker Act followed five years later and revoked the church's incorporation and ordered the seizure of church property valued over $50,000. The church eventually barred the practice of polygamy, but the laws at this time was understood by many members as a hostile act given the long history of persecution they had faced in previous decades.
Wilford Woodruff was the next president of the Church after John Taylor's death in 1887 and also maintained an office at the Gardo House. Because the church owned the property and faced fees and taxes because of the Edmunds-Tucker Act, church leaders tried to have this home certified as a parsonage. The effort failed and the Gardo House was eventually leased to the Keely Institute. This organization focused on alcohol and drug addiction and only used the home for a year. Church leaders decided to rent out the home over the next few years.
The Gardo House was purchased by Edward F. Holmes in 1901 as a present for his wife. The Holmes redecorated their new home, bringing the mansion to a new level of notoriety. The couple held lavish parties with various entertainments and had hundreds of visitors on days at home. The Holmes resided in the home till around the start of World War I. Becoming more accustom to their home in California, they listed the mansion, yet could not find a suitable buyer. Due to this, they lent the Gardo House to the Red Cross who commonly held lessons on health and basic skills till the war's end.