Morse grew up on a family farm in Thomaston, Maine. He was born to Obadiah and Chloe Morse in 1842, both descendants of a long line of English Puritans. Sadly, his father died when he was four and Charles spent his childhood working on the farm until he was seventeen when he left for a short-term stay in England. Upon his return, his interest in the California Gold rush inspired the young man to travel west to California.
Rather than traverse the length of what is now the contiguous U.S., Morse joined many other Americans on the East Coast by traveling to California via ship. As would be the case with most would be gold miners, the dream of striking it rich quickly proved chimerical. In 1862, Morse put mining life behind him and moved to Santa Clara where he worked several jobs including painting houses. After painting homes for a dozen years he discovered an interest in seeds.
In 1877, Morse seized on an opportunity that would reward him financially -- he and his business partner, A.L. Kellogg, purchased a small plot of farming land from R. W. Wilson for $20,000. The transaction included the acquisition of a few Eastern seed firm clients, a small warehouse and materials such as drying sheets cleaning machines and a few farming tools. It wouldn't be long before that small plot of land transitioned into the Ferry-Morse Seed Company, one of the largest vegetable and flower seed growers and supplies in the world.
Construction on the three-story Morse home finished in 1892, built as a classic Queen Anne Victorian. The house includes a raised basement, twin gables, witches' hat turret, and a host of ornate decor. The mansion's inside is adorned with elegant wood molding, stained glass windows, and chandeliers. Morse lived in the home with his wife, Maria Josephine Victoria, who he married in 1868, and five children. A local newspaper at the time described the mansion as the house that seed built.