Fite went to work building ramps and terraces out of the rubble left behind. His original plan was that the terraces would lead to the sculptures, but the work gradually took on a life of its own. He realized that the central sculpture, a 1.5 ton work called Flame, was too small to suit the scale of what he was doing in the quarry. Flame was replaced many years later with a 9 ton bluestone slab from a nearby riverbed.
Opus 40 began with 6.5 acres, but Fite gradually added a wood and stone home, a garage, a blacksmith's shop, and increased the amount of land to more than 70 acres. He also built the Quarryman's Museum, a small gallery to showcase the tools he used in his work. All of the work at Opus 40 was done solely by Fite.
For many years, the site had no name. Fite settled on Opus 40 because he believed it would take 40 years to complete. As it happened, Fite was killed in an accident on the site in 1976, 37 years after beginning his work there.
Opus 40, which is listed on the National Register of Historic Places, is open to the public but closes occasionally for weddings and other events.