Of the one thousand four hundred men that served in the unit, three hundred and seven died. Three colonels who led the unit died during the war. Colonel George Lumbard died at The Wilderness in Virginia while Colonel Harrison Jeffords died at Gettysburg and Dwight Woodburd who had died at Malvern Hill. After two years of action, the Fourth Infantry was reorganized and returned to Camp Williams for further training.
Following the end of the Civil War, Adrian College ceased to be officially Camp Williams and returned to its original purpose of higher education. With the exception of this marker, there are no physical indications of the college's role as a training camp for the Fourth Infantry.