Unfortunately for these men, many years passed before anyone gave them much thought. After the war, a naval yard was constructed at the site of these British jails, but the men simply picked up bones they saw and placed them in boxes. It wasn't until the late 1700s, when a conflict between Federalists and Republicans arose, that the idea for a memorial was suggested. It came up when the Republicans questioned Federalists building a monument in honor of George Washington. Despite the idea being suggested, a monument was still put off for a few more years until the British started causing problems for the new nation around 1806. Finally, in 1808, Republicans used anti-British sentiment to push for the creation of a monument to honor the dead.
After finally overcoming the obstacle of gaining support for the monument, the monument would face the challenge of father time. The first attempt at a monument was a vault built to honor the dead, but it soon fell to damage caused by neglect. In 1873, another attempt was made to create a monument. It was built in Fort Greene Park. The bones of the dead were moved there. Then, with the discovery of more bones in the early 1900s, the monument was approved to be rescaled to a larger size. Over the next 100 years, the monument took significant damage from theft, vandalism, and natural decay due to more neglect. Once more, in the early 2000s, the monument underwent a new makeover and was restored to its former glory.