Also known as the Witte's Marine Salvage, the boats here were planned to be scrapped by the Donjon Iron and Metal Scrap Processing Facility. Unfortunately, because the owner of the place had been getting boats quicker than he could scrap them, many of the vessels are now left rotting, rusting and in decay.
I do suggest that you come here. However, I will give you some bits of advice if you do. Firstly, go at low tide. You will see a lot more cool stuff by going at a strategic time. Try to choose a sunny day. Secondly, bring boots. If you want to actually get onto the boats, you will have to track through muck which will suck you in. If you do go out on the boats, be careful. The weather and the waters have rusted the metal, and planks of wood easily break off. Good balance is a must here. Be physically capable of navigating your way around. It's not easy. I'm pretty light, and I still managed to poke a hole in the rust of a ship. I didn't fall in but I was lucky that time. The last thing we need here is an accident that will result in the place getting sealed up.
Do some research. Many other sites feature this location. Opacity is a great one. Keep in mind that the photos taken there are from five years ago. The location is in worse condition now. The place is even featured on NYC Go, so perhaps it can already be considered a tourist attraction. Make sure to read up on it, and know before you go. This is an under-appreciated, incognito part of New York City's history, so going there is definitely an experience.