I camped on the islands in the Hudson area, just south of the swing bridge. its about a 5min run to the bayport in my boat @ about 25mph. i believe, you can camp on the islands north of stillwater as well.
I was able to find some sturgeons closer to the islands as well. I would look for areas of deeper water anywhere from 30-38′