I never found many close little hotels. There is a nice little campgrounds right on the water… south of Oshkosh with places to tie off and leave a boat in the water as well if I am correct.
Never camped there, but heard good things, and from the water it looks nice and clean. Just minutes by water from the reefs, and what I consider some of the best spots to fish that time of the year.
http://kalbuscountryharbor.com/