The lake proper doesn’t offer a very strong winter fishery anymore. There are a few areas that will hold a few fish. The beach at Frontenac can be good but one needs to be careful of thin ice over the wing dam there, especially with kids along. The beach at Hok-Si-La can be good fishing late in the day when shadows start to fall on the trees. Trailer Point historically was a great place to fish, the up-stream side of the point, but that hasn’t been the case in many years. You may find some fishing downstream from the ramp at Roschen Park….second and third creek areas, but be wary of the ice if you venture down that way.
The lake can toss up some large pressure ridges so be careful near those as the ice can fracture quite a ways away from the fault itself. Open water can be around the cracks as well.
I’d spend my time chasing panfish closer to Wabasha’s backwaters between there and Nelson Wisconsin. The backwaters found below Wabasha and near Kellogg are also good for panfish. Try the marina in Wabasha on young ice for panfish. Wilcox Landing and West Newton areas are pretty consistent panfish producers.
Do yourself a favor and look up the DNR’s website and go to publications. Find the “Mississippi River Guide” and have them send you a copy. Its free and it will show you all of the places I have mentioned to help you get around on the ice but its also a dandy guide for the boat too.