From what I have seen not a lot of ice fishing takes place in that stretch of river. Very pretty area up that way but limited access to many areas.
I have ice fished at Osceola. There is a back channel at the park that holds some pan fish not that I have every gotten into them real well there. There is also a spot on the north side of the road there that gets fished in the western backwater. There is a spring or stream that flows in there that keeps part of this open. Believe you will need a mn license to fish this back water lake.
Have heard that you can also fish the rock island area. You can access this from the franconia landing about 1/4 mile south of there. I have caught many crappies and walleyes in the fall in this area but have never ventured out on the ice. Use caution in this area. I do believe there are some current seams that may not get much ice cover.
Another spot I would like to try is a deeper hole on the main channel at Peasley lake. Hear again have caught many crappies and walleyes in the fall but have never ice fished it. This area is about half way between franconia and osceola. Best access may be from Franconia. I would guess a mile to mile and a half down river.