Frankb-
Call River’s Edge (for the Dells)… they most likely still offer a service of transporting you and the Kayak to the dam area, where you can fish up there, or work down stream. I have fished from the resort down river a couple times in the Kayak last year… the longer trips being around 11 miles to a spot called Pine Island.
If you are going with someone, and shuffle around a bit in a second vehicle, consider leaving a vehicle at the Highway O landing (down river a couple miles, on the opposite side of the river), and then fishing from River’s Edge back down to the landing. Once you get below an area called the Rapids, fishing can be very good, and unless water is high, you won’t see many others fishing the area as the rapids cuts off boat traffic from up river, and the small landing at Hwy O isn’t attractive to bigger boats. This is now one of my favorite places to fish period for all the reasons imaginable.
This all said… there can be a half way decent current right now. Not scary, but enough that you will cover some water drifting in a yak. If you are all new to kayaking, I would tend to consider waiting for a no current water, or warmer temps to figure things out. Anchoring can be a learning experience, setting up gear and all that has a little curve to it, and something about moving, cold water has mine still in storage.
From River’s edge, you would either find the most popular fishing spots down river, or a ways up river. Either is going to leave you with some paddling against current. I’ve done it… as have others. Just know it is a work out, and anytime in current, ya need to think safety.
I seen you posted a question on River’ Edge, on another site I am less likely to post on.
Have fun, and be safe.