I’m the exact same as the OP. I can’t spend more than $50 on a pair of glasses because when I lose them (which will happen) I would be so pissed. I have been using Strike King S11 shades for the last 2 seasons and they have been really nice. They are still a budget pair of sunglasses, but at around $40 they are polarized, have different lens colors to choose from and are designed by fisherman. They aren’t Costa’s or Oakleys, but if you want to save some money and not want to kick something when you lose them, these are pretty nice.
Cabelas also usually has them in stock.