I am in a similar boat. I don’t wear hearing protection when I hunt because I need to hear specific noises like a deer walking, a turkey gobble, or a pheasant flush, etc. My left ear is permanently damaged from shooting over the years because I shoot right handed and my right ear is covered up when I shoot, but my left ear is exposed. Audiology tests have confirmed that my left ear does not pick up high frequency sounds anymore and I wear a hearing aide in that ear now. I always wear muffs at the range, obviously.
I have been told and heard that the walker game ear is pretty good. It works like a hearing aide, but it blocks out loud noises like gun fire. Maybe someone else can offer their advice on it that has used it.