Sometimes I would switch to a little black or brown hair jig on those days. Or a black jig with small black twister tail.
Another option is up-sizing or down-sizing the spinner. I use way bigger spinners than most people.
Or change the way you are casting to the hole. If you are primarily casting downstream, try casting upstream. The one technique that rarely gets ignored is to let the spinner hang in the current without retrieving it. Just let the current turn the blades and let it sit there… I’ve seen trout come up to it many times before committing but it seems like after awhile… they can’t take it anymore.
One last thing to try is to let the spinner sink before starting your retrieve. This especially works with smaller spinners. In a deep hole, let the spinner ‘helicopter’ down vertically before initiating the retrieve. Be ready though because I’ve had trout hit on the fall many times before I even engaged the reel. I REALLY like to do that next to wood…
Just some things to try. I pretty much use one color of spinner and blades all the time so I vary the retrieves I use constantly. Good luck hope that helps! They can be picky some days!