couple observations from those pics…
-that entire setup is being secured by 3 small screws. not bolts. right? so there are basically 3 sheet metal like screws and the only thing holding all that weight is the grip the thin sheet metal has on the screw.
– your rigger mount setup isn’t even sitting flush on the gunwale. of course its going to have some play to it.
I’d say your current setup works but is far from ideal. lots of pressure when that downrigger ball is out and you have a rod or two sitting in the rodholders on the rigger, especially with that long of a boom. Over time those screws holding the mount to the gunwale will wiggle and work more and more play into the setup.
I’d get a flush mount and back plate and use BOLTS, not screws to mount it to the gunwale. You have a very nice sized gunwale for mounting a rigger… do it right and it will be snug.