You know I get some of the same from people… I run a 19″ Ranger 190 Reata, which is a bit more bass boat styled than a similar model 1850 Reata, which has a little deeper v and is said to handle rougher water, to date, never had an issue, really I never should…
Bottom line I fish for pleasure, I’m not out trying to scratch out 5 five for a tournament, if the water starts getting too rough, or the sky’s look bad, I’m done, time to head in. My boat does afford a bit more laziness when watching the weather, it’s quick and it’ll handle rough waves, I’m not looking to weather the perfect storm on the water.
I see plenty of “little” boats on the big, big waters, you just need to pay attention know the limits of your boat, and be smart, bigger boats IMHO afford with more room to handle worse situations, it may also allow you to fish areas in rougher water that you couldn’t in a smaller boat, plenty of times I ended up fishing areas I didn’t really want to fish in my 16′ Lund, that bigger boats were handling just fine… but the key in anything is to stay out of those situations in the first place. Technology certainly helps, I have access to weather radar on my phone (most phones can do it) and a radio, plus I watch the weather before hand and watch it when I’m out on big water.
Don’t buy into the nay sayers, just be smart about your boating. 