Every pic I've seen from the 1950's and earlier show men wearing some form of hat outdoors. Fedora, cowboy hat etc depending on region.
It was customary for English middle class men to often wear a suit and hat no matter what the event (Alfred Hitchcock dressed in this middle class fashion).
There was a photo published in the Houghton/Hancock MI newspaper of my grandfather fishing in a rowboot wearing a suit and hat.
He didn't look like Doug MacKenzie, though.