Try a ski helmet. They cost a bit more than Gaths but are super comfy, warm in winter and very light. I started wearing mine this winter instead of the Gaff - heaps more warm and comfy for those really cold mid winter sessions. Mine has removeable vent covers for warmer days.
I wouldn't ski or cycle without a helmet and see windsurfing the same way - unless I am just doodling around in 5 or 10 knots helping newbies.
Helmets are also great for reducing sun exposure, and for speedies like me I reckon I get about half a knot extra speed having my generously proportioned luggoles tucked in


edit - as for hearing loss, the ear flaps on my ski helmet are designed to not cause any hearing loss - I can hear very clearly with the helmet on.