I never used to wear one, when I first started riding. In fact, the dude ranch I worked at wouldn't ALLOW us trail guides to wear a hat!

We were to wear a 'cowboy' hat and look the part. They said that a riding hat showed a lack of confidence in our horses and would scare the people coming to ride. No one who rode was required to wear a helmet (even the children, unless their parents told them to, and most didn't

). The only people who were required to wear hats were the girl/boy scout troops who came because in order to pass their patch thingies (whatever) they were required to do everything properly, including hats. I would never work there now, not unless they completely changed their ways. At the summer camp I work at, EVERYONE must wear a hat. That's the way it should be.
That was when I was just starting riding. I'd never had lessons, and was riding by 'watching'. I couldn't ride properly, but was good enough to stick on in any gait. After a bad fall on Kallie three years ago, on a day when I'd just happened to grab my hat, flew ten feet, smashed into the wall and nearly shattered the hat (but not my head), I'd not really ridden without a hat since. Unless I was showing Western classes for the IHSA because a cowboy hat is worn. I sat on my horse once for a picture without a hat on, and even then I felt weird.
Mia has been so good lately, I nearly rode her on a hack the other day without a hat as it was so hot. That crazy thought only crossed my mind for about two seconds, and then I came to my senses. If my fall today was any indication...as perfectly behaved as my pony may be, she's still a pony, and can be frightened...*grimace*