When I loaned a horse from local RS and only had fixed days I could ride I wouldn't miss a day because of rain, I just used to get dressed appropriately, put a waterproof high-viz exercise sheet on the horse and get on with it. Hogan didn't mind the rain at all though. Now I've got Raf and can ride whenever I want (as long as it's light) I've relaxed and don't feel that I have to go out. Raf hates the rain too - he shuts his eyes and turns his head sideways - and I don't enjoy it if he's miserable, so although I'd go out if it was just light rain I wouldn't if it was tipping it down.
I wouldn't ride in fog (because we have to go on roads to get anywhere) or snow unless, as one year, I am lucky enough to be offered a ride on an unshod pony, which was the greatest fun ever!