I go out in all weather - it's just something you adjust for.
Although, I prefer that it not be rainy/muddy and no high winds, I still go. And I actually prefer WINTER camping - often with 2 to 3 feet of snow and -20 (F). That cold weather really clears the bozos/yahoos out of the woods!
Often on a -20(F) night in January/February with a full moon, I will grab my wool blanket and hike down into the pasture to just set on the one hill to watch the "natural" world go by below along the creek. It's comforting to watch the deer play along the creek, hear the coyotes howling two ridges over, and see the "steam" rising from the sections of open water in the creek. The air gets that "crisp" feel to it. Sometimes I'll light a small fire, usually not. Sometimes I'll stay and watch for an hour or so, sometimes I just curl up in my blanket and sleep there overnight on top of the snow - especially if it isn't windy.
But you really need to plan well for winter outings, and condition yourself for it.
Rain/mud/sleet are more something to ... endure ... than enjoy too much. But I still do enjoy them. That feeling of "accomplishment" stuff. And if you have friends with you to also experience it, then you have that "shared trevail" feelings.
Yeah, "bad" weather sure clears out the bozos and pikers.
Mikey - that grumpy ol' German blacksmith out in the Hinterlands