Let me explain my frustration.....................
I understand your frustration - honestly I do. I was a service rep for several years, doing 50k miles a year. One year I hit 80k miles. My patch included big chunks of rural lincolnshire and yorkshire, and I was no stranger to the cyclist, or the crowd of cyclists.
BUT
You are making a few mistakes here. First of all you are assuming that work is more important than pleasure and should take precedence. Please don't answer that one straight away, just have a bit of a think about it.
Second, you are assuming that anyone on a bike is on a pleasure day out. Personally, I really don't like cycling. I don't like driving either - I've done too much of it. No, I cycle for transport. Mainly to get to work. So how is your work related journey more important than mine?
Third, you're generalising your experience with a small number of people to anyone on a bike. I get impatient with cyclists too. I get impatient with huge groups of club cyclists taking up the space of a HGV at 15mph. I think it's uncooperative and provokes motorists at a time when cyclists could really do with getting along with motorists better. I get irritated with the ignorant b*st*rds around Ilkley who think that a punctured tube should just be left in the gutter. I get impatient with people who ride along in the gutter bumping over every grating and wheel trim, making them wobble and waver alarmingly and giving motorists the wrong idea that that's correct cycling behaviour. Yes, I also get irritated by the cyclists who ride in the middle of a country lane, knowing damn well I'm sat in my van behind them, but won't make any effort to let me past.
But I don't do any of those things, and neither do many other people who ride bikes. Behaving aggressively to everyone because you are frustrated with some is unreasonable, and it's going to get someone hurt. The 1m rule puts bikes in the field of vision of motorists, and away from slippy metal gratings, leaf mulch, and dangerous junk. It doesn't mean "don't make an effort to let people pass on a narrow road" - that's rude, and also against the highway code (Rule 66 - be considerate of other road users).
If we all ride/drive according to the rules, it all gets a lot more relaxing and safe. That's what they're there for.