Lanyard, lanyard, lanyard...
I make mine from cheap commercial "paracord". Loop sewn at one end, nappy safety pin at the other. Enables quick, secure attachment to anything except waterproofs. Wallet, SA knife and torch always attached to a loop inside my rucksack pocket - sometimes the same principle with pockets on clothing.
##
I hope my mate Neill doesn't read this - he'll be ranting on about it all day when I next see him. I've lost count how much money he's wasted on outdoor clothing that might be ideal except for one or two design faults. Some so stupid, they defy belief: obviously designed for fashion, not so functional for proper outdoor pursuits. Worn once then left at home forever more.
After numerous discussions this year, we've come to the conclusion that there's a conspiracy amongst the high street outdoor clothing manufacturers. Lots of fashionable stuff with design flaws. EG: a brand might make a perfect fleece - but with a design flaw that they don't repeat in other models. When their top-of-the-range items DON'T have these obvious flaws, it suggests that, if you're discerning, they're forcing you to fork out more for a higher priced model in their range.
Most of their items are fine for people who are seeking the "wilderness adventure" look they see on TV. For so many, the flaws MIGHT be a small inconvenience, no more. To us, it can have a significant negative impact.
Also, items may not be so well made as outdoors clothing needs to be. The small flaws plus this detail suggests to me that they want you to buy a replacement next year/season. Either because the clothing's become damaged or because you're so fed up of the flaw...
Personally, I'm not very knowledgeable on the latest clothing/kit: I don't mean to tar ALL outdoor brands with the same brush. I'm really talking about the more affordable clothing I see in the high street outdoors shops.
Personally, I stick to the military clothing with which I'm familiar - and I dye it. Sometimes, I modify them first - a favourite mod over decades is to buy 2 jungle shirts and sew the chest pockets of one to below the waist of the other to make a "safari" style lightweight jacket.
That said, MOST of the time I casually go out, it's in whatever I pick up from my bedroom, not necessarily outdoors clothing.