I rarely wear mine amongst people as it is DPM and quite frankly makes you look a prize doofus. Having said that in a solitary environment or when sitting out a storm it comes into its own.
Dont worry about what other people think, thats their problem. Wear it when you want eh!