I have a pair of British DPM trousers which i sometimes wear if i am out and about, partly because they are so damn comfortable, but also from an "aesthetic" point of view i actually quite like the way camo looks. To be brutally frank, i dont give rats **** what impression i give off to people and i refuse to pander to their irrational insecurities by changing the way i choose dress. Im sure most people really dont care at all, but if anyone does want to believe i am some survivalist nutjob, then so be it (they are half right anyway, i will leave it up to you to decide which half they are right about
).
I dont like brightly coloured clothing, so even if i got rid of my camo trousers not much is going to change, most of my wardrobe consists of greens, tans, browns, blacks and generally natural earthy colours. Im still going to blend in with nature at the end of the day.
Having said that, there are places where you should probably avoid wearing DPM like the plague, Northern Ireland is one example i can think of, for obvious reasons. There are countries where it is illegal for civilians to wear camo, particularly Central/South American and Caribbean countries.