In cold conditions, I wouldn't advise cotton underwear next to the skin.
I've worn it well below -30degrees, as long as you don't start sweating, and use it as a backing between rougher weaves, its OK, as Martti quoted its OK as long as it used in conjunction with other layers, and especially if those layers are itchy woollen types