If you wrap up warm then start doing some activity, don't let yourself get wet through from sweating. Stop and take some layers off, aim to be slightly cold when moving. Otherwise eventually you get wet underneath, its impossible to dry off and the water conducts heat away from you very quickly...