My comment refers to clothing. I live in a desert where the numbers easily reach over 100 F regularly in the warm months, with very low humidity. I can dress accordingly and adjust my hours of activity.
If I'm cold, and likely wet by now, it will be more difficult (not impossible, but more difficult) to get warm.
From personal experience, I stand by my comment.
You live in a dry desert and find it easier to get cool than get warm if you are cold....
I live in a notoriously cool and wet place and find it easier to get warm if I am cold than cool if I am too hot ...
You can dress accordingly and adjust your hours of activity
I can dress for my climate and adjust my hours of activity...
It sounds like it is all down to personal adaptation

If I get cold I put on an extra warm layer and/or increase physical activity reserving activities that may get me extra cold to the warmest hours.
In the desert I found that as long as I maintained hydration (difficult at times) it was possible to keep reasonably comfortable (though physical exertion had to stop between 11am and 3pm and we just lay and dripped - activity started before dawn and continued to nightfall to compensate). In the jungle I found the high humidity made it next to impossible to cool using the body's natural methods - sweating - and when I picked up a minor fever I went into a heat spiral very quickly. Clothing made no difference, cool wet cloths made no difference as the water could not cool me by evaporation....
From personal experience I find if I am too hot it is more difficult to get cool...
I will not go back to the jungle - but I love the snow

Personal adaptation makes your habitual environment/climate more acceptable despite its extremes - in West Wales (and perhaps most of Britain if not Europe) we are not used to the heat but we are used to the cold and wet ... so heat kills us more easily perhaps.
It is easier for me to warm up by putting on a layer of clothing than to cool down once I have removed all extraneous clothing

(that should have put a fearsome picture of my corpulent, sweaty body with minimal covering, into some folks minds... I am buying shares in the Mind Bleach mines

)