Some buildings trap heat and can actually be hotter than outside, with no airflow and often the humidity of dozens of sweating humans.

Yes, outdoor labor is strenuous and working in the sun is draining. But at least the air moves (usually)