We did in the 80s when you last were culture bombed about it. The textile industry is mostly in China now, and mostly automated, including cotton harvesting. Wool has some issues but animal cruelty tends not to register with you people, but poly blend clothing, which is by far the majority of clothing produced, has less human labor than most electronics manufacturing.
Shitting in a bucket in a van is less noble than you make it out to be.