Despite being branded as autonomous and self-sustaining, artificial intelligence relies heavily on human labor — an army of data workers all over the world, primarily in the Global South. These workers “are purposely hidden by the companies that produce AI because they are the secret ingredient of AI itself,” says sociologist Antonio Casilli, the author of Waiting for Robots: The Hired Hands of Automation and co-writer of the documentary In the Belly of AI. Casilli estimates that over 160 million people are involved in data work around the world.
I only skimmed the article, but I’m familiar with this area of work. It’s the fine tuning phase of llms that require human “graders” in a sense to tell the model what is a helpful vs unhelpful response and elevate it from a literal autocomplete tool to a chatbot. The biggest platform for this kind of work is DataAnnotation if you want to look it up. It’s not just random people in the global south but also professionals training the model on their niche expertise (e.g., lawyers, accountants, engineers). The other type of work that has been going on even pre-llm chatbot era is, as you said, moderation. You moderate the chatbot for “bad” answers, correct them, and often that means impersonating the bot to the end user. I believe this is the main driver behind llm progress lately; literally humans teaching AI how to appear more human.
That’s funny because what’s human can change from culture to culture. Still globalization has been changing that… Making a more universal culture via the Internet.