WASHINGTON, July 20 — Content moderation, the systematic screening and removal of user-generated material deemed harmful or inappropriate, has quietly grown into a US$9 billion global industry, drawing on a workforce spread across the United States, Europe, China, and increasingly the low-wage outsourcing hubs of India and the Philippines. The practice encompasses everything from algorithmic filtering and user reporting to the manual review of posts, videos, and comments by human moderators hired to flag hate speech, incivility, revenge porn, graphic content, child abuse material, and propaganda.
At its core, content moderation is the process of identifying, reducing, or removing user-generated content that is irrelevant, obscene, illegal, harmful, or insulting. Platforms employ a combination of algorithmic tools, user reporting, and human review to enforce community guidelines.
Administrators decide what comments are appropriate and delegate sifting to moderators, whose work aims to eliminate trolling, spamming, and flaming. Social media sites in particular rely on content moderators to manually flag or remove objectionable content while also ensuring the environment remains hospitable to advertisements. One form of this oversight is supervisor moderation, also known as unilateral moderation, in which a group chosen by administrators enforces rules with powers to delete, edit, or exclude users.
Another approach—visibility moderation, such as shadow banning—can restrict content without outright removal. Jawboning, where governments pressure platforms to moderate beyond legal requirements, has also emerged as a contested practice.
As of 2022, according to industry figures, there were an estimated 10,000 content moderators for TikTok, 15,000 for Facebook, and 1,500 for Twitter. The commercial content moderation industry as a whole is estimated to be worth US$9 billion.
Legal and Regional Context
In the United States, content moderation is governed by Section 230 of the Communications Decency Act, which provides platforms broad immunity for user-generated content while also enabling them to moderate in good faith. The legal landscape has seen significant challenges, including Moody v. NetChoice, LLC, a case that reached the U.S. Supreme Court.
In this environment, outcomes can include outright blocking, visibility moderation, and government pressure tactics. The term “Commercial Content Moderation” was coined by scholar Sarah T.
Roberts to describe the practice of monitoring and vetting user-generated content to ensure compliance with legal, regulatory, and community guidelines, as well as norms of taste. While content moderation was once handled by volunteers, commercial websites now routinely outsource the task to specialized companies operating in low-wage regions.
Global Value Chain and Human Cost
The global value chain of content moderation is structured around social media platforms such as Facebook and Google, headquartered in the United States, Europe, and China. Large multinational enterprises like Accenture and Foiwe—based in the global north or India—contract with these platforms. The actual labor of review is largely supplied by workers in global southern countries, particularly India and the Philippines, where wages are lower.
This outsourcing arrangement reflects a familiar pattern in the tech industry: work that once required volunteer effort is now industrialized and distributed across the world. Nearly every major site that allows user-generated content—including posts, comments, videos, forums, blogs, and news sites—relies on some form of moderation.
Administrators set the rules and delegate enforcement to moderators, who must balance the often-conflicting demands of free expression, user safety, advertiser expectations, and legal obligations. The role of these moderators, many of whom are based in low-cost countries, remains largely invisible to the average user, yet their decisions shape the digital public square daily. Looking ahead, the expansion of social media platforms in markets across the Middle East and Africa suggests that the demand for content moderation—and the need for a clearer regional and legal framework—will only intensify.
The global industry, now worth billions and employing tens of thousands, shows no sign of shrinking.
