This is the brutal cost of keeping the internet less terrible

The human toll of content moderation.
 By 
Marcus Gilmer
 on 
Watch Next

Warning: The above film contains graphic images.

We may not often stop to think about it, but for every piece of horrific content that makes its way onto social media, someone has to watch it to determine if it should be taken down. And that exacts a brutal toll on the person doing it.

The Moderators, a new short film by journalist Adrian Chen and director Ciaran Cassidy, is a deep dive into the world of social media content moderation. It follows workers in India who maneuver through the content minefield and decide what's appropriate for posting and what's not. In this age of algorithmic decision-making it's easy to forget that such systems often rely on people relentlessly reviewing the worst content imaginable, all day long.

The topic is one fresh on our minds in the wake of Sunday's deadly shooting in Cleveland, Ohio that was posted to Facebook.

The grim side of moderation is not a new subject for Chen. He has extensively covered the process of content moderation on social media and the effect it has on the humans who have to flag that offensive content, from pornography to beheadings.

Topics Facebook

Mashable Image
Marcus Gilmer

Marcus Gilmer is Mashable's Assistant Real-Times News Editor on the West Coast, reporting on breaking news from his location in San Francisco. An Alabama native, Marcus earned his BA from Birmingham-Southern College and his MFA in Communications from the University of New Orleans. Marcus has previously worked for Chicagoist, The A.V. Club, the Chicago Sun-Times and the San Francisco Chronicle.


Latest Videos

Stephen Colbert reacts to the Artemis II moon mission
A man in a suit stands on a talk show stage, gesturing.


'The Daily Show' reacts to judge halting Trump's White House ballroom
Desi Lydic presents "The Daily Show" beside an image of Donald Trump.


A24's 'Mother Mary' trailer is worth it for the FKA twigs track
Anne Hathway is dressed in a red pop star outfit with religious overtones in a film still from "Mother Mary."

Stephen Colbert gleefully recaps the best signs at the 'No Kings' protest
A man in a suit stands on a talk show stage, smiling. The caption at the bottom reads, "I like that one."

Riz Ahmed is troublingly intense in new 'SNL UK' promo
A close-up of a man grinning in a slightly creepy way.



Is This The End of Hollywood's ‘Bad Moms’?
Recent representations of motherhood on film: (from left) Amy Adams in 'Nightbitch', Jennifer Lawrence in 'Die My Love', and Rose Byrne in 'If I Had Legs I'd Kick You'
The biggest stories of the day delivered to your inbox.
These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up. See you at your inbox!