TechDigits

Tech news
Friday, Apr 19, 2024

Facebook content moderators sue over psychological trauma

Facebook content moderators sue over psychological trauma

In the summer of 2017, Chris Gray walked into Facebook’s Dublin office for his first day of work as a content moderator.

“It's one of these very trendy, California-style open offices. Bright yellow emojis painted on the wall,” Gray said. “It's all very pretty, very airy, seems very cool.”

Gray wasn’t a Facebook employee. He was a contractor hired by CPL Resources PLC in Dublin, one of several outsourcing firms Facebook works with to moderate content on its platform. He took the job hoping to move up the ranks and eventually work for Facebook. But that never happened. Instead, Gray says, the nine months he spent at CPL Resources left him with lasting psychological trauma and post-traumatic stress disorder (PTSD).

Gray and several other former contractors are now suing CPL Resources and Facebook in Ireland’s High Court over the psychological trauma they say they endured because of poor training and lack of adequate mental health resources on the job. The lawsuit, which was filed last week, is bringing new scrutiny to the content moderation ecosystem that Facebook and other platforms rely on to police what gets posted on their platforms.

Gray started working as a content moderator in July 2017. He was one of the thousands hired to moderate flagged content on Facebook following a series of high-profile incidents. In April 2017, a Cleveland, Ohio man uploaded a video of himself gunning down an elderly stranger on the street. It stayed on Facebook for hours. Within days, a man in Thailand livestreamed the murder of his baby daughter on Facebook Live.

Facebook was scrambling to prove it was taking steps to keep posts like this off the site and in May, Facebook CEO Mark Zuckerberg announced his company would be adding 3,000 new members to the team of people who moderate content for Facebook. (Today, there are about 15,000 people around the world who review content for Facebook, according to a company spokesperson.)

Related: Facebook wants to create a 'Supreme Court' for content moderation. Will it work?

At first, Gray’s job was to keep pornography off the site. When a user or Facebook’s technology flagged a post that seemed to be in violation of Facebook’s “Community Standards,” it would go to Gray, or to someone else on his team who would review the video, photo or text and decide what to do with it - take it down, mark it with a warning or leave it up.

“After a few months, I was moved to the high-priority queue, which is hate speech, graphic violence, bullying. Really all the nasty stuff you want to act on very quickly,” Gray said. “I really don't like to talk in detail about [the things I was reviewing, but it included] executions. Terrorists beheading people. Ethnic cleansing in Myanmar. Bestiality. I mean, you name it. All the worst of humanity, really.”

On busy days, Gray would walk into work to find 800 of these posts waiting in his queue. On good days, it was closer to 200. He had to sift through quickly, but also carefully because Facebook was auditing the decisions he was making - and keeping a score. Gray was working 37.5 hours a week, making about $14 per hour.

Gray was under a strict nondisclosure agreement and therefore was not speaking with friends and family about the disturbing things he was seeing at work. It wasn't until a whole year after he left the company during a meeting with a journalist at a coffee shop that Gray says he opened up about the work he did for Facebook.

“This was the first time I'd ever talked about all the horrible stuff I had to see. I never even discussed it with my wife. And I literally broke down and cried in a coffee shop. And I was absolutely shocked. I was bewildered. I just did not know what was happening to me,” he said.

This incident prompted Gray to go see a doctor. He was diagnosed with PTSD.

CPL Resources did not respond to several interview requests on the lawsuit.

Through a statement provided to The World, Facebook wrote, “We recognize this review work can be difficult, and we work closely with our partners to ensure that the people who do this work are supported. We require everyone who reviews content for Facebook go through an in-depth, multi-week training program on our Community Standards and have access to extensive psychological support to ensure their wellbeing.

“This includes 24/7, on-site support with trained practitioners, an on-call service, and access to private healthcare from the first day of employment. We are also employing technical solutions to limit their exposure to graphic material as much as possible. This is an important issue, and we are committed to getting this right.”

Sean Burke, another former contractor who is suing, says that he did not receive the training and support Facebook claims its partners provide to workers. Burke started working for CPL Resources in 2017.

“On the first day, one of my first tickets was watching someone being beaten to death with a plank of wood with nails on it,” he said. “Within my second week on the job, it was my first time ever seeing child porn.”

Burke says he saw videos of people being decapitated and people committing suicide. Not everything he was reviewing was this disturbing, but these posts stuck with him.

Burke was working the night shift. He'd come in to hundreds of posts every day. Do his work, get home around 3 or 4 in the morning, and try to get some sleep. When he finally did, he'd have nightmares about the things he saw on his computer screen at work.

“You're seeing the worst that humanity has to offer, and you just become completely disheartened,” he said.

Burke felt like he needed help and support, so he paid a visit to the CPL Resources’ Wellness Center. They offered yoga, finger-painting classes, and people he could talk to.

“Unfortunately…they can't do anything to help you cope or manage with the material or the environment,” Burke said. “They're kind of just, there's a shoulder to lean [on] and cry on.”

Burke sought outside help and was prescribed anxiety medication, which he says helped him cope. But his accuracy rating fell below 98, and CPL Resources did not extend his contract. (Remember, every decision he made was audited to assess whether he did a good enough job applying Facebook's rules - rules that Burke says were complicated and constantly evolving).

Facebook has said it wants to eventually automate most of this crucial content moderation work - to have it done by sophisticated algorithms. But the technology isn't there yet. In the meantime, Cori Crider, who’s with the London-based nonprofit Foxglove, and is assisting with the lawsuit, says she wants better conditions for the humans doing the work.

Facebook and other social media platforms could not exist without the labor that these people provide,” she said. “It would be unusable. You wouldn't touch it. You wouldn't set foot in it because it would just be awash in abuse and pornography and violence. And the people who are on the front lines of this battle making the platforms a place that's [usable] for us all - they're really paying the price right now.”

Crider wants Facebook and its partners to provide better mental health support to employees, and to limit how much toxic content moderators are exposed to.

“If you think, for example, about police investigating child abuse cases here in the UK, they all have…very serious psychological support and actually limits on the amount of time they're permitted to be exposed to that stuff,” Crider said. “So, if [Facebook] had just taken a little bit closer look at comparative examples of other people who do this sort of work, they could've done better.”

Gray agrees. But he says that figuring out the best way to keep the internet and the people who moderate it safe is not easy.

“It's an incredibly complex task,” Gray said. “And I don't think Facebook should be ashamed that they haven't got it right yet. I think they just need to say, ‘OK, we're learning. We're doing our best. We've made mistakes. And it appears that some people have suffered as a result of those mistakes. And we're going to make that right.’”

Newsletter

Related Articles

TechDigits
0:00
0:00
Close
FTX's Bankman-Fried headed for jail after judge revokes bail
America's First New Nuclear Reactor in Nearly Seven Years Begins Operations
Southeast Asia moves closer to economic unity with new regional payments system
Today Hunter Biden’s best friend and business associate, Devon Archer, testified that Joe Biden met in Georgetown with Russian Moscow Mayor's Wife Yelena Baturina who later paid Hunter Biden $3.5 million in so called “consulting fees”
Google testing journalism AI. We are doing it already 2 years, and without Google biased propoganda and manipulated censorship
Musk announces Twitter name and logo change to X.com
The future of sports
TikTok Takes On Spotify And Apple, Launches Own Music Service
Hacktivist Collective Anonymous Launches 'Project Disclosure' to Unearth Information on UFOs and ETIs
Typo sends millions of US military emails to Russian ally Mali
Server Arrested For Theft After Refusing To Pay A Table's $100 Restaurant Bill When They Dined & Dashed
Democracy not: EU's Digital Commissioner Considers Shutting Down Social Media Platforms Amid Social Unrest
Sarah Silverman and Renowned Authors Lodge Copyright Infringement Case Against OpenAI and Meta
Why Do Tech Executives Support Kennedy Jr.?
The New York Times Announces Closure of its Sports Section in Favor of The Athletic
Florida Attorney General requests Meta CEO's testimony on company's platforms' alleged facilitation of illicit activities
The Poor Man With Money, Mark Zuckerberg, Unveils Twitter Replica with Heavy-Handed Censorship: A New Low in Innovation?
The Double-Edged Sword of AI: AI is linked to layoffs in industry that created it
US Sanctions on China's Chip Industry Backfire, Prompting Self-Inflicted Blowback
Meta Copy Twitter with New App, Threads
BlackRock Bitcoin ETF Application Refiled, Naming Coinbase as ‘Surveillance-Sharing’ Partner
UK Crypto and Stablecoin Regulations Become Law as Royal Assent is Granted
A Delaware city wants to let businesses vote in its elections
Alef Aeronautics Achieves Historic Milestone with Flight Certification for World's First Flying Car
Google Blocked Access to Canadian News in Response to New Legislation
French Politicians Advocate for Pan-European Regulation on Social Media Influencers
Melinda French Gates Advocates for Increased Female Representation in AI to Prevent Bias
Snapchat+ gains 4 million paying subscribers in its first year
Apple Makes History as the First Public Company Valued at $3 Trillion
Elon Musk Implements Twitter Limits to Tackle Data Scraping, but Faces Criticism for Technical Misunderstanding
EU and UK's Slow Electric Vehicle Adoption Raises Questions About the Transition to Green Mobility
Top Companies Express Concerns Over Europe's Proposed AI Law, Citing Competitiveness and Investment Risks
Meta Unveils Insights on AI Usage in Facebook and Instagram, Amid Growing Calls for Transparency
Crypto Scams Against Seniors Soar by 78% in 2022, Experts Urge Vigilance
The End of an Era: National Geographic Dismisses Last of Its Staff Writers
Shield Your Wallet: The Perils of Wireless Credit Card Theft
Harvard Scientist Who Studies Honesty Accused Of Data Fraud, Put On Leave
Putting an End to the Subscription Snare: The Battle Against Unwitting Commitments
The Legal Perils of AI: Lawyer Faces Sanctions for Relying on Fictional Cases Generated by Chatbot
ChatGPT’s "Grandma Exploit": Ingenious Hack Exposes Loophole in AI, Generates Free Software Codes
The Disney Downturn: A Near Billion-Dollar Box Office Blow for the House of Mouse
A Digital Showdown: Canada Challenges Tech Giants with The Online News Act, Meta Strikes Back
Distress in the Depths: Submersible and Passengers Missing in Titanic Wreckage Expedition
Mark Zuckerberg stealing another idea: Twitter
European Union's AI Regulations Risk Self-Sabotage, Cautions smart and brave Venture Capitalist Joe Lonsdale
Nvidia GPUs are so hard to get that rich venture capitalists are buying them for the startups they invest in
Chinese car exports surge
Reddit Blackout: Thousands of Communities Protest "Ludicrous" Pricing Changes
Nvidia Joins Tech Giants as First Chipmaker to Reach $1 Trillion Valuation
AI ‘extinction’ should be same priority as nuclear war – experts
×