TechDigits

Tech news
Friday, Mar 29, 2024

Investigation into online platforms finds 'foul trove of racial hatred'

Investigation into online platforms finds 'foul trove of racial hatred'

The Centre for Analysis of the Radical Right, which carried out the research, said: "It makes you wonder what the point of moderation is when some of these obvious, overt and in some cases violence-inciting accounts can go literally years with no consequences, and certainly no moderation."

An investigation has exposed hundreds of thousands of online hate profiles, leading to a call for tougher regulation of online platforms.

A "foul trove of racial hatred" was uncovered on Twitter and Facebook as well as amongst the gaming community through research conducted by the UK-based Centre for Analysis of the Radical Right (CARR).

It comes six months after a public outcry at the abuse of England footballers Marcus Rashford, Jadon Sancho and Bukayo Saka, who were targeted online after missing penalties in the Euro 2020 final at Wembley.

Researchers found around 300 users or profile names on Twitter derived from a racist phrase


What was found on Twitter?


During their two-day analysis carried out in January, CARR researchers looked for profiles using simple words and phrases as indicators of "systemic failure".

On Twitter, they found around 300 users or profile names derived from a racist phrase, including the N-word, dating as far back as 2009.

Dr Edward Gillbard, who carried out the research, said the majority of accounts had fewer than two followers and were following less than two accounts.

He added that it would "appear there is no automatic moderation being performed by Twitter" in terms of analysing accounts for offensive usernames.

Twitter said the accounts had been "permanently suspended" for "violating our hateful conduct policy".

A spokesman said: "We acknowledge and want to reiterate our commitment to ensuring that Twitter doesn't become a forum that facilitates abuse and we continue to examine our own policy approaches and ways we can enforce our rules at speed and scale."

What was discovered on Facebook?


On Facebook, dozens of offensive profiles, including 83 variants of "hate (N-word)" and 91 on the Holocaust were identified.

Other profiles included the name Adolf Hitler and other high profile Nazis, as well as the names of mass killers such as the Christchurch mosque attacker in New Zealand.

By changing the spelling or inserting spaces and special characters, profiles seemed to be able to fool moderation systems, Dr Bethan Johnson, who found the accounts, said.

"It may be that when users set up profiles with names that clearly mock and flout community standards - from 'Jewkilla' to 'Nate Higgers' - they are telling Facebook what kind of user they will be, what kind of ideas they bring to the platform, and the reality is that is far from community-orientated," she said.

A spokesman for Meta, the parent company of Facebook, Instagram and WhatsApp, said hate speech was not allowed on its platforms and the "violating" accounts were removed after being flagged.

He added: "If we find content that violates our policies, including the use of symbols, emojis or misspellings attempting to beat our systems, we will remove it."

Offensive profiles were also found on Facebook.


What about gaming platforms?


An analysis of the digital gaming service Steam revealed more than 300,000 offensive profile names.

Of those, 241,729 were anti-black, 44,368 white supremacist, more than 28,000 neo-Nazi, 8,021 anti-Semitic, 5,607 homophobic, and 168 anti-Muslim.

On the game Fortnite, more than 100 racist and far-right extremist profile names were found and 34 were identified on Rainbow Six Siege, 18 of which were active.

A spokeswoman for Fortnite developer Epic Games said many of the offensive usernames are no longer in their systems and action has been taken against additional accounts provided.

"Usernames that include vulgarity, hate speech, offensive or derogatory language of any kind are in violation of our community rules," she added.

It is understood that the Rainbow Six Siege profiles have been reset with randomised names and any offending pictures have been removed.

A spokesman for the game's creator Ubisoft said the company "does not tolerate any form of bullying or harassment".

The firm takes "concrete actions" to tackle "toxic" behaviour, and violations of its code of conduct could lead to sanctions, including bans, he said.

While automated processes were not "foolproof", teams are constantly working on improving them, he added.

What has the reaction been?

"Finding a foul trove of racial hatred on social media is still shockingly easy," said director of CARR, Professor Matthew Feldman.

"It makes you wonder what the point of moderation is when some of these obvious, overt and in some cases violence-inciting accounts can go literally years with no consequences, and certainly no moderation.

"This material is disgusting and makes it seem that platforms just don't care enough to address this running sore."

He added that platforms had a "duty of care" to users but only government regulations and the threat of tens of millions in fines would bring change.

"Otherwise, these platforms will stay reactive - badly - rather than proactive in taking down hateful extremism," Prof Feldman added.

Danny Stone MBE, chief executive of the Antisemitism Policy Trust which jointly published the report, said: "Six months from the Euro finals, a year from the insurrection at the US capitol, but the story remains the same - social media companies profiting from the sale of our data but failing to properly protect people from harm."

He added: "I hope the forthcoming Online Safety Bill, and legislation across the world, will force social media companies to better look after their users because they appear to be in no hurry to help."

Newsletter

Related Articles

TechDigits
0:00
0:00
Close
FTX's Bankman-Fried headed for jail after judge revokes bail
America's First New Nuclear Reactor in Nearly Seven Years Begins Operations
Southeast Asia moves closer to economic unity with new regional payments system
Today Hunter Biden’s best friend and business associate, Devon Archer, testified that Joe Biden met in Georgetown with Russian Moscow Mayor's Wife Yelena Baturina who later paid Hunter Biden $3.5 million in so called “consulting fees”
Google testing journalism AI. We are doing it already 2 years, and without Google biased propoganda and manipulated censorship
Musk announces Twitter name and logo change to X.com
The future of sports
TikTok Takes On Spotify And Apple, Launches Own Music Service
Hacktivist Collective Anonymous Launches 'Project Disclosure' to Unearth Information on UFOs and ETIs
Typo sends millions of US military emails to Russian ally Mali
Server Arrested For Theft After Refusing To Pay A Table's $100 Restaurant Bill When They Dined & Dashed
Democracy not: EU's Digital Commissioner Considers Shutting Down Social Media Platforms Amid Social Unrest
Sarah Silverman and Renowned Authors Lodge Copyright Infringement Case Against OpenAI and Meta
Why Do Tech Executives Support Kennedy Jr.?
The New York Times Announces Closure of its Sports Section in Favor of The Athletic
Florida Attorney General requests Meta CEO's testimony on company's platforms' alleged facilitation of illicit activities
The Poor Man With Money, Mark Zuckerberg, Unveils Twitter Replica with Heavy-Handed Censorship: A New Low in Innovation?
The Double-Edged Sword of AI: AI is linked to layoffs in industry that created it
US Sanctions on China's Chip Industry Backfire, Prompting Self-Inflicted Blowback
Meta Copy Twitter with New App, Threads
BlackRock Bitcoin ETF Application Refiled, Naming Coinbase as ‘Surveillance-Sharing’ Partner
UK Crypto and Stablecoin Regulations Become Law as Royal Assent is Granted
A Delaware city wants to let businesses vote in its elections
Alef Aeronautics Achieves Historic Milestone with Flight Certification for World's First Flying Car
Google Blocked Access to Canadian News in Response to New Legislation
French Politicians Advocate for Pan-European Regulation on Social Media Influencers
Melinda French Gates Advocates for Increased Female Representation in AI to Prevent Bias
Snapchat+ gains 4 million paying subscribers in its first year
Apple Makes History as the First Public Company Valued at $3 Trillion
Elon Musk Implements Twitter Limits to Tackle Data Scraping, but Faces Criticism for Technical Misunderstanding
EU and UK's Slow Electric Vehicle Adoption Raises Questions About the Transition to Green Mobility
Top Companies Express Concerns Over Europe's Proposed AI Law, Citing Competitiveness and Investment Risks
Meta Unveils Insights on AI Usage in Facebook and Instagram, Amid Growing Calls for Transparency
Crypto Scams Against Seniors Soar by 78% in 2022, Experts Urge Vigilance
The End of an Era: National Geographic Dismisses Last of Its Staff Writers
Shield Your Wallet: The Perils of Wireless Credit Card Theft
Harvard Scientist Who Studies Honesty Accused Of Data Fraud, Put On Leave
Putting an End to the Subscription Snare: The Battle Against Unwitting Commitments
The Legal Perils of AI: Lawyer Faces Sanctions for Relying on Fictional Cases Generated by Chatbot
ChatGPT’s "Grandma Exploit": Ingenious Hack Exposes Loophole in AI, Generates Free Software Codes
The Disney Downturn: A Near Billion-Dollar Box Office Blow for the House of Mouse
A Digital Showdown: Canada Challenges Tech Giants with The Online News Act, Meta Strikes Back
Distress in the Depths: Submersible and Passengers Missing in Titanic Wreckage Expedition
Mark Zuckerberg stealing another idea: Twitter
European Union's AI Regulations Risk Self-Sabotage, Cautions smart and brave Venture Capitalist Joe Lonsdale
Nvidia GPUs are so hard to get that rich venture capitalists are buying them for the startups they invest in
Chinese car exports surge
Reddit Blackout: Thousands of Communities Protest "Ludicrous" Pricing Changes
Nvidia Joins Tech Giants as First Chipmaker to Reach $1 Trillion Valuation
AI ‘extinction’ should be same priority as nuclear war – experts
×