Tech news
Sunday, May 28, 2023

Investigation into online platforms finds 'foul trove of racial hatred'

Investigation into online platforms finds 'foul trove of racial hatred'

The Centre for Analysis of the Radical Right, which carried out the research, said: "It makes you wonder what the point of moderation is when some of these obvious, overt and in some cases violence-inciting accounts can go literally years with no consequences, and certainly no moderation."

An investigation has exposed hundreds of thousands of online hate profiles, leading to a call for tougher regulation of online platforms.

A "foul trove of racial hatred" was uncovered on Twitter and Facebook as well as amongst the gaming community through research conducted by the UK-based Centre for Analysis of the Radical Right (CARR).

It comes six months after a public outcry at the abuse of England footballers Marcus Rashford, Jadon Sancho and Bukayo Saka, who were targeted online after missing penalties in the Euro 2020 final at Wembley.

Researchers found around 300 users or profile names on Twitter derived from a racist phrase

What was found on Twitter?

During their two-day analysis carried out in January, CARR researchers looked for profiles using simple words and phrases as indicators of "systemic failure".

On Twitter, they found around 300 users or profile names derived from a racist phrase, including the N-word, dating as far back as 2009.

Dr Edward Gillbard, who carried out the research, said the majority of accounts had fewer than two followers and were following less than two accounts.

He added that it would "appear there is no automatic moderation being performed by Twitter" in terms of analysing accounts for offensive usernames.

Twitter said the accounts had been "permanently suspended" for "violating our hateful conduct policy".

A spokesman said: "We acknowledge and want to reiterate our commitment to ensuring that Twitter doesn't become a forum that facilitates abuse and we continue to examine our own policy approaches and ways we can enforce our rules at speed and scale."

What was discovered on Facebook?

On Facebook, dozens of offensive profiles, including 83 variants of "hate (N-word)" and 91 on the Holocaust were identified.

Other profiles included the name Adolf Hitler and other high profile Nazis, as well as the names of mass killers such as the Christchurch mosque attacker in New Zealand.

By changing the spelling or inserting spaces and special characters, profiles seemed to be able to fool moderation systems, Dr Bethan Johnson, who found the accounts, said.

"It may be that when users set up profiles with names that clearly mock and flout community standards - from 'Jewkilla' to 'Nate Higgers' - they are telling Facebook what kind of user they will be, what kind of ideas they bring to the platform, and the reality is that is far from community-orientated," she said.

A spokesman for Meta, the parent company of Facebook, Instagram and WhatsApp, said hate speech was not allowed on its platforms and the "violating" accounts were removed after being flagged.

He added: "If we find content that violates our policies, including the use of symbols, emojis or misspellings attempting to beat our systems, we will remove it."

Offensive profiles were also found on Facebook.

What about gaming platforms?

An analysis of the digital gaming service Steam revealed more than 300,000 offensive profile names.

Of those, 241,729 were anti-black, 44,368 white supremacist, more than 28,000 neo-Nazi, 8,021 anti-Semitic, 5,607 homophobic, and 168 anti-Muslim.

On the game Fortnite, more than 100 racist and far-right extremist profile names were found and 34 were identified on Rainbow Six Siege, 18 of which were active.

A spokeswoman for Fortnite developer Epic Games said many of the offensive usernames are no longer in their systems and action has been taken against additional accounts provided.

"Usernames that include vulgarity, hate speech, offensive or derogatory language of any kind are in violation of our community rules," she added.

It is understood that the Rainbow Six Siege profiles have been reset with randomised names and any offending pictures have been removed.

A spokesman for the game's creator Ubisoft said the company "does not tolerate any form of bullying or harassment".

The firm takes "concrete actions" to tackle "toxic" behaviour, and violations of its code of conduct could lead to sanctions, including bans, he said.

While automated processes were not "foolproof", teams are constantly working on improving them, he added.

What has the reaction been?

"Finding a foul trove of racial hatred on social media is still shockingly easy," said director of CARR, Professor Matthew Feldman.

"It makes you wonder what the point of moderation is when some of these obvious, overt and in some cases violence-inciting accounts can go literally years with no consequences, and certainly no moderation.

"This material is disgusting and makes it seem that platforms just don't care enough to address this running sore."

He added that platforms had a "duty of care" to users but only government regulations and the threat of tens of millions in fines would bring change.

"Otherwise, these platforms will stay reactive - badly - rather than proactive in taking down hateful extremism," Prof Feldman added.

Danny Stone MBE, chief executive of the Antisemitism Policy Trust which jointly published the report, said: "Six months from the Euro finals, a year from the insurrection at the US capitol, but the story remains the same - social media companies profiting from the sale of our data but failing to properly protect people from harm."

He added: "I hope the forthcoming Online Safety Bill, and legislation across the world, will force social media companies to better look after their users because they appear to be in no hurry to help."


Related Articles

TikTok Sues Montana Over Law Banning the App
Mobile phone giant Vodafone to cut 11,000 jobs globally over three years as new boss says its performance not good enough
Warren Buffett Sells TSMC Shares Over Concerns About Taiwan's Stability
'Godfather Of AI' Geoffrey Hinton Quits Google To Warn Of The Tech's Dangers
Vermont Man Charged with Stalking After Secretly Tracking Woman with Apple AirTag
Elon Musk Statements About Tesla Autopilot Could Be 'Deepfakes,' Lawyers Claim. Judge Evette Pennypacker Does Not Understand How Far and Advanced This Technology Became
AT&T's Successful Test of Satellite-Based Phone Call Raises Possibility of Widespread Coverage
Pulitzer Prize-winning journalist Seymour Hersh slams New York Times' pro-government stance and treatment of sources
Fox News Settles their case with Dominion Voting Systems for a staggering $787.5 MILLION
The G-7 aims to make global crypto regulations tougher
China and Brazil have signed a new deal that will allow them to trade in their own currencies, bypassing the US dollar as an intermediary
Elon Musk and Others Call for Pause on A.I., Citing ‘Profound Risks to Society’
U.S. charges FTX's Bankman-Fried with paying $40 million bribe
Fallen 'Crypto King' Who Owes Millions to Investors Was Kidnapped and Tortured
Regulators blame social media for SVB's rapid collapse: 'Complete game changer'
AOC explains why she opposes banning TikTok
Gordon Moore, a co-founder of Intel Corporation, died at 94
Donald Trump arrested – Twitter goes wild with doctored pictures
Credit Suisse's Scandalous History Resulted in an Obvious Collapse - It's time for regulators who fail to do their job to be held accountable and serve as an example by being behind bars.
Russian Hackers Preparing New Cyber Assault Against Ukraine
A brief banking situation report
Elon Musk Is Planning To Build A Town In Texas For His Employees
The Silicon Valley Bank’s collapse effect is spreading around the world, affecting startup companies across the globe
Market Chaos as USDC Loses Peg to USD after $3.3 Billion Reserves Held by Silicon Valley Bank Closed.
Banking regulators close SVB, the largest bank failure since the financial crisis
In a major snub to Downing Street's Silicon Valley dreams, UK chip giant Arm has dealt a serious blow to the government's economic strategy by opting for a US listing
It's the question on everyone's lips: could a four-day workweek be the future of employment?
Corruption and Influence Buying Uncovered in International Mainstream Media: Investigation Reveals Growing Disinformation Mercenaries
Being a Tiktoker might be expensive…
China's top tech firms, including Alibaba, Tencent, Baidu, NetEase, and, are developing their own versions of Open AI's AI-powered chatbot, ChatGPT
This shocking picture, showing how terrible is the results of the earthquake in Turkey
The desk of King Carlos Alberto of Sardinia has many secret compartments
Charlie Munger, calls for a ban on cryptocurrencies in the US, following China's lead
First generation unopened iPhone set to fetch more than $50,000 at auction.
Almost 30% of professionals say they've tried ChatGPT at work
Interpol seeks woman who ran elaborate exam cheating scam in Singapore
What is ChatGPT?
Tesla reported record profits and record revenues for 2022
Microsoft is finalising plans to become the latest technology giant to reduce its workforce during a global economic slowdown
Tesla slashes prices globally by as much as 20 percent
After Failing To Pay Office Rent, Twitter May Sell User Names
FTX fraud investigators are digging deeper into Sam Bankman-Fried's inner circle – and reportedly have ex-engineer Nishad Singh in their sights
TikTok CEO Plans to Meet European Union Regulators
U.S. Moves to Seize Robinhood Shares, Silvergate Accounts Tied to FTX
Coinbase to Pay $100 Million in Settlement With New York Regulator
FTX assets worth $3.5bn held by Bahamas securities regulator
Former FTX CEO Bankman-Fried finally arrested in Bahamas after U.S. files charges
Corruption works: House Financial Services Chair Waters doesn't plan to subpoena her donor, Sam Bankman-Fried, to testify at hearing on FTX collapse
Yellen hints at ‘national security’ probe into Twitter purchase
Elon Musk reinstates Donald Trump's Twitter account.