Social media algorithms promote harmful content: BBC report

Social media algorithms visual for Meta and TikTok.
| Image: BBC |

Social media platforms are turning user outrage into profit. A new BBC investigation, serving as the basis for the documentary “Inside the Rage Machine,” has exposed a fundamental flaw in social media algorithms. More than a dozen internal whistleblowers from major IT corporations provided evidence that platforms intentionally promote harmful content. Internal company research confirmed that nothing fuels user activity and engagement quite like feelings of indignation or fury.

In the battle for audience attention, corporations took a calculated risk, turning a blind eye to the spread of content related to violence, conspiracy theories, and even sexual extortion.

The investigation focuses heavily on Meta (the owner of Facebook and Instagram). To halt audience churn, management implemented an unprecedented relaxation of internal moderation rules. According to insights from Meta engineers and researchers (including senior researcher Matt Motyl), top management directly ordered developers to allow “borderline harmful” content into algorithmic feeds. Special priority was given to posts containing misogyny and radical conspiracy theories, as they generated the most controversy.

Company engineers explicitly state that investor fear was the primary driver behind these decisions. Management justified flooding feeds with aggressive content as a necessity to stop the decline in the company’s stock price.

Regarding Instagram Reels—the tool designed to compete with TikTok’s short-form videos—it was launched in 2020 without adequate safety filters. Internal analytics revealed that levels of bullying, hate speech, and incitement to violence in Reels comments significantly exceeded those in all other sections of Instagram.

While Meta sacrificed safety for stock value, Chinese giant ByteDance (the owner of TikTok) engaged in systemic violations to survive in Western markets. A former employee provided BBC journalists with rare access to internal moderation control panels.

The data from these panels revealed a cynical priority list for handling complaints:

  • Ignoring threats to minors. Moderators were instructed to delay or ignore serial reports of harmful and dangerous posts involving children.
  • VIP protocol for politicians. Instead of responding to real threats, all resources were thrown into prioritizing individual complaints from political figures.
  • Fear of bans. The whistleblower emphasized that these decisions were dictated solely by management’s desire to “maintain strong relationships” with authorities. TikTok critically needs the loyalty of politicians to avoid legislative restrictions, regulations, or a total ban of the app in the US and Europe.

The social media industry appears to have finally transformed into a machine that processes human anger into advertising dollars. TikTok’s incredibly effective recommendation algorithm changed the game, forcing competitors to abandon basic principles of digital hygiene. Today, algorithms are tuned not to inform or entertain, but to provoke neurobiological stress, keeping users scrolling their feeds in a state of permanent outrage.

Read also