TikTok excluded millions from crucial safety guardrails

This story includes discussion of suicide.

Back in 2021, TikTok tweaked its algorithm in an effort to address dangerous filter bubbles — a sort of algorithmic spiral of recommendations for high-risk content like extreme dieting or self-harm. But internal company documents obtained by Bloomberg Businessweek show 10% of U.S. users — 15 million Americans — were purposely excluded from this safety update. This was part of user testing to validate the new feature and track whether it reduced engagement with the famously sticky platform.

One of those users was then-16-year-old Chase Nasca, who subsequently died by suicide. Olivia Carville, Bloomberg Businessweek investigative reporter, has been on the story.