AI-Generated TikTok Content Draws Billions of Views, Raises Moderation Concerns
AI-Generated TikTok Content Draws Billions of Views, Raises Moderation Concerns
……………..
Hundreds of TikTok accounts are generating billions of views with AI-created content, including sexualized material and anti-immigrant posts, The Guardian reported. A report by Paris-based non-profit AI Forensics found 354 accounts publishing 43,000 AI-generated posts over a month, collectively amassing 4.5 billion views. Many of these accounts appear to use automated methods to maximize virality, posting frequently and at regular intervals.
The study noted that half of the most active accounts focused on sexualized depictions of women, often in stereotypically attractive attire. Many posts were unlabeled, with less than 2% displaying TikTok’s AI content designation, raising concerns about the potential for deception. Some accounts also shared fake broadcast-style news segments promoting anti-immigrant narratives, occasionally using the likenesses of established news brands.
Despite TikTok’s moderation efforts, including removing harmful content and blocking bot accounts, researchers found that some AI-generated material had gone unmoderated for months. Dozens of flagged accounts have since been deleted, suggesting some action was taken by the platform.
AI Forensics highlighted the prevalence of “slop” content, which is nonsensical AI-generated material designed to fill feeds, such as animals performing unusual tasks or talking babies. While some slop content was considered entertaining, the report emphasized the blurring line between human-created and AI-generated posts.
The report also raised concerns over monetization attempts, including fake influencers promoting health supplements or AI tools. Researchers urged TikTok to improve labeling, consider segregating AI content from human-created posts, and implement stricter enforcement to ensure users can clearly distinguish synthetic content from authentic material.
TikTok defended its efforts, stating it removes harmful AI content, blocks millions of bot accounts, and provides tools to limit AI-generated content exposure, while questioning whether the report fairly represented issues faced across multiple platforms.
