Become a Member

Regulation TrackerLaws, orders and treaties read for their security duties and clocks Standards & FrameworksAttack taxonomies, control catalogues and frontier frameworks AI Incident DatabaseThe security incident record, with mechanism and lesson Research Paper LibraryThe papers that define the field, summarised OSS DirectoryRed teaming, guardrail, supply chain and evaluation tools Case StudiesProgrammes built, with measured outcomes AI Vulnerability TrackerCVEs and advisories for the components AI systems are built from

Latest in the tracker

New York Stop Addictive Feeds Exploitation (SAFE) for Kids Act and implementing rulesNew York's law restricting algorithmic feeds for minors takes effect on 25 January 2027 under final rules published in July 2026, with certified age assurance and $5,000-per-violation penalties.

Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Become a Member

Home/AI Incident Database/OpenAI disrupts covert influence operations from Russia, China, Iran and Israel using ChatGPT to generate propaganda

OpenAI disrupts covert influence operations from Russia, China, Iran and Israel using ChatGPT to generate propaganda

OpenAI's first influence-operations report showed state-linked networks using ChatGPT to mass-produce social media content in several languages, including Storm-2035's output about the 2024 US election.

Severity: Mediuminfluence operationsopenaidoppelgangerspamouflage

At a glance

Organisation: OpenAI; operations including Doppelganger, Spamouflage, Storm-2035 and STOIC
Industry: Politics and elections
Country or region: Global
Occurred: 1 Dec 2023
Disclosed: 30 May 2024
Type of harm: Disinformation and influence operations, Election interference

All details 15

Kind of system: Large language models
Severity: Medium
Confirmation: Confirmed by the organisation
Model: GPT-4 (ChatGPT)
Model provider: OpenAI
Technique: Generating multilingual comments, articles and fake engagement; debugging bot code
Primary root cause: Insider or user misuse
Scale: Five networks in the first report; dozens more in subsequent quarterly reports through 2026
Outcome: Accounts banned and indicators shared; OpenAI assessed that none of the operations gained significant authentic engagement, but the reports established recurring vendor transparency on influence operations.

Sources

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.

Submit incident Report a correction or request removal

OpenAI disrupts covert influence operations from Russia, China, Iran and Israel using ChatGPT to generate propaganda

Sources

Contribute

Related in AI Incident Database

AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media

TikTok AI System Used to Amplify Election Disinformation by Foreign Networks

China Reportedly Intensifying AI to Spread Disinformation to U.S. and Taiwanese Voters