Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/Case Studies/Rules File Backdoor: Supply Chain Attack on AI Coding Assistants

Rules File Backdoor: Supply Chain Attack on AI Coding Assistants

Pillar Security researchers demonstrated how adversaries can compromise AI-generated code by injecting malicious instructions into rules files used to configure AI coding assistants like Cursor and GitHub Copilot. The attack uses invisible Unicode characters to hide malicious prompts that manipulate the AI to insert backdoors, vulnerabilities, or malicious scripts into generated code. These poisoned rules files are distributed through open-source repositories and developer communities, creating a scalable supply chain attack that could affect millions of developers and end users through compromised software. Vendor Response to Responsible Disclosure: - Cursor: Determined that this risk falls under the users’ responsibility. - GitHub Copilot: Implemented a new security feature that displays a warning when a file's contents include hidden Unicode text on github.com.

Stage CapabilitiesLLM Prompt CraftingLLM Prompt ObfuscationAI SoftwareModify AI Agent ConfigurationDirectLLM JailbreakLLM Trusted Output Components Manipulation
9ATLAS techniques in the documented procedure
2025-03-18date of the exercise
AML.CS0041MITRE ATLAS case study

Sources

Case study data from MITRE ATLAS, used under the Apache License 2.0.

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.