Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/Dealership chatbot manipulated into agreeing to sell a vehicle for one dollar

Dealership chatbot manipulated into agreeing to sell a vehicle for one dollar

Users instructed the customer service assistant to agree with everything and end responses with a legally binding statement, then had it accept a one-dollar price for a new SUV and write code for competitors, in a viral demonstration of instruction override.

Severity: LowInstruction overrideCustomer chatbotTopic restrictionLiability

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.