Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/Chatbot Tessa gives unauthorized diet advice to users seeking help for eating disorders

Chatbot Tessa gives unauthorized diet advice to users seeking help for eating disorders

The National Eating Disorders Association (NEDA) has shut down its chatbot named Tessa after it gave weight-loss advice to users seeking help for eating disorders. The incident has raised concerns about the risks of using chatbots and AI assistants in healthcare settings, particularly in addressing sensitive issues like eating disorders. NEDA is investigating the matter, emphasizing the need for caution and accuracy when utilizing technology to provide mental health support.

Severity: HighLack of capability or robustness

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.