Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

Researchers at Cornell reportedly found that OpenAI's Whisper, a speech-to-text system, can hallucinate violent language and fabricated details, especially with long pauses in speech, such as from those with speech impairments. Analyzing 13,000 clips, they determined 1% contained harmful hallucinations. These errors pose risks in hiring, legal trials, and medical documentation. The study suggests improving model training to reduce these hallucinations for diverse speaking patterns.

Severity: MediumWhisperUnequal performance across groups

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.