Sources
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
Researchers at Cornell reportedly found that OpenAI's Whisper, a speech-to-text system, can hallucinate violent language and fabricated details, especially with long pauses in speech, such as from those with speech impairments. Analyzing 13,000 clips, they determined 1% contained harmful hallucinations. These errors pose risks in hiring, legal trials, and medical documentation. The study suggests improving model training to reduce these hallucinations for diverse speaking patterns.
Incident summary from the AI Incident Database, used under CC BY-SA 4.0.
Spot an error, or know a record we should add? Members can propose additions and submit corrections.