Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/AI Incident Database/NarxCare’s Risk Score Model Allegedly Lacked Validation and Trained on Data with High Risk of Bias

NarxCare’s Risk Score Model Allegedly Lacked Validation and Trained on Data with High Risk of Bias

NarxCare's overdose risk algorithm, lacking peer-reviewed validation, uses sensitive data like doctor visits, prescriptions, and possibly genetic information, leading to significant biases against women and Black patients. Factors like sexual abuse and criminal records exacerbate stigmas and disparities, often resulting in unjust denial of necessary pain medication. The newly approved AvertD genetic test shares similar issues, further complicating and potentially harming medical treatment decisions.

Severity: MediumAi Enabled Decision Support SystemsLack of capability or robustness

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.