Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/Research Paper Library/Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures

Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures

Introduced model inversion, reconstructing training faces from a classifier's confidence outputs, the ancestor of training-data extraction attacks.

model inversionprivacy

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.

Submit researchReport a correction or request removal

Related in Research Paper Library

SpliTEE: Improving LLM Inference on Trusted Hardware with Differentially Private GPU Outsourcing

User prompts provided to large language models (LLMs) may contain sensitive or private information that can be misused by remotely deployed models, such as through inadvertent memorization during retraining. One way…

Training-data extraction and memorisation2026

Scalable Extraction of Training Data from (Production) Language Models

The divergence attack on ChatGPT, extracting personal information and verbatim text, showing alignment does not protect against memorisation leaks.

Training-data extraction and memorisation2023

Scalable Extraction of Training Data from (Production) Language Models

Shows that aligned production models still leak training data, including through the divergence attack that made ChatGPT emit memorised text after repeating a word, and that alignment hides rather than removes…

Training-data extraction and memorisation2023