Knowledge Base Regulation Tracker Standards & Frameworks OSS Directory AI Incident Database Research Paper Library Case Studies Society Articles News Jobs About Charter Sign inBecome a Member
Home/Case Studies/Advai: Robustness Assurance Framework for Guardrail Implementation in Large Language Models (LLMs)

Advai: Robustness Assurance Framework for Guardrail Implementation in Large Language Models (LLMs)

Advai applies a robustness assurance framework that attacks a client LLM with adversarial prompts optimised across several model architectures, uses the findings to set guardrails that keep outputs inside the boundaries the organisation defines, and re-tunes a reward model against a growing prompt dataset. The stated trade-offs: it needs continuous investment in the prompt dataset and cannot guarantee complete protection.

Adversarial testingGuardrailsLLMReward modelJailbreak
Multiplemodel architectures the adversarial attacks were optimised across
Pre-deploymentpoint at which assurance is applied
2024-06published in the OECD catalogue

Sources

Contains public sector information licensed under the Open Government Licence v3.0.

Contribute

Spot an error, or know a record we should add? Members can propose additions and submit corrections.