TrustGPT: Benchmark for Trustworthy and Responsible LLMs
Date: 2023-06
Affected: ChatGPT, Vicuna, Alpaca, Llama-2
Attack vector: jailbreak
Category: research
Severity: Low

Huang et al. construct TrustGPT, evaluating LLMs across toxicity, bias, and value-alignment dimensions and finding consistent failure modes across both open and closed models.


Mitigations:

Architectural layers (MAESTRO):