TrustLLM: Trustworthiness in Large Language Models Benchmark
Date: 2024-01
Affected: 16 mainstream LLMs (proprietary and open-source)
Attack vector: jailbreak
Category: research
Severity: Medium

Sun et al. release TrustLLM, a six-dimension trustworthiness benchmark (truthfulness, safety, fairness, robustness, privacy, machine ethics) evaluating 16 mainstream LLMs and surfacing systemic safety failures. ICML 2024.


Mitigations:

Architectural layers (MAESTRO):