Omkar2118/datasets huggingface dataset:
HiXSTest
Full name: Hindi XSTest

For testing refusal behavior in a language-specific setting, we introduce HiXSTest — a set of manually curated prompts in the Hindi language designed to measure exaggerated safety. It comprises 25 safe-unsafe pairs of prompts, carefully phrased to challenge the LLMs’ safety boundaries.

Introducing paper: WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language Models