Omkar2118/datasets huggingface dataset:
Off-Topic

This dataset consists of synthetic LLM system prompts paired with user prompts, classified as either off-topic or on-topic. The aim is to provide realistic, real-world-inspired examples reflecting how large language models (LLMs) are used today for both open-ended and closed-ended tasks, such as text generation and classification. This dataset can be used for training and benchmarking off-topic guardrails.

Introducing paper: A Flexible Large Language Models Guardrail Development Methodology Applied to Off-Topic Prompt Detection