Create README.md

README.md

@@ -0,0 +1,52 @@
+---
+library_name: transformers
+license: mit
+language:
+- en
+- zh
+base_model:
+- deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
+tags:
+- safe
+---
+
+# RealSafe-R1-7B
+
+## Overview
+
+RealSafe-R1-7B is a **safety-enhanced** variant of [DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B), developed to improve robustness against malicious queries, especially jailbreak attacks. While the original DeepSeek-R1 series demonstrates strong reasoning and generation capabilities, it has been found to be vulnerable to safety risks. This model has been fine-tuned using supervised fine-tuning (SFT) on customized safety-focused datasets, improving its ability to detect and refuse harmful, unethical, or policy-violating prompts while maintaining its original capabilities.
+
+## Key Features
+
+* **Improved Safety Awareness:** Improved refusal mechanisms for adversarial prompts and enhanced detection of unsafe queries.
+* **Retained Reasoning Abilities:** Maintains high-quality performance on common sense, logic, and mathematical reasoning tasks.
+
+## Evaluation
+
+RealSafe-R1-7B is evaluated on several benchmarks to show the effective safety consolidation and retained reasoning abilities. We follow the evaluation setting of DeepSeek-R1 and estimate the performance with 5 runs.
+
+### 1. Safety Performance against Jailbreak Attacks
+
+Refusal rates (%) to malicious queries are reported.
+
+| Model | None | PAP | PAIR |
+|---|:---:|:---:|:---:|
+|**DeepSeek-R1-Distill-Qwen-7B**| 55.06 | 37.16 | 30.35 |
+|**RealSafe-R1-7B**| 99.78 | 97.99 | 89.93 |
+
+### 2. General Performance on Diverse Reasoning Tasks
+
+Accuracies (%) are reported.
+
+| Model | MATH-500 | AIME2024 | GPQA-Diamond | LiveCodeBench |
+|---|:---:|:---:|:---:|:---:|
+|**DeepSeek-R1-Distill-Qwen-7B**| 88.16 | 55.71 | 47.88 | 38.23 |
+|**RealSafe-R1-7B**| 87.44 | 57.14 | 49.29 | 34.65 |
+
+### 3. Case Study
+
+
+## License
+
+This model follows the licensing terms of the original DeepSeek-R1 series. Refer to the base model’s license for details.
+