File size: 1,670 Bytes
5abc3d1 9b1d44f 5abc3d1 89420cf df0a259 9b1d44f 89420cf 9b1d44f 89420cf 9b1d44f 89420cf 9b1d44f 89420cf 9b1d44f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
license: other
license_name: tongyi-qianwen
license_link: https://huggingface.co/Qwen/Qwen1.5-7B-Chat/blob/main/LICENSE
datasets:
- REILX/extracted_tagengo_gpt4
- TigerResearch/sft_zh
- alexl83/AlpacaDataCleaned
- LooksJuicy/ruozhiba
- silk-road/alpaca-data-gpt4-chinese
- databricks/databricks-dolly-15k
- microsoft/orca-math-word-problems-200k
- Sao10K/Claude-3-Opus-Instruct-5K
language:
- zh
- en
---
### 数据集
使用以下8个数据集
![image/png](https://cdn-uploads.huggingface.co/production/uploads/636f54b95d2050767e4a6317/maYhXsWKddThOBRvU5HtZ.png)
对Qwen1.5-7B-Chat微调,测试结果显示CEVAL和MMLU分数均有上升
### 模型:
- https://huggingface.co/Qwen/Qwen1.5-7B-Chat
### 数据集:
- https://huggingface.co/datasets/REILX/extracted_tagengo_gpt4
- https://huggingface.co/datasets/TigerResearch/sft_zh
- https://huggingface.co/datasets/silk-road/alpaca-data-gpt4-chinese
- https://huggingface.co/datasets/LooksJuicy/ruozhiba
- https://huggingface.co/datasets/microsoft/orca-math-word-problems-200k
- https://huggingface.co/datasets/alexl83/AlpacaDataCleaned
- https://huggingface.co/datasets/Sao10K/Claude-3-Opus-Instruct-5K
### 结果
| 模型名称 | CEVAL | MMLU |
|------------------------ |-------|------|
| Qwen1.5-7B-Chat | 68.61 | 61.56 |
| Qwen1.5-7B-Chat-sft-lora-tigerbot-alpacadatagpt4-ruozhiba-1epoch | 71.36 | |
### License
This project utilizes certain datasets and checkpoints that are subject to their respective original licenses. Users must comply with all terms and conditions of these original licenses. The content of this project itself is licensed under the Apache license 2.0. |