|
--- |
|
library_name: peft |
|
datasets: |
|
- timdettmers/openassistant-guanaco |
|
pipeline_tag: conversational |
|
base_model: internlm/internlm-20b |
|
--- |
|
|
|
<div align="center"> |
|
<img src="https://github.com/InternLM/lmdeploy/assets/36994684/0cf8d00f-e86b-40ba-9b54-dc8f1bc6c8d8" width="600"/> |
|
|
|
|
|
[](https://github.com/InternLM/xtuner) |
|
|
|
|
|
</div> |
|
|
|
## Model |
|
|
|
internlm-20b-qlora-oasst1 is fine-tuned from [InternLM-20B](https://huggingface.co/internlm/internlm-20b) with [openassistant-guanaco](https://huggingface.co/datasets/timdettmers/openassistant-guanaco) dataset by [XTuner](https://github.com/InternLM/xtuner). |
|
|
|
|
|
## Quickstart |
|
|
|
### Usage with XTuner CLI |
|
|
|
#### Installation |
|
|
|
```shell |
|
pip install xtuner |
|
``` |
|
|
|
#### Chat |
|
|
|
```shell |
|
xtuner chat internlm/internlm-20b --adapter xtuner/internlm-20b-qlora-oasst1 --prompt-template internlm_chat |
|
``` |
|
|
|
#### Fine-tune |
|
|
|
Use the following command to quickly reproduce the fine-tuning results. |
|
|
|
```shell |
|
xtuner train internlm_20b_qlora_oasst1_e3 |
|
``` |
|
|
