vilarin's picture
Update README.md
e098dee verified
|
raw
history blame
1.63 kB
metadata
license: apache-2.0

Intro

A Chinese law fine-tuned Yi-1.5-6B-Chat model. Personal test.

Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples.

Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.

Model Context Length Pre-trained Tokens
Yi-1.5 4K 3.6T

Models

Fine-tuned

Fine-tuned By Unsloth and Skepsun/lawyer_llama_data