Hugging Face's logo

Lil2J
/
mini_llm

Text Generation
Transformers
PyTorch
qwen
custom_code
Model card Files Community
Lil2J commited on
Commit
b19ccfc
•
1 Parent(s): e662c97

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ 个人项目：https://github.com/jiahe7ay/MINI_LLM/tree/main中的预训练模型权重
2
+ 基座是对qwen进行修改，参数量改为1.4b
3
+ 训练数据为维基百科+baidu百科+天工数据集前20个文件，token数量约为8b