BAAI
/

shunxing1234 commited on
Commit
9ffef71
1 Parent(s): 08a2252

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +59 -2
README.md CHANGED
@@ -1,5 +1,62 @@
1
  ---
2
  license: other
3
- license_name: baai-aquila-model-license-agreement
4
- license_link: LICENSE
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
 
 
3
  ---
4
+
5
+
6
+ ![Aquila_logo](./log.jpeg)
7
+
8
+
9
+ <h4 align="center">
10
+ <p>
11
+ <b>English</b> |
12
+ <a href="https://huggingface.co/BAAI/AquilaChat2-7B/blob/main/README_zh.md">简体中文</a>
13
+ </p>
14
+ </h4>
15
+
16
+ Aquila Language Model is the first open source language model that supports both Chinese and English knowledge, commercial license agreements, and compliance with domestic data regulations.
17
+
18
+ - 🌟 **Supports open source commercial licenses**. The source code of the Aquila series models is based on the [Apache 2.0 agreement](https://www.apache.org/licenses/LICENSE-2.0), while the model weight is based on the [BAAI Aquila Model License Agreement](https://huggingface.co/BAAI/AquilaChat-7B/resolve/main/BAAI%20Aquila%20Model%20License%20Agreement.pdf). Users can use it for commercial purposes as long as they meet the licensing restrictions.
19
+
20
+ - ✍️ **Possesses Chinese and English knowledge**. The Aquila series model is trained from scratch on a high-quality corpus of Chinese and English languages, with Chinese corpora accounting for about 40%, ensuring that the model accumulates native Chinese world knowledge during the pre-training phase, rather than translated knowledge.
21
+
22
+ - 👮‍♀️ **Complies with domestic data regulations**. The Chinese corpora of the Aquila series models come from Intelligence Source's accumulated Chinese datasets over the years, including Chinese internet data from over 10,000 sources (more than 99% of which are domestic sources), as well as high-quality Chinese literature and book data supported by authoritative domestic organizations. We will continue to accumulate high-quality and diverse datasets and incorporate them into the subsequent training of the Aquila base models.
23
+
24
+ - 🎯 **Continuous improvements and open sourcing**. We will continue to improve training data, optimize training methods, and enhance model performance, cultivate a flourishing "model tree" on a better base model foundation, and continuously update open-source versions.
25
+
26
+ The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
27
+
28
+ ## Chat Model Performance
29
+
30
+ <br>
31
+ <p align="center">
32
+ <img src="chat_metrics.jpeg" width="1024"/>
33
+ <p>
34
+ <br>
35
+
36
+ ## Quick Start AquilaChat-7B(Chat model)
37
+
38
+ ### 1. Inference
39
+
40
+ ```python
41
+ from transformers import AutoTokenizer, AutoModelForCausalLM
42
+ import torch
43
+ device = torch.device("cuda")
44
+ model_info = "BAAI/AquilaChat-7B"
45
+ tokenizer = AutoTokenizer.from_pretrained(model_info, trust_remote_code=True)
46
+ model = AutoModelForCausalLM.from_pretrained(model_info, trust_remote_code=True)
47
+ model.eval()
48
+ model.to(device)
49
+ text = "请给出10个要到北京旅游的理由。"
50
+ tokens = tokenizer.encode_plus(text)['input_ids'][:-1]
51
+ tokens = torch.tensor(tokens)[None,].to(device)
52
+ stop_tokens = ["###", "[UNK]", "</s>"]
53
+ with torch.no_grad():
54
+ out = model.generate(tokens, do_sample=True, max_length=512, eos_token_id=100007, bad_words_ids=[[tokenizer.encode(token)[0] for token in stop_tokens]])[0]
55
+ out = tokenizer.decode(out.cpu().numpy().tolist())
56
+ print(out)
57
+ ```
58
+
59
+
60
+ ## License
61
+
62
+ AquilaChat-7B and AquilaChat-33B open-source model is licensed under [ BAAI Aquila Model Licence Agreement](https://huggingface.co/BAAI/AquilaChat-7B/resolve/main/BAAI%20Aquila%20Model%20License%20Agreement.pdf)