btyu commited on
Commit
39cc552
1 Parent(s): 9223def

Upload model.

Browse files
Files changed (3) hide show
  1. README.md +39 -0
  2. adapter_config.json +31 -0
  3. adapter_model.bin +3 -0
README.md CHANGED
@@ -1,3 +1,42 @@
1
  ---
 
 
2
  license: cc-by-4.0
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  license: cc-by-4.0
5
+ tags:
6
+ - instruction tuning
7
+ - chemistry
8
+ - molecule
9
+ - small molecule
10
  ---
11
+
12
+ ![Logo of LlaSMol.](fig/logo.png)
13
+
14
+ <h1 align="center"> LlaSMol </h1>
15
+ <h3 align="center"> LlaSMol-Mistral-7B </h3>
16
+
17
+ **Paper**: [LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset]()
18
+
19
+ **Page**: [https://osu-nlp-group.github.io/LlaSMol](https://osu-nlp-group.github.io/LlaSMol)
20
+
21
+ **Code**: [https://github.com/OSU-NLP-Group/LlaSMol](https://github.com/OSU-NLP-Group/LlaSMol)
22
+
23
+ **Models**: [https://huggingface.co/osunlp/LlaSMol](https://huggingface.co/osunlp/LlaSMol-Mistral-7B)
24
+
25
+ LlaSMol-Mistral-7B is an LLM for chemistry. It is based on [Mistral](https://huggingface.co/mistralai/Mistral-7B-v0.1) and tuned on our [SMolInstruct](https://huggingface.co/datasets/osunlp/SMolInstruct) dataset with LoRA. This repo contains the weight of the low-rank adapter.
26
+
27
+ ## ⚔️ Usage
28
+
29
+ For instructions to run the model, please refer to our [repository](https://github.com/OSU-NLP-Group/LlaSMol).
30
+
31
+
32
+ ## 🚨 Limitations
33
+
34
+ While the model is carefully trained, we do not guarantee its effectiveness. The model may output incorrect or inaccurate information. Please use it at your own risk.
35
+
36
+ Additionally, the model is built as a mature product but solely for research purpose. It may generate harmful or biased information. We emphatically urge all users to adhere to the highest ethical standards when using the model, including maintaining fairness, transparency, and responsibility in their research. Any usage of the dataset that may lead to harm or pose a detriment to society is strictly **forbidden**.
37
+
38
+ ## 📚 Citation
39
+ If our paper or related resources prove valuable to your research, we kindly ask for citation. Please feel free to contact us with any inquiries.
40
+
41
+ ```
42
+ ```
adapter_config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "mistralai/Mistral-7B-v0.1",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layers_pattern": null,
10
+ "layers_to_transform": null,
11
+ "loftq_config": {},
12
+ "lora_alpha": 16,
13
+ "lora_dropout": 0.05,
14
+ "megatron_config": null,
15
+ "megatron_core": "megatron.core",
16
+ "modules_to_save": [],
17
+ "peft_type": "LORA",
18
+ "r": 16,
19
+ "rank_pattern": {},
20
+ "revision": null,
21
+ "target_modules": [
22
+ "k_proj",
23
+ "v_proj",
24
+ "o_proj",
25
+ "q_proj",
26
+ "gate_proj",
27
+ "up_proj",
28
+ "down_proj"
29
+ ],
30
+ "task_type": "CAUSAL_LM"
31
+ }
adapter_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:caa85963742ccf0b5c5fac60db6b10116562dd0be138f9cffb2765f0235b23b2
3
+ size 84047501