upload model

README.md

@@ -1,3 +1,54 @@
 ---
+language:
+  - en
 license: cc-by-4.0
+tags:
+  - instruction tuning
+  - chemistry
+  - molecule
+  - small molecule
 ---
+
+<p align="center">
+<img style="width: 20%;" src="llasmol.png">
+</p>
+
+<h1 align="center">  LlaSMol  </h1>
+<h3 align="center"> LlaSMol-Galactica-6.7B </h3>
+
+**Paper**: [LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset](https://arxiv.org/abs/2402.09391)
+
+**Page**: [https://osu-nlp-group.github.io/LlaSMol](https://osu-nlp-group.github.io/LlaSMol)
+
+**Code**: [https://github.com/OSU-NLP-Group/LlaSMol](https://github.com/OSU-NLP-Group/LlaSMol)
+
+**Models**: 
+- LlaSMol-Galactica-6.7B: [https://huggingface.co/osunlp/LlaSMol-Galactica-6.7B](https://huggingface.co/osunlp/LlaSMol-Galactica-6.7B)
+- LlaSMol-Llama2-7B: [https://huggingface.co/osunlp/LlaSMol-Llama2-7B](https://huggingface.co/osunlp/LlaSMol-Llama2-7B)
+- LlaSMol-CodeLlama-7B: [https://huggingface.co/osunlp/LlaSMol-CodeLlama-7B](https://huggingface.co/osunlp/LlaSMol-CodeLlama-7B)
+- LlaSMol-Mistral-7B: [https://huggingface.co/osunlp/LlaSMol-Mistral-7B](https://huggingface.co/osunlp/LlaSMol-Mistral-7B)
+
+LlaSMol-Galactica-6.7B is an LLM for chemistry. It is based on [facebook/galactica-6.7b](https://huggingface.co/facebook/galactica-6.7b) and tuned on our [SMolInstruct](https://huggingface.co/datasets/osunlp/SMolInstruct) dataset with LoRA. This repo contains the weight of the low-rank adapter.
+
+## ⚔️ Usage
+
+For instructions to run the model, please refer to our [repository](https://github.com/OSU-NLP-Group/LlaSMol).
+
+
+## 🚨 Limitations
+
+While the model is carefully trained, we do not guarantee its effectiveness. The model may output incorrect or inaccurate information. Please use it at your own risk.
+
+Additionally, the model is built as a mature product but solely for research purpose. It may generate harmful or biased information. We emphatically urge all users to adhere to the highest ethical standards when using the model, including maintaining fairness, transparency, and responsibility in their research. Any usage of the dataset that may lead to harm or pose a detriment to society is strictly **forbidden**.
+
+## 📚 Citation
+If our paper or related resources prove valuable to your research, we kindly ask for citation. Please feel free to contact us with any inquiries.
+
+```
+@article{yu2024llasmol,
+  title={LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset},
+  author={Botao Yu and Frazier N. Baker and Ziqi Chen and Xia Ning and Huan Sun},
+  journal={arXiv preprint arXiv:2402.09391},
+  year={2024}
+}
+```

adapter_config.json

@@ -0,0 +1,30 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "facebook/galactica-6.7b",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": [],
+  "peft_type": "LORA",
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "fc2",
+    "fc1",
+    "v_proj",
+    "out_proj",
+    "k_proj"
+  ],
+  "task_type": "CAUSAL_LM"
+}

adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cabaefb46a6817d94d03ece3d2f9f44f4ecabc6d267db5f77aed24552a6ba027
+size 75638029