HiTZ
/

GoLLIE-7B

Text Generation

text-generation-inference

Information Extraction

Named Entity Recogniton

Event Extraction

Relation Extraction

Inference Endpoints

Model card Files Files and versions Community

Iker commited on Oct 3, 2023

Commit

ff21edd

•

1 Parent(s): 26a99dd

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -127,10 +127,12 @@ pip install git+https://github.com/HazyResearch/flash-attention.git#subdirectory
 Then you can load the model using
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
 tokenizer = AutoTokenizer.from_pretrained("HiTZ/GoLLIE-7B")
-model = AutoModelForCausalLM.from_pretrained("HiTZ/GoLLIE-7B", trust_remote_code=True)
 ```
 Read our [🚀 Example Jupyter Notebooks](notebooks/) to learn how to easily define guidelines, generate model inputs and parse the output!

 Then you can load the model using
 ```python
+import torch
 from transformers import AutoTokenizer, AutoModelForCausalLM
 tokenizer = AutoTokenizer.from_pretrained("HiTZ/GoLLIE-7B")
+model = AutoModelForCausalLM.from_pretrained("HiTZ/GoLLIE-7B", trust_remote_code=True, torch_dtype=torch.bfloat16)
+model.to("cuda")
 ```
 Read our [🚀 Example Jupyter Notebooks](notebooks/) to learn how to easily define guidelines, generate model inputs and parse the output!