jacobthebanana commited on
Commit
1f6f118
1 Parent(s): 8020c85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -1,3 +1,25 @@
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
4
+
5
+ JAX weights converted from Torch checkpoint at `facebook/galactica-125m`.
6
+
7
+ ```python
8
+ >>> from transformers import FlaxOPTForCausalLM
9
+ >>> model = FlaxOPTForCausalLM.from_pretrained("facebook/galactica-125m", from_pt=True)
10
+ >>> model.push_to_hub(hf_model_repo)
11
+ ```
12
+
13
+ ## Citation and Attribution
14
+
15
+ Citation from the original repo is reproduced below as per the cc-by-nc-4.0 licsense.
16
+
17
+ ```bibtex
18
+ @inproceedings{GALACTICA,
19
+ title={GALACTICA: A Large Language Model for Science},
20
+ author={Ross Taylor and Marcin Kardas and Guillem Cucurull and Thomas Scialom and Anthony Hartshorn and Elvis Saravia and Andrew Poulton and Viktor Kerkez and Robert Stojnic},
21
+ year={2022}
22
+ }
23
+ ```
24
+
25
+ > Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)