jacobthebanana commited on
Commit
81b2e6f
1 Parent(s): f8c4a0e

Added model card.

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -1,3 +1,29 @@
1
  ---
2
- license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: cc-by-nc-4.0
3
  ---
4
+
5
+ JAX weights converted from Torch checkpoint at `facebook/galactica-6.7b`.
6
+
7
+ ```python
8
+ (env) ubuntu@vm:~$ JAX_PLATFORM_NAME=cpu python3
9
+ >>> import jax
10
+ >>> print(jax.devices())
11
+ [CpuDevice(id=0)] # Ensure that model weights are loaded into CPU RAM, not accelerator memory.
12
+ >>> from transformers import FlaxOPTForCausalLM
13
+ >>> model = FlaxOPTForCausalLM.from_pretrained("facebook/galactica-6.7b", from_pt=True)
14
+ >>> model.push_to_hub(hf_model_repo)
15
+ ```
16
+
17
+ ## Citation and Attribution
18
+
19
+ Citation from the original repo is reproduced below as per the cc-by-nc-4.0 licsense.
20
+
21
+ ```bibtex
22
+ @inproceedings{GALACTICA,
23
+ title={GALACTICA: A Large Language Model for Science},
24
+ author={Ross Taylor and Marcin Kardas and Guillem Cucurull and Thomas Scialom and Anthony Hartshorn and Elvis Saravia and Andrew Poulton and Viktor Kerkez and Robert Stojnic},
25
+ year={2022}
26
+ }
27
+ ```
28
+
29
+ > Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)