szymonxai commited on
Commit
15af4e5
1 Parent(s): a1d5101

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -1,3 +1,19 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ # Grok-1
5
+
6
+ This repository contains JAX example code for loading and running the Grok-1 open-weights model.
7
+
8
+ Make sure to download the `int8` checkpoint to the `checkpoints` directory and run
9
+
10
+ ```shell
11
+ pip install -r requirements.txt
12
+ python transformer.py
13
+ ```
14
+
15
+ to test the code.
16
+
17
+ You should be seeing output from the language model.
18
+
19
+ Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.