metadata

license: apache-2.0
pipeline_tag: text-generation

Grok-1

This repository contains the weights of the Grok-1 open-weights model.

Make sure to download the int8 checkpoint to the checkpoints directory.

huggingface-cli download xai-org/grok-1 --repo-type model --include ckpt/tensor* --local-dir checkpoints/ckpt-0 --local-dir-use-symlinks False

Then, you can run:

pip install -r requirements.txt
python transformer.py

to test the code.

You should be seeing output from the language model.

Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.