YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

After downloading both .calm files and the run binary, run:

chmod a+x run

and then:

./run llama3-8b-fp8.calm -i "?" -n 32 -r 5
CALM_POSO=4000 ./run llama3-8b-fp8.calm -i "?" -n 32 -r 5
./run llama3-8b-gf4.calm -i "?" -n 32 -r 5
CALM_POSO=4000 ./run llama3-8b-gf4.calm -i "?" -n 32 -r 5

Note: the run binary is not signed, so macOS will refuse to run it by default, but you can ctrl+click the binary and press "Open", which will show a dialog where you need to press "Open" again. After this the binary should be fine to run from terminal.

If you'd rather build the binary yourself, you can do it like this:

git clone https://github.com/zeux/calm
make -C calm

... but you'll need Xcode installed for this to work.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support