compressa-ai
/

Llama-3-8B-Instruct-OmniQuant

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3-8B-Instruct-OmniQuant / tokenizer_config.json

Commit History

kinda fix eos token to stop model from chatting with itself

70e329e

Vasily Alexeev commited on Apr 24

add model weights and stuff

1a27dec

Vasily Alexeev commited on Apr 23