neuralmagic-ent
/

Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation

4-bit precision

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-quantized.w4a16 / tokenizer_config.json

Commit History

Upload folder using huggingface_hub

4d14217
verified

nm-research commited on 9 days ago