PrunaAI
/

NousResearch-Meta-Llama-3-8B-Instruct-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

NousResearch-Meta-Llama-3-8B-Instruct-AWQ-4bit-smashed / smash_config.json

Commit History

34098872f66e8b16e365837993beac9b3da8f60e01cd86df27131be20585ba32

4129fd8
verified

sharpenb commited on May 2

Upload folder using huggingface_hub (#1)

52258a4
verified

sharpenb commited on Apr 29