nm-testing
/

Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors

Commit History

Updated compression_config to quantization_config

b9c5c0b
verified

mgoin commited on Oct 9, 2024

Upload folder using huggingface_hub

7d8764c
verified

robertgshaw2 commited on Jul 16, 2024

initial commit

7ab0d60
verified

robertgshaw2 commited on Jul 16, 2024