Hugging Face model: compressa-ai/Llama-3-70B-Instruct-OmniQuant
Author: compressa-ai
Created: 2024-04-27 22:48:26
Last modified: 2024-05-02 22:43:09
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, llama3, omniquant, gptq, triton, conversational, base_model:NousResearch/Meta-Llama-3-70B-Instruct, base_model:quantized:NousResearch/Meta-Llama-3-70B-Instruct, license:other, text-generation-inference, endpoints_compatible, 4-bit, region:us
Base model relation: quantized
Base models: id: NousResearch/Meta-Llama-3-70B-Instruct
Card metadata:
base_model: NousResearch/Meta-Llama-3-70B-Instruct
model_type: llama
pipeline_tag: text-generation
quantized_by: Compressa
license: other
license_name: llama3
license_link: https://llama.meta.com/llama3/license
tags: llama3, omniquant, gptq, triton