Model: compressa-ai/Llama-3-70B-Instruct-OmniQuant
Author: compressa-ai
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, llama3, omniquant, gptq, triton, conversational, base_model:NousResearch/Meta-Llama-3-70B-Instruct, base_model:quantized:NousResearch/Meta-Llama-3-70B-Instruct, license:other, text-generation-inference, endpoints_compatible, 4-bit, region:us
Base models (quantized): id: NousResearch/Meta-Llama-3-70B-Instruct
Card metadata: base_model: NousResearch/Meta-Llama-3-70B-Instruct
model_type: llama
pipeline_tag: text-generation
quantized_by: Compressa
license: other
license_name: llama3
license_link: https://llama.meta.com/llama3/license
tags: llama3, omniquant, gptq, triton
Likes: 0 | All-time downloads: 12
Created: 2024-04-27 22:48:26