Model: ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Author: ISTA-DASLab
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, aqlm, facebook, meta, llama-3, conversational, text-generation-inference, arxiv:2401.06118, arxiv:2405.14852, base_model:meta-llama/Llama-3.1-70B, base_model:quantized:meta-llama/Llama-3.1-70B, endpoints_compatible, region:us
Base models (quantized): id: meta-llama/Llama-3.1-70B
Card metadata: library_name: transformers
tags: aqlm, llama, facebook, meta, llama-3, conversational, text-generation-inference
base_model: meta-llama/Meta-Llama-3.1-70B
Likes: 18 | All-time downloads: 883
Created: 2024-09-13 17:44:31