Hugging Face model: ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf
Author: ISTA-DASLab
Created: 2024-08-09 08:02:04
Last modified: 2024-08-09 12:24:49
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 47
Tags: transformers, safetensors, llama, text-generation, facebook, meta, llama-3, conversational, text-generation-inference, arxiv:2401.06118, arxiv:2405.14852, endpoints_compatible, 8-bit, aqlm, region:us
Card metadata:
library_name: transformers
tags: llama, facebook, meta, llama-3, conversational, text-generation-inference