Hugging Face model: azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16
Author: azhiboedova
Created: 2024-07-26 05:25:59
Last modified: 2024-08-28 02:55:20
Pipeline: text-generation
Library: transformers
Likes: 13 | Downloads: 22
Tags: transformers, safetensors, llama, text-generation, facebook, meta, llama-3.1, conversational, text-generation-inference, dataset:tasksource/mmlu, arxiv:2401.06118, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, endpoints_compatible, aqlm, region:us, deploy:azure
Base model relation: quantized
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
library_name: transformers
tags: llama, facebook, meta, llama-3.1, conversational, text-generation-inference
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
datasets: tasksource/mmlu