Hugging Face model: Devy1/CodeLlama-34b-hf-AQLM-2bit-mixed-1x15
Author: Devy1
Created: 2025-01-18 09:59:21
Last modified: 2025-03-07 13:31:07
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, safetensors, llama, text-generation, aqlm, base_model:codellama/CodeLlama-34b-hf, base_model:quantized:codellama/CodeLlama-34b-hf, text-generation-inference, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: codellama/CodeLlama-34b-hf
Card metadata:
library_name: transformers
tags: aqlm
base_model: codellama/CodeLlama-34b-hf
base_model_relation: quantized