This repository contains quantized weights for Qwen/Qwen2.5-72B-Instruct.

Built with Alibaba Cloud Qwen 2.5.

This model is a derivative work of Alibaba Clouds's Qwen 2.5 and is governed by the Qwen License Agreement and the Qwen Usage Policy.

By downloading, copying, or using these quantized weights, you agree to compliance with the terms, conditions, and restrictions outlined.

Safetensors

Model size

73B params

Tensor type

BF16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lierseleow/Qwen2.5-72B-Instruct-bnb-4bit

Base model

Finetuned

Quantized

(93)

this model

Collection including lierseleow/Qwen2.5-72B-Instruct-bnb-4bit