Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

This is a 4.5 bpw quantized version of Qwen/Qwen2.5-Coder-7B-Instruct made with exllamav2.

License

This model is available under the Apache 2.0 License.

Discord Server

Join our Discord server here.

Feeling Generous? 😊

Eager to buy me a cup of 2$ coffee or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?

Downloads last month: 8

Inference API

Unable to determine this model's library. Check the docs .

Model tree for DrNicefellow/Qwen2.5-Coder-7B-Instruct-4.5bpw-exl2

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-Coder-7B

Finetuned

Qwen/Qwen2.5-Coder-7B-Instruct

Quantized

(76)

this model

Collection including DrNicefellow/Qwen2.5-Coder-7B-Instruct-4.5bpw-exl2

Qwen2.5-Coder-7B-Instruct

Collection

10 items • Updated 14 days ago