Hugging Face model: RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
Author: RedHatAI
Created: 2025-01-03 14:44:25
Last modified: 2026-08-05 19:49:01
Likes: 0 | Downloads: 203
Tags: safetensors, mixtral, moe, w4a16, int4, vllm, en, license:apache-2.0, compressed-tensors, region:us
Card metadata:
license: apache-2.0
language: en
tags: moe, w4a16, int4, vllm