Hugging Face model: amd/Mixtral-8x7B-Instruct-v0.1-da8w8-torchao-v0.17.0
Author: amd
Created: 2026-06-22 10:54:58
Last modified: 2026-06-22 10:58:15
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 11
Tags: transformers, pytorch, mixtral, text-generation, quantized, int8, dynamic-quantization, 8-bit, moe, zendnn, torchao, amd, cpu-inference, conversational, en, base_model:mistralai/Mixtral-8x7B-Instruct-v0.1, base_model:quantized:mistralai/Mixtral-8x7B-Instruct-v0.1, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: mistralai/Mixtral-8x7B-Instruct-v0.1
Card metadata:
license: apache-2.0
base_model: mistralai/Mixtral-8x7B-Instruct-v0.1
base_model_relation: quantized
library_name: transformers
pipeline_tag: text-generation
tags: quantized, int8, dynamic-quantization, 8-bit, moe, zendnn, torchao, amd, cpu-inference
language: en