Hugging Face model: RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Author: RedHatAI
Created: 2025-04-25 13:11:57
Last modified: 2026-06-09 17:37:14
Pipeline: image-text-to-text
Likes: 13 | Downloads: 16533
Tags: safetensors, llama4, facebook, meta, pytorch, llama, neuralmagic, redhat, llmcompressor, quantized, W4A16, INT4, conversational, compressed-tensors, image-text-to-text, ar, de, en, es, fr, hi, id, it, pt, th, tl, vi, base_model:meta-llama/Llama-4-Scout-17B-16E-Instruct, base_model:quantized:meta-llama/Llama-4-Scout-17B-16E-Instruct, license:llama4, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-4-Scout-17B-16E-Instruct
Card metadata:
language: ar, de, en, es, fr, hi, id, it, pt, th, tl, vi
base_model: meta-llama/Llama-4-Scout-17B-16E-Instruct
pipeline_tag: image-text-to-text
tags: facebook, meta, pytorch, llama, llama4, neuralmagic, redhat, llmcompressor, quantized, W4A16, INT4, conversational, compressed-tensors
license: llama4
license_name: llama4
name: RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
description: This model was obtained by quantizing weights of Llama-4-Scout-17B-16E-Instruct to INT4 data type.
readme: https://huggingface.co/RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16/main/README.md
tasks: image-text-to-text, text-to-text
provider: Meta
license_link: https://www.llama.com/llama4/license/
validated_on: RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5, vLLM 0.8.4