Hugging Face model: RedHatAI/Phi-4-mini-instruct-FP8-dynamic
Author: RedHatAI
Created: 2025-03-03 22:35:42
Last modified: 2026-04-28 22:16:19
Pipeline: text-generation
Likes: 1 | Downloads: 673
Tags: safetensors, phi3, nlp, code, red hat, FP8, compressed-tensors, llm-compressor, text-generation, conversational, custom_code, multilingual, ar, zh, cs, da, nl, en, fi, fr, de, he, hu, it, ja, ko, no, pl, pt, ru, es, sv, th, tr, uk, base_model:microsoft/Phi-4-mini-instruct, base_model:quantized:microsoft/Phi-4-mini-instruct, license:mit, region:us
Base model relation: quantized
Base models: id: microsoft/Phi-4-mini-instruct
Card metadata:
language: multilingual, ar, zh, cs, da, nl, en, fi, fr, de, he, hu, it, ja, ko, no, pl, pt, ru, es, sv, th, tr, uk
license: mit
license_name: mit
license_link: https://huggingface.co/microsoft/Phi-4-mini-instruct/resolve/main/LICENSE
name: RedHatAI/Phi-4-mini-instruct-FP8-dynamic
base_model: microsoft/Phi-4-mini-instruct
provider: Microsoft
description: This model was obtained by quantizing activation and weights of Phi-4-mini-instruct to FP8 data type.
validated_on: RHOAI 3.4 EA1, RHAIIS 3.4 EA1, vLLM 0.14.1
readme: https://huggingface.co/RedHatAI/Phi-4-mini-instruct-FP8-dynamic/blob/main/README.md
pipeline_tag: text-generation
tags: nlp, code, red hat, FP8, compressed-tensors, llm-compressor