Model: RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Author: RedHatAI
Pipeline: text-generation
Tags: safetensors, phi3, fp8, vllm, text-generation, conversational, custom_code, base_model:microsoft/Phi-3.5-mini-instruct, base_model:quantized:microsoft/Phi-3.5-mini-instruct, license:mit, compressed-tensors, region:us
Base models (quantized): id: microsoft/Phi-3.5-mini-instruct
Card metadata: tags: fp8, vllm
pipeline_tag: text-generation
license: mit
license_link: https://huggingface.co/microsoft/Phi-3.5-mini-instruct/resolve/main/LICENSE
base_model: microsoft/Phi-3.5-mini-instruct
Likes: 2 | All-time downloads: 2651
Created: 2024-09-27 17:57:13