Hugging Face model: RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Author: RedHatAI
Created: 2024-09-27 17:57:13
Last modified: 2024-10-01 18:01:10
Pipeline: text-generation
Likes: 2 | Downloads: 132
Tags: safetensors, phi3, fp8, vllm, text-generation, conversational, custom_code, base_model:microsoft/Phi-3.5-mini-instruct, base_model:quantized:microsoft/Phi-3.5-mini-instruct, license:mit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: microsoft/Phi-3.5-mini-instruct
Card metadata:
tags: fp8, vllm
pipeline_tag: text-generation
license: mit
license_link: https://huggingface.co/microsoft/Phi-3.5-mini-instruct/resolve/main/LICENSE
base_model: microsoft/Phi-3.5-mini-instruct