Hugging Face model: nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache
Author: nintwentydo
Created: 2024-12-29 03:38:10
Last modified: 2025-01-06 04:10:50
Pipeline: image-text-to-text
Library: vllm
Likes: 1 | Downloads: 337
Tags: vllm, safetensors, llava, fp8, image-text-to-text, conversational, en, de, fr, it, pt, hi, es, th, dataset:HuggingFaceH4/ultrachat_200k, base_model:mistral-experimental/pixtral-12b, base_model:quantized:mistral-experimental/pixtral-12b, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: mistral-experimental/pixtral-12b
Card metadata:
tags: fp8, vllm
language: en, de, fr, it, pt, hi, es, th
pipeline_tag: image-text-to-text
license: apache-2.0
library_name: vllm
base_model: mistral-community/pixtral-12b, mistralai/Pixtral-12B-2409
base_model_relation: quantized
datasets: HuggingFaceH4/ultrachat_200k