Model: nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache
Author: nintwentydo
Pipeline: image-text-to-text
Library: vllm
Tags: vllm, safetensors, llava, fp8, image-text-to-text, conversational, en, de, fr, it, pt, hi, es, th, dataset:HuggingFaceH4/ultrachat_200k, base_model:mistral-community/pixtral-12b, base_model:quantized:mistral-community/pixtral-12b, license:apache-2.0, compressed-tensors, region:us
Base models (quantized): id: mistral-community/pixtral-12b
Card metadata: tags: fp8, vllm
language: en, de, fr, it, pt, hi, es, th
pipeline_tag: image-text-to-text
license: apache-2.0
library_name: vllm
base_model: mistral-community/pixtral-12b, mistralai/Pixtral-12B-2409
base_model_relation: quantized
datasets: HuggingFaceH4/ultrachat_200k
Likes: 1 | All-time downloads: 46
Created: 2024-12-29 03:38:10