Update README.md

README.md

@@ -28,13 +28,21 @@ license: apache-2.0
 library_name: vllm
 inference: false
 base_model:
-- mistralai/Mistral-Small-3.1-24B-Base-2503
+- mistralai/Mistral-Small-3.2-24B-Instruct-2506
 extra_gated_description: >-
   If you want to learn more about how we process your personal data, please read
   our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
 pipeline_tag: image-text-to-text
 ---
 
+Quantized with (llm-compressor)[https://github.com/vllm-project/llm-compressor/tree/main/experimental/mistral] experimental update for mistral
+
+Ideal to use with vllm
+
+```
+vllm serve bullerwins/Mistral-Small-3.2-24B-Instruct-2506-FP8 -tp 4 --tokenizer-mode mistral --config-format mistral --load-format mistral --tool-call-parser mistral --enable-auto-tool-choice
+```
+
 # Mistral-Small-3.2-24B-Instruct-2506
 
 Mistral-Small-3.2-24B-Instruct-2506 is a minor update of [Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503).