Hugging Face model: tensorblock/TinyMistral-6x248M-Instruct-GGUF
Author: tensorblock
Created: 2024-12-16 20:16:08
Last modified: 2026-01-27 20:50:49
Likes: 2 | Downloads: 20
Tags: gguf, moe, TensorBlock, GGUF, en, dataset:Locutusque/hercules-v1.0, base_model:M4-ai/TinyMistral-6x248M-Instruct, base_model:quantized:M4-ai/TinyMistral-6x248M-Instruct, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: M4-ai/TinyMistral-6x248M-Instruct
Card metadata:
license: apache-2.0
datasets: Locutusque/hercules-v1.0
language: en
base_model: M4-ai/TinyMistral-6x248M-Instruct
inference: parameters: do_sample: yes
temperature: 0.2
top_p: 0.14
top_k: 12
max_new_tokens: 250
repetition_penalty: 1.1
tags: moe, TensorBlock, GGUF