Hugging Face model: tensorblock/TinyMistral-6x248M-GGUF
Author: tensorblock
Created: 2024-12-16 03:30:59
Last modified: 2026-01-27 21:14:40
Likes: 0 | Downloads: 32
Tags: gguf, moe, frankenmoe, merge, mergekit, lazymergekit, Locutusque/TinyMistral-248M-v2, Locutusque/TinyMistral-248M-v2.5, Locutusque/TinyMistral-248M-v2.5-Instruct, jtatman/tinymistral-v2-pycoder-instruct-248m, Felladrin/TinyMistral-248M-SFT-v4, Locutusque/TinyMistral-248M-v2-Instruct, TensorBlock, GGUF, dataset:nampdn-ai/mini-peS2o, base_model:M4-ai/TinyMistral-6x248M, base_model:quantized:M4-ai/TinyMistral-6x248M, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: M4-ai/TinyMistral-6x248M
Card metadata:
license: apache-2.0
tags: moe, frankenmoe, merge, mergekit, lazymergekit, Locutusque/TinyMistral-248M-v2, Locutusque/TinyMistral-248M-v2.5, Locutusque/TinyMistral-248M-v2.5-Instruct, jtatman/tinymistral-v2-pycoder-instruct-248m, Felladrin/TinyMistral-248M-SFT-v4, Locutusque/TinyMistral-248M-v2-Instruct, TensorBlock, GGUF
base_model: M4-ai/TinyMistral-6x248M
inference: parameters: do_sample: yes
temperature: 0.2
top_p: 0.14
top_k: 12
max_new_tokens: 250
repetition_penalty: 1.15
datasets: nampdn-ai/mini-peS2o