Hugging Face model: M4-ai/TinyMistral-6x248M
Author: M4-ai
Created: 2024-01-28 01:39:05
Last modified: 2024-01-30 23:17:34
Pipeline: text-generation
Library: transformers
Likes: 17 | Downloads: 139
Tags: transformers, safetensors, mixtral, text-generation, moe, frankenmoe, merge, mergekit, lazymergekit, Locutusque/TinyMistral-248M-v2, Locutusque/TinyMistral-248M-v2.5, Locutusque/TinyMistral-248M-v2.5-Instruct, jtatman/tinymistral-v2-pycoder-instruct-248m, Felladrin/TinyMistral-248M-SFT-v4, Locutusque/TinyMistral-248M-v2-Instruct, dataset:nampdn-ai/mini-peS2o, base_model:Felladrin/TinyMistral-248M-Chat-v4, base_model:merge:Felladrin/TinyMistral-248M-Chat-v4, base_model:Locutusque/TinyMistral-248M-v2, base_model:merge:Locutusque/TinyMistral-248M-v2, base_model:Locutusque/TinyMistral-248M-v2-Instruct, base_model:merge:Locutusque/TinyMistral-248M-v2-Instruct, base_model:Locutusque/TinyMistral-248M-v2.5, base_model:merge:Locutusque/TinyMistral-248M-v2.5, base_model:Locutusque/TinyMistral-248M-v2.5-Instruct, base_model:merge:Locutusque/TinyMistral-248M-v2.5-Instruct, base_model:jtatman/tinymistral-v2-pycoder-instruct-248m, base_model:merge:jtatman/tinymistral-v2-pycoder-instruct-248m, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: merge
Base models: id: Felladrin/TinyMistral-248M-Chat-v4, id: Locutusque/TinyMistral-248M-v2, id: Locutusque/TinyMistral-248M-v2-Instruct, id: Locutusque/TinyMistral-248M-v2.5, id: Locutusque/TinyMistral-248M-v2.5-Instruct, id: jtatman/tinymistral-v2-pycoder-instruct-248m
Card metadata:
license: apache-2.0
tags: moe, frankenmoe, merge, mergekit, lazymergekit, Locutusque/TinyMistral-248M-v2, Locutusque/TinyMistral-248M-v2.5, Locutusque/TinyMistral-248M-v2.5-Instruct, jtatman/tinymistral-v2-pycoder-instruct-248m, Felladrin/TinyMistral-248M-SFT-v4, Locutusque/TinyMistral-248M-v2-Instruct
base_model: Locutusque/TinyMistral-248M-v2, Locutusque/TinyMistral-248M-v2.5, Locutusque/TinyMistral-248M-v2.5-Instruct, jtatman/tinymistral-v2-pycoder-instruct-248m, Felladrin/TinyMistral-248M-SFT-v4, Locutusque/TinyMistral-248M-v2-Instruct
inference: parameters: do_sample: yes
temperature: 0.2
top_p: 0.14
top_k: 12
max_new_tokens: 250
repetition_penalty: 1.15
datasets: nampdn-ai/mini-peS2o