Hugging Face model: QuantFactory/TinyMistral-248M-v2.5-Instruct-GGUF
Author: QuantFactory
Created: 2024-10-17 16:27:49
Last modified: 2024-10-17 16:29:42
Likes: 1 | Downloads: 37
Tags: gguf, chemistry, biology, not-for-all-audiences, merge, code, en, dataset:Locutusque/hercules-v1.0, dataset:Open-Orca/SlimOrca-Dedup, base_model:Locutusque/TinyMistral-248M-v2.5, base_model:quantized:Locutusque/TinyMistral-248M-v2.5, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: Locutusque/TinyMistral-248M-v2.5
Card metadata:
license: apache-2.0
datasets: Locutusque/hercules-v1.0, Open-Orca/SlimOrca-Dedup
language: en
base_model: Locutusque/TinyMistral-248M-v2.5
tags: chemistry, biology, not-for-all-audiences, merge, code
inference: parameters: do_sample: yes
renormalize_logits: no
temperature: 0.8
top_p: 0.14
top_k: 12
min_new_tokens: 2
max_new_tokens: 96
repetition_penalty: 1.15
no_repeat_ngram_size: 5
epsilon_cutoff: 0.002