Hugging Face model: BasedBots/TinyMistral-248M-v2.5-Instruct-Q4_K_M-GGUF
Author: BasedBots
Created: 2024-04-09 16:59:10
Last modified: 2024-04-09 16:59:15
Likes: 0 | Downloads: 8
Tags: gguf, chemistry, biology, not-for-all-audiences, merge, code, llama-cpp, gguf-my-repo, en, dataset:Locutusque/hercules-v1.0, dataset:Open-Orca/SlimOrca-Dedup, base_model:Locutusque/TinyMistral-248M-v2.5, base_model:quantized:Locutusque/TinyMistral-248M-v2.5, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: Locutusque/TinyMistral-248M-v2.5
Card metadata:
language: en
license: apache-2.0
tags: chemistry, biology, not-for-all-audiences, merge, code, llama-cpp, gguf-my-repo
base_model: Locutusque/TinyMistral-248M-v2.5
datasets: Locutusque/hercules-v1.0, Open-Orca/SlimOrca-Dedup
inference: parameters: do_sample: yes
renormalize_logits: no
temperature: 0.8
top_p: 0.14
top_k: 12
min_new_tokens: 2
max_new_tokens: 96
repetition_penalty: 1.15
no_repeat_ngram_size: 5
epsilon_cutoff: 0.002