Hugging Face model: ijohn07/neural-chat-mini-v2.2-1.8B-Q8_0-GGUF
Author: ijohn07
Created: 2024-08-28 06:35:26
Last modified: 2024-08-28 06:35:36
Library: transformers
Likes: 0 | Downloads: 7
Tags: transformers, gguf, llama-cpp, gguf-my-repo, en, dataset:Open-Orca/SlimOrca, dataset:m-a-p/Code-Feedback, dataset:MaziyarPanahi/WizardLM_evol_instruct_V2_196k, dataset:camel-ai/math, dataset:camel-ai/physics, dataset:camel-ai/biology, dataset:camel-ai/chemistry, dataset:LDJnr/Capybara, dataset:jondurbin/airoboros-3.2, dataset:microsoft/orca-math-word-problems-200k, base_model:M4-ai/neural-chat-mini-v2.2-1.8B, base_model:quantized:M4-ai/neural-chat-mini-v2.2-1.8B, license:other, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: M4-ai/neural-chat-mini-v2.2-1.8B
Card metadata:
base_model: M4-ai/neural-chat-mini-v2.2-1.8B
datasets: Open-Orca/SlimOrca, m-a-p/Code-Feedback, MaziyarPanahi/WizardLM_evol_instruct_V2_196k, camel-ai/math, camel-ai/physics, camel-ai/biology, camel-ai/chemistry, LDJnr/Capybara, jondurbin/airoboros-3.2, microsoft/orca-math-word-problems-200k
language: en
library_name: transformers
license: other
tags: llama-cpp, gguf-my-repo
inference: parameters: do_sample: yes
temperature: 0.8
top_p: 0.95
top_k: 40
max_new_tokens: 250
repetition_penalty: 1.1