brittlewis12/TinyOpenHermes-1.1B-4k-GGUF

TinyOpenHermes-1.1B-4k GGUF

Original model: TinyOpenHermes-1.1B-4k Model creator: Ba2han

This repo contains GGUF format model files for Ba2han’s TinyOpenHermes-1.1B-4k.

Compared to TinyLlama-1.1B-Chat-v1.0:

• Algebra UP 17.4%
• Formal Logic UP 24.2%
• Logical Fallacies UP 35.4%

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp b1932 (revision 942c010)

Prompt template: Alpaca

{{system_message}}

### Instruction:
{{prompt}}

### Response:

---

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs is the best app for private, local AI on your device:

• create & save Characters with custom system prompts & temperature settings
• download and experiment with any GGUF model you can find on HuggingFace!
• make it your own with custom Theme colors
• powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
• try it out yourself today, on Testflight!
• follow cnvrs on twitter to stay up to date

---

Original Model Evaluations:

Task	Version	Metric	Value		Stderr
hendrycksTest-logical_fallacies	1	acc	0.3067	±	0.0362
		acc_norm	0.3067	±	0.0362
hendrycksTest-global_facts	1	acc	0.3	±	0.0461
		acc_norm	0.3	±	0.0461
hendrycksTest-abstract_algebra	1	acc	0.2700	±	0.0446
		acc_norm	0.2700	±	0.0446
hendrycksTest-college_chemistry	1	acc	0.3100	±	0.0465
		acc_norm	0.3100	±	0.0465
hendrycksTest-college_physics	1	acc	0.2157	±	0.0409
		acc_norm	0.2157	±	0.0409
hendrycksTest-formal_logic	1	acc	0.2857	±	0.0404
		acc_norm	0.2857	±	0.0404