Upload README.md with huggingface_hub

185d8fc verified about 2 months ago

No virus

4.69 kB

	---
	language:
	- en
	license: other
	tags:
	- axolotl
	- generated_from_trainer
	- Mistral
	- instruct
	- finetune
	- chatml
	- gpt4
	- synthetic data
	- science
	- physics
	- chemistry
	- biology
	- math
	- llama-cpp
	- gguf-my-repo
	base_model: mistralai/Mistral-7B-v0.1
	datasets:
	- allenai/ai2_arc
	- camel-ai/physics
	- camel-ai/chemistry
	- camel-ai/biology
	- camel-ai/math
	- metaeval/reclor
	- openbookqa
	- mandyyyyii/scibench
	- derek-thomas/ScienceQA
	- TIGER-Lab/ScienceEval
	- jondurbin/airoboros-3.2
	- LDJnr/Capybara
	- Cot-Alpaca-GPT4-From-OpenHermes-2.5
	- STEM-AI-mtl/Electrical-engineering
	- knowrohit07/saraswati-stem
	- sablo/oasst2_curated
	- glaiveai/glaive-code-assistant
	- lmsys/lmsys-chat-1m
	- TIGER-Lab/MathInstruct
	- bigbio/med_qa
	- meta-math/MetaMathQA-40K
	- openbookqa
	- piqa
	- metaeval/reclor
	- derek-thomas/ScienceQA
	- scibench
	- sciq
	- Open-Orca/SlimOrca
	- migtissera/Synthia-v1.3
	- TIGER-Lab/ScienceEval
	model-index:
	- name: Einstein-v4-7B
	results:
	- task:
	type: text-generation
	name: Text Generation
	dataset:
	name: AI2 Reasoning Challenge (25-Shot)
	type: ai2_arc
	config: ARC-Challenge
	split: test
	args:
	num_few_shot: 25
	metrics:
	- type: acc_norm
	value: 64.68
	name: normalized accuracy
	source:
	url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Weyaxi/Einstein-v4-7B
	name: Open LLM Leaderboard
	- task:
	type: text-generation
	name: Text Generation
	dataset:
	name: HellaSwag (10-Shot)
	type: hellaswag
	split: validation
	args:
	num_few_shot: 10
	metrics:
	- type: acc_norm
	value: 83.75
	name: normalized accuracy
	source:
	url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Weyaxi/Einstein-v4-7B
	name: Open LLM Leaderboard
	- task:
	type: text-generation
	name: Text Generation
	dataset:
	name: MMLU (5-Shot)
	type: cais/mmlu
	config: all
	split: test
	args:
	num_few_shot: 5
	metrics:
	- type: acc
	value: 62.31
	name: accuracy
	source:
	url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Weyaxi/Einstein-v4-7B
	name: Open LLM Leaderboard
	- task:
	type: text-generation
	name: Text Generation
	dataset:
	name: TruthfulQA (0-shot)
	type: truthful_qa
	config: multiple_choice
	split: validation
	args:
	num_few_shot: 0
	metrics:
	- type: mc2
	value: 55.15
	source:
	url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Weyaxi/Einstein-v4-7B
	name: Open LLM Leaderboard
	- task:
	type: text-generation
	name: Text Generation
	dataset:
	name: Winogrande (5-shot)
	type: winogrande
	config: winogrande_xl
	split: validation
	args:
	num_few_shot: 5
	metrics:
	- type: acc
	value: 76.24
	name: accuracy
	source:
	url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Weyaxi/Einstein-v4-7B
	name: Open LLM Leaderboard
	- task:
	type: text-generation
	name: Text Generation
	dataset:
	name: GSM8k (5-shot)
	type: gsm8k
	config: main
	split: test
	args:
	num_few_shot: 5
	metrics:
	- type: acc
	value: 57.62
	name: accuracy
	source:
	url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Weyaxi/Einstein-v4-7B
	name: Open LLM Leaderboard
	---

	# DavidAU/Einstein-v4-7B-Q4_K_M-GGUF
	This model was converted to GGUF format from [`Weyaxi/Einstein-v4-7B`](https://huggingface.co/Weyaxi/Einstein-v4-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
	Refer to the [original model card](https://huggingface.co/Weyaxi/Einstein-v4-7B) for more details on the model.
	## Use with llama.cpp

	Install llama.cpp through brew.

	```bash
	brew install ggerganov/ggerganov/llama.cpp
	```
	Invoke the llama.cpp server or the CLI.

	CLI:

	```bash
	llama-cli --hf-repo DavidAU/Einstein-v4-7B-Q4_K_M-GGUF --model einstein-v4-7b.Q4_K_M.gguf -p "The meaning to life and the universe is"
	```

	Server:

	```bash
	llama-server --hf-repo DavidAU/Einstein-v4-7B-Q4_K_M-GGUF --model einstein-v4-7b.Q4_K_M.gguf -c 2048
	```

	Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.

	```
	git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make && ./main -m einstein-v4-7b.Q4_K_M.gguf -n 128
	```