DavidAU commited on
Commit
a5ed4b7
1 Parent(s): b327398

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +79 -0
README.md ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - llama-cpp
5
+ - gguf-my-repo
6
+ base_model: alpindale/Mistral-7B-v0.2-hf
7
+ datasets:
8
+ - ai2_arc
9
+ - allenai/ultrafeedback_binarized_cleaned
10
+ - argilla/distilabel-intel-orca-dpo-pairs
11
+ - jondurbin/airoboros-3.2
12
+ - codeparrot/apps
13
+ - facebook/belebele
14
+ - bluemoon-fandom-1-1-rp-cleaned
15
+ - boolq
16
+ - camel-ai/biology
17
+ - camel-ai/chemistry
18
+ - camel-ai/math
19
+ - camel-ai/physics
20
+ - jondurbin/contextual-dpo-v0.1
21
+ - jondurbin/gutenberg-dpo-v0.1
22
+ - jondurbin/py-dpo-v0.1
23
+ - jondurbin/truthy-dpo-v0.1
24
+ - LDJnr/Capybara
25
+ - jondurbin/cinematika-v0.1
26
+ - WizardLM/WizardLM_evol_instruct_70k
27
+ - glaiveai/glaive-function-calling-v2
28
+ - jondurbin/gutenberg-dpo-v0.1
29
+ - grimulkan/LimaRP-augmented
30
+ - lmsys/lmsys-chat-1m
31
+ - ParisNeo/lollms_aware_dataset
32
+ - TIGER-Lab/MathInstruct
33
+ - Muennighoff/natural-instructions
34
+ - openbookqa
35
+ - kingbri/PIPPA-shareGPT
36
+ - piqa
37
+ - Vezora/Tested-22k-Python-Alpaca
38
+ - ropes
39
+ - cakiki/rosetta-code
40
+ - Open-Orca/SlimOrca
41
+ - b-mc2/sql-create-context
42
+ - squad_v2
43
+ - mattpscott/airoboros-summarization
44
+ - migtissera/Synthia-v1.3
45
+ - unalignment/toxic-dpo-v0.2
46
+ - WhiteRabbitNeo/WRN-Chapter-1
47
+ - WhiteRabbitNeo/WRN-Chapter-2
48
+ - winogrande
49
+ ---
50
+
51
+ # DavidAU/bagel-7b-v0.5-Q8_0-GGUF
52
+ This model was converted to GGUF format from [`jondurbin/bagel-7b-v0.5`](https://huggingface.co/jondurbin/bagel-7b-v0.5) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
53
+ Refer to the [original model card](https://huggingface.co/jondurbin/bagel-7b-v0.5) for more details on the model.
54
+ ## Use with llama.cpp
55
+
56
+ Install llama.cpp through brew.
57
+
58
+ ```bash
59
+ brew install ggerganov/ggerganov/llama.cpp
60
+ ```
61
+ Invoke the llama.cpp server or the CLI.
62
+
63
+ CLI:
64
+
65
+ ```bash
66
+ llama-cli --hf-repo DavidAU/bagel-7b-v0.5-Q8_0-GGUF --model bagel-7b-v0.5.Q8_0.gguf -p "The meaning to life and the universe is"
67
+ ```
68
+
69
+ Server:
70
+
71
+ ```bash
72
+ llama-server --hf-repo DavidAU/bagel-7b-v0.5-Q8_0-GGUF --model bagel-7b-v0.5.Q8_0.gguf -c 2048
73
+ ```
74
+
75
+ Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
76
+
77
+ ```
78
+ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make && ./main -m bagel-7b-v0.5.Q8_0.gguf -n 128
79
+ ```