Triangle104 commited on
Commit
61479f3
1 Parent(s): 96df626

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -17,6 +17,25 @@ tags:
17
  This model was converted to GGUF format from [`nbeerbower/Llama3.1-Allades-8B`](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) for more details on the model.
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## Use with llama.cpp
21
  Install llama.cpp through brew (works on Mac and Linux)
22
 
 
17
  This model was converted to GGUF format from [`nbeerbower/Llama3.1-Allades-8B`](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) for more details on the model.
19
 
20
+ ---
21
+ Model details:
22
+ -
23
+ Allades finetunes abliterated Llama 3.1 with 5 datasets to improve creative writing, reasoning, and roleplay.
24
+ Datasets
25
+
26
+ jondurbin/gutenberg-dpo-v0.1
27
+ nbeerbower/gutenberg2-dpo
28
+ jondurbin/truthy-dpo-v0.1
29
+ kyujinpy/orca_math_dpo
30
+ antiven0m/physical-reasoning-dpo
31
+
32
+ Training
33
+
34
+ ORPO tuned for 1 epoch with 2x RTX 3090 (sponsored by Schneewolf Labs).
35
+
36
+ Data was prepared with Llama 3.1 Instruct.
37
+
38
+ ---
39
  ## Use with llama.cpp
40
  Install llama.cpp through brew (works on Mac and Linux)
41