Sweaterdog
commited on
Commit
•
7aaf7cf
1
Parent(s):
a2cd8c5
Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,7 @@
|
|
1 |
---
|
2 |
-
base_model:
|
|
|
|
|
3 |
tags:
|
4 |
- text-generation-inference
|
5 |
- transformers
|
@@ -10,6 +12,8 @@ tags:
|
|
10 |
license: apache-2.0
|
11 |
language:
|
12 |
- en
|
|
|
|
|
13 |
---
|
14 |
|
15 |
# Uploaded model
|
@@ -38,13 +42,13 @@ In order to use this model, A, download the GGUF file of the version you want, e
|
|
38 |
#
|
39 |
1.Download the .gguf Model u want. For this example it is in the standard Windows "Download" Folder
|
40 |
|
41 |
-
2.
|
42 |
|
43 |
-
3.Open the Modelfile.txt and
|
44 |
|
45 |
-
4.Safe+Close Modelfile
|
46 |
|
47 |
-
5.Rename "Modelfile.txt" into "Modelfile"
|
48 |
|
49 |
6.Open CMD and type in "ollama create Hermes1 -f Modelfile" (You can change the name to anything you'd like, for this example, I am just using the same name as the GGUF)
|
50 |
|
@@ -53,6 +57,8 @@ In order to use this model, A, download the GGUF file of the version you want, e
|
|
53 |
8.In the CMD window, type "ollama run Hermes1" (replace the 1 in Hermes with whatever version you downloaded)
|
54 |
|
55 |
#
|
|
|
|
|
56 |
This qwen2 and gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
57 |
|
58 |
-
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
1 |
---
|
2 |
+
base_model:
|
3 |
+
- unsloth/Qwen2.5-7B-bnb-4bit
|
4 |
+
- unsloth/gemma-2-9b-it-bnb-4bit
|
5 |
tags:
|
6 |
- text-generation-inference
|
7 |
- transformers
|
|
|
12 |
license: apache-2.0
|
13 |
language:
|
14 |
- en
|
15 |
+
datasets:
|
16 |
+
- Sweaterdog/MindCraft-LLM-tuning
|
17 |
---
|
18 |
|
19 |
# Uploaded model
|
|
|
42 |
#
|
43 |
1.Download the .gguf Model u want. For this example it is in the standard Windows "Download" Folder
|
44 |
|
45 |
+
2.Download the Modelfile
|
46 |
|
47 |
+
3.Open the Modelfile with / in notepad, or you can rename it to Modelfile.txt, and change the GGUF path, for example, this is my PATH "C:\Users\SweaterDog\OneDrive\Documents\Raw GGUF Files\Hermes-1.0\Hermes-1.Q8_0.gguf"
|
48 |
|
49 |
+
4.Safe + Close Modelfile
|
50 |
|
51 |
+
5.Rename "Modelfile.txt" into "Modelfile" if you changed it before-hand
|
52 |
|
53 |
6.Open CMD and type in "ollama create Hermes1 -f Modelfile" (You can change the name to anything you'd like, for this example, I am just using the same name as the GGUF)
|
54 |
|
|
|
57 |
8.In the CMD window, type "ollama run Hermes1" (replace the 1 in Hermes with whatever version you downloaded)
|
58 |
|
59 |
#
|
60 |
+
I'm aware it does say there are multiple Qwen2.5 files, even though there are two, and it also says there are Gemma2 models, even though there isn't, I am aware and have been trying to train the rest of these models.
|
61 |
+
#
|
62 |
This qwen2 and gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
63 |
|
64 |
+
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|