prithivMLmods commited on
Commit
002b9af
1 Parent(s): 54627ef

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +73 -1
README.md CHANGED
@@ -19,4 +19,76 @@ tags:
19
 
20
  This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
  This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
+
23
+ # Run with Ollama 🦙
24
+
25
+ ### Download and Install Ollama
26
+
27
+ To get started, download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it on your Windows or Mac system.
28
+
29
+ ### Run Your Own Model in Minutes
30
+
31
+ ### Steps to Run GGUF Models:
32
+
33
+ #### 1. Create the Model File
34
+ - Name your model file appropriately, for example, `nemo-minitron`.
35
+
36
+ #### 2. Add the Template Command
37
+ - Include a `FROM` line with the base model file. For instance:
38
+
39
+ ```bash
40
+ FROM Nemo-Minitron-8B-Instruct-GGUF
41
+ ```
42
+
43
+ - Make sure the model file is in the same directory as your script.
44
+
45
+ #### 3. Create and Patch the Model
46
+ - Use the following command in your terminal to create and patch your model:
47
+
48
+ ```bash
49
+ ollama create nemo-minitron -f ./nemo-minitron
50
+ ```
51
+
52
+ - Upon success, a confirmation message will appear.
53
+
54
+ - To verify that the model was created successfully, run:
55
+
56
+ ```bash
57
+ ollama list
58
+ ```
59
+
60
+ Ensure that `metallama` appears in the list of models.
61
+
62
+ ---
63
+
64
+ ## Running the Model
65
+
66
+ To run the model, use:
67
+
68
+ ```bash
69
+ ollama run nemo-minitron
70
+ ```
71
+
72
+ ### Sample Usage
73
+
74
+ In the command prompt, run:
75
+
76
+ ```bash
77
+ D:\>ollama run nemo-minitron
78
+ ```
79
+
80
+ Example interaction:
81
+
82
+ ```plaintext
83
+ >>> write a mini passage about space x
84
+ Space X, the private aerospace company founded by Elon Musk, is revolutionizing the field of space exploration.
85
+ With its ambitious goals to make humanity a multi-planetary species and establish a sustainable human presence in
86
+ the cosmos, Space X has become a leading player in the industry. The company's spacecraft, like the Falcon 9, have
87
+ demonstrated remarkable capabilities, allowing for the transport of crews and cargo into space with unprecedented
88
+ efficiency. As technology continues to advance, the possibility of establishing permanent colonies on Mars becomes
89
+ increasingly feasible, thanks in part to the success of reusable rockets that can launch multiple times without
90
+ sustaining significant damage. The journey towards becoming a multi-planetary species is underway, and Space X
91
+ plays a pivotal role in pushing the boundaries of human exploration and settlement.
92
+ ```
93
+
94
+ ---