prithivMLmods commited on
Commit
dc7c865
·
verified ·
1 Parent(s): c3649af

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -0
README.md CHANGED
@@ -147,3 +147,57 @@ To customize the password length, modify the `password_length` variable in the s
147
 
148
  Llama 3.2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
149
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
147
 
148
  Llama 3.2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
149
 
150
+ # **Run with Ollama [ Ollama Run ]**
151
+
152
+ Ollama simplifies running machine learning models. This guide walks you through downloading, installing, and running GGUF models in minutes.
153
+
154
+ ## Table of Contents
155
+
156
+ - [Download and Install](#download-and-install)
157
+ - [Run GGUF Models](#run-gguf-models)
158
+ - [Running the Model](#running-the-model)
159
+ - [Sample Usage](#sample-usage)
160
+
161
+ ## Download and Install
162
+
163
+ Download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it on your Windows or Mac system.
164
+
165
+ ## Run GGUF Models
166
+
167
+ 1. **Create the Model File**
168
+ Create a model file, e.g., `metallama`.
169
+
170
+ 2. **Add the Template Command**
171
+ Include a `FROM` line in the file to specify the base model:
172
+ ```bash
173
+ FROM Llama-3.2-1B.F16.gguf
174
+ ```
175
+
176
+ 3. **Create and Patch the Model**
177
+ Run the following command:
178
+ ```bash
179
+ ollama create metallama -f ./metallama
180
+ ```
181
+ Verify the model with:
182
+ ```bash
183
+ ollama list
184
+ ```
185
+
186
+ ## Running the Model
187
+
188
+ Run your model with:
189
+ ```bash
190
+ ollama run metallama
191
+ ```
192
+
193
+ ### Sample Usage
194
+
195
+ Interact with the model:
196
+ ```plaintext
197
+ >>> write a mini passage about space x
198
+ Space X, the private aerospace company founded by Elon Musk, is revolutionizing the field of space exploration...
199
+ ```
200
+
201
+ ---
202
+
203
+ With these steps, you can easily run custom models using Ollama. Adjust as needed for your specific use case.