SicariusSicariiStuff
commited on
Commit
•
4abae19
1
Parent(s):
7e59285
Update README.md
Browse filesAdded Mobile (ARM) optimized quants for SnapDragon and other instruction sets.
README.md
CHANGED
@@ -38,7 +38,7 @@ A model for thee, a model for all!
|
|
38 |
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
|
39 |
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
|
40 |
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1_iMatrix_GGUF
|
41 |
-
|
42 |
## Usage
|
43 |
|
44 |
- For the best experience, use the Gemma Instruct template and modify it to support the `system` role (e.g., `<start_of_turn>system`)
|
|
|
38 |
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
|
39 |
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
|
40 |
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1_iMatrix_GGUF
|
41 |
+
- Mobile (ARM) (Q4_0_X_X): https://huggingface.co/SicariusSicariiStuff/TheDrummer_Gemmasutra-Mini-2B-v1_ARM
|
42 |
## Usage
|
43 |
|
44 |
- For the best experience, use the Gemma Instruct template and modify it to support the `system` role (e.g., `<start_of_turn>system`)
|