apepkuss79 commited on
Commit
0d7f339
·
verified ·
1 Parent(s): 889f61c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -3
README.md CHANGED
@@ -1,3 +1,34 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: nvidia/Nemotron-Mini-4B-Instruct
3
+ license: other
4
+ license_name: nvidia-community-model-license
5
+ inference: false
6
+ model_creator: nvidia
7
+ model_name: Nemotron-Mini-4B-Instruct
8
+ quantized_by: Second State Inc.
9
+ library_name: nemo
10
+ ---
11
+
12
+ # Nemotron-Mini-4B-Instruct-GGUF
13
+
14
+ ## Original Model
15
+
16
+ [nvidia/Nemotron-Mini-4B-Instruct](https://huggingface.co/nvidia/Nemotron-Mini-4B-Instruct)
17
+
18
+ ## Run with Gaianet
19
+
20
+ **Prompt template:**
21
+
22
+ prompt template: `chatml`
23
+
24
+ **Context size:**
25
+
26
+ chat_ctx_size: `4096`
27
+
28
+ **Run with GaiaNet:**
29
+
30
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
31
+
32
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
33
+
34
+ *Quantized with llama.cpp b3751*