apepkuss79 commited on
Commit
5b937f1
1 Parent(s): 47475ca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -3
README.md CHANGED
@@ -1,3 +1,38 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.1
3
+ model_name: Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
4
+ base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
5
+ inference: false
6
+ model_creator: nvidia
7
+ quantized_by: Second State Inc.
8
+ tags:
9
+ - nvidia
10
+ - llama3.1
11
+ - reward model
12
+ ---
13
+
14
+ ![](https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee)
15
+
16
+ # Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
17
+
18
+ ## Original Model
19
+
20
+ [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF)
21
+
22
+ ## Run with Gaianet
23
+
24
+ **Prompt template:**
25
+
26
+ prompt template: `llama-3-chat`
27
+
28
+ **Context size:**
29
+
30
+ chat_ctx_size: `128000`
31
+
32
+ **Run with GaiaNet:**
33
+
34
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
35
+
36
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
37
+
38
+ *Quantized with llama.cpp b3932*