CyberNative commited on
Commit
ec9a6fe
1 Parent(s): 6b78b29

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -7
README.md CHANGED
@@ -1,18 +1,17 @@
1
  ---
2
  license: llama2
3
  ---
4
-
5
- !!! THIS IS A PLACEHOLDER !!!
6
  !!! MODEL COMMING SOON !!!
7
 
8
  # CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
9
 
10
  Base cybersecurity model for future fine-tuning, it is not reccomended to use on it's own.
11
- - **CyberBase is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on of [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
12
- - **sequence_len: 8192
13
- - **lora_r: 128
14
- - **lora_alpha: 16
15
- - **num_epochs: 2
16
 
17
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
18
 
 
1
  ---
2
  license: llama2
3
  ---
4
+ !!! **THIS IS A PLACEHOLDER** !!!
 
5
  !!! MODEL COMMING SOON !!!
6
 
7
  # CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
8
 
9
  Base cybersecurity model for future fine-tuning, it is not reccomended to use on it's own.
10
+ - **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
11
+ - **sequence_len:** 8192
12
+ - **lora_r:** 128
13
+ - **lora_alpha:** 16
14
+ - **num_epochs:** 2
15
 
16
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
17