Commit
•
c4083fa
1
Parent(s):
d3f16ed
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,7 @@ license: llama2
|
|
| 9 |
|
| 10 |
Base cybersecurity model for future fine-tuning, it is not recomended to use on it's own.
|
| 11 |
- **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
|
|
|
|
| 12 |
- **sequence_len:** 8192
|
| 13 |
- **lora_r:** 128
|
| 14 |
- **lora_alpha:** 16
|
|
|
|
| 9 |
|
| 10 |
Base cybersecurity model for future fine-tuning, it is not recomended to use on it's own.
|
| 11 |
- **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
|
| 12 |
+
- It might, therefore, inherit [promp template of FastChat](https://github.com/lm-sys/FastChat/blob/main/docs/vicuna_weights_version.md#prompt-template)
|
| 13 |
- **sequence_len:** 8192
|
| 14 |
- **lora_r:** 128
|
| 15 |
- **lora_alpha:** 16
|