File size: 1,984 Bytes
888d462 50b4134 888d462 3078d4a 888d462 3078d4a 888d462 50b4134 888d462 6042229 97aa094 6042229 c0a8364 50b4134 888d462 50b4134 888d462 6b01d32 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 4ed8667 ca93247 4ed8667 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 |
---
library_name: transformers
tags:
- cybersecurity
- security
- cybersec
- base
- llama3
license: llama3
language:
- en
---
# Colibri_8b_v0.1
<!-- Provide a quick summary of what the model is/does. -->
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/cybernative_ai_colibri_logo.jpeg" alt="CyberNative-AI/Colibri_8b_v0.1"/>
## Colibri: Conversational CyberSecurity Model
[**TRY** colibri via huggingface Spaces!](https://huggingface.co/spaces/CyberNative-AI/Colibri_8b_v0.1_chat)
GGUF Quant used in Spaces available here: <a href="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1_q5_gguf">CyberNative-AI/Colibri_8b_v0.1_q5_gguf</a>
Colibri_8b_v0.1 is a conversational model for cybersecurity fine-tuned from the awesome [dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b). (llama-3-8b -> cognitivecomputations/dolphin-2.9-llama3-8b -> CyberNative-AI/Colibri_8b_v0.1)
We derived our training dataset by creating Q/A pairs from a huge amount of cybersecurity related texts.
> v0.1 trained for 3 epochs using around 35k Q/A pairs FFT on all parameters using a single A100 80gb for 3 hours.
This model is using ChatML prompt template format.
example:
```
<|im_start|>system
You are Colibri, an advanced cybersecurity AI assistant developed by CyberNative AI.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
**ILLEGAL OR UNETHICAL USE IS PROHIBITED!**
> Use accordingly with the law.
Provided by [CyberNative AI](https://cybernative.ai/)
## Examples:
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/Screenshot%20from%202024-05-15%2018-30-44.png" alt="Example1"/>
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/Screenshot%20from%202024-05-15%2018-38-19.png" alt="Example2"/>
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/Screenshot%20from%202024-05-15%2018-50-31.png" alt="Example3"/> |