File size: 2,202 Bytes
888d462 de308d9 888d462 50b4134 888d462 3078d4a 888d462 3078d4a 888d462 50b4134 888d462 6042229 97aa094 6042229 c0a8364 50b4134 888d462 50b4134 888d462 6b01d32 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 4ed8667 9d71e3f ca93247 4ed8667 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
---
language:
- en
license: llama3
library_name: transformers
tags:
- cybersecurity
- security
- cybersec
- base
- llama3
---
# Colibri_8b_v0.1
<!-- Provide a quick summary of what the model is/does. -->
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/cybernative_ai_colibri_logo.jpeg" alt="CyberNative-AI/Colibri_8b_v0.1"/>
## Colibri: Conversational CyberSecurity Model
[**TRY** colibri via huggingface Spaces!](https://huggingface.co/spaces/CyberNative-AI/Colibri_8b_v0.1_chat)
GGUF Quant used in Spaces available here: <a href="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1_q5_gguf">CyberNative-AI/Colibri_8b_v0.1_q5_gguf</a>
Colibri_8b_v0.1 is a conversational model for cybersecurity fine-tuned from the awesome [dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b). (llama-3-8b -> cognitivecomputations/dolphin-2.9-llama3-8b -> CyberNative-AI/Colibri_8b_v0.1)
We derived our training dataset by creating Q/A pairs from a huge amount of cybersecurity related texts.
> v0.1 trained for 3 epochs using around 35k Q/A pairs FFT on all parameters using a single A100 80gb for 3 hours.
This model is using ChatML prompt template format.
example:
```
<|im_start|>system
You are Colibri, an advanced cybersecurity AI assistant developed by CyberNative AI.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
**ILLEGAL OR UNETHICAL USE IS PROHIBITED!**
> Use accordingly with the law.
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
Provided by [CyberNative AI](https://cybernative.ai/)
## Examples:
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/Screenshot%20from%202024-05-15%2018-30-44.png" alt="Example1"/>
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/Screenshot%20from%202024-05-15%2018-38-19.png" alt="Example2"/>
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/Screenshot%20from%202024-05-15%2018-50-31.png" alt="Example3"/> |