--- library_name: transformers tags: - cybersecurity - security - cybersec - base - llama3 license: llama3 language: - en --- # Colibri_8b_v0.1 CyberNative-AI/Colibri_8b_v0.1 ## Colibri: Conversational CyberSecurity Model [**TRY** colibri via huggingface Spaces!](https://huggingface.co/spaces/CyberNative-AI/Colibri_8b_v0.1_chat) GGUF Quant used in Spaces available here: CyberNative-AI/Colibri_8b_v0.1_q5_gguf Colibri_8b_v0.1 is a conversational model for cybersecurity fine-tuned from the awesome [dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b). (llama-3-8b -> cognitivecomputations/dolphin-2.9-llama3-8b -> CyberNative-AI/Colibri_8b_v0.1) We derived our training dataset by creating Q/A pairs from a huge amount of cybersecurity related texts. > v0.1 trained for 3 epochs using around 35k Q/A pairs FFT on all parameters using a single A100 80gb for 3 hours. This model is using ChatML prompt template format. example: ``` <|im_start|>system You are Colibri, an advanced cybersecurity AI assistant developed by CyberNative AI.<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant ``` **ILLEGAL OR UNETHICAL USE IS PROHIBITED!** > Use accordingly with the law. [Built with Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) Provided by [CyberNative AI](https://cybernative.ai/) ## Examples: Example1 Example2 Example3