README.md

SecureBERT: A Domain-Specific Language Model for Cybersecurity

SecureBERT is a domain-specific language model based on RoBERTa which is trained on a huge amount of cybersecurity data and fine-tuned/tweaked to understand/represent cybersecurity textual data.

Reference

Use the paper below to cite our work. https://arxiv.org/pdf/2204.02685

** The paper has been accepted in "EAI SecureComm 2022 - 18th EAI International Conference on Security and Privacy in Communication Networks".