VulnBERTa
This is a tiered model for CWE classification based on vulnerability description. The models fine-tuned from RoBERTa-base with vulnerabilities from NIST feeds spanning from 2002 to early 2022.
References
@INPROCEEDINGS{10628784, author={Turtiainen, Hannu and Costin, Andrei}, booktitle={2024 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW)}, title={VulnBERTa: On Automating CWE Weakness Assignment and Improving the Quality of Cybersecurity CVE Vulnerabilities Through ML/NLP}, year={2024}, volume={}, number={}, pages={618-625}, keywords={Systematics;Databases;Terminology;Organizations;Machine learning;NIST;Transformers;CWE;CVE;ML;AI;BERT;RoBERTa;Vulnerabilities;Vulnerability management;VulnBERTa;CWEml}, doi={10.1109/EuroSPW61312.2024.00075}}