ehsanaghaei
commited on
Commit
•
0391fb4
1
Parent(s):
2308937
Update README.md
Browse files
README.md
CHANGED
@@ -4,6 +4,8 @@ language:
|
|
4 |
- en
|
5 |
tags:
|
6 |
- cybersecurity
|
|
|
|
|
7 |
---
|
8 |
# SecureBERT+
|
9 |
This model represents an improved version of the [SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT) model, trained on a corpus eight times larger than its predecessor, leveraging the computational power of 8xA100 GPUs. This version, known as SecureBERT+, brings forth an average improvment of 9% in the performance of the Masked Language Model (MLM) task. This advancement signifies a substantial stride towards achieving heightened proficiency in language understanding and representation learning within the cybersecurity domain.
|
|
|
4 |
- en
|
5 |
tags:
|
6 |
- cybersecurity
|
7 |
+
widget:
|
8 |
+
- text: "Virus causes <maks>."
|
9 |
---
|
10 |
# SecureBERT+
|
11 |
This model represents an improved version of the [SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT) model, trained on a corpus eight times larger than its predecessor, leveraging the computational power of 8xA100 GPUs. This version, known as SecureBERT+, brings forth an average improvment of 9% in the performance of the Masked Language Model (MLM) task. This advancement signifies a substantial stride towards achieving heightened proficiency in language understanding and representation learning within the cybersecurity domain.
|