Kun Ma commited on
Commit
ba83c3b
1 Parent(s): feb9943

update README

Browse files
Files changed (2) hide show
  1. README.md +11 -0
  2. fill-mask-result.png +0 -0
README.md CHANGED
@@ -34,5 +34,16 @@ Available models include:
34
  * [`SecBERT`](https://huggingface.co/jackaduma/SecBERT)
35
  * [`SecRoBERTa`](https://huggingface.co/jackaduma/SecRoBERTa)
36
 
 
 
 
 
 
 
 
 
 
 
 
37
 
38
  The original repo can be found [here](https://github.com/jackaduma/SecBERT).
 
34
  * [`SecBERT`](https://huggingface.co/jackaduma/SecBERT)
35
  * [`SecRoBERTa`](https://huggingface.co/jackaduma/SecRoBERTa)
36
 
37
+ ---
38
+ ## **Fill Mask**
39
+
40
+ We proposed to build language model which work on cyber security text, as result, it can improve downstream tasks (NER, Text Classification, Semantic Understand, Q&A) in Cyber Security Domain.
41
+
42
+ First, as below shows Fill-Mask pipeline in [Google Bert](), [AllenAI SciBert](https://github.com/allenai/scibert) and our [SecBERT](https://github.com/jackaduma/SecBERT) .
43
+
44
+
45
+ <img src="./fill-mask-result.png" width="150%" height="150%">
46
+
47
+ ---
48
 
49
  The original repo can be found [here](https://github.com/jackaduma/SecBERT).
fill-mask-result.png ADDED