antoinelouis commited on
Commit
5aebaf1
1 Parent(s): 5730ceb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ![](https://img.shields.io/github/license/antoiloui/netbert)
2
+
3
+ # NetBERT 📶
4
+
5
+ **A BERT-base model pre-trained on a huge corpus of computer networking text (~23Gb)**.
6
+
7
+ ## Usage
8
+ You can use NetBERT with [🤗 transformers](https://github.com/huggingface/transformers):
9
+
10
+ ```python
11
+ import torch
12
+ from transformers import BertTokenizer, BertForMaskedLM
13
+
14
+ # Load pretrained model and tokenizer
15
+ model = BertForMaskedLM.from_pretrained("antoiloui/netbert")
16
+ tokenizer = BertTokenizer.from_pretrained("antoiloui/netbert")
17
+ ```
18
+
19
+ ## Documentation
20
+
21
+ Detailed documentation on the pre-trained model, its implementation, and the data can be found [here](https://github.com/antoiloui/netbert/blob/master/docs/index.md).
22
+
23
+ ## Citation
24
+
25
+ For attribution in academic contexts, please cite this work as:
26
+
27
+ ```
28
+ @mastersthesis{louis2020netbert,
29
+ title={NetBERT: A Pre-trained Language Representation Model for Computer Networking},
30
+ author={Louis, Antoine},
31
+ year={2020},
32
+ school={University of Liege}
33
+ }
34
+ ```