File size: 1,037 Bytes
0b6d276 dcc4a67 38e67fd dcc4a67 0b6d276 5aebaf1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
---
language:
- en
license:
- mit
widget:
- text: "The nodes of a computer network may include [MASK]."
---
# NetBERT 📶
**A BERT-base model pre-trained on a huge corpus of computer networking text (~23Gb)**.
## Usage
You can use NetBERT with [🤗 transformers](https://github.com/huggingface/transformers):
```python
import torch
from transformers import BertTokenizer, BertForMaskedLM
# Load pretrained model and tokenizer
model = BertForMaskedLM.from_pretrained("antoiloui/netbert")
tokenizer = BertTokenizer.from_pretrained("antoiloui/netbert")
```
## Documentation
Detailed documentation on the pre-trained model, its implementation, and the data can be found [here](https://github.com/antoiloui/netbert/blob/master/docs/index.md).
## Citation
For attribution in academic contexts, please cite this work as:
```
@mastersthesis{louis2020netbert,
title={NetBERT: A Pre-trained Language Representation Model for Computer Networking},
author={Louis, Antoine},
year={2020},
school={University of Liege}
}
``` |