arxyzan commited on
Commit
f800955
1 Parent(s): 65028fa

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ A RoBERTa model trained using Data2Vec based on the paper [data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language](https://arxiv.org/abs/2202.03555).<br>
2
+ This model is provided here for [this repo](https://github.com/AryanShekarlaban/data2vec-pytorch) but was NOT trained using that codebase but instead, copied from `facebook/data2vec-text-base` for convenience and reproducibility.
3
+
4
+ ### BibTeX entry and citation info
5
+
6
+ ```bibtex
7
+ @misc{https://doi.org/10.48550/arxiv.2202.03555,
8
+ doi = {10.48550/ARXIV.2202.03555},
9
+ url = {https://arxiv.org/abs/2202.03555},
10
+ author = {Baevski, Alexei and Hsu, Wei-Ning and Xu, Qiantong and Babu, Arun and Gu, Jiatao and Auli, Michael},
11
+ keywords = {Machine Learning (cs.LG), FOS: Computer and information sciences, FOS: Computer and information sciences},
12
+ title = {data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language},
13
+ publisher = {arXiv},
14
+ year = {2022},
15
+ copyright = {arXiv.org perpetual, non-exclusive license}
16
+ }
17
+ ```