DeepPavlov
/

rubert-base-cased-conversational

Feature Extraction

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

Yura Kuratov commited on Nov 8, 2021

Commit

645946c

•

1 Parent(s): 2aaf1c5

upload model with MLM and NSP heads

Files changed (3) hide show

README.md +1 -0
flax_model.msgpack +2 -2
pytorch_model.bin +2 -2

README.md CHANGED Viewed

@@ -7,6 +7,7 @@ language:
 Conversational RuBERT \(Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on OpenSubtitles\[1\], [Dirty](https://d3.ru/), [Pikabu](https://pikabu.ru/), and a Social Media segment of Taiga corpus\[2\]. We assembled a new vocabulary for Conversational RuBERT model on this data and initialized the model with [RuBERT](../rubert-base-cased).
 \[1\]: P. Lison and J. Tiedemann, 2016, OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the 10th International Conference on Language Resources and Evaluation \(LREC 2016\)

 Conversational RuBERT \(Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on OpenSubtitles\[1\], [Dirty](https://d3.ru/), [Pikabu](https://pikabu.ru/), and a Social Media segment of Taiga corpus\[2\]. We assembled a new vocabulary for Conversational RuBERT model on this data and initialized the model with [RuBERT](../rubert-base-cased).
+08.11.2021: upload model with MLM and NSP heads
 \[1\]: P. Lison and J. Tiedemann, 2016, OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the 10th International Conference on Language Resources and Evaluation \(LREC 2016\)

flax_model.msgpack CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d3dc5cdfd7d3496471e1c6d96c92f380a4ffb918a7e693dc9de9b018911b32d9
-size 711420911

 version https://git-lfs.github.com/spec/v1
+oid sha256:531caf551269b5ac347d79c49cf387d1953bd24b85d31ef90db56b0b9543aff7
+size 714274024

pytorch_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:21c02c846eafecd9308dddb32f662e369d97aa6ab7a220af3203896dd5f5c6a9
-size 711456782

 version https://git-lfs.github.com/spec/v1
+oid sha256:a299b6726dbe7d7e082124e1260d1c7c94e8a2a3552712f66c141b25d4ba2fac
+size 714355318