Hugging Face's logo

SauravMaheshkar
/
clr-pretrained-roberta-base

Fill-Mask Transformers PyTorch Safetensors
roberta kaggle Inference Endpoints
Model card Files Community
1
SauravMaheshkar commited on
Commit
b99e333
•
1 Parent(s): f8df4a6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ thumbnail: "https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true"
3
+ tags:
4
+ - kaggle
5
+ license: "CC0-1.0 License"
6
+ datasets:
7
+ - Commonlit-Readibility
8
+ metrics:
9
+ - Perplexity
10
+ ---
11
+
12
+ ![](https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true)
13
+
14
+ # PreTraining
15
+
16
+ | **Architecture** | **Weights** | **PreTraining Loss** | **PreTraining Perplexity** |
17
+ |:-----------------------:|:---------------:|:----------------:|:----------------------:|
18
+ | roberta-base | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-roberta-base) | **0.3488** | **3.992** |
19
+ | bert-base-uncased | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-bert-base-uncased) | 0.3909 | 6.122 |
20
+ | electra-large | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-electra-large) | 0.723 | 6.394 |
21
+ | albert-base | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-albert-base) | 0.7343 | 7.76 |
22
+ | electra-small | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-electra-small) | 0.9226 | 11.098 |
23
+ | electra-base | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-electra-base) | 0.9468 | 8.783 |
24
+ | distilbert-base-uncased | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-pretrained-distilbert-base-uncased) | 1.082 | 7.963 |