---
thumbnail: https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true
tags:
- kaggle
license: cc0-1.0
datasets:
- Commonlit-Readibility
---
![](https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true)
# FineTuning
|       **Architecture**      |     **Weights**     | **Training Loss** | **Validation Loss** |
|:-----------------------:|:---------------:|:----------------:|:----------------------:|
|       roberta-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-base) |      **0.641**      |          **0.4728**         |
|    bert-base-uncased    | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-base-uncased) |      0.6781     |          0.4977         |
|      albert-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-base) |       0.7119      |          0.5155         |
|       xlm-roberta-base       | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-xlm-roberta-base) |      0.7225      |          0.525          |
|      bert-large-uncased      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-large-uncased) |      0.7482      |         0.5161         |
|       albert-large      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-large) |      1.075      |          0.9921         |
| roberta-large | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-large) |       2.749      |          1.075         |