Text Classification
Transformers
Safetensors
English
Indonesian
xlm-roberta
Inference Endpoints
File size: 1,013 Bytes
0319646
3f3f5fc
 
 
2a6d4fe
3f3f5fc
2a6d4fe
56b1c95
 
2a6d4fe
0319646
 
1436fa1
84bc98b
3a7efca
 
 
 
 
 
2a6d4fe
56b1c95
2a6d4fe
3a7efca
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
language:
- en
- id
license: apache-2.0
library_name: transformers
datasets:
- carant-ai/indonesian_sentiment_dataset
- carant-ai/english_sentiment_dataset
pipeline_tag: text-classification
---
### Model Description
Finetuned xlm-roberta-base for Sentiment Analysis in English and Bahasa Indonesia
### Training results
Trained on TPU VM v4-8 for ~3 hours
|epoch|step|train_accuracy|train_loss|val_accuracy|val_loss|
| --- | --- | --- | --- | --- | --- |
|0|5391|0.955597997|0.118527733|0.963498533|0.098501749|
|1|10783|0.965486944|0.092906699|0.964689374|0.094814248|
|2|16175|0.968293846|0.085916176|0.965770006|0.093040377|
### Training procedure
For replication, go to [GitHub page](https://github.com/carant-ai/tpu-sentiment-trainer/tree/main)
### Special Thanks
1. Google’s TPU Research Cloud (TRC) for providing Cloud TPU VM.
2. [carlesoctav](https://huggingface.co/carlesoctav) for making the training script on TPU VM
3. [thonyyy](https://huggingface.co/thonyyy) for gathering the sentiment dataset