Edit model card

Environmental Impact (CODE CARBON DEFAULT)

Metric Value
Duration (in seconds) 84011.51312685013
Emissions (Co2eq in kg) 0.0508366407956621
CPU power (W) 42.5
GPU power (W) [No GPU]
RAM power (W) 3.75
CPU energy (kWh) 0.9918002305580506
GPU energy (kWh) [No GPU]
RAM energy (kWh) 0.087511053611338
Consumed energy (kWh) 1.0793112841693833
Country name Switzerland
Cloud provider nan
Cloud region nan
CPU count 2
CPU model Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
GPU count nan
GPU model nan

Environmental Impact (for one core)

Metric Value
CPU energy (kWh) 0.1617221627691865
Emissions (Co2eq in kg) 0.03290450930801629

Note

21 May 2024

My Config

Config Value
checkpoint damgomz/ThunBERT_bs32_lr5
model_name ft_32_1e6_cv
sequence_length 400
num_epoch 6
learning_rate 1e-06
batch_size 32
weight_decay 0.0
warm_up_prop 0.0
drop_out_prob 0.1
packing_length 100
train_test_split 0.2
num_steps 32586

Training and Testing steps

Epoch Train Loss Test Loss Accuracy Recall
0 0.642228 0.575971 0.717441 0.844145
1 0.538308 0.502920 0.763702 0.859974
2 0.465677 0.445179 0.802447 0.862693
3 0.410307 0.409979 0.814821 0.862174
4 0.369260 0.391564 0.823072 0.850320
5 0.341751 0.380959 0.826754 0.843111
Downloads last month
2
Safetensors
Model size
11.7M params
Tensor type
F32
·