Edit model card

Environmental Impact (CODE CARBON DEFAULT)

Metric Value
Duration (in seconds) [More Information Needed]
Emissions (Co2eq in kg) [More Information Needed]
CPU power (W) [NO CPU]
GPU power (W) [No GPU]
RAM power (W) [More Information Needed]
CPU energy (kWh) [No CPU]
GPU energy (kWh) [No GPU]
RAM energy (kWh) [More Information Needed]
Consumed energy (kWh) [More Information Needed]
Country name [More Information Needed]
Cloud provider [No Cloud]
Cloud region [No Cloud]
CPU count [No CPU]
CPU model [No CPU]
GPU count [No GPU]
GPU model [No GPU]

Environmental Impact (for one core)

Metric Value
CPU energy (kWh) [No CPU]
Emissions (Co2eq in kg) [More Information Needed]

Note

20 Juin 2024

My Config

Config Value
checkpoint recovering
model_name ft_4_16e6_x1
sequence_length 400
num_epoch 6
learning_rate 1.6e-05
batch_size 4
weight_decay 0.0
warm_up_prop 0.0
drop_out_prob 0.1
packing_length 100
train_test_split 0.2
num_steps 1

Training and Testing steps

Epoch Train Loss Test Loss F-beta Score
0 0.000000 0.708933 0.574045
1 0.258336 0.219195 0.918077
2 0.165827 0.208746 0.930545
3 0.103685 0.235973 0.925807
4 0.056429 0.260337 0.921557
5 0.034590 0.337197 0.909600
6 0.022576 0.360232 0.934762
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Examples
Unable to determine this model's library. Check the docs .