Edit model card

Environmental Impact (CODE CARBON DEFAULT)

Metric Value
Duration (in seconds) [More Information Needed]
Emissions (Co2eq in kg) [More Information Needed]
CPU power (W) [NO CPU]
GPU power (W) [No GPU]
RAM power (W) [More Information Needed]
CPU energy (kWh) [No CPU]
GPU energy (kWh) [No GPU]
RAM energy (kWh) [More Information Needed]
Consumed energy (kWh) [More Information Needed]
Country name [More Information Needed]
Cloud provider [No Cloud]
Cloud region [No Cloud]
CPU count [No CPU]
CPU model [No CPU]
GPU count [No GPU]
GPU model [No GPU]

Environmental Impact (for one core)

Metric Value
CPU energy (kWh) [No CPU]
Emissions (Co2eq in kg) [More Information Needed]

Note

12 juillet 2024

My Config

Config Value
checkpoint damgomz/fp_bs32_lr1e4_x1
model_name ft_2_11e6_x1
sequence_length 400
num_epoch 6
learning_rate 1.1e-05
batch_size 2
weight_decay 0.0
warm_up_prop 0.0
drop_out_prob 0.1
packing_length 100
train_test_split 0.2
num_steps 29328

Training and Testing steps

Epoch Train Loss Test Loss F-beta Score
0 0.000000 0.705396 0.651041
1 0.256904 0.195741 0.925667
2 0.151187 0.184829 0.926147
3 0.085708 0.243880 0.916987
4 0.039275 0.300470 0.928804
5 0.017497 0.370547 0.929377
6 0.009101 0.390778 0.923237
Downloads last month
3
Safetensors
Model size
11.7M params
Tensor type
F32
·
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.