damgomz/ft_16_5e6_x2

Environmental Impact (CODE CARBON DEFAULT)

Metric	Value
Duration (in seconds)	[More Information Needed]
Emissions (Co2eq in kg)	[More Information Needed]
CPU power (W)	[NO CPU]
GPU power (W)	[No GPU]
RAM power (W)	[More Information Needed]
CPU energy (kWh)	[No CPU]
GPU energy (kWh)	[No GPU]
RAM energy (kWh)	[More Information Needed]
Consumed energy (kWh)	[More Information Needed]
Country name	[More Information Needed]
Cloud provider	[No Cloud]
Cloud region	[No Cloud]
CPU count	[No CPU]
CPU model	[No CPU]
GPU count	[No GPU]
GPU model	[No GPU]

Environmental Impact (for one core)

Metric	Value
CPU energy (kWh)	[No CPU]
Emissions (Co2eq in kg)	[More Information Needed]

Note

20 Juin 2024

My Config

Config	Value
checkpoint	recovering
model_name	ft_16_5e6_x2
sequence_length	400
num_epoch	6
learning_rate	5e-06
batch_size	16
weight_decay	0.0
warm_up_prop	0.0
drop_out_prob	0.1
packing_length	100
train_test_split	0.2
num_steps	1

Training and Testing steps

Epoch	Train Loss	Test Loss	F-beta Score
0	0.000000	0.708899	0.742375
1	0.390904	0.261778	0.910094
2	0.225553	0.229772	0.895308
3	0.182254	0.233851	0.891425
4	0.139949	0.230494	0.931200
5	0.103257	0.243570	0.925299
6	0.074268	0.287022	0.914020