damgomz/ft_4_16e6_base_x2

Environmental Impact (CODE CARBON DEFAULT)

Metric	Value
Duration (in seconds)	[More Information Needed]
Emissions (Co2eq in kg)	[More Information Needed]
CPU power (W)	[NO CPU]
GPU power (W)	[No GPU]
RAM power (W)	[More Information Needed]
CPU energy (kWh)	[No CPU]
GPU energy (kWh)	[No GPU]
RAM energy (kWh)	[More Information Needed]
Consumed energy (kWh)	[More Information Needed]
Country name	[More Information Needed]
Cloud provider	[No Cloud]
Cloud region	[No Cloud]
CPU count	[No CPU]
CPU model	[No CPU]
GPU count	[No GPU]
GPU model	[No GPU]

Environmental Impact (for one core)

Metric	Value
CPU energy (kWh)	[No CPU]
Emissions (Co2eq in kg)	[More Information Needed]

Note

20 Juin 2024

My Config

Config	Value
checkpoint	recovering
model_name	ft_4_16e6_base_x2
sequence_length	400
num_epoch	6
learning_rate	1.6e-05
batch_size	4
weight_decay	0.0
warm_up_prop	0.0
drop_out_prob	0.1
packing_length	100
train_test_split	0.2
num_steps	1

Training and Testing steps

Epoch	Train Loss	Test Loss	F-beta Score
0	0.000000	0.739579	0.241663
1	0.299590	0.259272	0.897336
2	0.202640	0.240557	0.890311
3	0.156079	0.249552	0.939492
4	0.110257	0.275880	0.928374
5	0.085959	0.282593	0.919402
6	0.058081	0.318861	0.904849