Hugging Face's logo

damgomz
/
ft_bs64_1lr6_base_x8

Fill-Mask
Transformers
Safetensors
English
albert
text-classification
Inference Endpoints
Model card Files Community
ft_bs64_1lr6_base_x8 / README.md
damgomz's picture
damgomz
Upload README.md with huggingface_hub
917ca05 verified
preview code
|
raw
history blame contribute delete
No virus
3.76 kB
metadata
language: en
tags:
  - fill-mask
kwargs:
  timestamp: '2024-05-21T06:46:22'
  project_name: ft_bs64_1lr6_base_x8_emissions_tracker
  run_id: 303058b9-e0ff-4ee5-9b11-7641f638c5ac
  duration: 29068.91158723831
  emissions: 0.0190162663339998
  emissions_rate: 6.541788218293073e-7
  cpu_power: 42.5
  gpu_power: 0
  ram_power: 7.5
  cpu_energy: 0.3431740666680863
  gpu_energy: 0
  ram_energy: 0.0605597464993595
  energy_consumed: 0.4037338131674456
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 3
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 20
  tracking_mode: machine
  on_cloud: 'N'
  pue: 1

Environmental Impact (CODE CARBON DEFAULT)

Metric Value
Duration (in seconds) 29068.91158723831
Emissions (Co2eq in kg) 0.0190162663339998
CPU power (W) 42.5
GPU power (W) [No GPU]
RAM power (W) 7.5
CPU energy (kWh) 0.3431740666680863
GPU energy (kWh) [No GPU]
RAM energy (kWh) 0.0605597464993595
Consumed energy (kWh) 0.4037338131674456
Country name Switzerland
Cloud provider nan
Cloud region nan
CPU count 3
CPU model Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
GPU count nan
GPU model nan

Environmental Impact (for one core)

Metric Value
CPU energy (kWh) 0.05595765480543375
Emissions (Co2eq in kg) 0.011385323705001673

Note

20 May 2024

My Config

Config Value
checkpoint albert-base-v2
model_name ft_bs64_1lr6_base_x8
sequence_length 400
num_epoch 20
learning_rate 1e-06
batch_size 64
weight_decay 0.0
warm_up_prop 0.0
drop_out_prob 0.1
packing_length 100
train_test_split 0.2
num_steps 108600

Training and Testing steps

Epoch Train Loss Test Loss Accuracy Recall
0 0.600790 0.530991 0.729750 0.803681
1 0.490914 0.515528 0.750368 0.937117
2 0.454214 0.454406 0.784242 0.837423
3 0.420142 0.442943 0.794551 0.891104
4 0.391595 0.418620 0.801915 0.854294
5 0.372766 0.409371 0.809278 0.808282
6 0.351249 0.411269 0.816642 0.884969
7 0.337517 0.410223 0.814433 0.897239
8 0.331506 0.397039 0.825479 0.881902
9 0.318005 0.416837 0.804124 0.730061
10 0.309892 0.406303 0.818115 0.907975
11 0.301596 0.390790 0.832106 0.840491
12 0.295900 0.391270 0.832842 0.865031
13 0.284800 0.392566 0.832106 0.860429
14 0.271658 0.397234 0.829897 0.823620
15 0.267081 0.404172 0.837261 0.883436
16 0.251110 0.409858 0.828424 0.823620
17 0.246977 0.409189 0.829161 0.852761
18 0.235927 0.413321 0.828424 0.838957
19 0.226951 0.428528 0.824006 0.819018