ft_32_16e6_base_x12 / README.md
damgomz's picture
Upload README.md with huggingface_hub
49d8a3d verified
|
raw
history blame
2.61 kB
metadata
language: en
tags:
  - text-classification
pipeline_tag: text-classification
widget:
  - text: >-
      GEPS Techno is the pioneer of hybridization of renewable energies at sea.
      We imagine, design and commercialize innovative off-grid systems that aim
      to generate power at sea, stabilize and collect data. The success of our
      low power platforms WAVEPEAL enabled us to scale-up the device up to
      WAVEGEM, the 150-kW capacity platform.

Environmental Impact (CODE CARBON DEFAULT)

Metric Value
Duration (in seconds) [More Information Needed]
Emissions (Co2eq in kg) [More Information Needed]
CPU power (W) [NO CPU]
GPU power (W) [No GPU]
RAM power (W) [More Information Needed]
CPU energy (kWh) [No CPU]
GPU energy (kWh) [No GPU]
RAM energy (kWh) [More Information Needed]
Consumed energy (kWh) [More Information Needed]
Country name [More Information Needed]
Cloud provider [No Cloud]
Cloud region [No Cloud]
CPU count [No CPU]
CPU model [No CPU]
GPU count [No GPU]
GPU model [No GPU]

Environmental Impact (for one core)

Metric Value
CPU energy (kWh) [No CPU]
Emissions (Co2eq in kg) [More Information Needed]

Note

19 juin 2024

My Config

Config Value
checkpoint albert-base-v2
model_name ft_32_16e6_base_x12
sequence_length 400
num_epoch 6
learning_rate 1.6e-05
batch_size 32
weight_decay 0.0
warm_up_prop 0.0
drop_out_prob 0.1
packing_length 100
train_test_split 0.2
num_steps 29328

Training and Testing steps

Epoch Train Loss Test Loss F-beta Score
0 0.000000 0.745482 0.425709
1 0.368146 0.265085 0.898074
2 0.225921 0.238311 0.888580
3 0.187288 0.263459 0.891032
4 0.150420 0.238125 0.911862
5 0.115398 0.255953 0.922487
6 0.086221 0.300761 0.907217