Hugging Face's logo

farid1088
/
RoBERTa-legal-de-cased_German_legal_SQuAD_17

Question Answering
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
farid1088 commited on
Commit
e80f629
•
1 Parent(s): 54a0c55

Model save

Browse files
Files changed (5) hide show
  1. README.md +20 -20
  2. emissions.csv +1 -1
  3. model.safetensors +1 -1
  4. runs/Mar08_00-24-42_hcdsgpu1/events.out.tfevents.1709857487.hcdsgpu1.1648580.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model was trained from scratch on the None dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 4.7370
17
 
18
  ## Model description
19
 
@@ -33,8 +33,8 @@ More information needed
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 2e-05
36
- - train_batch_size: 128
37
- - eval_batch_size: 32
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
@@ -44,23 +44,23 @@ The following hyperparameters were used during training:
44
 
45
  | Training Loss | Epoch | Step | Validation Loss |
46
  |:-------------:|:-----:|:----:|:---------------:|
47
- | No log | 1.0 | 3 | 6.2584 |
48
- | No log | 2.0 | 6 | 6.2805 |
49
- | No log | 3.0 | 9 | 6.0729 |
50
- | No log | 4.0 | 12 | 5.8138 |
51
- | No log | 5.0 | 15 | 5.6807 |
52
- | No log | 6.0 | 18 | 5.6045 |
53
- | No log | 7.0 | 21 | 5.5064 |
54
- | No log | 8.0 | 24 | 5.4357 |
55
- | No log | 9.0 | 27 | 5.3360 |
56
- | No log | 10.0 | 30 | 5.2367 |
57
- | No log | 11.0 | 33 | 5.1599 |
58
- | No log | 12.0 | 36 | 5.0429 |
59
- | No log | 13.0 | 39 | 4.9351 |
60
- | No log | 14.0 | 42 | 4.8577 |
61
- | No log | 15.0 | 45 | 4.8063 |
62
- | No log | 16.0 | 48 | 4.7567 |
63
- | No log | 17.0 | 51 | 4.7370 |
64
 
65
 
66
  ### Framework versions
 
13
 
14
  This model was trained from scratch on the None dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 4.9667
17
 
18
  ## Model description
19
 
 
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 2e-05
36
+ - train_batch_size: 160
37
+ - eval_batch_size: 40
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
 
44
 
45
  | Training Loss | Epoch | Step | Validation Loss |
46
  |:-------------:|:-----:|:----:|:---------------:|
47
+ | No log | 1.0 | 2 | 6.2537 |
48
+ | No log | 2.0 | 4 | 6.3434 |
49
+ | No log | 3.0 | 6 | 6.2256 |
50
+ | No log | 4.0 | 8 | 6.0253 |
51
+ | No log | 5.0 | 10 | 5.8198 |
52
+ | No log | 6.0 | 12 | 5.5768 |
53
+ | No log | 7.0 | 14 | 5.4665 |
54
+ | No log | 8.0 | 16 | 5.4053 |
55
+ | No log | 9.0 | 18 | 5.3656 |
56
+ | No log | 10.0 | 20 | 5.3181 |
57
+ | No log | 11.0 | 22 | 5.2573 |
58
+ | No log | 12.0 | 24 | 5.1785 |
59
+ | No log | 13.0 | 26 | 5.1147 |
60
+ | No log | 14.0 | 28 | 5.0536 |
61
+ | No log | 15.0 | 30 | 5.0101 |
62
+ | No log | 16.0 | 32 | 4.9799 |
63
+ | No log | 17.0 | 34 | 4.9667 |
64
 
65
 
66
  ### Framework versions
emissions.csv CHANGED
@@ -1,2 +1,2 @@
1
  timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
- 2024-03-06T14:42:30,codecarbon,c492c8a5-e0e5-4b1f-981e-289cfda9114e,46.83648610115051,0.007150635511220812,0.00015267233104930049,112.5,1068.346,377.88994789123535,0.0014636098891496658,0.013810163357660901,0.004907689994357122,0.02018146324116769,Germany,DEU,free and hanseatic city of hamburg,,,Linux-6.5.0-21-generic-x86_64-with-glibc2.35,3.11.4,2.2.3,128,AMD EPYC 7543 32-Core Processor,4,4 x NVIDIA A40,9.9683,53.5649,1007.7065277099609,machine,N,1.0
 
1
  timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
+ 2024-03-08T00:25:47,codecarbon,b45e3c0f-b0b3-4804-989b-8251b43a964f,59.549744844436646,0.008350089492199713,0.00014022040756031566,112.5,606.642,377.8920922279358,0.0018609036058187486,0.015463341509491208,0.00624247477732775,0.023566719892637703,Germany,DEU,free and hanseatic city of hamburg,,,Linux-5.15.0-97-generic-x86_64-with-glibc2.35,3.11.4,2.2.3,128,AMD EPYC 7543 32-Core Processor,5,4 x NVIDIA A401 x NVIDIA A100 80GB PCIe,9.9683,53.5649,1007.7122459411621,machine,N,1.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ff2c4931942e6d6a3e07895f2bfafebd8df3c4d30bc5f65640f7b540663a4f3
3
  size 496250232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0436060fc173c6dc6bcefd5fa507b9421bdc5de53bba9fcd4a0202c794777c95
3
  size 496250232
runs/Mar08_00-24-42_hcdsgpu1/events.out.tfevents.1709857487.hcdsgpu1.1648580.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44b5ac67a1d93511cec8263aafdab48de3830ad525290bcd8fb56556c9af6919
3
+ size 9576
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:17c4ac5ea49e5b03d0be8604458ca967bb7a1b5e19179a5de0b0ef398bbed3f5
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d532efc789695b8447ad75f606bad7451ebaec625e17975b551588e88ecfe795
3
  size 4920