MSey
/

CaGBERT-base_fl32_checkpoint-15852

@@ -1,199 +1,156 @@
 ---
 library_name: transformers
-tags: []
 ---
 # Model Card for Model ID
-<!-- Provide a quick summary of what the model is/does. -->
-## Model Details
-### Model Description
-<!-- Provide a longer summary of what this model is. -->
-This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-### Model Sources [optional]
-<!-- Provide the basic links for the model. -->
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-## Uses
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-### Direct Use
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-[More Information Needed]
-### Downstream Use [optional]
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-[More Information Needed]
-### Out-of-Scope Use
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-[More Information Needed]
-## Bias, Risks, and Limitations
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-[More Information Needed]
-### Recommendations
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-## How to Get Started with the Model
-Use the code below to get started with the model.
-[More Information Needed]
-## Training Details
-### Training Data
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-[More Information Needed]
-### Training Procedure
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-#### Preprocessing [optional]
-[More Information Needed]
-#### Training Hyperparameters
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-#### Speeds, Sizes, Times [optional]
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-[More Information Needed]
-## Evaluation
-<!-- This section describes the evaluation protocols and provides the results. -->
-### Testing Data, Factors & Metrics
-#### Testing Data
-<!-- This should link to a Dataset Card if possible. -->
-[More Information Needed]
-#### Factors
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-[More Information Needed]
-#### Metrics
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-[More Information Needed]
-### Results
-[More Information Needed]
-#### Summary
-## Model Examination [optional]
-<!-- Relevant interpretability work for the model goes here -->
-[More Information Needed]
-## Environmental Impact
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-## Technical Specifications [optional]
-### Model Architecture and Objective
-[More Information Needed]
-### Compute Infrastructure
-[More Information Needed]
-#### Hardware
-[More Information Needed]
-#### Software
-[More Information Needed]
-## Citation [optional]
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-**BibTeX:**
-[More Information Needed]
-**APA:**
-[More Information Needed]
-## Glossary [optional]
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-[More Information Needed]
-## More Information [optional]
-[More Information Needed]
-## Model Card Authors [optional]
-[More Information Needed]
-## Model Card Contact
-[More Information Needed]

 ---
 library_name: transformers
+language:
+- de
+base_model:
+- deepset/gbert-base
+pipeline_tag: token-classification
 ---
 # Model Card for Model ID
+We fine-tuned our base model on the Ca dataset.
+## Metrics
+seqeval entity-wise in evaulate
+_train_AVGf10.9756326545937595
+_train_DIAGNOSIS.avg_tokens_per_entity6.812357501139991
+_train_DIAGNOSIS.entity_count8772
+_train_DIAGNOSIS.f10.9847202499289974
+_train_DIAGNOSIS.precision0.9813200498132005
+_train_DIAGNOSIS.recall0.9881440948472412
+_train_DIAGNOSIS.token_count59758
+_train_DIAGNOSTIC.avg_tokens_per_entity5.99338106173173
+_train_DIAGNOSTIC.entity_count7403
+_train_DIAGNOSTIC.f10.9729585006693441
+_train_DIAGNOSTIC.precision0.9643094069258326
+_train_DIAGNOSTIC.recall0.9817641496690531
+_train_DIAGNOSTIC.token_count44369
+_train_DRUG.avg_tokens_per_entity3.8747056052755533
+_train_DRUG.entity_count4246
+_train_DRUG.f10.9928328046058043
+_train_DRUG.precision0.9906213364595545
+_train_DRUG.recall0.9950541686292982
+_train_DRUG.token_count16452
+_train_MEDICAL_FINDING.avg_tokens_per_entity8.822587975587586
+_train_MEDICAL_FINDING.entity_count30804
+_train_MEDICAL_FINDING.f10.9658010684140024
+_train_MEDICAL_FINDING.precision0.9603299419071156
+_train_MEDICAL_FINDING.recall0.9713348915725231
+_train_MEDICAL_FINDING.token_count271771
+_train_THERAPY.avg_tokens_per_entity8.560322448421916
+_train_THERAPY.entity_count7319
+_train_THERAPY.f10.9618506493506493
+_train_THERAPY.precision0.9524447421299397
+_train_THERAPY.recall0.9714441863642574
+_train_THERAPY.token_count62653
+_train_accuracy0.9938551197147224
+_train_f10.9709934550640488
+_train_loss0.020609384402632713
+_train_precision0.9651517964122382
+_train_recall0.9769062585405849
+_train_runtime142.8691
+_train_samples_per_second229.063
+_train_steps_per_second28.635
+eval_AVGf10.7889642398534424
+eval_DIAGNOSIS.avg_len6.790370685982105
+eval_DIAGNOSIS.avg_tokens_per_entity6.790370685982105
+eval_DIAGNOSIS.count2347
+eval_DIAGNOSIS.entity_count2347
+eval_DIAGNOSIS.f10.7870941224825319
+eval_DIAGNOSIS.precision0.760222310440651
+eval_DIAGNOSIS.recall0.815935236472092
+eval_DIAGNOSIS.token_count15937
+eval_DIAGNOSTIC.avg_len6.030130756111427
+eval_DIAGNOSTIC.avg_tokens_per_entity6.030130756111427
+eval_DIAGNOSTIC.count1759
+eval_DIAGNOSTIC.entity_count1759
+eval_DIAGNOSTIC.f10.7870518994114499
+eval_DIAGNOSTIC.precision0.7433046993431026
+eval_DIAGNOSTIC.recall0.8362706083001705
+eval_DIAGNOSTIC.token_count10607
+eval_DRUG.avg_len3.9235500878734624
+eval_DRUG.avg_tokens_per_entity3.9235500878734624
+eval_DRUG.count1138
+eval_DRUG.entity_count1138
+eval_DRUG.f10.9196581196581196
+eval_DRUG.precision0.8951747088186356
+eval_DRUG.recall0.945518453427065
+eval_DRUG.token_count4465
+eval_MEDICAL_FINDING.avg_len8.781120867768594
+eval_MEDICAL_FINDING.avg_tokens_per_entity8.781120867768594
+eval_MEDICAL_FINDING.count7744
+eval_MEDICAL_FINDING.entity_count7744
+eval_MEDICAL_FINDING.f10.7699975080986794
+eval_MEDICAL_FINDING.precision0.7438613384689456
+eval_MEDICAL_FINDING.recall0.7980371900826446
+eval_MEDICAL_FINDING.token_count68001
+eval_THERAPY.avg_len8.44420941300899
+eval_THERAPY.avg_tokens_per_entity8.44420941300899
+eval_THERAPY.count1891
+eval_THERAPY.entity_count1891
+eval_THERAPY.f10.6810195496164316
+eval_THERAPY.precision0.64
+eval_THERAPY.recall0.7276573241671074
+eval_THERAPY.token_count15968
+eval_accuracy0.9332097564796261
+eval_f10.7744305184135064
+eval_loss0.5050501823425293
+eval_precision0.7437801708132195
+eval_recall0.8077155722830835
+eval_runtime36.8437
+eval_samples_per_second222.073
+eval_steps_per_second27.766
+test_AVGf10.7491200818619402
+test_DIAGNOSIS.avg_len7.408243727598566
+test_DIAGNOSIS.avg_tokens_per_entity7.408243727598566
+test_DIAGNOSIS.count2790
+test_DIAGNOSIS.entity_count2790
+test_DIAGNOSIS.f10.703534151254349
+test_DIAGNOSIS.precision0.7192062897791089
+test_DIAGNOSIS.recall0.6885304659498208
+test_DIAGNOSIS.token_count20669
+test_DIAGNOSTIC.avg_len6.136954503249767
+test_DIAGNOSTIC.avg_tokens_per_entity6.136954503249767
+test_DIAGNOSTIC.count2154
+test_DIAGNOSTIC.entity_count2154
+test_DIAGNOSTIC.f10.7718579234972678
+test_DIAGNOSTIC.precision0.7573726541554959
+test_DIAGNOSTIC.recall0.786908077994429
+test_DIAGNOSTIC.token_count13219
+test_DRUG.avg_len3.7937931034482757
+test_DRUG.avg_tokens_per_entity3.7937931034482757
+test_DRUG.count1450
+test_DRUG.entity_count1450
+test_DRUG.f10.9024472008045592
+test_DRUG.precision0.878016960208741
+test_DRUG.recall0.9282758620689655
+test_DRUG.token_count5501
+test_MEDICAL_FINDING.avg_len9.53191489361702
+test_MEDICAL_FINDING.avg_tokens_per_entity9.53191489361702
+test_MEDICAL_FINDING.count8366
+test_MEDICAL_FINDING.entity_count8366
+test_MEDICAL_FINDING.f10.7280362842264404
+test_MEDICAL_FINDING.precision0.6848203939745076
+test_MEDICAL_FINDING.recall0.7770738704279225
+test_MEDICAL_FINDING.token_count79744
+test_THERAPY.avg_len8.884771802982376
+test_THERAPY.avg_tokens_per_entity8.884771802982376
+test_THERAPY.count2213
+test_THERAPY.entity_count2213
+test_THERAPY.f10.639724849527085
+test_THERAPY.precision0.6100861008610086
+test_THERAPY.recall0.6723904202440126
+test_THERAPY.token_count19662
+test_accuracy0.9229989726085077
+test_f10.7327920332701502
+test_loss0.6381183862686157
+test_precision0.7048546859693045
+test_recall0.7630354091792847
+test_runtime42.7477
+test_samples_per_second221.977
+test_steps_per_second27.768