ajtamayoh's picture
Update README.md
6ca92fa verified
metadata
tags:
  - generated_from_trainer
metrics:
  - precision
  - recall
  - f1
  - accuracy
model-index:
  - name: bert-finetuned-ADEs_model_1
    results: []
widget:
  - text: >-
      A key component in tuberculosis treatment called isoniazid, may cause
      peripheral neuropathy. Vitamin B6 supplementation is often recommended to
      mitigate this neurological complication.
  - text: >-
      Simvastatin, a cholesterol-lowering medication, can cause myopathy,
      characterized by muscle pain and weakness. Monitoring creatine kinase
      levels helps identify and address this adverse effect promptly.
  - text: >-
      Amiodarone, prescribed for various cardiac arrhythmias, may result in
      thyroid dysfunction as an adverse effect. Regular thyroid function tests
      are necessary to detect and manage these endocrine complications.
  - text: >-
      Methotrexate, commonly used in the treatment of rheumatoid arthritis, can
      lead to hepatotoxicity, necessitating regular liver function tests. Close
      monitoring is crucial to identify early signs of liver damage and adjust
      treatment accordingly.
  - text: >-
      Clozapine, an atypical antipsychotic, may result in agranulocytosis, a
      serious condition characterized by a severe reduction in white blood cell
      count. Regular blood monitoring is essential for patients on clozapine to
      promptly detect and manage this potentially life-threatening adverse
      effect.
  - text: >-
      Lisinopril, prescribed for hypertension, can cause a persistent dry cough
      as a side effect. Patients experiencing this adverse reaction often
      require a change in medication to maintain blood pressure control without
      the bothersome cough.
  - text: >-
      Aspirin, commonly used as an antiplatelet agent, may lead to
      gastrointestinal bleeding in some patients. This adverse effect is
      particularly notable in individuals with a history of peptic ulcers or
      those concurrently taking other medications that increase the risk of
      bleeding.
  - text: >-
      Metformin, employed to manage type 2 diabetes, may induce stomach
      discomfort and diarrhea in some patients. It is crucial for those
      experiencing these symptoms to communicate with their doctor to adjust the
      dosage or consider alternative medications.
  - text: >-
      Venlafaxine, prescribed for depressive disorders, can lead to
      discontinuation syndrome when abruptly stopping treatment. A gradual
      reduction in dosage under medical supervision is advised to prevent this
      syndrome.
  - text: >-
      Rivaroxaban, used to prevent clot formation, carries a risk of bleeding,
      especially in older patients or those with liver conditions. Monitoring
      coagulation levels is essential to ensure safe and effective use.

bert-finetuned-ADEs_model_1

This model is a fine-tuned version of jsylee/scibert_scivocab_uncased-finetuned-ner on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.1938
  • Precision: 0.6759
  • Recall: 0.6710
  • F1: 0.6735
  • Accuracy: 0.9132

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-07
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 5

Training results

Training Loss Epoch Step Validation Loss Precision Recall F1 Accuracy
0.1987 1.0 640 0.1989 0.6618 0.6692 0.6655 0.9116
0.1954 2.0 1280 0.1953 0.6710 0.6532 0.6620 0.9132
0.1934 3.0 1920 0.1961 0.6586 0.6823 0.6702 0.9120
0.1879 4.0 2560 0.1940 0.6727 0.6718 0.6722 0.9133
0.1897 5.0 3200 0.1938 0.6759 0.6710 0.6735 0.9132

Framework versions

  • Transformers 4.18.0
  • Pytorch 1.11.0+cu113
  • Datasets 2.1.0
  • Tokenizers 0.12.1