autoevaluator's picture
Add evaluation results on the bc4chemd config and test split of drAbreu/bc4chemd_ner
2d8dbfa
metadata
language: en
license: apache-2.0
tags:
  - token-classification
  - NER
  - Biomedical
  - Chemicals
datasets:
  - BC5CDR-chemicals
  - BC4CHEMD
  - tner/bc5cdr
  - commanderstrife/jnlpba
  - bc2gm_corpus
  - drAbreu/bc4chemd_ner
  - linnaeus
  - chintagunta85/ncbi_disease
model-index:
  - name: sschet/biobert_chemical_ner
    results:
      - task:
          type: token-classification
          name: Token Classification
        dataset:
          name: drAbreu/bc4chemd_ner
          type: drAbreu/bc4chemd_ner
          config: bc4chemd
          split: test
        metrics:
          - type: accuracy
            value: 0.9505454039628846
            name: Accuracy
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjJiMzExZjJmZTA5MWMxODM1YTM3ODc0NjY5ZWJlNDRmMjBhOWYwNGE2ZjQ4MTAxOTdhMDkwZDAxOTI1MmE5YiIsInZlcnNpb24iOjF9.wFgqZw0KCgTbfR1BxSClee-7r-gJHqZdk4ohqoGEJ33kQEwSrG30Og1xsZyKCbPiCQfs_2_1T_ZJO6QbiAlyDA
          - type: precision
            value: 0.3525598807584318
            name: Precision
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTg0OWY2M2E4ODQwNjNiZDE5MGY4ODViYzI0ZTY1YTE0NzBhMmRhNzYxNzYwN2Y5NWRjMWQ0YjQ5ZWJjYjlhMCIsInZlcnNpb24iOjF9.MslrcG8olNcabp-pReQbq2N4gK7gOKwOtYb3ZtYIooJcl8MjX5M5Lyy_XEVoOiSD_FvP2jjyOfxcTTT3RjFiDA
          - type: recall
            value: 0.14230150402238545
            name: Recall
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWI3MGQzNjQ2N2ViN2QyODY2MDZjZjljOTc2N2JhNTFmOWU2ODY4MjFhZDE4MjBjZGVlZjc1ZWI3NDcwNjhiYSIsInZlcnNpb24iOjF9.YUz3zGkrGV7cA5q4YCg3NLX1Uyw11_XB3MaHVmVag5dUEHgU_i3o4NW7ZF19pxVLfsz3yiSRjr4VK2VaswziBQ
          - type: auc
            value: NaN
            name: AUC
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTlmZDg4NDM4YzJiODJlOTNmNTc0NzNmNWUzMzc4MWFkY2VkOTI5NmVhMGI0ZDQzZWQ4Mzg3OWYwZTY2OTE0ZCIsInZlcnNpb24iOjF9.Yi7IpASPVwopN1liwZ1RR39B-THlJDRBiN4Qo-FMGtThLTknrHvO2SWtDaJN39rQF5cw7kh5zg0u_ULw9VbLBg
          - type: f1
            value: 0.2027630477253698
            name: F1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjBjMDQxNjhmNTMzYjJmYTIyMzhlNjEyYTk0ZjNkYzcyZTE1OTM3ZDMyNzhhNGJhYTA4YTc3MmE0MGU1MzczNCIsInZlcnNpb24iOjF9.Q3M94eWFKYnE38ohHRuNE99PYul_k0XtMVUc1HMICcagvqoG_SbWLERdm7XU-TFgAFrdOTgKqSGAPBoO9qzOCA
          - type: loss
            value: 0.45500192046165466
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiN2M0Yjk4MTIyYmYzNzIyNjdmNTZlMzVlNDMwNGFmZDZjNGVhY2Q3NTc1NTQ0NzgyMzdkMTI0NGJiMjAwZjQzYyIsInZlcnNpb24iOjF9.cyDohUTdqPYDc-QVz3fZ6AT6OagMk_UpPB9g4GBVm5n4bCPCYFk74HZYr72kwIfrcF3rEXa4nEBbXg0LjzXpDw

BioBERT model fine-tuned in NER task with BC5CDR-chemicals and BC4CHEMD corpus.

This was fine-tuned in order to use it in a BioNER/BioNEN system which is available at: https://github.com/librairy/bio-ner