Model: Derify/ModChemBERT-MLM-DAPT-TAFT
Author: Derify
Pipeline: fill-mask
Library: transformers
Tags: transformers, safetensors, modchembert, fill-mask, modernbert, ModChemBERT, cheminformatics, chemical-language-model, molecular-property-prediction, mergekit, merge, custom_code, dataset:Derify/augmented_canonical_druglike_QED_Pfizer_15M, arxiv:2505.15696, arxiv:2503.03360, arxiv:2412.13663, arxiv:2407.20750, arxiv:2407.21783, base_model:Derify/ModChemBERT-MLM-DAPT, base_model:finetune:Derify/ModChemBERT-MLM-DAPT, license:apache-2.0, model-index, region:us
Base models (finetune): id: Derify/ModChemBERT-MLM-DAPT
Card metadata: license: apache-2.0
base_model: Derify/ModChemBERT-MLM-DAPT
datasets: Derify/augmented_canonical_druglike_QED_Pfizer_15M
metrics: roc_auc, rmse
library_name: transformers
tags: modernbert, ModChemBERT, cheminformatics, chemical-language-model, molecular-property-prediction, mergekit, merge
pipeline_tag: fill-mask
model-index: name: Derify/ModChemBERT-MLM
results: task: type: text-classification
name: Classification (ROC AUC)
dataset: name: BACE
type: BACE
metrics: type: roc_auc
value: 0.8213
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: BBBP
type: BBBP
metrics: type: roc_auc
value: 0.7356
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: CLINTOX
type: CLINTOX
metrics: type: roc_auc
value: 0.9664
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: HIV
type: HIV
metrics: type: roc_auc
value: 0.775
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: SIDER
type: SIDER
metrics: type: roc_auc
value: 0.6415
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: TOX21
type: TOX21
metrics: type: roc_auc
value: 0.7263
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: BACE
type: BACE
metrics: type: rmse
value: 0.9713
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: CLEARANCE
type: CLEARANCE
metrics: type: rmse
value: 42.801
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ESOL
type: ESOL
metrics: type: rmse
value: 0.8169
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: FREESOLV
type: FREESOLV
metrics: type: rmse
value: 0.5445
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: LIPO
type: LIPO
metrics: type: rmse
value: 0.682
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: Antimalarial
type: Antimalarial
metrics: type: roc_auc
value: 0.8819
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: Cocrystal
type: Cocrystal
metrics: type: roc_auc
value: 0.855
verified: no, task: type: text-classification
name: Classification (ROC AUC)
dataset: name: COVID19
type: COVID19
metrics: type: roc_auc
value: 0.8013
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ADME microsom stab human
type: ADME
metrics: type: rmse
value: 0.4206
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ADME microsom stab rat
type: ADME
metrics: type: rmse
value: 0.44
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ADME permeability
type: ADME
metrics: type: rmse
value: 0.4899
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ADME ppb human
type: ADME
metrics: type: rmse
value: 0.8927
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ADME ppb rat
type: ADME
metrics: type: rmse
value: 0.6942
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: ADME solubility
type: ADME
metrics: type: rmse
value: 0.4641
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: AstraZeneca CL
type: AstraZeneca
metrics: type: rmse
value: 0.5022
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: AstraZeneca LogD74
type: AstraZeneca
metrics: type: rmse
value: 0.7467
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: AstraZeneca PPB
type: AstraZeneca
metrics: type: rmse
value: 0.1195
verified: no, task: type: regression
name: Regression (RMSE)
dataset: name: AstraZeneca Solubility
type: AstraZeneca
metrics: type: rmse
value: 0.8564
verified: no
Likes: 0 | All-time downloads: 49
Created: 2025-09-24 01:54:20