BETO ATC Hierarchical Classifier

This model is a multi-label transformer encoder based on dccuchile/bert-base-spanish-wwm-cased (BETO) fine-tuned on the official AEMPS CIMA Research Dataset (hsilvosa/aemps-cima) and integrated with procurement metadata from (hsilvosa/openplacsp).

Given a drug description, active ingredients, dosage form, or patient leaflet snippet in Spanish, it predicts its 5-level ATC (Anatomical Therapeutic Chemical) code taxonomy classification.

Intended Use & Disclaimer

Intended exclusively for medical research and pharmaceutical data analytics. Not intended for clinical prescribing or medical advice.

Usage

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

tokenizer = AutoTokenizer.from_pretrained("your-hf-username/BETO-ATC-Hierarchical-Classifier")
model = AutoModelForSequenceClassification.from_pretrained("your-hf-username/BETO-ATC-Hierarchical-Classifier")

text = "Medicamento: Omeprazol 20 mg | Forma farmacéutica: COMPRIMIDO | Principios activos: Omeprazol"
inputs = tokenizer(text, return_tensors="pt")
outputs = model(**inputs)
probs = torch.softmax(outputs.logits, dim=-1)
print(probs)
Downloads last month
8
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train hsilvosa/BETO-ATC-Hierarchical-Classifier

Evaluation results