Model: llm-semantic-router/toolcall-verifier
Author: llm-semantic-router
Pipeline: token-classification
Library: transformers
Tags: transformers, safetensors, modernbert, token-classification, security, jailbreak-detection, prompt-injection, tool-calling, llm-safety, mcp, en, dataset:microsoft/llmail-inject-challenge, dataset:allenai/wildjailbreak, dataset:hackaprompt/hackaprompt-dataset, dataset:JailbreakBench/JBB-Behaviors, base_model:answerdotai/ModernBERT-base, base_model:finetune:answerdotai/ModernBERT-base, license:apache-2.0, model-index, endpoints_compatible, region:us
Base models (finetune): id: answerdotai/ModernBERT-base
Card metadata: language: en
license: apache-2.0
library_name: transformers
tags: modernbert, security, jailbreak-detection, prompt-injection, token-classification, tool-calling, llm-safety, mcp
datasets: microsoft/llmail-inject-challenge, allenai/wildjailbreak, hackaprompt/hackaprompt-dataset, JailbreakBench/JBB-Behaviors
base_model: answerdotai/ModernBERT-base
pipeline_tag: token-classification
model-index: name: toolcall-verifier
results: task: type: token-classification
name: Unauthorized Tool Call Detection
metrics: name: UNAUTHORIZED F1
type: f1
value: 0.935
verified: no, name: UNAUTHORIZED Precision
type: precision
value: 0.9501
verified: no, name: UNAUTHORIZED Recall
type: recall
value: 0.9205
verified: no, name: Accuracy
type: accuracy
value: 0.9288
verified: no
Likes: 1 | All-time downloads: 15
Created: 2025-12-18 06:41:20