Model: ykae/monarch-bert-base-mnli
Author: ykae
Pipeline: text-classification
Library: transformers
Tags: transformers, pytorch, safetensors, bert, text-classification, fast, monarch-matrices, mnli, efficiency, triton, hardware-efficient, sub-quadratic, fast-inference, h100-optimized, custom_code, en, dataset:glue, dataset:wikipedia, license:apache-2.0, model-index, endpoints_compatible, region:us
Card metadata: language: en
license: apache-2.0
library_name: transformers
tags: bert, fast, monarch-matrices, mnli, efficiency, triton, hardware-efficient, sub-quadratic, fast-inference, h100-optimized
datasets: glue, wikipedia
metrics: accuracy, throughput, latency
pipeline_tag: text-classification
model-index: name: Monarch-BERT-Base-MNLI-Full
results: task: type: text-classification
name: Natural Language Inference
dataset: name: GLUE MNLI
type: glue
config: mnli
split: validation_matched
metrics: name: Accuracy
type: accuracy
value: 79.4
description: Approx. 5% accuracy trade-off for maximum speed compared to dense BERT.
verified: no, name: Throughput (TPS on H100)
type: throughput
value: 9029.4
description: Measured with torch.compile(mode='max-autotune') on NVIDIA H100. Represents a 24.3% increase over the optimized Triton baseline.
verified: no, name: Latency (ms)
type: latency
value: 3.54
description: Batch size 32, sequence length 128. Achieves a ~20% faster inference time.
verified: no
Likes: 0 | All-time downloads: 59
Created: 2026-01-05 14:11:52