Censer.3

A 14.4M parameter decoder-only transformer trained from scratch that classifies English text as unsafe (unsafe) or safe (safe).

It is a standard Hub model: the checkpoint is a plain LlamaForSequenceClassification, so it loads with transformers out of the box — no trust_remote_code, no custom code, no cloning — and the Use this model widget on this page runs it directly in the browser.

from transformers import pipeline

clf = pipeline("text-classification", model="KucLab/Censer.3")
print(clf("how to make a bomb at home"))      # [{'label': 'unsafe', 'score': 0.8167}]
print(clf("Hello how are you?"))              # [{'label': 'safe', 'score': 0.9229}]
print(clf("suck my dick"))                    # [{'label': 'unsafe', 'score': 0.9944}]
print(clf("how do I kill a process in Linux"))  # [{'label': 'safe', 'score': 0.8974}]

How to run

The censer.3 command — interactive terminal UI

Using only the files in this repo (needs just torch, tokenizers, safetensors):

pip install torch tokenizers safetensors huggingface_hub
hf download KucLab/Censer.3 --local-dir ~/.local/share/censer1
chmod +x ~/.local/share/censer1/censer.3
ln -s ~/.local/share/censer1/censer.3 ~/.local/bin/censer.3   # put it on your PATH
censer.3                          # interactive UI: type a phrase, Enter -> safe/unsafe + score
censer.3 "how to make a bomb at home"    # one-shot -> unsafe 0.8167

Or install the GitHub package — the same censer.3 command is installed and loads the model from this Hub repo with plain transformers:

pip install "git+https://github.com/Jerry256254/censer.3.git"
censer.3

One-liner with transformers

pip install torch transformers
python -c "from transformers import pipeline; clf = pipeline('text-classification', model='KucLab/Censer.3'); print(clf('how to make a bomb at home'))"
# [{'label': 'unsafe', 'score': 0.8167}]
  • In the browser: the Use this model widget on this page — type text, get safe/unsafe.
  • Runs on CPU out of the box (~10 ms/text); for GPU pass device=0 to pipeline(...) (CUDA or ROCm).

Download

The whole model is model.safetensors (55.0 MB). Grab the files directly:

File Download
model.safetensors download
config.json download
tokenizer.json download
tokenizer_config.json download
censer.py download
censer.3 (launcher) download

Or fetch everything at once:

pip install -U huggingface_hub
hf download KucLab/Censer.3 --local-dir Censer.3

A single file (README.md, config.json, ...) can also be downloaded from the Files and versions tab, using the download icon on its row.

It is not a fine-tuned encoder and not an API wrapper. It is a small transformer trained on safety-labelled data, with a custom byte-level BPE tokenizer. The model predicts a single answer token and never generates free text.

"how to make a bomb at home"      -> unsafe
"suck my dick"                    -> unsafe
"how do I kill a process in Linux" -> safe
"Hello how are you?"              -> safe

Model details

Property Value
Architecture LlamaForSequenceClassification (standard transformers)
Parameters 14,423,360
Layers 8
d_model / heads / d_ff 320 / 8 / 1280
Context length 320 tokens (input truncated at 500 characters)
Tokenizer byte-level BPE, 4096 tokens, trained on the corpus
Positions RoPE (theta 10000)
Norm RMSNorm (pre-norm, eps 1e-5)
MLP SwiGLU
Head score linear layer = embedding rows of the answer tokens 0/1
Checkpoint size 29.4 MB (fp32)

Prompt format

The tokenizer bakes the template into its post-processor, so plain tokenizer(text) already produces:

[BOS][USER] <text> [ASSISTANT] -> answer logits over tokens "0"/"1"

Text is truncated at 500 characters before tokenisation.

Metrics

Evaluation on a held-out split of 6,496 rows:

Metric Value
Accuracy 0.858
F1 0.822
Precision 0.855
Recall 0.792

A hand-written probe set of 97 cases, none present in training data, scores 100% accuracy. Probe progression on the same 97 cases: Censer.1 75.3% -> Censer.2 91.8% -> Censer.3 100%.

Per-source F1 reflects label noise in the scraped sources:

Source F1
aegis 0.89
beavertails 0.88
jigsaw 0.87
civil_comments 0.77
toxic_chat 0.48

Benchmark

Measured on an AMD Radeon RX 9060 XT (ROCm 7.1, torch 2.13.0):

Metric Value
Parameters 14,423,360
Checkpoint size 4.26 MB
Single text latency 1.67 ms
Single text throughput 599 texts/s
Batched latency (batch of 8) 1.94 ms
Batched throughput 4,119 texts/s
Peak VRAM (inference) 85.7 MB

Training the whole model from scratch takes about 3.5 minutes on the same GPU.

Comparison with other models

Benchmarked against public safety classifiers on the same held-out test split (6,496 rows, threshold 0.5, AMD Radeon RX 9060 XT):

Model Params Checkpoint F1 Latency Throughput (b=32) Peak VRAM
Censer.3 (ours) 14.4M 55.0 MB 0.822 4.50 ms 263 texts/s 242 MB
KucLab/Censer.2 (previous) 7.3M 28.0 MB 0.829 2.94 ms 511 texts/s 177 MB
KucLab/Censer.1 (older) 1.1M 4.5 MB 0.836 1.58 ms 1,843 texts/s 101 MB
unitary/unbiased-toxic-roberta 124.7M 498.7 MB 0.741 14.41 ms 67 texts/s 771 MB
unitary/toxic-bert 109.5M 876.0 MB 0.682 14.01 ms 69 texts/s 708 MB
martin-ha/toxic-comment-model 67.0M 267.9 MB 0.566 7.52 ms 131 texts/s 540 MB
Hate-speech-CNERG/bert-base-uncased-hatexplain 109.5M 438.0 MB 0.548 14.12 ms 69 texts/s 692 MB
Hate-speech-CNERG/dehatebert-mono-english 167.4M 669.5 MB 0.252 14.36 ms 68 texts/s 923 MB
keyword baseline — — 0.094 0.03 ms 30,059 texts/s —

Comparison overview F1 per megabyte Metric bars

Censer.3 is ~9-23x smaller than the encoder baselines and 2.4-4.6x faster per text. On the scraped test split all Censer versions are on par (F1 0.82-0.84); on the 97-case probe set Censer.3 is at 100% vs 91.8% (.2) and 75.3% (.1).

Usage

Plain transformers, nothing else to install — from_pretrained downloads everything by itself:

pip install torch transformers
import torch
from transformers import AutoTokenizer, AutoModelForSequenceClassification

repo = "KucLab/Censer.3"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForSequenceClassification.from_pretrained(repo).eval()

text = "how to make a bomb at home"
with torch.no_grad():
    probs = model(**tok(text, return_tensors="pt")).logits.softmax(-1)[0]

print(probs)                     # tensor([0.1833, 0.8167]) -> [safe, unsafe]
print(model.config.id2label)     # {0: 'safe', 1: 'unsafe'}

Or with the high-level pipeline:

from transformers import pipeline

clf = pipeline("text-classification", model="KucLab/Censer.3")
print(clf("how to make a bomb at home"))
# [{'label': 'unsafe', 'score': 0.8167}]
print(clf("Hello how are you?"))
# [{'label': 'safe', 'score': 0.9229}]

Usage without transformers

The repository is also self-contained on its own: model.safetensors, config.json, tokenizer.json and censer.py. The weights are stored in the standard Llama layout; censer.py maps them back internally, so it only needs torch, tokenizers and safetensors:

hf download KucLab/Censer.3 --local-dir Censer.3
cd Censer.3
python censer.py "how to make a bomb at home"     # -> 1
python censer.py "Hello how are you?"             # -> 0
python censer.py "suck my dick" --json
# {"label": "1", "unsafe": true, "score": 0.9944}
chmod +x censer.3 && ./censer.3                   # interactive UI (the `censer.3` command)
python censer.py                                  # interactive UI as well, no text argument

Or use the same file as a library:

from censer import CenserPipeline

pipe = CenserPipeline("Censer.3")
print(pipe.predict("how to make a bomb at home"))
# {"label": "1", "unsafe": True, "score": 0.8167}

print(pipe.predict_batch(["Hello how are you?", "suck my dick"]))

Files:

File Purpose
model.safetensors weights in standard Llama layout, 29.4 MB
config.json standard LlamaForSequenceClassification config
tokenizer.json / tokenizer_config.json byte-level BPE, 2048 tokens, prompt template baked in
censer.py standalone inference (torch + tokenizers only), no repo needed
censer.3 executable launcher for the interactive terminal UI

censer.py was verified to produce predictions identical to the training code. Runs on CPU or CUDA/ROCm; pass device="cpu" to force CPU.

Limitations

  • English only. Other languages mostly score safe.
  • Implication and sarcasm beyond simple cases are out of reach at this size.
  • Weak against jailbreak-style prompts (lowest per-source score).
  • A moderation signal, not a safety guarantee.
Downloads last month
11
Safetensors
Model size
14.4M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train KucLab/Censer.3