PeetPedro/kompress-v32

kompress-v3.2

Token compression classifier fine-tuned from PeetPedro/kompress-v31 (ModernBERT-base, 149M params). Trained as part of the ultrawhale fine-tuning loop.

Kompress classifies each token in a message as keep (1) or drop (0). Used by the headroom proxy to compress LLM context before it reaches the model.

Eval results (heretic adversarial benchmark)

Heretic-style prompts generate responses maximally dense with must-keep tokens (chemical formulas, CVE identifiers, memory addresses, line numbers). The benchmark measures what fraction of those tokens survive compression.

Metric	Value
heretic exact_pct	0.929
keep_rate	—
override_delta	+0.002
base model	kompress-v31

Full progression across all versions

Training

Domain data refined from v3.1. Must-keep token weight increased (3.0 to 6.0). Modest heretic improvement over v3.1.

Usage

# Via headroom proxy (recommended)
# ANTHROPIC_BASE_URL=http://localhost:8787 claude

# Direct library use
from headroom import compress, CompressConfig
result = compress(messages, config=CompressConfig(kompress_model="PeetPedro/kompress-v32"))

CONCLUSION

Domain refinement helped marginally. Diminishing returns on domain data quality.

USECASE

Intermediate domain experiment. Not recommended for production.

Series

Version	heretic	keep_rate	Notes
v3	0.942	0.728	first self-label
v3.1	0.925	—	domain data
v3.2	0.929	—	domain refined
v3.3	0.942	—	domain-only, overfit
v4	0.967	0.823	override internalized
v5	0.961	—	loop converged
v6	0.962	0.854	agent-distribution

Training code: ultrawhale