Unlearned Checkpoint

Field Value
Unlearning method SNMF
Base model Qwen/Qwen3.5-2B
Target concept Baseball
Checkpoint type Full Model Weights
Rank / seed 100 / 42
Train eval protocol mc

Unlearning Configuration

Selected hyperparameters (from unlearned_checkpoints.json):

Parameter Value
coverage_thresh 0.95
delta_embed 0
delta_in 7
delta_out 1
feature_source all
k_features_embed 0
k_features_mlp_in 25
k_features_mlp_out 25
layer_hi_in 7
layer_hi_out 7
layer_lo_in 0
layer_lo_out 0
n_tokens_edited 0
ratio_thresh 2
w_mode both

Primary Unlearning Metrics (held-out test, MC protocol)

Headline scores used for checkpoint selection:

Metric Train (after unlearning) Test (after unlearning)
Efficacy 0.542 0.488
Specificity 0.553 0.475
Harmonic mean 0.548 0.482
Relearning QA (MC) — 0.56

Full Evaluation (baseline → unlearned)

From evaluation/score_comparison.csv:

Metric Baseline (train) After unlearn (train) Baseline (test) After unlearn (test)
QA accuracy 0.84 0.52 0.66 0.46
QA fraction 1 0.458 1 0.512
SimDom accuracy 0.62 0.4 0.66 0.38
SimDom fraction 1 0.405 1 0.317
MMLU accuracy 0.56 0.52 0.588 0.571
MMLU fraction 1 0.871 1 0.95

Files in This Repository

File Description
unlearned_checkpoints.json Checkpoint metadata & hyperparameters
evaluation/evaluation_summary.json Full evaluation payload (train/test/relearning)
evaluation/score_comparison.csv Baseline vs. unlearned comparison table
Downloads last month
324
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for shirasko/qwen3.5-2b-snmf-baseball

Finetuned
Qwen/Qwen3.5-2B
Finetuned
(351)
this model

Collection including shirasko/qwen3.5-2b-snmf-baseball