LiamCarter/grasprune_qwen3-8b_ratio0.2

Qwen3-8B — original GRASPrune, pruning ratio 0.2

This is a structurally pruned derivative of Qwen/Qwen3-8B.

Model provenance

This checkpoint was produced by the original GRASPrune pruning pipeline in methods/GRASPrune, not by new_method_2. The local new_method_2 code was used only for downstream evaluation and did not produce or alter the pruned weights.

• Method: GRASPrune: Global Gating for Budgeted Structured Pruning of Large Language Models
• Original implementation: ZiY-Wang/GRASPrune
• Upstream source revision recorded with this release: 666f4f04ec9e5e3218904df4d0935841bbd570fc
• Base model: Qwen/Qwen3-8B
• Target pruning ratio: 0.2
• GRASPrune retained budget: keep_ratio=0.8
• Export dtype/format: torch.bfloat16, materialized state dict
• Rescale compensation: rescale_alpha=0.5

The 20% ratio is the target reduction of GRASPrune's global prunable structural budget across FFN intermediate channels and attention KV groups. It is not a uniform per-layer sparsity ratio or a file-size reduction ratio.

Files and loading

This is not a standard Transformers save_pretrained directory and cannot be loaded directly with AutoModelForCausalLM.from_pretrained().

• pruned_state_dict.safetensors: materialized pruned weights
• meta.json: layer-specific shapes required to rebuild the architecture
• layer_mask_report.csv: layer-wise retention report
• provenance.json: release provenance and artifact identity
• SHA256SUMS: checksum for the weight file

Clone the original GRASPrune repository, run from its root, and use its rebuild.py loader:

import os
import torch
from huggingface_hub import snapshot_download
from rebuild import load_pruned_model

checkpoint_dir = snapshot_download("LiamCarter/grasprune_qwen3-8b_ratio0.2")
model, tokenizer, meta = load_pruned_model(
    model_id="Qwen/Qwen3-8B",
    state_dict_path=os.path.join(checkpoint_dir, "pruned_state_dict.safetensors"),
    meta_path=os.path.join(checkpoint_dir, "meta.json"),
    torch_dtype=torch.bfloat16,
    device="cuda:0",
    use_fast_tokenizer=True,
    trust_remote_code=True,
    local_only=False,
)

Local evaluation

The weights were evaluated read-only with the local new_method_2 evaluation flow. Percentages:

Common-sense 5-task macro avg	ICL 0-shot	ICL 1-shot	ICL 4-shot	ICL 8-shot
62.514	30.64	29.74	51.06	55.82

These are local benchmark results, not upstream GRASPrune claims.

Intended use and limitations

This checkpoint is intended for structured-pruning and benchmark research. It has not been validated for production deployment, safety, factual reliability, bias, multilingual robustness, or long-context behavior. Performance can be lower than the parent model.

This derivative follows the Apache-2.0 license of the Qwen3-8B base model. GRASPrune code is separately distributed under Apache-2.0.