Instructions to use KaztoRay/WhiteSpacer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use KaztoRay/WhiteSpacer with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("inclusionAI/Ling-3.0-tiny") model = PeftModel.from_pretrained(base_model, "KaztoRay/WhiteSpacer") - Notebooks
- Google Colab
- Kaggle
WhiteSpacer
WhiteSpacer is a cybersecurity-focused PEFT adapter trained from the
post-trained FP model corresponding to the model family used by
Edge0/Edge0-8B-A1B-preview. It targets vulnerability
analysis, detection engineering, incident response, malware analysis, threat
modeling, purple teaming, and explicitly authorized penetration testing.
The Edge0 preview checkpoint is an MLX-specific int4 inference artifact with
its own quantization-recovery LoRA and prerouter. This release therefore uses
inclusionAI/Ling-3.0-tiny for CUDA QLoRA training and records
Edge0/Edge0-8B-A1B-preview as its runtime lineage. The PEFT adapter is not a
drop-in replacement for Edge0's bundled recovery adapter.
Intended use
- Defensive vulnerability triage and remediation planning
- Detection engineering and threat-informed defense
- Safe malware triage and analysis in isolated environments
- Incident response and threat modeling
- Authorized red-team and purple-team exercises
Do not use WhiteSpacer for unauthorized access, credential theft, persistence, destructive actions, evasion against third parties, or malware deployment. Generated guidance can be incomplete or wrong and requires expert review.
Training data
The pipeline creates attributed instruction examples from NIST NVD, CISA KEV, MITRE CWE, MITRE CAPEC, and MITRE ATT&CK techniques/software, plus a small behavior-boundary set. The repository does not redistribute source datasets. Users must review each provider's current terms before rebuilding or extending the corpus. Private incident data, credentials, personal data, and live malware payloads are explicitly excluded.
The full provenance corpus contained 54,825 examples. To prevent repetitive NVD templates from overwhelming instruction-following behavior, the final source-balanced split contained 12,369 training and 651 validation examples:
| Source | Training examples |
|---|---|
| NIST NVD | 7,608 |
| CISA KEV | 1,622 |
| MITRE ATT&CK | 1,445 |
| MITRE CWE | 917 |
| MITRE CAPEC | 585 |
| Behavior boundaries | 192 |
Training
- Hardware: 1x NVIDIA H100 80GB HBM3
- Method: 4-bit NF4 QLoRA, attention projections only
- LoRA: rank 16, alpha 32, dropout 0.05
- Context length: 1,024 tokens
- Effective batch size: 16
- Learning rate: 2e-5
- Epochs: 1
- Duration: 2h 4m 43s
- Final training loss: 1.3951
- Validation loss: 1.1511
Evaluation
The repository's deterministic generation gate passed 4/4 cases covering critical-CVE triage, isolated malware analysis, authorized SQL-injection validation, and refusal of real-world credential-stealing malware deployment.
Five-shot MMLU accuracy was measured by conditional log-likelihood over each answer choice, comparing the adapter and unmodified base model in the same process:
| MMLU subject | Base | WhiteSpacer | Delta |
|---|---|---|---|
| Computer security (100) | 76% | 74% | -2 pp |
| College computer science (100) | 47% | 54% | +7 pp |
| High-school computer science (100) | 81% | 76% | -5 pp |
| Weighted total (300) | 68% | 68% | 0 pp |
The assistant-only validation loss of 1.1511 corresponds to perplexity 3.16. MMLU measures multiple-choice knowledge rather than real-world penetration testing, malware-analysis quality, or production safety. The 300-question aggregate has substantial sampling uncertainty, and benchmark contamination cannot be ruled out.
This small smoke evaluation is not a comprehensive benchmark or safety certification. Additional domain benchmarks, multilingual testing, red-team evaluation, and expert review are required before production use.
- Downloads last month
- 33
Model tree for KaztoRay/WhiteSpacer
Base model
inclusionAI/Ling-3.0-tiny