syssec-utd/pylingual-shared-mlm-v1

Universal (all-version) PyLingual mlm backbone for the shared-backbone + per-version LoRA study, trained on Python 3.6-3.14 with 3.15 held out. last-checkpoint/ holds the latest resumable Trainer checkpoint while training runs; the repo root holds the final model.

  • Data: syssec-utd/pylingual-shared-encoded-v1 universal/segmentation at revision 0f70ef5ada329b652a6cd67502244db733f98109 (50000 source files, 1540697 encoded rows, tokenizer.json sha256 61c4f9cd711448c6f71db41e93b6cbbe9fc3d0c994f3d427b0faecfd02e954df)
  • Initialization: None
  • 2 epochs, global batch 28 (28 x 1 accumulation x 1 GPU), learning rate 5e-05, weight decay 0, FP32, seed 20261020
  • Code: https://github.com/quinntyx/pylingual branch feat-shared-backbone-lora, commit cb0c7b9fa5810ed5c1c09c1fe7a17c0a1eaf5606

run/provenance.json records every training argument and the full data manifest.

Downloads last month
23
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support