jjang-ai/vmlx (github)
vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler  + Cont Batching + etc!
Trust score: 6.69/10 (tier: established)
Stars: 814, Forks: 82
License: Apache-2.0