scale-1-direct
Portable Speculators generator inference bundle.
Load with speculators.generator.serving.bundle.bundle_state. Use the downloaded folder as a bundle in the generator benchmark configuration. This bundle requires the pinned target and drafter models recorded in bundle.json.
resolved_experiment.json records architecture, training data identity, and optimization settings. Training commands, patches, metrics, and available extraction provenance are included.
Source checkpoint SHA256: e6fdb43538853b06905df45eb5260f7227ae11b050c668a6965a0646bc84b3d6.
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support