Base Checkpoints - a OctoLong Collection

OctoLong 's Collections

Extended Checkpoints

Base Checkpoints

Base Checkpoints

updated about 20 hours ago

Qwen3 checkpoints with modified configurations for long context fine-tuning in the OctoLong project

OctoLong/Qwen3-0.6B-Base

Text Generation • 0.6B • Updated about 20 hours ago • 18
OctoLong/Qwen3-1.7B-Base

Text Generation • 2B • Updated about 19 hours ago • 109
OctoLong/Qwen3-4B-Base

Text Generation • 4B • Updated about 19 hours ago • 86
OctoLong/Qwen3-8B-Base

Text Generation • 8B • Updated about 19 hours ago • 96 • 1
OctoLong/Qwen3-14B-Base

Text Generation • 15B • Updated about 19 hours ago • 63