1.06B parameter coding LLM trained from scratch on B6000. 70% CodeParrot, 30% OpenWebMath. Architecture: LLaMA 20L, 2048 hidden, 16 heads.
Files info