File size: 577 Bytes
115962a
 
d33a55e
 
115962a
d33a55e
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
---
license: apache-2.0
datasets:
- wikitext
---

The main stuff is stored in branches: BakaLLM is intented to be my pet project with series of gradual improvements. 
Basically one improvement per branch, from 001_pristine(simplest version) to ⑨⑨⑨_humanity_is_conquered.

HF repo contains code and weights. Github code only. 

Code will not work AS IS, tinkering requirements. For one, I didn't place weight in weights dir(I wanted to zstd them first, but forgot)
For two, bench (benchmark script to test against other models) is very opinionaned where models are stored.