Move readme to developer notes
Update build and formatting, write tokenizer and index docs