fixed bugs (loading project w/ no commit, query) and added custom tokenizer function