indexer can handle test corpus, tokenizer doesn't fail on empty token, indexer working on server