Minor fix to indexer

Increase varchar for terms, add try,except statement, and more filters
for tokens