remove empty files, rather recreate dir automatically
moved max length check to Tokenizer
Merge branch 'master' of github.com:ftes/de.uni-potsdam.hpi.ir.searchengine