Tokenizer now drops slashes and garbage (num/currency) lines
Changed some logging levels
Temporarily writting missing tokens to /tmp/missing_tokens
minor changes