added tokenizer of the standard library to jedi, because in the future it shall replace tokenize
removed unnecessary stuff for the jedi tokenizer
Merge branch 'dev' into tokenizer
tokenizer py27 support
tokenizer removed unused functions
tokenizer: removed encoding
tokenizer: removed raised errors
use tokenizer instead of tokenize in all modules
removed more unused code
fix a problem with statements without parents
remove py2.5 from travis - this also removes python 2.5 support
Merge pull request #203 from davidhalter/tokenizer

Tokenizer