Changed the token extraction method for both the models. Replaces all non-alphanumberic occurences with white space
and splits on white space now