get all types and tokens from corpus
fixed cant be true in gsub in clean()