reached an acceptable twitter text tokenization. more testing is required anyway