brendano/ark-tweet-nlp — pull request #9 by stevenbedrick (2011-11-16 19:45:17+00:00)
Title: Changed the URL regex to use the "web-only" version of Gruber's URL regex...

I happened to have an implementation of Gruber's URL regex lying around in a different program, and agreed with the comment in the twokenizer about the Larry David stare. :-) I don't know what sorts of unit tests you guys have for the twokenizer, but this seems to work for me, and this particular regex has worked very well for me in other projects.