twitter/twitter-text-java — pull request #27 by kscanne (2012-02-16 07:11:29+00:00)
Title: Add Arabic, Hebrew, and Thai unicode characters

Small number of tests I added pass; I can add more when Kaveh provides some Arabic hashtag examples. Also note that I fixed an existing, subtle bug: some of the character ranges for Cyrillic were separated by unicode 0x2013 instead of an ASCII dash and so the full range of characters was not being included in the regex (just the first and last and 0x2013!). Fortunately these were all in the extended Cyrillic range which is why no one noticed.