jiminoc/goose — pull request #39 by chechu (2012-02-29 21:58:32+00:00)
Title: Automatic detection of the char encoding using the juniversalchardet

First, thank you for your work!

I have included the autodetection of the char encoding used by the web page using the juniversalchardet library. Feel free to include it in the master branch or discard it :-)

Moreover, I have added some code to make easy the integration of an autodetection language library (as jlangdetect or lingpipe) in StopWords.scala. Nowadays I am using my own private language identifier but it would be easy to include some other library. Maybe in the future :-)

Thank you again, and good luck