grangier/python-goose — pull request #62 by sp576 (2013-12-12 06:20:21+00:00)
Title: Adding Korean support

Hi, I added Korean support to Goose extraction.

Korean is obviously different from English and needs different way of finding stopword.

I also added Korean stopword list.

So far it is working on major Korean news websites.
You can also check an example I added on my README file.

There is an issue with UnicodeDecodeError at line 184 of text.py that sometimes makes StopWordsKorean unable to check if the stopword is in the word correctly.

Regardless of UnicodeDecodeError issue, since it is working on major Korean news websites.
So, I thought it would be great if Korean support is merged into the actual Goose.

Thanks.