Some work on filtering large files and recognising charsets (fixes #2)

tests for the encoding - very valuable!

Note that the ICU library used for detecting charset encoding is
compatible with the GPL:

http://userguide.icu-project.org/icufaq#TOC-How-is-the-ICU-licensed-