boobot: Fix weird/unicode URLs

http://stackoverflow.com/questions/1916684/cant-open-unicode-url-with-python
boobot: Guess page encoding

This seems to work with most pages.
boobot: Force shitty Windows encoding

Because web browsers actually do that!

Test URL: http://www.universfreebox.com/article/20715/Deutche-Telekom-met-fin-a-l-internet-illimite-bientot-le-tour-de-la-France
boobot: Better newline handling
boobot: Ignore NBSP in URLs
boobot: Support servers with no HEAD