Uncomment wiki downloading code (accidentally commented out previously)
Allow FileIterator to keep newlines if necessary: this means that an additional newline is not appended to the end of each of the split-up wikimedia dump files, which potentially breaks the XML parsing when a page is split between files.
A few tweaks to wiki title parsing, to match what is done on Commons, and allow control characters in filenames, which occasionally happens.
Stamp on last API bug (also present in previous wikimedia codebase): there is an (undocumented) maximum length to wikimedia API URLs which can be exceeded when we have a collection of very long (usually unicode) titles. This was causing hundreds of files to be missed. Here we make a guess as to the maximum URL length, given the urlencoded titles, and make sure we process the batch of files when the URL risks becoming too long.
Correct simple typo which was accidentally sending the encoding types as the user agent string.
Be polite to commons - give a sensible user-agent string (see https://meta.wikimedia.org/wiki/User-Agent_policy and https://en.wikipedia.org/wiki/User_agent#Format_for_automated_agents_.28bots.29)
Comment on a few TODOs, plus comment on links to wiki info
set contact email for user agent to tech@eol.org
Merge pull request #71 from hyanwong/wikimedia_small_bugfixes

Wikimedia small bugfixes