changes the way files are chunked from a line based system to a token based one. this results in a speedup of almost 4x, so now I'm getting 270 pages/sec on my laptop
moves away from go's builting xml parser in favor of an ad hoc one. memory consumption is down by two orders of magnitude, speed is up to 1500 pages/sec
adds newlines to the invalid character regex for pages
adds unit tests for isTitle