fixed 2 bugs in tokenizer: bad handling of blank code tokens, and merging of single-line docblocks ignoring the line between them (resulting in skipped entries)