updates log2code database, distinct now ignores lines that are too long to output.