A partial fix for the new Transfer-Encoding: chunked problem.
don't try to repair broken lines at collect time; fix them at parse time in json2rawtsv
don't crash on partial tweet at end of file
sync up if file opens with broken tweet