Parse nutch segments into a TDF. Light on memory: only one line is loaded at a time and one html is stored at a time; on the other hand is more IO intensive.

_input is the dumped html content form nutch:
_output is the tdf that is generated

requirements:
pandas