robots parser and results file generator