more user-agents, used from the first dl
trim text
handle more file formats / generate final csv per corpus