get it working with requests 1.1

also start making the output scheduler and optimiser