fixes superagent request piping, moved call to main processing out of req.end callback