Fuck it, new rework of the cralwer. Only HTTP tested.