urls written to redis, sorting, colouring