fix bug for crawler urls from csv