GitHub repository: streetquant/img2dataset
Description: Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.