added robots.txt and handling for unlikely scenario where no images are available from the DB