the loop should continue when it handles a None url instead of completely returning from the function call