iterating through urls, adding exceptions for varying data