updated to use all_urls + include_globs