removes requirement for progress bar, url cache is now a set, supports command line as well as direct calling
directory url generator works
directory url generator works
last commit was off, added url generator
left in a print