Improved concurrency & prevented duplicate urls