Removed URL discovery mechanism for clustering