remove all fake-links and remove duplicate urls