list and url cleanup + duplication removal