add customize link extract and fix dedupt bugs