prevent duplicate links

added option to prevent duplicate links being archived