Robot can now make a list of all disallowed links