small tweaks to link checking algorthim