I am not sure how is this type different from the normal link extraction method already in slybot? Can't we just accomplish the same by setting start urls and follow_patterns?