Don't recurse if we already have all known members