BST implemented for crawler