Move children decision down the tree so we don't ignore umbrella children