Fixed assertion error from removing a node that wasn't a child