Track the sources that the kubelet has seen, and only delete pods
when every source has been seen at least once.