It's not necessary but it allows to rely on the OS to cleanup after ourselves if we fail to do so or if the user required keepTestFiles().