I think it might be a bit more clear if we just used `File#delete` here.