Don't delete ovs tmp files immediately