Close stale files immediately after initial open