Don't destroy the parent listen socket from an accepted socket