Remove socket when stopped