Don't allow duplicate connect packets to blow us up