Fix recent breakage

The idea was to ignore any new packets while switching subscriptions (sometimes a packet makes it through while switching). Using `m_started` was obviously incorrect since it's not used anywhere (I thought I removed it already but it seems I hadn't), this fixes the logic.