Resolve issue where leaving a chan would crash with ConcurrentModificationExceptions