Clean up the event subscriber queue