Don't remove channel handlers in the main thread - can case deadlock.