Make sure ChannelHandler.handlerRemoved() is invoked while handler methods are not running

- Fixes #1664