Need to account for separate notification process we do with ChannelFuture to avoid spurious select wakeups