Be more aggressive and defensive in all uses of SelectionKey in select loop