HevEventLoop: Don't remove event source fd if events not be handled.