unify poller and scheduler fd registration