Don't stop Poll handles when rearming them

It can hurt performance, specially on Windows