select.poll timeout should be in ms

Not sure how it ever worked properly.

Signed-off-by: Fredrik Lindberg <fli@shapeshifter.se>