Reduce log noise on server

Especially when select() decides to always return instantly...