Use get_rlist & get_wlist instead of fileno.

This improves extensibility.
Backend may return None when accepting connection.