Revert "Wrap accesses to the fd_sets in struct fdtable"

This reverts commit f5028ffb0212430bc9360edcfd69ee5fecb602f1.