Reset file descriptor set only, if necessary now.