pass fd in so that read and write use the correct one.  TLS has the fds already in the ssl_ thingie