Clean up after ourselves

We don't need to hold two file descriptors open after putting stderr
back to where it was. Let's not leak OS resources.