Support SSH directory sharing despite UID mismatch

This enables us to use the user's ~/.ssh/config despite it not having
the right UID, etc.