Original:  After the appointment, the three of us split up, and Matt and I both went back to work;
Updated:   After the appointment, the three of us split up, and Matt and I both went back to work;