I think this is the source of the home button problem.  Without having thought about it as much as I should, I think that we want to set the camera's transform at the beginning of the flight, and then if it changes while the flight is in progress we want to continue doing the flight in the new frame and not change it again at the end.  This approach should make the home button work when creating an inertial camera in the way that my code snippet does.