Filter view pairs from known orientations of views. View pairs are removed if
the relative rotation estimates of the view pair differs from the relative
rotation formed from the known rotations.

Change-Id: I7659e261850970ebd77b70f3defa45ed26cbc78f