Skip common ancestor check for AheadBy/BehindBy