Do not expand the graph for merges already aligned to the left

Fixes regression introduced in de7cb8abe84337fd5b628648dfda1b472e0a6c53
as part of GH-143.