(This isn't to say Dole was pondering his wives' relative fertility.)
This is to say that Dole was pondering his wives' fertility.
mnli hypothesis: This is to say that Dole was pondering his wives' fertility. premise: (This isn't to say Dole was pondering his wives' relative fertility.)