(This isn't to say Dole was pondering his wives' relative fertility.)
This isn't saying that Dole was wondering about his wives' fertility.