First, I want to praise you for your concern for your children. Debt is a very difficult thing with which to wrestle when you are thinking about changing the amount of income you will be receiving. You don't ask for advice, and with the small amount of information which you give, if would be difficult for us to weigh the necessity of a quicker payment of debt over against a longer payment period for your debt and more time with your children. I would always opt for the children when it is something like paying off the debt in three years verses paying off the debt in six years. Children's souls are forever.
Debt is temporal.
It does sound like you can see yourselves paying off the debt without you working. Then it becomes a timing decision. When children are little is when they seem to need and benefit the most from the presence of loving parents. There are, of course, other options. That may mean changing jobs.