In the latter case, a government that cares about children would want to discourage household moves (say through subsidies to homeownership), even at the cost of higher unemployment.
Children are more important than the cost of higher unemployment.