Broken build on 32 bit: Pending TODO: Reenable assertion.

On a1a0c00589a8efc664db82be6743136bb462e08f, an assertion was disabled
because of breaking 32bit build.
This fixes that so that it now always work.