Remove a debugging assert.

Sorry for the noise, I have no idea how it survived to the final version.