mp3enc: fix a triggerable assert

We have to check against the number of bytes actually needed, not the
theoretical maximum size.