Use uint32_t for symbols and alphabet size.

This eliminates some warnings about signed/unsigned comparison.
This return value is only used in the debug build.