Change integer literals to unsigned to avoid warnings about comparison between signed and unsigned

This fixes warnings in gcc.

Review at https://rbcommons.com/s/OpenH264/r/907/.