Fix compiler warnings about comparison between signed and unsigned

Review at https://rbcommons.com/s/OpenH264/r/846/.