Fix build warnings with gcc in EncodeDecodeTest

Avoid a comparison between signed and unsigned integers, and avoid
a warning about a variable which is set but not used.

Review at https://rbcommons.com/s/OpenH264/r/811/.