Silence some -Wsign-compare warnings.

Ah, I forgot, this is technically pointer arithmetic (the subtraction, so the result will be signed), so actually a cast would be needed in this case.