Remove some sig/unsign comp warnings

The newly added code introduced some warning, which is fixed with
this change.