I think it's fine to remove this FIXME, a cast from `uint` to `int` when you do `ptr::offset` is also fine.