TST: Fixed int32/int64 problem in csv parser tests

Fixes #5316

I think this was just an issue with 32 bit OSes.