Fix bad usage of aligned_load on unaligned data in to(u)ints tests