rand!(A): use pointer directly instead of pointer_to_array

This is to avoid the small allocations of pointer_to_array, which can
add up and slow down repeated calls to rand!(A) on a same array A,
in particular when A is small.