Also memalign the memory matrix.