Revert "[DF-185] used pointer_size for matrix cache instead of uint32"

This reverts commit 7a2c4e0e2d0c53fff597cbbe7ac14584025725b2.