remove pointer to start address of matrix from column vector implementation.

This is not needed as we already have the start address of the column.