TST: do not attempt to convert to a matrix if scipy is not available