Predict number of off-diagonal elements we'll need to duplicate when reading the matrix in and reserve that much room