For testing sparse linear system solvers, several useful resources are available. The evaluation characteristics of sparse solvers that can be assessed largely from inspection of the code and its documentation include the following. Capabilities Includes methods, formats Methods Identify which methods and preconditioners are used in the package. Formats Identify which matrix formats are supported. Packages that use non-standard matrix formats may be harder to test and to use, and will tend to have a relatively small base of users.
Architectures Identify on which architectures the packages has been tested and is supported.
Versatility Includes methods, interfaces Methods Identify the extent to which a user can design or specify the method or preconditioner to be used. Interfaces Identify how well the package interfaces with other packages, and whether it has multi-language support. Ease of use Identify adequacy of documentation, examples, and support. Our current emphasis in the HPC-Netlib evaluation is on sparse linear system solvers, although many of the sparse packages also fall into the PDE category.