We give a detailed description of the evaluation criteria below. Note that it is has been refined and expanded to a level of detail to enable it to serve as an evaluation checklist.
Performance Includes accuracy, efficiency, and scalability.
A performance monitoring tool is accurate if it does not cause too great a change in the behavior and timing of the program it is monitoring. The software runs fast enough, in that slow speed does not make it an ineffective tool. Scalability A parallel tool is scalable if its overhead grows in a reasonable manner with increases in system and problem sizes. In some cases, linear growth may not be acceptable. The tool has adequate functionality to effectively accomplish its intended tasks.