component or system. See also performance testing, stress testing. Maintainability The ease with which a software product can be modified to correct defects, modified to meet new requirements, modified to make future maintenance easier, or adapted to a changed environment. Maintainability Testing The process of testing to determine the maintainability of a software product. Maintenance Modification of a software product after delivery to correct defects, to improve performance or other attributes, or to adapt the product to a modified environment. Master Test Plan A test plan that typically addresses multiple test levels. See also test plan. Metric A measurement and the method used for measurement. Milestone A in time in a project at which defined (intermediate) deliverables and results should be ready. Monitor A software tool or hardware device that runs concurrently with the component or system under test and supervises, records, and/or analyzes the behavior of the component or system. Non-Functional Requirement A requirement that does not relate to functionality, but to attributes such as reliability, efficiency, usability, maintainability and portability. Off-The-Shelf Software A software product that is developed for the general market (i.e., for a large number of customers) and that is delivered to many customers in identical format. Operational Environment Hardware and software products installed at users’ or customers’ sites where the component or system under test will be used. The software may include operating systems, database management systems, and other applications. Operational Testing Testing conducted to evaluate a component or system in its operational environment. Output A variable (whether stored within a component or outside) that is written by a component.
Test Environment An environment containing hardware, instrumentation, simulators, software tools, and other support elements needed to conduct a test. Test Execution The process of running a test on the component or system under test producing actual result(s). Test Item The individual element to be tested. There usually is one test object and many test items. See also test object. Test Level A group of test activities that is organized and managed together. A test level is linked to the responsibilities in a project. Examples of test levels are component test, integration test, system test, and acceptance test. Test Log A chronological record of relevant details about the execution of tests. Test Management The planning, estimating, monitoring, and control of test activities typically carried out by a test manager. Test Manager The person responsible for management of project testing activities, resources, and evaluation of a test object. The individual that directs, controls, administers, plans, and regulates the evaluation of a test object. Test Object The component or system to be tested. See also test item. Test Phase A distinct set of test activities collected into a manageable phase of a project (e.g., the execution activities of a test level). Test Plan A document describing the scope, approach, resources, and schedule of intended test activities. It identifies, among other test items: the features to be tested, the testing tasks, the resource that will perform each task, the degree of tester independence, the test environment, the test design techniques, the entry and exit criteria, and any risks requiring contingency planning. It is a record of the test planning process. See also Master Test Plan. Test Planning The activity of establishing or updating a test plan. Test Result See result. Test Scenario See test procedure specification.