Inc. See the permissions statement below. This article derives from a position statement prepared for the Workshop on Strategic Directions in Computing Research .
Most companies still rely primarily on testing to evaluate the quality of their systems.
Although industrial products are now available to help manage testing artifacts, such as test cases, test drivers, and test results, the actual selection of the test cases is primarily an ad hoc process. It is an interesting paradox that while most companies claim to be proud of the quality of their own software, everyone seems universally disappointed in the quality of the software they buy from others. One has to question why so few research ideas have permeated industrial practice. One answer is that academic researchers have not produced many ideas that are actually practical. Software testing is a fertile research area.