Let us examine three types of problems that can occur in tools generated automatically. Incorrect metatool input. The input to the metatool must conform to the assumptions on which the metatool is based. A critiquing system can check the metatool input and output to ensure that the generation process is working correctly. Incorrect custom adjustments.
Developers can make mistakes when custom tailoring knowledge-acquisition tools.
Critiquing systems can examine the custom adjustments, or, alternatively, the tools generated to detect problematic cases. Incorrect metatool implementation. Naturally, there can be bugs in the metatool implementation that result in incorrect knowledge-acquisition tools. Critiquing systems can detect some of these problems, because metatool bugs often result in incomplete target tools. Thus, developers get confused by incorrect metatool input that manifests itself in the target tool.