# Patent

## Title
Image data storage

## Abstract

A system having a sensor array adapted to provide image data. A process node is connected to the sensor array, and analyzes portions of the image data. A job manager is connected to the process node, and instructs the process node to send the portions of the image data to a storage node. The storage node receives and stores the sent portions of the image data. In this manner, image data can be stored and run multiple times in order to tune a recipe for the analysis system. Because the same image data can be used over and over again, the recipe creating process can be more finely tuned to detect both the types of defects and at a level that is desired.

## Background
FIELD
This invention relates to the field of integrated circuit fabrication. More particularly, this invention relates to substrate inspection systems. This application relates to the copending applications listed below, all of which were filed on 2004 Oct. 18:














Application Ser. No.
U.S. Pat. No.









10/967,388
7,149,642



10/967,397
7,076,390



10/967,419
7,181,368



10/967,542



10/967,375



10/967,838
7,024,339



10/967,376



10/967,832



10/967,420



10/967,418











BACKGROUND
Integrated circuit manufacturers use inspection systems to detect anomalies, such as defects, in substrates. Generally, an inspection system rasters the surface of the substrate with one or more optical sensors, and generates image data based on the images detected by the sensors. This image data is analyzed according to one or more of a variety of different algorithms to determine where defects might exist on the substrate. Integrated circuit manufacturers demand that such inspection systems meet several criteria. Among these criteria is that the inspection system must be extremely accurate, fast, and reliable. Further, such inspection systems should preferably be reasonably priced and relatively flexible.
Prior art inspection systems have implemented one or both of pipelined systems or computers that are networked in a switched fabric topology, which use highly customized hardware. Customized hardware has several disadvantages as compared to commercially available hardware, including higher nonrecurring engineering costs for the developer, lower reliability, longer development times, and more inflexibility in changing algorithms. Switched fabric systems have additional disadvantages, including high cost, lack of standards between manufacturers, and development lag in the components, such as the level of microprocessor that is built into such systems.
Commercial hardware, by contrast, tends to be more reliable, more versatile, and less expensive. For example, large computer manufacturers devote a tremendous amount of engineering effort to ensure that the latest technologies are implemented in their products, and that those products are brought to market as soon as possible. This large engineering effort is then factored into the price of the many, many units that they anticipate selling. Thus, the large development costs are spread quite thin as to each unit that is purchased. The development costs for customized hardware, on the other hand, must be borne on a relatively very small number of units.
Further, once a commercial product is developed, the engineering support team continually updates, improves, and bug fixes that product. Again, these costs are distributed over all of the many units that are sold by a large manufacturer. Again, the expenses of such efforts for customized hardware must be borne by a very few units. Often, the number of units makes such levels of support for customized hardware financially unreasonable to offer or to buy. Thus, prior art inspection systems, while perhaps having acceptable speed and accuracy, have been woefully lacking in the categories of flexibility, reliability, and cost.
What is needed, therefore, is a system that overcomes problems such as those described above, at least in part.
SUMMARY
The above and other needs are met by a system having a sensor array adapted to provide image data. A process node is connected to the sensor array, and analyzes portions of the image data. A job manager is connected to the process node, and instructs the process node to send the portions of the image data to a storage node. The storage node receives and stores the sent portions of the image data.
In this manner, image data can be stored and run multiple times in order to tune a recipe for the analysis system. Because the same image data can be used over and over again, the recipe creating process can be more finely tuned to detect both the types of defects and at a level that is desired.
In various embodiments, the storage node includes a RAID. The storage node is preferably selectively severable from the process node. A storage node host is preferably connected to the storage node, and adapted to configure the storage node. In one embodiment, the storage node is a RAID that is disposed within the process node. Preferably, the process node is a plurality of process nodes and the storage node is a plurality of storage nodes. In one embodiment, the image data is sent from the sensor array to the process node on a first network, and the sent portions of the image data are sent from the process node to the storage node on a second network. Most preferably, the image data is sent from the sensor array to the process node on a fiber optic network and the sent portions of the image data are sent from the process node to the storage node on a gigabit Ethernet network. In alternate embodiments, the sent portions of the image data sent from the process nodes to the storage nodes is communicated on a single network, or the sent portions of the image data sent from a given one of the process nodes is communicated on a dedicated network to an associated given one of the storage nodes.



BRIEF DESCRIPTION OF THE DRAWINGS
Further advantages of the invention are apparent by reference to the detailed description when considered in conjunction with the figures, which are not to scale so as to more clearly show the details, wherein like reference numbers indicate like elements throughout the several views, and wherein:
FIG. 1 is a functional block diagram of an inspection system according to a preferred embodiment of the invention.
FIG. 2 is a functional block diagram of an interface of a process node of the inspection system of FIG. 1, according to a preferred embodiment of the invention.
FIG. 3 is a functional block diagram of a storage cluster according to a preferred embodiment of the invention.
FIG. 4 is a functional block diagram of a storage cluster according to an alternate embodiment of the invention.



DETAILED DESCRIPTION
One advantage of the inspection system 10 described herein is that the components are readily commercially available and do not require customized design and manufacture, except perhaps an interface 22, which is relatively easily produced. This has a number of advantages. First, the reliability of the inspection system 10 is generally increased by using components for which a large engineering effort has been invested, for which upgrades and fixes are continually produced, and which have a good track record in the marketplace. In addition, with large numbers of a single component being produced by the original manufacturer, problems are generally discovered faster and fixed sooner.
Further, commercially available computers, such as the process nodes 20 and other components as described below, can run many different kinds of algorithms, whereas customized hardware, and more especially the customized and optimized hardware that is so prevalent in prior art inspection systems, tends to be extremely limited in what it can do, because the cost of adding additional functionality to such customized hardware is extremely high.
With reference now to FIG. 1, there is depicted a functional block diagram of an inspection system 10 according to a preferred embodiment of the present invention. A general description of the inspection system 10 is first presented. Following the general description, more detailed descriptions of various aspects of the inspection system 10 are presented.
GENERAL DESCRIPTION
The inspection system 10 is preferably used for analyzing image data, such as that gathered from optical sensors. For example, both bright field inspection systems and dark field inspection systems use optical sensors. In various embodiments, the inspection system 10 includes a sensor array 26, which is operable for optically gathering the image data. The sensor array 26 as depicted in simplified form in FIG. 1 preferably includes functions such as those provided by a common run time alignment processor, which sends the image data out on different output streams 58.
The sensor array 26 preferably includes sensors and handling systems for optically inspecting substrates, such as the substrates that are used in integrated circuit fabrication processes, such as semiconductor wafers, masks, reticles, and other such substrates. Thus, the inspection system 10 is particularly well adapted to the integrated circuit fabrication industry, which relies greatly upon the optical inspection of such substrates.
As the term is used herein, “integrated circuit” includes devices such as those formed on monolithic semiconducting substrates, such as those formed of group IV materials like silicon or germanium, or group III-V compounds like gallium arsenide, or mixtures of such materials. The term includes all types of devices formed, such as memory and logic, and all designs of such devices, such as MOS and bipolar. The term also comprehends applications such as flat panel displays, solar cells, and charge coupled devices.
In a most preferred embodiment, the sensors in the sensor array 26 are time domain and integration sensors. However, in other embodiments, other sensor types may also be used. The substrate handling systems in the sensor array 26 are preferably adapted to automatically unload the substrate from an input staging system, such as from a cassette, move the substrate under the sensors, such as by moving one or both of the sensors and the substrate relative to one another, and then load the substrate back into an output staging system, such as a cassette.
Thus, in its most preferred embodiments, the inspection system 10 is adapted to automatically inspect the substrate and produce image data. However, in alternate embodiments the inspection system 10 can accept image data that has been stored for later analysis, either in addition to or in place of image data that is being generated in real time.
Many different factors of the inspection 10 combine to produce a very large quantity of image data at a very fast rate. Because of the very small size of modern integrated circuits, the imaging of the substrates by the inspection system 10 is preferably performed at a very high magnification. The inspection system 10 is preferably adapted to detect anomalies on the substrate, which may be defects such as scratches, extraneous particles, voids, short circuits, open circuits, and so forth. To support the optical inspection of such very small features, the pixel size for the sensors is preferably about one tenth of a micron. This small pixel size is one of the factors in the large amount of image data that is produced, and the high rate at which it is produced.
In addition, the inspection system 10 is preferably adapted to handle relatively large substrates having a diameter of about a foot or more. Further, the substrate handling system of the sensor array 26 preferably moves the substrate as rapidly as can be supported by the rest of the inspection system 10, so that the inspection system 10 can process as many substrates within a given length of time as possible. As introduced above, all of this combines to create a very large amount of image data that is delivered at a very fast rate.
For example, the inspection system 10 preferably generates more than three billion pixels per second, with each pixel having eight grayscale bits. This produces an image data stream of over three gigabytes per second. Thus, the preferred embodiments of the present invention as described in greater detail below are adapted to process large amounts of data through a variety of different means.
The inspection system 10 is preferably under the control of a control computer 12, which provides top level control for the inspection system 10, including the storage, selection, and delivery of the recipes by which the inspection system 10 is controlled, interfacing with system operators, and receipt, storage, and delivery of information from and to other computer systems on a network.
However, because the inspection system 10 preferably handles large amounts of data at high rates as described above, there is preferably at least one job manager 14 that performs most if not all of the detailed control aspects for the various components of the inspection system 10. The number of job managers 14 that are implemented preferably varies according to various criteria, such as the type of inspection that is performed by the inspection system 10—be it bright field or dark field, for example.
The job manager 14 is most preferably a logical structure, such as a set of Java routines that run on a host computer. In a preferred embodiment, the job manager 14 is hosted on a separate computer that is used substantially only for that function. Such a configuration tends to isolate the job managers 14 from other computational demands that may be hosted by a commonly used computer. However, in alternate embodiments the job manager 14 is hosted on a common computing platform, such as on the control computer 12.
The job manager 14 preferably, among other things, directs the transmission of image data to the process nodes 20 for processing. Stated in other words, the job manager 14 does not actually transfer the image data to the process nodes 20, but directs other components of the inspection system 10 to do, as described in more detail below. The job manager 14 preferably also provides instructions for the inspection of the image data to the process nodes 20. The instructions preferably define inspection parameters such as pixel size, optics mode, number of gray scales, inspection swath length, and so forth.
The control computer 12, job manager 14, and sensor array 26 are all preferably in communication with one another through a network, which is most preferably a relatively high speed network such as gigabit Ethernet. It is appreciated that other protocols besides Ethernet could also be used, and speeds other than gigabit could also be used. However, gigabit Ethernet is preferred for this portion of the communication between the components, because it has a relatively high bandwidth that generally supports the design goals of high data throughput in the inspection system 10.
In various embodiments, the network connections 44, 46, and 48 are made through one or more network switches. Alternately, other devices such as routers or hubs could be used for this purpose. In one embodiment, all of these network connections are made through the same switch, such as switch 16 or switch 18. However, in a most preferred embodiment, these network connections are locally made through a first switch 16, so that control information that is delivered between the job manager 14, control computer 12, and sensor array 26 does not steal bandwidth from other network connections, which are described in more detail below.
In such a configuration, the first switch 16 is preferably connected to a second switch 18, such as via a network connection 54. Other network connections are preferably also made to the second switch 18, as described in more detail below. Most preferably, the job manager 14 is connected to both the first switch 16, so as to communicate lower priority instructions to the elements of the inspection system 10 as described above, and also to the second switch 18, so as to communicate higher priority instructions to other elements of the inspection system 10, as describe in more detail below.
The analysis of the image data is preferably accomplished by a node array 60 of the inspection system 10. The node array 60 is preferably an array of process nodes 20, which can be thought of as being disposed in rows 28, 30, 32, and 34 and columns 36, 38, 40, and 42. The number of rows and column as depicted in the node array 60 of FIG. 1 is by way of example only, and is preferably determined by factors that are described in more detail below. The process nodes 20 preferably receive image data on lines 58 of a high speed network, such as a fiber optic network. Although a different protocol may be used for the high speed network 58, such as gigabit Ethernet, Firewire, high speed USB, or fast wide ultra SCSI, fiber optic tends to have greater bandwidth when used in combination with the other components of the inspection system 10 than these other options, and so tends to be more preferred.
The portion of the image data that is delivered on the network 58 to a single column of process nodes 36, 38, 40, or 42 preferably comes from a given portion of the sensors in the sensor array 26. For example, the first column 36 may receive image data from a first quarter portion of a time delay and integration sensor, the second column 38 may receive image data from a second quarter portion of the sensor, the third column 40 from a third quarter portion, and the fourth column 42 from a fourth quarter portion. The process nodes 20 in a given column are preferable connected to the network 58 in a daisy chain topology, as described in more detail hereafter.
In one embodiment, each of the process nodes 20 is a dual processor G5 PowerMac computer running OS X, as manufactured by Apple Computer, Inc. of Cupertino Calif., preferably operating at a clock speed of at least about two gigahertz. The inspection system 10 preferably includes at least twelve of the process nodes 20, which are most preferably disposed in four logical columns of three rows each. However, the same computational capacity might also be provided in other embodiments with a total of eight different three gigahertz, dual processor computers, which are preferably disposed in four columns of two rows each. It is appreciated that the selection, number, and arrangement of the process nodes 20 in the inspection system 10 is adjustable as necessary to handle the desired throughput of image data.
It is appreciated that other computers besides PowerMac computers may be used in the inspection system 10. For example, Opteron based computers, as manufactured by Advanced Micro Devices, Inc. of Sunnyvale Calif., having similar speeds and memory capacity could also be used with the Linux operating system. However, because of the interdependencies of the computations being performed by each of the process nodes 20, most preferably all of the process nodes 20 in a given inspection system 10 are of the same type and configuration. Each of the process nodes 20 preferably includes at least about three gigabytes of memory. The computer hosting the job managers 14 is preferably of a similar class, with some differences. Speed is also important for the job manager 14, but data buffering is less so and storage space is more so than for the process nodes 20. Thus, while the process nodes 20 preferably have lots of memory and no hard drive, the job manager 14 preferably has less memory and at least one hard drive.
The process nodes 20 most preferably receive the image data through an interface 22 that is preferably installed in each process node 20, which interface 22 is adapted to receive the image data on the high speed network 58, and provide it to the process node 20 at a speed that is preferably at least as fast as the speed at which a given process node 20 can process the image data. This speed is most preferably no less than about eight hundred megabits per second. However, in embodiments where a greater number of process nodes 20 can be used, each process node 20 does not need to accept the image data at such a high rate of speed. However, by preferably maximizing the image data delivery rate to the process nodes 20, fewer process nodes 20 are required, and the overall cost of the inspection system 10 is generally reduced. The interface 22 most preferably performs some amount of processing on the image data that it receives, such as verifying checksums, stripping off packet headers, and re-ordering the bits to more fully optimize the image data stream for processing by the process node 20.
The process nodes 20 preferably analyze the image data that is sent to them, and generate reports on the image data that they have analyzed. The reports from the process nodes 20 are preferably delivered to the job manager 14. Most preferably, the process nodes 20 communicate with the job manager, and other elements of the inspection system 10 as may be desired, through the network connections 56. In the preferred embodiment, the network 56 is again a gigabit Ethernet network, and the connections 56 are most preferably made to the second switch 18. However, in other embodiments, other protocols and topologies can also be used, as described above.
The processing of the image data by the process nodes 20 is most preferably accomplished with relatively high speed routines, such as those written in a programming language such as C. Communication between the process nodes 20 and other components, such as the job manager 14, is preferably accomplished with a low overhead routine, such as those written in a programming language such as Java, and most preferably using the remote method invocation protocol.
Because the process nodes 20 receive image data at an extremely high rate, they tend to generate the reports at a high rate. However, because the reports preferably do not contain as much data as the image data, a relatively slower network can be used to communicate the reports to the job manager 14 than is used to communicate the image data to the process nodes 20. Therefore, high speed fiber 58 is preferably used for the image data, and relatively slower gigabit Ethernet 56 is preferably used for reporting. It is appreciated that the network 56 may run at a slower speed than gigabit, such as one or more of the automatic fallback rates of one hundred megabits per second and ten megabits per second, as supported by the gigabit Ethernet protocol.
Preferably, the network 56 also carries instructions from the job manager 14 to the process nodes 20. These instructions include information such as set up data and processing instructions that are to be performed on the image data. Because the process nodes 20 are operating under a relatively heavy computational load, and thus may require such instructions at a fairly rapid rate, and also because the reports delivered by the process nodes 20 are sent at a relatively high rate, the job manager 14 preferably has a second network connection 52 to the second switch 18, through which such higher priority communication is preferably accomplished.
Various aspects of the inspection system 10 are now presented in greater detail in the following sections.
Image Data Interface
As introduced above, the image data delivered to the process nodes 20 is most preferably divided into four streams, with each stream preferably representing a one-quarter portion of an inspection swath on the substrate that is about five hundred and twelve pixels wide. One of each of these four image data streams is preferably delivered to one of each of the four columns 36, 38, 40, and 42 of the process nodes 20. As mentioned above, the number of columns and the segmentation of the image data stream can be set at other values besides four. The fiber optic network 58 preferably delivers the image data at a rate of about eight hundred megabytes per second. In a preferred embodiment, the fiber network 58 implements a serial, full duplex data transfer architecture.
In the embodiment of FIG. 1, the image data is received by the interface 22, which is preferably installed in each process node 20. In one preferred embodiment, the interfaces 22 are input data adapter cards having serial fiber optic inputs, such as transceivers 100, which convert the fiber optic image data received on the fiber network 58 into electrical image data, and deliver the image data to a pre processor, such as a field programmable gate array 102, all as depicted in FIG. 2. The transceivers 100 preferably support a bandwidth of about two and a half gigabits per second. Most preferably, each of the interfaces 22 has four such transceivers 100, with each of the transceivers 100 in each process node 20 of a given column 36, 38, 40, and 42 independently daisy chained to the corresponding transceivers 100 in each of the other process nodes 20 within the column 36, 38, 40, or 42 of the node array 60. Thus, the network 58 preferably provide four connections to each column of process nodes 20 in the node array 60. Three of these four connections are depicted as stubs in FIG. 1, so as to not unduly burden the figure with detail.
In some embodiments, the gate array 102 provides some image data processing functions, such as segmented auto thresholding histogramming. The gate array 102 is preferably additionally adapted to handle input tracking, input processing, PCI-X interface, and memory interface processes. The interface 22 preferably includes at least about one to two gigabytes of buffer memory 104, which is used to buffer the image data as necessary prior to transferring it to the memory in the process node 22. If the process node 20 can keep up with the flow of image data received on the network 58, then no buffering is needed. However, if the process node 20 cannot sustain that rate of data flow, such as for intermittent periods of time, then the backlog of image data is preferably buffered in the memory 104. The interface 22 preferably communicates with the process node 20 through a PCI-X slot 106, although interface protocols with similar bandwidth capabilities of at least about eight hundred megabits per second could also be used.
Memory Load Balancing
As described above, the process nodes 20 are preferably adapted to store a portion of the image data that they receive, such as within the buffer 104 of the interface 22. Thus, the process nodes 20 preferably have a sufficient amount of memory to continue receiving image data even if the rate of analysis of the image data within the process node 20 falls below the rate of data acquisition by the process node 20. In this manner, the inspection system 10 can readily handle a peak load of image data without slowing down image data acquisition and analysis.
For example, at a standard load of delivery of the image data, a given process node 20 may be able to process the image data at a faster rater than it is delivered. In such a situation, the buffer memory 104 is generally not used to buffer any significant amount of the image data, because there is no need to relieve the computational load on the process node 20. However, for various reasons, such as the scanning of particularly complex portion of the substrate that is being inspected, a relatively large amount of image data may be delivered within a brief period of time, or the process node 20 may take a longer period of time to process the image data that it has already received.
If the additional image data load extends beyond that which the process node 20 is capable of processing on the fly, the additional image data load is preferably buffered, such as in the memory 104 in a first in, first out process. Then, when the image data load ebbs again, the process node 20 receives the buffered image data, and starts receiving the image data without it building up a load within the buffer 104. Such control of the delivery of the image data is most preferably under the control of the gate array 102, as explained in more detail elsewhere herein.
With the buffer 104 configuration as described above, the software requirement for the inspection system 10 is significantly less than that for prior art inspection systems. For example, the job manager 14 preferably does not provide dynamic load balancing between the process nodes 20, because the process nodes 20 are preferably assigned to a segmented stream of the image data from the sensor array 26, and have sufficient memory and speed for handling the peak loads of the image data stream. Thus, no complex and expensive switched fabric topology is needed, as is commonly employed in prior art systems. Further, the number of process nodes 20 used in the node array 60 can be kept at a number that is less than that which would otherwise be required to handle a peak load of image data, resulting in a lower overall cost for the inspection system 10, without compromising the throughput of the inspection system 10.
Status Polling
As introduced above, the image data is preferably moved from the interface 22 to the process node 20 via direct memory access. As the process node 20 is able to accommodate more image data, the interface 22 delivers the image data through the PCI-X interface 106, and when the process node 20 cannot handle more image data, the interface 22 buffers the image data in the buffer memory 104.
In prior art designs, an interrupt is used as a signal when more data can be delivered via a direct memory access process. However, interrupts are typically handled by the central processing unit of the host, which in this case is the process node 20. As described at length above, the process node 20 is under a severe computational load, and various aspects of the inspection system 10 are designed to preferably keep the process node 20 processing image data as fast as it can. Thus, any additional computation load on the process node 20 is unwelcome.
Therefore, the inspection system 10 according to the preferred embodiments of the invention does not use interrupts to signal when additional image data can be delivered via direct memory access to the process node 20. Rather, a polling method is used. In one embodiment, the gate array 102 polls a register or some other memory location to determine the status of the register. When the register is in a first status, then the process node 20 will accept more image data via direct memory access, and when the register is in a second status, then the process node 20 will not accept more image data via direct memory access. In this manner, the image data is delivered in a smooth manner via direct memory access, without losing the processing cycles on the process node 20 that would otherwise be required to handle an interrupt.
Daisy Chain Topology
The benefits of disposing the process nodes 20 into columns 36, 38, 40, and 42 have been generally described above. Some of the benefits of disposing the process nodes 20 into different rows 34, 32, 30, and 28 are now described. In addition to load leveling the computational demands of the inspection system 10 by increasing the memory capacity of the process nodes 20 and providing buffer memory 104 in the interface 22, the architecture of the node array 60 also both increases the capacity and levels the computational load of the inspection system 10.
For example, with reference to FIG. 1, first swaths or portions of the image data stream are sent out on the network 58. Because the four process nodes 20 in row 34 of the node array 60 are not working on anything else at the time that the first portion of the image data is delivered, they accept the first portion of the image data, and the process nodes 20 in row 34 begin processing the first portions of the image data. While the process nodes 20 in row 34 are still processing the first portions of the image data, second portions of the image data stream are sent out on the network 58. However, this time the four process nodes 20 in row 34 of the node array 60 are busy processing the first portion of the image data stream, and thus they preferably do not accept the second portion of the data stream.
Instead, the transceivers 100 of the interfaces 22 reflect the second portions of the image data stream back out onto the network 58, to be received by the four process nodes 20 in row 32 of the node array 60. Because the four process nodes 20 in row 32 of the node array 60 are not doing anything else at the time, they accept the second portions of the image data, and the process nodes 20 in row 32 begin processing the second portions of the image data. By the time third portions of the image data stream are provided by the sensor array 26 on the network 58, and one or more of various different options can be implemented.
In a first example, the process nodes 20 in row 34 of the node array 60 have completed processing the first portions of the image data stream, and thus they can receive and process the third portions of the image data stream. If the process nodes 20 in row 34 of the node array 60 have not as yet completed processing the first portions of the image data stream, then the third portions of the image data stream can optionally still be sent to the process nodes 20 in row 34, to be buffered in memory, such as the memory 104, before being processed by the process nodes 20, because each of the process nodes 20 preferably has enough memory to hold at least two such portions of image data. In this manner, as long as no one of the process nodes 20 within a row of the node array 60 does not get too far behind in computation, the inspection system 10 will not stall.
Alternately, additional rows 30 and 28 of process nodes 20 may be implemented in the node array 60. In this manner, either the memory requirements for each of the process nodes 20 may be reduced, or the speed at which image data is delivered to the inspection system 10 may be increased, or additional processing of each portion of the image data may be accomplished by each process node 20. In one embodiment, the control of such decisions is preferably specified at the job manager 14, and implemented within the gate array 102, which determines whether it will or will not accept the image data.
This bumping of the successive portions of the image data is enabled, at least in part, by the daisy chain topology of the network 58. Preferably under the control of the gate array 102, portions of the image data are bumped to rows of process nodes 20 that are deeper within the node 60, when the shallower process nodes 20 are busy. In a most preferred embodiment, if one of the process nodes 20 within a row of the node array 60 is not able to accept an image data portion, then none of the process nodes 20 within the row of the node array 60 accepts the image data portion, and the image data portion is bumped via the network 58 to the next deeper row of process nodes 20 within the node array 60. In alternate embodiments, the different columns of process nodes 20 within a given row are more independent, and bumping occurs within a given column from one row to another based only upon the load of the shallower process nodes 20 within that column.
In alternate embodiments, this daisy chain topology as preferably implemented in the fiber network 58 can be implemented in other network protocols, such as gigabit Ethernet. However, fiber network 58 is preferred because of the generally greater bandwidth which it affords.
The number of rows and columns in the node array 60 and the processing capabilities of the process nodes 20 are all preferably interrelated. It is preferred to send image data to the node array 60 on the network 58 as fast as it can be generated by the sensor array 26. Thus, it is also preferred to process the image data with the node array 60 as fast as it can be sent by the network 58. By increasing the number of column within the node array 60 and dividing the swath of image data into a number of different segments that preferably corresponds to that number of columns, the computational requirements of each process node 20 in the node array 60 generally decreases for a given level of image data delivery. By increasing the number of rows within the node array 60, the computational requirements of each process node 20 in the node array 60 further generally decreases for a given level of image data delivery.
By selecting process nodes 20 with as high a computational capacity as is practical, the number of rows and columns in the node array 60 can generally be reduced for a given level of image data delivery. Thus, process nodes 60 with relatively high computational capacities are preferably selected. The number of rows and columns in the node array 60 is then preferably set so that the node array 60 can process an amount of image data that represents the faster average amount that can be delivered by the sensor array 26 on the network 58. Memory is added to either the process node 20 or the interface 22 as described above to handle any additional, intermittent computational load that might be required, as described above. In this manner, the inspection system 10 does not specify either too few or too many process nodes 20.
Full Swath Analysis
In the embodiments described above, the image data for a single swath has preferably been segmented as delivered from the sensor array 26, such as into four quarter portions. It is appreciated that other segmentations could also be used. However, in some embodiments, no segmentation of the image data is desirable. Such an embodiment would, for example, allow for a greater portion of the imaged substrate to be used for detection of anomalies, such as defects. Such segmentation can be specified, for example, by the job manager 14, and implemented in one or more of the various components that are generally referred to as the sensor array 26 herein.
As described elsewhere above, the process nodes 20 preferably contain sufficient memory, either within themselves or within the buffer memory 104, to enable continued acquisition of image data even if the rate of analysis of the image data in the process node 20 falls behind the rate of image data acquisition. The process nodes 20 may also contain sufficient memory so that an entire swath width of the image data may be sent to a single column 36, 38, 40, or 42 of process nodes 20, without segmenting the image data.
The architecture of the inspection system 10 would not need to change from that as depicted in FIG. 1. Rather, the job manager 14 could instruct the appropriate elements of the sensor array 26 to provide the entire swath of the image data along a single output of network 58 to a single column of the node array 60. Alternately, the architecture of the node array 60 could be changed to a single column. However, accomplishing the image data delivery as described in this section by using instructions to the sensor array 26 rather than altering the architecture of the node array 60 provides for a much more adaptable inspection system 10.
To implement such an embodiment, each process node 20 would preferably have about six gigabytes of memory, which could either be resident in the process node 20 itself, or within the buffer memory 104.
Mirror Node Verification
One goal of inspection system 10 is to maintain consistent and uniform processing by each of the process nodes 20. Each process node 20 in the node array 60 preferably produces a report that is substantially similar to the report that would be generated by any other process node 20 in the node array 60. Ensuring that this condition is met is of particular concern when new hardware or software is introduced into the inspection system 10.
In the preferred embodiment, a new process node 20 is configured to mirror one of the existing process nodes 20 within the node array 60. The job manager 14 is preferably configured to send instructions to both the existing process node 20 and the mirror node. Most preferably, the instructions are redundant in the case of the mirror node, so that the results from the mirror node can be compared to the results from the existing process node 20. The mirror node is preferably programmed by the job manager 14 to produce the output that the process node 20 produces, including information such as defect results, images, histograms, and projections.
The mirror node can exist in various logical positions within the inspection system 10. for example, the mirror node may be disposed within the node array 60, such as on one of the deeper rows 28 or 30, so that it resides within a row that can be turned off in regard to normal image data processing, without substantially effecting the throughput of the inspection system 10. Alternately, the mirror node can be on the network 56, such as through the switch 18, but be logically outside of the node array 60, in that it does not reduce the computational ability of the node array 60 in any manner.
In yet another embodiment, the mirror node can be placed anywhere within the node array 60, but the job manager 14 instructs the inspection system 10 to always have the process node 20 that is one row deeper within the same column of the node array 60 to also process the image data that is received by the mirror node. This is accomplished such as by the interface 22 reflecting all of the image data that is received by the mirror node back out along the network 58 to be received by the next deeper process node 20, which is connected to the network 58 in the daisy chain topology, as described in more detail elsewhere herein.
The job manager 14 preferably verifies whether the mirror node and the process node 20 produce results that are in agreement within an allowable tolerance. If they are not, then there is a problem with one or more of the mirror node and the process node 20, and the job manager 14 reports this condition. The job manager 14 is preferably programmed to not reject an inspected substrate based upon either a bad report from the mirror node or a discrepancy between the mirror node and the process node 20.
If a discrepancy of too great a size exists between the mirror node and the process node 20, it may be an indication that the mirror node is unacceptable, or alternately, it may be an indication that the process node 20 is faltering. In this manner, the mirror node can be used as a check of the various process nodes 20 within the node array 60. Further yet, a discrepancy may be an indication that both the mirror node and the process node 20 are faulty.
In some embodiments, the mirror node is a candidate computer that is of unknown performance, and the purpose of connecting the mirror node to the inspection system 10 is to determine whether the mirror node is acceptable. In alternate embodiments the mirror node is known to be acceptable, and the purpose of connecting the mirror node to the inspection system 10 is to verify that the process node 20, which may be of unknown performance, is equivalent to the mirror node. In these embodiments the mirror node is a known good computer.
If the mirror node is a candidate computer and the report from the mirror node is unacceptably different from the report provided by the process node 20, then the mirror node is judged to not be acceptable. If the mirror node is a known good computer and the report from the mirror node is unacceptably different from the report provided by the process node 20, then that process node is judged to not be acceptable, and the job manager 14 preferably identifies it as a failed process node 20. Under such circumstances, the reports from the mirror node may be substituted for the reports from the failed process node 20, until the failed process node 20 can be replaced.
In some embodiments, the job manager 14 cyclically transmits the common portion of the image data to the mirror node and the process node 20 for which the reports are being compared. In some embodiments involving cyclical transmission, a regression analysis is performed on the test results to determine differences among some or all of the process nodes 20, and between the process node 20 and the mirror node.
Offline Program Optimization
As inspection systems 10 become more complex, it becomes more difficult to create inspection recipes that find all the defects that the inspection system 10 is capable of finding. Highly trained application engineers can create excellent recipes, but this requires both a highly trained application engineer and machine time on the analysis system 10. Because users often do not have such expertise, the inspection system 10 might be operated with inefficient or ineffectual recipes. Even with the requisite expertise, the machine time necessary may make the tuning process counterproductive for many users.
Offline recipe optimization is intended to address this situation, by allowing a user to create better recipes. There are preferably three basic steps that are used to implement off line recipe optimization, as given below.
First, enough of the image data from a substrate is stored so that different recipes can be run on the stored image data while varying the operating parameters of the inspection system 10. It is preferably not necessary to store the image data from an entire substrate. It is, however, preferred to be able to store multiple partial substrate images that are acquired, such as with different pixel sizes and optics modes, like full sky and edge contrast.
The second step is to manually score the candidate defects. A human preferably reviews the candidate defects found by a fairly sensitive recipe run on the stored portions of the substrate. The human is preferred to determine which anomalies are real defects and which are nuisance defects. The inspection system 10 preferably groups the candidate defects so that the human scoring can go quickly. The set of real defects preferably constitutes the training set.
The third step is machine learning. Given a known input set, which is the stored image data from step one, and a known output set, which is the training set from step two, it is a straightforward machine learning problem to optimize the recipe, using methods such as hill climbing, simulated annealing, and genetic algorithms.
The following descriptions focus primarily on storing the image data. With reference now to FIG. 3, the preferred approach is to build a storage cluster 300 of storage nodes 310, such as Macintosh XServe computers. Other computers could also be used, as explained in more detail elsewhere herein. A network 312 preferably connects some of the process nodes 20 to the storage cluster 300. In a most preferred embodiments, gigabit Ethernet is used for the network 312, which enables the network lines to be connected to the switch 18, if it exists in the embodiment of the inspection system 10. With two gigabit Ethernet controllers in each of the storage nodes 310, port bonding is preferably used to make the gigabit Ethernet connection appear to be two gigabits per second instead of one gigabit per second. Most preferably, the connections are made through a switch 316.
The storage cluster 300 preferably includes a host computer 314. The host 314 preferably network boots the storage nodes 310 and enables the storage cluster 300 to be used as a standalone simulator for the inspection system 10. This capacity is useful for playback optimization.
If image data for a substrate is to be saved, the job manager 14 preferably distributes the jobs such that one column of the process nodes 20 does all the defect detection and the other columns send image data to the storage Cluster 300. Moving the image data into the process node 20 by direct memory access from the interface 22, and sending the image data over the network 312 to be saved is preferably accomplished concurrently in the one or more columns of the node array 60 that the job manager 14 instructs to perform such functions. In a single column node array 60, the single column preferably does each step in turn. Saving the image data will tend to slow down the analysis system 10 to the extent that that analysis of the image data on a single column of the node array 60 will be sufficient.
The storage nodes 310 preferably include large amount of storage capacity for saving the image data. Preferably, the storage capacity is provided by hard drives, which are most preferably configured in a redundant array of inexpensive disks, or RAID. Various RAID configurations can not only provide data redundancy, but can also provide reduced data read and write times. As the amount of the image data that is produced tends to be extreme, as described elsewhere herein, the enhanced speed of a RAID is a benefit for the storage nodes 310.
In one embodiment, the image data is stored in a directory structure where a given substrate is specified by a top-level directory, and each mode (pixel size, optics mode) that was sampled resides in a subdirectory. Within a given substrate mode directory, there is a recipe file specifying how the given image data was collected, and a collection of swath directories. Within each swath directory are sub-swath directories, reflecting how the image data is partitioned coming off the sensor. The image data for a given sub-swath can reside in a single large image file or in multiple image files. Additionally, each sub-swath directory can contain additional data files if desired. Each storage node 310 only needs to see that sub-set of the directory structure that it reads or writes to.
In various alternate embodiments, the RAID can be placed within the process nodes 20 of one of more columns of the node array 60. The image data can alternately be provide to the storage cluster 300 via the high speed network 58. Further still, the process nodes 20 of one or more of the columns in the node array 60 can be individually connected to one storage node 310 each, rather than having all image data traffic flowing on a common network, as depicted in FIG. 4.
In this manner, large amounts of image data can be stored, so that it can be used for a variety of purposes, such as using the image data off line to optimize recipes for the inspection system 10.
The foregoing description of preferred embodiments for this invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Obvious modifications or variations are possible in light of the above teachings. The embodiments are chosen and described in an effort to provide the best illustrations of the principles of the invention and its practical application, and to thereby enable one of ordinary skill in the art to utilize the invention in various embodiments and with various modifications as are suited to the particular use contemplated. All such modifications and variations are within the scope of the invention as determined by the appended claims when interpreted in accordance with the breadth to which they are fairly, legally, and equitably entitled.

## Claims

1. A system comprising:
a sensor array adapted to provide image data,
a process node connected to the sensor array and adapted to analyze portions of the image data,
a job manager connected to the process node and adapted to instruct the process node to send the portions of the image data to a storage node, and
the storage node adapted to receive and store the sent portions of the image data,
wherein the image data is sent from the sensor array to the process node on a first network and the sent portions of the image data are sent from the process node to the storage node on a second network.

2. The system of claim 1 wherein the storage node includes a RAID.

3. The system of claim 1 wherein the storage node is selectively severable from the process node.

4. The system of claim 1 further comprising a storage node host connected to the storage node and adapted to configure the storage node.

5. The system of claim 1 wherein the storage node comprises a RAID disposed within the process node.

6. The system of claim 1 wherein the process node comprises a plurality of process nodes.

7. The system of claim 1 wherein the storage node comprises a plurality of storage nodes.

8. The system of claim 1 wherein the image data is sent from the sensor array to the process node on a fiber optic network and the sent portions of the image data are sent from the process node to the storage node on a gigabit Ethernet network.

9. The system of claim 1 wherein the process node comprises a plurality of process nodes and the storage node comprises a plurality of storage nodes, and the sent portions of the image data sent from the process nodes to the storage nodes is communicated on a single second network.

10. The system of claim 1 wherein the process node comprises a plurality of process nodes and the storage node comprises a plurality of storage nodes, and the sent portions of the image data sent from a given one of the process nodes is communicated on a dedicated second network to an associated given one of the storage nodes.

11. A method for developing an inspection system recipe, the method comprising the steps of:
creating image data,
storing the image data,
manually scoring to determine a first defect set,
iteratively processing the image data with different settings until a second defect set as determined by the inspection system matches the first defect set to within a desired degree.

12. The method of claim 11, wherein the image data is stored on a storage node while the image data is concurrently analyzed by a process node.

13. A system comprising:
an analysis system having a sensor array and at least one process node coupled to the sensor array to receive image data,
a storage cluster having at least one storage node,
a network coupled between the analysis system and the storage cluster, and
a job manager adapted to transmit the image data over the network from the at least one process node to the at least one storage node,
wherein the image data is sent from the sensor array to the process node on a first network and the image data is sent from the analysis system to the storage cluster on a second network.

14. The system of claim 13 wherein the storage node includes a RAID.

15. The system of claim 13 wherein the storage cluster is selectively severable from the analysis system.

16. The system of claim 13 further comprising a storage cluster host connected to the storage node and adapted to configure the storage node.

17. A method of processing image data, the method comprising the steps of:
generating image data with a sensor array,
sending the image data from the sensor array to a process node on a first network,
analyzing portions of the image data with the process node,
instructing the process node to send portions of the image data to a storage node using a job manager that is connected to the process node,
sending the portions of the image data from the process node to the storage node on a second network, and
storing the sent portions of the image data on the storage node.