Non-destructive inspection system for display panel and method, and non-destructive inspection apparatus thereof

A non-destructive inspection apparatus includes a light source generating light, an optical coupler which divides the light, irradiates the divided light to a reference part and a sample part, generates coherent light, and transmits the coherent light to a detecting part, the reference part which phase-scans the irradiated light and reflects the light, the sample part which irradiates the light incident from the optical coupler to a display panel, and scans and reflects the light reflected from the display panel, the detecting part which obtains an image signal of the display panel from the coherent light, a transferring part which moves a position of the sample part, and the control part which generates an image of the display panel based on the image signal of the display panel transmitted from the detecting part and detects a foreign substance, and controls movement of the transferring part.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority benefit of Korean Patent Application No. 10-2013-0139188, filed on Nov. 15, 2013 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.

BACKGROUND

The following description relates to a non-destructive inspection system for a display panel and method using a real-time optical tomography technique, and a non-destructive inspection apparatus thereof.

2. Description of the Related Art

Recently, as demand for portable electronic products such as smartphones and tablets has increased, the use of touchscreen panels providing intuitive user interfaces and convenience as input devices such as keyboards has increased. A market for the touchscreen panels is growing rapidly all over the world. Also, various display devices and panels have been gradually developed to have highly multiple and ultra-thin layers, ultra-fine pattern arrays, and integrated chips-packages, and thus, a manufacturing technique thereof has made much progress.

However, in spite of such progress, an inspection method for detecting a defect in an ultra-thin touchscreen panel, or monitoring whole processes and finding a cause of the defect is still reliant on destructive inspection or visual inspection by an operator.

In the past, the inspection could be performed manually. However, in a current touchscreen manufacturing technique similar to a semiconductor manufacturing process, a new method which monitors whole processes in real time and enhances reliability for a complete product is required.

SUMMARY

Therefore, it is an aspect of the present disclosure to provide a non-destructive inspection system for a display panel and method, which non-destructively inspects a defect in producing and manufacturing processes of a touchscreen panel having multiple layers, and the display panel using the same, and a non-destructive inspection apparatus thereof.

In accordance with an aspect of the present disclosure, a non-destructive inspection apparatus includes a light source generating light, an optical coupler which divides the light generated from the light source, irradiates the divided light to a reference part and a sample part, generates coherent light by combining light reflected and incident from the reference part and the sample part, and transmits the coherent light to a detecting part, the reference part which phase-scans the light incident from the optical coupler at a high speed and then reflects the light, the sample part which irradiates the light incident from the optical coupler to a display panel to be inspected, and scans and reflects the light reflected from the display panel, the detecting part which obtains an image signal of the display panel from the coherent light incident from the optical coupler, a transferring part which moves a position of the sample part up and down according to controlling of a control part so that the display panel is located at a predetermined scan area, and the control part which generates an image of the display panel based on the image signal of the display panel transmitted from the detecting part and detects a foreign substance, and also controls movement of the transferring part.

The sample part may include a first collimating lens which converts incident light into parallel light, a scanner which reflects the parallel light incident from the first collimating lens so that the parallel light is irradiated to a photographing area of the display panel, and a scanning lens which controls focus of the parallel light irradiated through the scanner so that the parallel light is concentrated to one point.

The scanner may control the parallel light output from the first collimating lens in an irradiation direction and may perform scanning in an X-axial direction and a Y-axial direction of the display panel.

The detecting part may obtain a two-dimensional image signal based on a plurality of coherent light beams incident, in turn, according to controlling of the irradiation direction of the parallel light of the scanner.

The scanner may be a galvano-scan mirror.

The control part may generate a one-dimensional cross-sectional display panel image, a two-dimensional tomographic display panel image, and a three-dimensional display panel image based on the image signal transmitted from the detecting part.

The control part may determine whether the foreign substance exists through the one-dimensional cross-sectional display panel image, may determine whether the foreign substance exists between layers and a size of the foreign substance through the two-dimensional tomographic display panel image, and may determine a volume and shape of the foreign substance through the three-dimensional display panel image.

The reference part may include a second collimating lens which converts incident light into parallel light, a first focusing lens which controls focus of the parallel light transmitted through the second collimating lens so that the parallel light is concentrated to one point, and a reference mirror which changes an optical path to reflect the light incident from the first focusing lens.

The detecting part may include a third collimating lens which converts coherent light incident from the optical coupler into parallel light, a diffraction grid which distributes the parallel light according to wavelengths, a second focusing lens which controls focuses of the distributed parallel light so that the distributed parallel light is concentrated to each point according to each wavelength, and a spectrometer which scans the light in a line state incident from the second focusing lens and generates an image signal.

The spectrometer may include a line scan camera comprising a complementary metal-oxide-semiconductor (CMOS) camera and a charge coupled device (CCD) camera.

The non-destructive inspection apparatus may further include a photographing part which is disposed at a position spaced upward from the display panel located on an inspection table to photograph a surface of the display panel and thus primarily detect a foreign substance estimation area on the display panel.

The display panel may be a touchscreen panel or a display device to which the touchscreen panel is applied.

In accordance with an aspect of the present disclosure, a non-destructive inspection system which is connected with a non-destructive inspection apparatus to detect a foreign substance in a display panel includes an image signal processing part which generates an image of the display panel from an image signal of an electrical signal type transmitted from the non-destructive inspection apparatus, a foreign substance detecting part which determines existence of the foreign substance by comparing the image of the display panel with a previously stored reference image, calculates a size of the determined foreign substance, compares the calculated size with a predetermined reference size of the foreign substance, and thereby determines a defect is present when the calculated size exceeds the predetermined reference size of the foreign substance, and a displaying part which displays a real-time monitoring state of the display panel generated from the image signal processing part.

The non-destructive inspection apparatus may include a sample part for irradiating light to the display panel and a transferring part which moves a position of the sample part up and down, and the non-destructive inspection system may further include a focusing control part which compares brightness of a particular area of the image of the display panel, which is obtained by scanning the display panel using the sample part, with reference brightness, and controls an up and down position of the sample part through the transferring part according to comparison results.

The focusing control part may fix the sample part to a present position, when the brightness of the particular area of the image of the display panel exceeds the reference brightness, and may move the position of the sample part up and down when the brightness of the particular area of the image of the display panel is less than or equal to the reference brightness.

The image signal processing part may include an A/D converter which converts an analog type image signal output from the non-destructive inspection apparatus into a digital type image signal, and an image generating part which generates a display panel image based on the digital type image signal, generates a one-dimensional cross-sectional display panel image and a two-dimensional tomographic display panel image based on the digital signal, and generates a three-dimensional display panel image for each layer of the display panel based on the two-dimensional tomographic display panel image.

The foreign substance detecting part may include a foreign substance size calculating part which detects the foreign substance by comparing the image of the display panel with a previously stored reference image and calculates a size of the foreign substance through location coordinates of the foreign substance from the image of the display panel, and a foreign substance deciding part which decides a defect when the size of the foreign substance calculated through the foreign substance detecting part exceeds the predetermined reference size of the foreign substance.

The display panel may be a touchscreen panel or a display device to which the touchscreen panel is applied.

In accordance with an aspect of the present disclosure, a non-destructive inspection method may include dividing light emitted from a light source and irradiating the divided light to a reference part and a sample part through a non-destructive inspection apparatus, phase-scanning light incident from an optical coupler at a high speed and then reflecting the light through the reference part, irradiating light incident from the optical coupler to a display panel to be inspected, and scanning and reflecting the light reflected from the display panel through the sample part, generating a one-dimensional display panel image based on light incident from the reference part and the sample part, generating a two-dimensional display panel image based on image signals obtained in turn, and generating a three-dimensional display panel image based on the two-dimensional display panel image.

The non-destructive inspection method may further include primarily determining a foreign substance estimation area located on a surface of the display panel, before the dividing of light and the irradiating of the divided light to the reference part and the sample part.

In the irradiating of light to a display panel to be inspected, and the scanning and reflecting of the light reflected from the display panel, when irradiating the light to the display panel, the light may be irradiated along a predetermined observation range on the basis of the foreign substance estimation area.

When the light is irradiated along the predetermined observation range, the light may be irradiated to a single point.

The non-destructive inspection method may further include calculating a size of a foreign substance from the two-dimensional display panel image, and deciding a defect when the calculated size of the foreign substance exceeds a predetermined size of the foreign substance, after the generating of a three-dimensional display panel image.

The non-destructive inspection method may further include moving the sample part up and down so that the display panel to be inspected is located at a predetermined scan area before the dividing of light and the irradiating of the divided light to the reference part and the sample part.

DETAILED DESCRIPTION

Objects, particular advantages, and novel characteristics of the present disclosure will be more apparent from the following detailed description and preferred embodiments in connection with the accompanying drawings. In the drawings, the same components are designated by the same reference numerals, even though they are depicted in different drawings. In the following description, if it is considered that the specific description of the related and noticed functions or structures may obscure the gist of the present disclosure, the specific description will be omitted. Furthermore, the terms first, second, and the like in the description and in the claims are used for distinguishing one component from other components, and thus the components should not be limited by the terms.

Embodiments of the present disclosure will be described herein below with reference to the accompanying drawings.

FIG. 1is a view illustrating an external appearance of a non-destructive inspection apparatus.

As illustrated inFIG. 1, a non-destructive inspection apparatus10may include an inspection table11on which a display panel S to be inspected is located, a photographing part13which photographs a surface of the display panel S and primarily detects a foreign substance estimation area, and an optical coherence tomography (OCT) device15which obtains a one-dimensional cross-sectional display panel image, a two-dimensional tomographic display panel image, and a three-dimensional rendering display panel image of the display panel S through an optical tomography technique, and detects foreign substances. The foreign substance estimation area refers to an estimated area in which it is estimated that the foreign substances exist. The foreign substance estimation area may be detected through the obtained images.

Also, the OCT device15may determine a size of each of the foreign substances, a position of a corresponding layer on which the foreign substances exist, and a volume of each of the foreign substances, as well as whether the foreign substances exist through the obtained one-dimensional, two-dimensional, and three-dimensional images. Also, the display panel to be inspected may be a touchscreen panel having multiple layers, or a display device to which the touchscreen panel is applied, such as a mobile phone, a personal digital assistant (PDA), a portable multimedia player (PMP), or a laptop, for example. The display panel is not limited thereto and may include home appliances, such as a television or a refrigerator, for example, which have a multilayered structure like in the touchscreen panel, or to which the touchscreen panel is applied. The display panel may include a flexible display.

The non-destructive inspection apparatus10as described above determines a defect generated by foreign substances, such as air bubbles or fine dust, for example, in a touchscreen panel manufacturing process or a display panel manufacturing process, including a process of bonding the touchscreen panel to the display panel S, using the one-dimensional, two-dimensional, and three-dimensional images obtained in real time.

FIG. 2is a block diagram illustrating a configuration of the non-destructive inspection apparatus, andFIG. 3is a detailed view illustrating a partial configuration of the non-destructive inspection apparatus.

Hereinafter, description will be provided with reference toFIG. 9illustrating a structure of the touchscreen panel to be inspected,FIG. 10illustrating an example of the one-dimensional cross-sectional image obtained through a non-destructive inspection,FIG. 11illustrating an example of the two-dimensional tomographic image obtained through a non-destructive inspection, andFIG. 12illustrating an example of the three-dimensional rendering image obtained through a non-destructive inspection.

As illustrated inFIG. 2, the non-destructive inspection apparatus10may include a light source100generating light, an optical coupler200, a sample part300, a reference part400, a transferring part500, a detecting part600, and a control part700. The light source100, the sample part300, the reference part400, the transferring part500, and the detecting part600may be embodied in the OCT device15, but the disclosure is not limited thereto.

More specifically, the optical coupler200may divide light L1generated from the light source100into light L2and light L3, may output the divided light to the reference part400and the sample part300, may generate coherent light L4by combining the light L2and light L3reflected and incident from the reference part400and the sample part300, and then may transmit the coherent light L4to the detecting part600. The optical coupler200may divide a broadband source in a ratio of 50:50, but the disclosure is not limited thereto.

The sample part300may irradiate the light L2incident from the optical coupler200to a display panel (350ofFIG. 3) to be inspected and may scan and reflect the light reflected from the display panel350. The display panel350may be a touchscreen panel having multiple layers (e.g., a touchscreen panel having multiple layers in the order of polarizer/glass/cell/glass/polarizer ofFIG. 9) or a display device to which the touchscreen panel is applied. However, the display panel350is not limited thereto and may include home appliances, such as a television or a refrigerator, for example, to which the touchscreen panel is applied.

As illustrated inFIG. 3, the sample part300may include a first collimating lens310converting incident light into parallel light, a scanner320reflecting the parallel light incident from the first collimating lens310so that the parallel light is irradiated to a photographing area of the display panel350, and a scanning lens330controlling focus of the parallel light irradiated through the scanner320so that the parallel light is concentrated to one point. The sample part300may further include a polarization controller340which is disposed between the optical coupler200and the first collimating lens310to output polarized light. Also, the scanner may be a galvano-scan mirror.

That is, the sample part300converts the light output from the optical coupler200into the parallel light through the first collimating lens310and then irradiates the light beam concentrated through the scanner320and the scanning lens330to the display panel350to be inspected. And reflected light back-scattered by a scatterer of the display panel350is incident again to the optical coupler200through the scanning lens330, the scanner320, and the first collimating lens310.

The scanner320may control the parallel light output from the first collimating lens310in an irradiation direction and thus may perform scanning in an X-axial direction (a transverse direction) and a Y-axial direction (a longitudinal direction) of the display panel350. Therefore, the detecting part600may obtain a two-dimensional image signal based on a plurality of coherent light beams incident, in turn, according to controlling of the irradiation direction of the parallel light of the scanner320. That is, it is possible to obtain a two-dimensional tomographic display panel image through connection of the plurality of coherent light beams obtained, in turn, while the scanner320is moved. A three-dimensional image signal is obtained based on the obtained two-dimensional image signal.

The reference part400may phase-scan the light L3incident from the optical coupler200at a high speed and then may reflect the light L3.

As illustrated inFIG. 3, the reference part400may include a second collimating lens410converting incident light into parallel light, a first focusing lens420controlling focus of the parallel light transmitted through the second collimating lens410so that the parallel light is concentrated to one point, and a reference mirror430changing an optical path to reflect the light incident from the first focusing lens420. The reference part400may further include a polarization controller440which is disposed between the optical coupler200and the second collimating lens410to output polarized light.

The detecting part600may obtain an image signal of the display panel350from the coherent light L3incident from the optical coupler200. The detecting part600may include a photographing device having an OCT function. Therefore, the detecting part600may obtain pixel information on pixels of the photographing device. The pixel information may be used in determining a size of the foreign substance from an image of the display panel.

As illustrated inFIG. 3, the detecting part600may include a third collimating lens610converting the coherent light L4incident from the optical coupler200into parallel light, a diffraction grid620distributing the parallel light according to wavelengths, a second focusing lens630controlling focuses of the distributed parallel light so that the distributed parallel light is concentrated to each point according to each wavelength, and a spectrometer640scanning the light in a line state incident from the second focusing lens630and generating an image signal.

The spectrometer640may include a line scan camera including a complementary metal-oxide-semiconductor (CMOS) camera and a charge coupled device (CCD) camera.

The transferring part500may move a position of the sample part300up and down according to controlling of the control part700so that the display panel350is located at a predetermined scan area. Referring toFIG. 1, the transferring part500adjusts a distance I between the display panel (S ofFIG. 1) located on the inspection table11(FIG. 1) and a head portion (an OCT head) of the sample part300according to the controlling of the control part700and enables automatic focusing. Accordingly, because a series of operations relevant to the inspection of the foreign substances in the display panel may be performed automatically and the focusing for obtaining an image may be performed more precisely, it is possible to enhance reliability for inspection results of the foreign substances in the display panel.

The control part700may generate an image of the display panel350based on the image signal of the display panel350transmitted from the detecting part600and may detect the foreign substances, and also may control movement of the transferring part500. However, the control part700is not limited thereto and may control other operations of the non-destructive inspection apparatus10.

More specifically, the control part700may generate a one-dimensional cross-sectional display panel image (referring toFIG. 10), a two-dimensional tomographic display panel image (referring toFIG. 11) and a three-dimensional display panel image (referring toFIG. 12) based on the image signal transmitted from the detecting part600. The two-dimensional tomographic display panel image may be obtained through the coherent light obtained by that the scanner320of the sample part300irradiates the light to the display panel350while controlling the irradiation direction and then scans, in turn, the light reflected from the display panel350.

For example, as illustrated inFIG. 9, because the touchscreen panel and the display panel to which the touchscreen panel is applied have multiple layers (polarizer/glass/cell/glass/polarizer) of which each is made of a different material, different refractive indexes N may appear on a one-dimensional cross-section, as illustrated inFIG. 10. Also, intensity of the touchscreen panel and an ultraviolet adhesive may also appear differently. Due to this principle, if an area in an object to be inspected, which exceeds a standard value of a refractive index according to each material, is found, it may be determined that a foreign substance exists.

Also, the control part700may determine whether the foreign substance exists through the one-dimensional cross-sectional display panel image, may determine whether the foreign substance A (FIG. 11) exists between layers and a size of the foreign substance through the two-dimensional tomographic display panel image, and may determine each volume and shape of the foreign substances B1, B2, and B3(FIG. 12) through the three-dimensional display panel image. In the two-dimensional tomographic display panel image according to the present disclosure, the foreign substance may be displayed as A ofFIG. 11, and in the three-dimensional display panel image, each shape of the foreign substances may be displayed as B1, B2, and B3ofFIG. 12.

As illustrated inFIG. 1, the non-destructive inspection apparatus10may further include the photographing part13which is disposed at a position above the display panel S located on the inspection table11to photograph the surface of the display panel S and thus primarily detect the foreign substance estimation area on the display panel S. Therefore, when the sample part300irradiates the light to the display panel350, the light may be irradiated along a predetermined observation range on the basis of the foreign substance estimation area. At this time, when the light is irradiated along the predetermined observation range, the light may be irradiated to a single point.

FIG. 4is a view illustrating a configuration of a non-destructive inspection system,FIG. 5is a view illustrating a configuration of an image signal processing part, andFIG. 6is a view illustrating a configuration of a foreign substance detecting part. Hereinafter, a non-destructive inspection system800in which the control part700ofFIG. 2is described more specifically will be described with reference to the drawings.

As illustrated inFIG. 4, the non-destructive inspection system800which is connected with the non-destructive inspection apparatus to detect the foreign substance in the display panel may include an image signal processing part810, a foreign substance detecting part820, a displaying part830, a focusing control part840, a database850, and a control part860.

More specifically, the image signal processing part810may generate the image of the display panel from an image signal of an electrical signal type transmitted from the non-destructive inspection apparatus10. The display panel (350ofFIG. 3) may be a touchscreen panel or a display device to which the touchscreen panel is applied.

As illustrated inFIG. 5, the image signal processing part810may include an A/D converting part811which converts an analog type image signal output from the non-destructive inspection apparatus10into a digital type image signal, and an image generating part813which generates a display panel image based on the digital type image signal, generates the one-dimensional cross-sectional display panel image and the two-dimensional tomographic display panel image based on the digital signal, and generates the three-dimensional display panel image for each layer of the display panel based on the two-dimensional tomographic display panel image.

The foreign substance detecting part820may determine the existence of the foreign substance by comparing the image of the display panel with a previously stored reference image, may calculate a size of the determined foreign substance, may compare the calculated size with a predetermined reference size of the foreign substance, and thereby may determine a defect is present when the calculated size exceeds the predetermined reference size of the foreign substance.

As illustrated inFIG. 6, the foreign substance detecting part820may include a foreign substance size calculating part821which detects the foreign substance by comparing the image of the display panel with the previously stored reference image and calculates the size of the foreign substance through location coordinates of the foreign substance from the image of the display panel, and a foreign substance deciding part823which determines a defect is present when the size of the foreign substance calculated through the foreign substance size calculating part821exceeds the predetermined reference size of the foreign substance.

The displaying part830may display a real-time monitoring state of the display panel generated from the image signal processing part810.

The focusing control part840may compare a brightness of a particular area of the display panel image, which is obtained by scanning the display panel350using the sample part300(FIG. 2), with a reference brightness, and may control an up and down position of the sample part300through the transferring part500(FIG. 2) according to the comparison results.

When the brightness of the particular area of the display panel image exceeds the reference brightness, the focusing control part840may fix the sample part300to a present position, and when the brightness of the particular area of the display panel image is less than or equal to the reference brightness, the focusing control part840may move the position of the sample part300up and down. That is, the focusing control part840controls a distance between the display panel350and the OCT head (referring toFIG. 1) of the sample part300, which irradiates light to the display panel350, in order to obtain a high quality display panel image.

As illustrated inFIG. 7, the non-destructive inspection apparatus10may move the sample part300up and down so that the display panel350to be inspected is located at the predetermined scan area (operation S101).

More specifically, the non-destructive inspection apparatus10may set an initial distance between the sample part300and the display panel350located on the inspection table11, may scan the display panel350through the sample part300, and thus may obtain the display panel image. The non-destructive inspection apparatus10may compare the brightness of the particular area of the display panel image with the reference brightness, fix the sample part300to the present position when the brightness of the particular area of the display panel image exceeds the reference brightness, and move the position of the sample part300up or down when the brightness of the particular area of the display panel image is less than or equal to the reference brightness.

The non-destructive inspection apparatus10may divide the light emitted from the light source100and then may output to the reference part400and the sample part300(operation S103).

The reference part400may phase-scan the light incident from the optical coupler200at a high speed and reflect the light (operation S105).

The sample part300may irradiate the light incident from the optical coupler200to the display panel350to be inspected, scan the light reflected from the display panel350to be inspected, and reflect the light (operation S107).

The operation S105and the operation S107may be performed at the same time, or the operation S107may be performed before the operation S105.

The display panel image may be generated based on the light incident from the reference part400and the sample part300(operation S109).

In the operation S109, the non-destructive inspection apparatus10may generate the one-dimensional display panel image based on the light incident from the reference part400and the sample part300, may generate the two-dimensional display panel image based on the image signal obtained in turn, and may generate the three-dimensional display panel image based on the two-dimensional display panel image.

Meanwhile, although not shown, before the operation S103of dividing the light and then irradiating the divided light to the reference part and the sample part, the non-destructive inspection apparatus10may primarily determine the foreign substance estimation area on the surface of the display panel350through the photographing part13(FIG. 1).

Therefore, in the operation S107, when irradiating the light to the display panel350, the light may be irradiated along a predetermined observation range on the basis of the foreign substance estimation area. At this time, when the light is irradiated along the predetermined observation range, the light may be irradiated to a single point. By concentrically performing the foreign substance inspection within the predetermined observation range on the basis of the foreign substance estimation area, it is possible to rapidly and precisely perform the foreign substance inspection, compared to a case of irradiating the light over an entire surface of an object to be inspected.

Operations in the flowchart ofFIG. 8may be carried out after the operation S109.

As in operation S109, the display panel image may be generated based on the light incident from the reference part400and the sample part300(operation S201).

The non-destructive inspection apparatus10may calculate the size of the foreign substance from the two-dimensional display panel image (operation S203).

More specifically, the non-destructive inspection apparatus10detects the foreign substance by comparing the display panel image with the previously stored reference image and calculates the size of the foreign substance through the location coordinates of the foreign substance.

the non-destructive inspection apparatus10checks whether the calculated size of the foreign substance exceeds the predetermined size of the foreign substance (operation S205), and it is possible to determine whether a defect is present, when the calculated size of the foreign substance exceeds the predetermined size of the foreign substance (operation S207).

Because the method of inspecting the defect of the display panel using the non-destructive inspection apparatus may determine a corresponding layer on which the foreign substance exists as well as whether the foreign substance exists in each layer of the display panel, through the two-dimensional and three-dimensional images, and may also determine the size and volume of the foreign substance, it is possible to enhance reliability for the inspection results, compared to the conventional method of inspecting only a surface of a product. Also, because it is possible to determine the layer on which the foreign substance exists, only the corresponding layer may be replaced when the defect is found, and thus it is possible to improve productivity and reduce production costs, compared to a conventional case in which an entire defective product may be scrapped.

In accordance with an aspect of the non-destructive inspection system for the display panel and method, and the non-destructive inspection apparatus thereof, because the size and position of the foreign substance may be non-destructively provided in real time, it is possible to secure efficiency and reliability in the manufacturing process.

Also, because the display panel is inspected using the real-time OCT technique, it is possible to determine detailed information of the foreign substance, such as the size and volume of the foreign substance and whether the foreign substance exists between layers, through the one-dimensional, two-dimensional, and three-dimensional images, when the defect occurs.

The above-described embodiments may be recorded in computer-readable media including program instructions to implement various operations embodied by a computer. The media may also include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the purposes of embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM disks and DVDs; magneto-optical media such as optical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like. The computer-readable media may also be a distributed network, so that the program instructions are stored and executed in a distributed fashion. The program instructions may be executed by one or more processors. The computer-readable media may also be embodied in at least one application specific integrated circuit (ASIC) or Field Programmable Gate Array (FPGA), which executes (processes like a processor) program instructions. Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter. The above-described devices may be configured to act as one or more software modules in order to perform the operations of the above-described embodiments, or vice versa.