Patent Description:
In steel plants, for example, it is necessary to promptly detect the occurrence of corrosion pits in pipes and deterioration of electrical facilities, and then carry out repair and other works. The detection often involves measuring sound waves emitted when a gas leaks through the corrosion pits in pipes or when corona discharge occurs in the electrical facilities. Measurement of sound waves in the audible range is significantly affected, for example, by ambient noise. Since this may interfere with accurate detection of abnormalities, ultrasound is typically measured to detect abnormalities in various facilities.

A technique has been known in which, for the purpose of determining the incoming direction of waves, such as sound waves including ultrasound or electromagnetic waves, a plurality of sensors are used to determine the azimuth of a wave source from a time difference (phase difference) between signals received by the sensors. For example, as illustrated in <FIG>, a time difference, t (in seconds), between the times when waves reach two sensors <NUM> is determined by the following formula (<NUM>), where d (mm) is the spacing between the two sensors <NUM>, and θ is the angle of a wave incoming direction (indicated by a thick arrow in the drawing) with respect to the front direction of the sensor <NUM>. The wave incoming direction, θ, is identified using t.

The technique used in practice to determine a wave source azimuth by applying the formula (<NUM>) described above may generally be called beamforming. For a predetermined wave incoming direction, θ<NUM>, with respect to the front direction of a sensor, beamforming delays one sensor signal by a propagation delay time (t<NUM>) calculated from the angle (θ<NUM>) and adds the delayed sensor signal to the other sensor signal. When θ<NUM> coincides with the wave source azimuth, the waveforms of the sensors are in phase. Superimposition of waves is thus maximized, and θ<NUM> is regarded as the wave source azimuth. Although the description above refers to using two sensors, the same principle may be applied to the case of using three or more sensors to determine the wave source azimuth. By performing this processing for all azimuths of the measured object, the wave source azimuth can be determined from the signal intensity and distribution.

For example, Patent Literature <NUM> discloses a technique that uses beamforming.

At the same time, ultrasound detecting apparatuses have been known, which measure the sound pressure of ultrasound using a sensor, such as a microphone or receiving element, to detect, for example, gas leakage from pipes or corona discharge in electrical facilities. The ultrasound detecting apparatuses of this type typically use one sensor.

Other examples of ultrasound detecting apparatuses are provided by <CIT>, which discloses a composite video output device for nondestructive inspection using a composite sensor consisting of an actual image camera, a thermal image camera, and sound and ultrasonic wave array, <CIT>, which discloses a multi-channel ultrasonic acoustic camera for mechanical state monitoring, and <CIT>, which object location detection apparatus, which receives reflected waves reflected by an object at array elements for detecting the location of the object.

Since a conventional ultrasound detecting apparatus measures ultrasound using one microphone, a region for which ultrasound can be measured at one time depends on the directivity of the microphone, and the azimuth from which ultrasound arrives is unknown. Accordingly, a sound collector, such as a parabola, is used to enhance the sensitivity and directivity of the microphone. However, although it is possible in this case to determine the incoming direction of ultrasound, measurement of ultrasound can be made only within a dot-like region. To perform ultrasound measurement on a facility to be measured using this apparatus, a desired range of measurement needs to be finely scanned by the ultrasound detecting apparatus many times. This not only makes the measurement work complex, but also makes it more likely that measurement omissions will occur.

Accordingly, there has been a demand for ultrasound detecting apparatuses capable of thoroughly searching for ultrasound sources in a planar area over a wider measurement range by means of beamforming which involves using a plurality of microphones. However, applying beamforming to ultrasound measurement is difficult due to the following reasons.

Using beamforming may cause so-called grating lobes, where significant aliasing is observed at azimuths different from the azimuth of an actual sound source. The grating lobes are a phenomenon in which, in a composite image (described in detail below), a region where a high sound pressure is recorded appears at a position where no sound source exists. The occurrence of grating lobes becomes more likely as the spacing between receiving elements becomes larger relative to the wavelength of sound waves to be measured. To completely prevent the occurrence of grating lobes, satisfying the following formula (<NUM>) to avoid superimposition of out-of-phase waves is effective.

In the formula (<NUM>), d is the spacing (mm) between receiving elements and λ is the wavelength (mm) of detected sound waves.

Using beamforming to search for ultrasound sources may result in significant determination errors caused by grating lobes, and it is difficult to determine the azimuth of an actual sound source. This is because since ultrasound has a higher frequency and a shorter wavelength (λ) than sound waves in the audible range, it is difficult to make the spacing between receiving elements small relative to the wavelength.

For example, the frequency band of ultrasound used to detect abnormalities in a facility and the sound speed in air are set to <NUM> and <NUM>/second, respectively, and substituting them in the formula (<NUM>) yields λ/<NUM> = <NUM> (mm). That is, to completely prevent the occurrence of grating lobes, the microphone spacing needs to be less than <NUM>. Making the microphone spacing less than <NUM> automatically requires that the diameter of the microphones be less than <NUM>. However, it is difficult in practice to prepare microphones of such a small size.

To solve this problem, Non Patent Literature <NUM> presents a sensor unit in which three ultrasound microphones with a small tip diameter are bundled together and brought as close as possible to one another. With this structure, however, it is difficult to increase the number of microphones. For beamforming, the directivity is wide and this makes it difficult to improve accuracy in azimuth determination.

If the microphone spacing does not satisfy the formula (<NUM>), the occurrence of grating lobes becomes more likely as the search range for measuring ultrasound at one time is widened by using a plurality of microphones.

In the conventional technique, when beamforming, which involves using a plurality of microphones, is used to determine the azimuth of an ultrasound source with a short wavelength, the occurrence of grating lobes cannot be suppressed and it is difficult to correctly identify the azimuth of the sound source.

Additionally, for signal processing of ultrasound with higher frequencies, received ultrasound needs to be sampled at high speed. However, with beamforming, which typically involves using many receiving elements, it is difficult to achieve both high-speed sampling and updating the result of signal processing at a sufficient rate.

The present invention has been conceived in view of the problems described above. An object of the present invention is to provide an ultrasound source azimuth determining apparatus that is compact and capable of measuring ultrasound over a wide search range at one time while reducing the effect of grating lobes, and achieves a practically sufficient level of azimuth determination accuracy and a practically sufficient rate of updating the processing result, and to also provide a composite image analyzing method performed using the ultrasound source azimuth determining apparatus.

The present invention provides an ultrasound source azimuth determining apparatus as defined in independent claim <NUM>, an analyzing method for a composite image as defined in independent claim <NUM> and a composite image analyzing method for analyzing a composite image as defined in independent claim <NUM>.

The present invention provides convenience of portability based on compactness, reduces the effect of grating lobes to achieve accurate identification of ultrasound sources, and enables ultrasound measurement within a wide planar field of view.

<FIG> provides a front view, a back view, and a side view illustrating a general configuration of an azimuth determining apparatus. An ultrasound source azimuth determining apparatus <NUM> (which may hereinafter be simply referred to as "azimuth determining apparatus") according to the present embodiment will be first described using <FIG>.

The azimuth determining apparatus <NUM> according to the present embodiment includes a camera <NUM>, an array sensor <NUM>, a computing means <NUM>, and a display means <NUM>. In the example of <FIG>, as in <FIG>, the camera <NUM> and the array sensor <NUM> are disposed on the front side of a housing <NUM> included in the azimuth determining apparatus <NUM>. Also, as illustrated in <FIG>, the computing means <NUM> is disposed inside the housing <NUM>, and as illustrated in <FIG>, the display means <NUM> is disposed on the back side of the housing <NUM>. The computing means <NUM> may be disposed outside the housing <NUM>.

The camera <NUM> picks up an image of a measured object and outputs the picked-up image to the computing means <NUM>. The picked-up image is used for being superimposed with a two-dimensional sound pressure map of ultrasound obtained by beamforming. The magnification and the field of view of the camera <NUM> can be appropriately adjusted, for example, in accordance with the desired size of a composite image. The camera <NUM> used here may be, for example, a commercially available CCD camera.

The array sensor <NUM> is formed by a plurality of surface mount sensors (hereinafter described as "sensors") <NUM> for ultrasound measurement. The array sensor <NUM> measures ultrasound originating from a direction in which the array sensor <NUM> is directed, and acquires sound pressure information. The sensors <NUM> are, for example, surface-soldered onto a printed circuit board. The sensors <NUM> are as small as about half the size of typical ultrasound microphones and can be densely mounted.

<FIG> is an explanatory diagram illustrating how a camera's field of view and an array sensor's search range in the azimuth determining apparatus relate to a measured object. A search range of the array sensor <NUM> will now be described using <FIG>. As indicated by a solid arrow in the drawing, the array sensor <NUM> can measure the sound pressure of ultrasound within the range of +<NUM>° to -<NUM>° in the horizontal (right-left) direction. <FIG> is a plan view as viewed from above the azimuth determining apparatus <NUM>, and the same applies to a side view as viewed from the right side (or left side) of the azimuth determining apparatus <NUM>. That is, the array sensor <NUM> can also measure ultrasound within the range of +<NUM>° to -<NUM>° in the vertical (up-down) direction. Although the arrangement and spacing of the sensors <NUM> in the array sensor <NUM> will be described later on, the incoming direction and the sound pressure of ultrasound can be measured by using the principle of beamforming for a plurality of sensors. Angles related to the search range of the array sensor <NUM> and the field of view of the camera <NUM> are calculated with respect to a straight line perpendicular to the surface of the azimuth determining apparatus. For example, in the plan view of <FIG>, the angle of the field of view (or search range) extending right and left, with a perpendicular line between the azimuth determining apparatus <NUM> and the measured object <NUM> being <NUM>°, is calculated as an angle in the horizontal direction. Also, in a side view, an angle in the vertical direction is calculated in a similar manner. The right and left (or upper and lower) angles may be positive (+) and negative (-), respectively, or the other way around.

The computing means <NUM> generates a sound pressure map on the basis of sound pressure information obtained by the array sensor <NUM>, and superimposes the picked-up image obtained by the camera <NUM> and the sound pressure map to generate a composite image. As described above, ultrasound measurement by the array sensor <NUM> can be made within the range of ±<NUM>°. To generate a sound pressure map, it is only necessary to search for ultrasound sources within the field of view of the camera <NUM>. For example, a sound pressure map can be generated by simply searching for ultrasound sources within the field of view of the camera <NUM> indicated by a dotted arrow in <FIG>. This eliminates the need for computation for determination of unnecessary azimuths, reduces the load of computation on the computing means <NUM>, and increases the frequency of updating the sound pressure map. According to the invention, the search range of the array sensor <NUM> is in a range narrower than ±<NUM>° and wider than ±<NUM>° in the horizontal and vertical directions. For suppression of the occurrence of grating
lobes, the search range of the array sensor <NUM> is preferably narrower than ±<NUM>° in the horizontal and vertical directions, and more preferably narrower than ±<NUM>° in the horizontal and vertical directions. The search range in the vertical direction and the search range in the horizontal direction may be ranges of different sizes.

The computing means <NUM> outputs the generated composite image to the display means <NUM>, and causes the display means <NUM> to display the composite image. In the composite image, a color corresponding to the intensity of ultrasound is shown for each position in the picked-up image. This makes it possible to readily identify the correspondence between the position in the picked-up image and the distribution of sound pressure of ultrasound. The display means <NUM> used here may be, for example, a liquid crystal display.

<FIG> provides plan views each illustrating an arrangement of sensors <NUM> in the array sensor <NUM>. Each sensor arrangement in the array sensor <NUM> will now be described using <FIG>.

It is preferable, as illustrated in <FIG>, that at least some of the sensors <NUM> of the array sensor <NUM> be arranged in a cruciform on the X-axis and the Y-axis. This enables two-dimensional planar ultrasound measurement, suppresses the occurrence of grating lobes, and reduces dependence on the incoming direction of ultrasound in generating a sound pressure map by computation. The X-axis and the Y-axis may be any two axes that are in the same plane and orthogonal to each other. In particular, it is preferable that the X-axis be parallel to the horizontal plane, and that the Y-axis be orthogonal to the horizontal plane. The sensors <NUM> may be arranged excluding the X-axis and the Y-axis.

The number of the sensors <NUM> forming the array sensor <NUM> is greater than or equal to <NUM> and less than or equal to <NUM>. When the number of the sensors <NUM> is greater than or equal to <NUM>, ultrasound azimuth determination in a plane can be made with a practically sufficient level of stability. When the number of the sensors <NUM> is less than or equal to <NUM>, it is possible not only to prevent an increase in the size of the apparatus caused by the presence of an amplifier and a filter circuit required for each sensor <NUM>, but also to reduce calculation load on the computing means <NUM> and to reduce delay in processing. Thus, without using the computing means <NUM> of large scale, the composite image can be updated at a practically sufficient rate in the compact lightweight apparatus. To prevent variation in measurement accuracy, it is preferable that the sensors <NUM> be symmetrically arranged up and down and right and left.

The computing means <NUM> superimposes the picked-up image and the sound pressure map at regular intervals to update the composite image. The update frequency is preferably three times or more per second, and more preferably five times or more per second. In consideration of the processing speed achievable by the computing means <NUM> of compact size, the number of the sensors <NUM> is preferably <NUM> for updating <NUM> times per second, and the number of the sensors <NUM> may be increased to <NUM> in the case of updating only <NUM> times per second.

The frequency band of ultrasound measured by the array sensor <NUM> may be any frequency higher than the audible range, and may be, for example, about <NUM> or higher. It is preferable, however, that the frequency band of ultrasound measured be <NUM> or higher and <NUM> or lower, with <NUM> being the center. When the frequency band of ultrasound measured is <NUM> or higher, a sufficient S/N ratio can be ensured against background noise caused by audible sound in the environment. When the frequency band of ultrasound measured is <NUM> or lower, since the wavelength to be measured is prevented from becoming too short, the field of view where no grating lobes appear can be prevented from being narrowed.

If the sensors <NUM> are excessively spaced apart in the array sensor <NUM>, the occurrence of grating lobes becomes more likely and this makes it difficult to correctly identify the azimuth of a sound source. To suppress the occurrence of grating lobes, it is preferable that the spacing of the sensors <NUM> be as small as possible. To reduce the spacing of the sensors <NUM>, it is preferable to use the sensors <NUM> of small size. For example, the sensors <NUM> have a size of about <NUM> to <NUM> in length on one side (or in diameter or major axis) in plan view.

On the other hand, if the sensors <NUM> are arranged too close to each other, the azimuth resolution deteriorates due to the narrow width of the entire array sensor <NUM> in the horizontal and vertical directions. This means that if a plurality of sound sources exist in proximity within the field of view, it is difficult to distinguish one sound source from another.

Accordingly, a simulation of the azimuth determining apparatus was carried out to study the size of the spacing of the sensors <NUM> (sensor spacing) so as to suppress the occurrence of grating lobes within the search range for searching for ultrasound sources. Since the human field of view is ±<NUM>° in the right-left (horizontal) and up-down (vertical) directions, a sound source was set at an azimuth of -<NUM>° in the horizontal direction on the assumption that there was a sound source at an azimuth within the field of view but outside the search range, and the frequency of ultrasound originating from the sound source was set to <NUM>, <NUM>, <NUM>, and <NUM>. The search range of the array sensor <NUM> was set to ±<NUM>°. An azimuth at which grating lobes appearing on the sound pressure map had a maximum peak intensity of -<NUM> dB was defined as a grating lobe boundary azimuth, and if the grating lobe boundary azimuth was smaller than the maximum search azimuth (i.e., if an azimuth corresponding to the maximum peak intensity of -<NUM> dB was detected within the search range), this event was defined as the occurrence of grating lobes. Note that "-<NUM> dB" is merely an example, and any azimuth at which the sound pressure is lower than the maximum peak intensity by a predetermined value may be defined as a grating lobe boundary azimuth.

In evaluating the sensor spacing, a nondimensional sensor spacing obtained by dividing the sensor spacing (mm) by the wavelength (mm) of ultrasound to be measured was used. Specifically, the nondimensional sensor spacing was determined by the following formula (<NUM>).

In the frequency band of ultrasound to be measured, a main value (central value) of the best sensitivity may be employed as the wavelength of ultrasound.

Again, as the nondimensional sensor spacing increases, the occurrence of grating lobes becomes more likely, and as the nondimensional sensor spacing decreases, the azimuth resolution deteriorates.

<FIG> is a graph showing a relation between a grating lobe boundary azimuth and nondimensional sensor spacing. In <FIG>, the vertical axis represents the grating lobe boundary azimuth (°) and the horizontal axis represents the nondimensional sensor spacing. The grating lobe boundary azimuth is expressed in relative angle in the horizontal direction, with the azimuth at which a sound source is located (i.e., an azimuth of -<NUM>° in the horizontal direction) being <NUM>°. <FIG> shows that setting the nondimensional sensor spacing to <NUM> or less makes it possible to prevent grating lobes from appearing in a range (±<NUM>°) corresponding to the minimum search range required in practice. To prevent grating lobes from appearing in a wider search range (±<NUM>°), it is preferable that the nondimensional sensor spacing be set to <NUM> or less. To prevent grating lobes from appearing in a wider search range (±<NUM>°), it is preferable that the nondimensional sensor spacing be set to <NUM> or less.

By adjusting the nondimensional sensor spacing as described above, it is possible to improve resolution for adjacent sound sources while suppressing the occurrence of grating lobes to a practically negligible level within the camera's field of view. By thus adjusting the nondimensional sensor spacing as described above, even if the sensor spacing does not satisfy the formula (<NUM>), the occurrence of grating lobes can be suppressed in a practically sufficient range, and an azimuth resolution higher than that achieved with a sensor arrangement satisfying the formula (<NUM>) is achieved. Therefore, the sensor spacing is greater than or equal to a half-wavelength of ultrasound to be measured, and is preferably set such that the occurrence of grating lobes is suppressed to a practically negligible level within the search range of the array sensor.

For example, the sensor spacing used when ultrasound of <NUM> is to be measured is about <NUM> to <NUM>. The sensor spacing is a distance between the centers of adjacent sensors along the X-axis or Y-axis.

To improve measurement accuracy when there are a plurality of sound sources in the measured object <NUM>, it is preferable that all sensor spacing is uniform.

As described above, an exemplary arrangement of the sensors <NUM> in the array sensor <NUM> is illustrated in <FIG>. In the example illustrated in <FIG>, a total of nine sensors <NUM>, five on the X-axis and five on the Y-axis, are arranged in a cruciform. With the sensors <NUM> thus arranged along the two axes, ultrasound from the direction in which the array sensor <NUM> is directed can be detected in a planar area, and the occurrence of grating lobes can be suppressed.

To more accurately determine the two-dimensional distribution of sound pressure even when there is a plurality of sound sources, the number of sensors may be increased. That is, more sensors <NUM> may be arranged on y = x and y = -x in the XY plane so as to be symmetric with respect to the X-axis and the Y-axis. An example is illustrated in <FIG>. In the example illustrated in <FIG>, in addition to the sensors <NUM> on the X-axis and the Y-axis, a total of four sensors <NUM>, two on y = x and two on y = -x, are arranged. Thus, even when the sensors <NUM> are added outside the X-axis and the Y-axis, a value preferable for the number of sensors <NUM> and a value preferable for the spacing of sensors <NUM> are the same as those described above, and it is also preferable that the spacing of the sensors <NUM> be uniform.

When the number of the sensors <NUM> is <NUM>, a <NUM>-by-<NUM> matrix of sensors <NUM> along the X-axis and the Y-axis may be arranged in a square shape.

In the present embodiment, where the spacing between the sensors <NUM> is adjusted, the occurrence of grating lobes within a camera's field of view can be suppressed even in the case of measuring ultrasound with a short wavelength.

A description will now be given of how the azimuth determining apparatus according to the present embodiment is used.

First, the camera <NUM> and the array sensor <NUM> of the azimuth determining apparatus <NUM> are directed, for example, toward a piping or electrical facility to be measured. The camera <NUM> picks up an image of an object to be inspected, and the array sensor <NUM> measures ultrasound. The picked-up image and a sound pressure map of ultrasound are superimposed to form a composite image, which is then displayed in the display means <NUM> of the azimuth determining apparatus. The distance between the surface of the azimuth determining apparatus <NUM> and the measured object in a straight line may be changed here, for example, in accordance with the size of the measured object or the intensity of ultrasound emitted. For example, for use within a steel plant, the distance may be up to about <NUM>. If the distance exceeds <NUM>, the resulting attenuation of ultrasound may make it difficult to measure a sufficient level of sound pressure.

In the present embodiment, which uses the sensors <NUM> of compact size and minimizes the number of sensors <NUM> of compact size, the size of the azimuth determining apparatus <NUM> can be reduced. This enables the user to easily carry around the azimuth determining apparatus <NUM> and to easily perform measurement by simply directing the camera <NUM> and the array sensor <NUM> of the azimuth determining apparatus <NUM> toward the object to be measured. Additionally, reducing the number of the sensors <NUM> prevents excessive computing load on the computing means <NUM>, and ensures a sufficient rate of updating the composite image.

The wider the field of view of the camera <NUM> during image pickup operation, the wider the range where detection of abnormalities can be made by a single measurement. However, if the field of view is too wide, the positions of sound sources cannot be precisely identified, for example, in relation to the resolution of the camera <NUM>, and the occurrence of grating lobes within the field of view becomes more likely. Therefore, it is preferable that the field of view be within a range narrower than ±<NUM>° in the up-down and right-left directions. To reduce the load of calculating the sound pressure map and increase the frequency of updating the composite image, the range for which the computing means <NUM> computes the sound pressure map (ultrasound search range) is also preferably within a range narrower than ±<NUM>° in the up-down and right-left directions.

After the measurement, a composite image displayed in the display means <NUM> is analyzed. In the composite image, different sound pressures of ultrasound are shown, for example, in different colors. This makes it possible to readily identify the level of sound pressure at each position. It is thus possible to determine that in the vicinity of a peak portion where the sound pressure is highest in the composite image, there is an ultrasound source or in other words, for example, a pipe is cracked or a failure occurs in the electrical facility. If a high sound pressure region substantially concentrically spreads around the peak portion, it is possible to estimate that there is an ultrasound source near the center of the circle.

On the other hand, if the high sound pressure region does not substantially concentrically spread, or occupies a large area within the field of view, it can be estimated that there are a plurality of sound sources within the region, and it is difficult to identify the locations of the sound sources within the region. Particularly in the azimuth determining apparatus <NUM> of the present embodiment, where the sensor spacing is narrowed to suppress the effect of grating lobes, a sufficient level of azimuth resolution may not be achieved depending on, for example, the measurement conditions. In this case, if there is a plurality of sound sources within the field of view, high sound pressure regions formed by the respective sound sources are combined and occupy a larger area. This makes it difficult to distinguish one sound source from another.

<FIG> is a schematic diagram of a composite image. In the example illustrated in <FIG>, the levels of sound pressure are represented by gradations of black color. A darker region <NUM> represents a higher level of sound pressure, and the sound pressure gradually weakens as the black color gradually lightens to a region <NUM> and to a region <NUM>. As a composite image displayed in the display means <NUM> in practice, a color image may be used, and the color may be continuously varied in accordance with the level of sound pressure.

In the example illustrated in <FIG>, the high sound pressure region <NUM> is formed over a relatively wide range in the composite image. The high sound pressure region <NUM> is elliptic and not substantially concentric. Although it is possible, in this example, to estimate that there are a plurality of sound sources within the region, it is difficult to identify the locations of the sound sources within the region.

A composite image analyzing method according to the present embodiment first involves setting a threshold for sound pressure, and then identifying, within the composite image, a region (high sound pressure region) where a sound pressure exceeding the threshold is observed.

<FIG> is an explanatory diagram illustrating a composite image analyzing method. In <FIG>, a darker gray region enclosed by a black dotted line is a high sound pressure region <NUM>, and a lighter gray region enclosed by a black dotted line is a low sound pressure region <NUM>.

As illustrated in <FIG>, when the high sound pressure region <NUM> is not substantially circular, it can be estimated that there are a plurality of ultrasound sources within the high sound pressure region <NUM>. The composite image analyzing method of the present embodiment assumes that there are two ultrasound sources in the high sound pressure region <NUM>.

First, as illustrated in <FIG>, the positions of upper, lower, left, and right end portions of the high sound pressure region <NUM> are identified, and an upper end line, a lower end line, a left end line, and a right end line are drawn. Next, a first circle tangent to three of these end lines and having the smallest area is drawn. In the example illustrated in <FIG>, a circle on the left side, tangent to the upper end line, the left end line, and the lower end line, is defined as the first circle. Also, a second circle tangent to one end line not tangent to the first circle (i.e., the right end line in the example of <FIG>) and two of the three end lines tangent to the first circle (i.e., the upper end line and the lower end line in the example of <FIG>) and having the smallest area is drawn. Two points, the center of the first circle and the center of the second circle, can thus be estimated as ultrasound sources.

<FIG> is an explanatory diagram illustrating another composite image analyzing method. In the example illustrated in <FIG>, an ellipse tangent to a left end line, a right end line, an upper end line, and a lower end line is drawn in a composite image, and two foci of the ellipse can be estimated as ultrasound sources.

Thus, even when there are sound sources at a plurality of portions close to each other within a measurement field of view, it is possible, with the methods described above, to accurately estimate the azimuths of the sound sources.

An ultrasound source azimuth determination was performed using an azimuth determining apparatus according to the present invention. The type of sensors used to form an array sensor was MA40H1S-R (by Murata Manufacturing Co. The sensors were arranged as illustrated in <FIG> at uniform sensor spacing of <NUM>. An object to be inspected was a gas pipe facility in a steel plant. The distance from a measured object was set to <NUM>, and the frequency of ultrasound to be measured was set to <NUM>. The nondimensional sensor spacing was determined by <NUM> (mm)/<NUM> (mm) to be about <NUM>. The camera's field of view and the search range of the array sensor were set to be within ±<NUM>° in the horizontal direction and within ±<NUM>° in the vertical direction.

<FIG> illustrates a composite image obtained in Example <NUM>. In <FIG>, a dark gray portion enclosed by a black dotted line is a region <NUM> with a particularly high sound pressure, and a part of the dark gray portion enclosed by a white dotted line is a peak portion with the highest sound pressure. The occurrence of corrosion pits in a pipe was actually found near the peak portion, and the azimuth of an ultrasound source was successfully determined. Even when the distance to the sound source was further reduced to a minimum of about <NUM>, the azimuth of the ultrasound source was able to be determined without problem.

Composite images were generated using an azimuth determining apparatus with the sensor arrangement illustrated in <FIG> (hereinafter referred to as "arrangement A") and an azimuth determining apparatus with the sensor arrangement illustrated in <FIG> (hereinafter referred to as "arrangement B"). Conditions, such as the type of sensors and the sensor spacing, are the same as those for Example <NUM>.

<FIG> provides enlarged views of the composite images obtained in Example <NUM>. <FIG> is an enlarged view of the composite image obtained by the azimuth determining apparatus with arrangement A, and <FIG> is an enlarged view of the composite image obtained by the azimuth determining apparatus with arrangement B. In the case of arrangement A illustrated in <FIG>, artifact regions <NUM> with high sound pressure were seen at the lower right and upper left of the drawing, as well as an ultrasound source <NUM> observed at the upper right of the drawing. In the case of arrangement B illustrated in <FIG>, however, these artifact regions <NUM> were not observed and the occurrence of grating lobes was able to be more effectively suppressed.

A composite image was acquired by directing an azimuth determining apparatus of the present embodiment toward a measured object provided with two points of simulated pipe leakage. The azimuth determining apparatus used here was one with arrangement B for Example <NUM>.

<FIG> is an analysis diagram for the composite image obtained in Example <NUM>. In <FIG>, a high sound pressure region <NUM> with sound pressure higher than or equal to a predetermined value in the obtained composite image is shown in a different color. In the composite image, positions <NUM> at which simulated pipe leakage exists are each represented by a white circle, positions <NUM> at which the sound pressure is highest are each indicated by a rectangle drawn with a white dotted line, and the high sound pressure region <NUM> is indicated by a black dotted line.

<FIG> is an analysis diagram for the composite image obtained in Example <NUM>. In the example illustrated in <FIG>, two circles were drawn in the high sound pressure region <NUM> in accordance with the composite image analyzing method according to the present embodiment, and the centers of the two circles were estimated as ultrasound sources. As illustrated in <FIG>, the ultrasound sources were able to be identified with a certain degree of accuracy.

Claim 1:
An ultrasound source azimuth determining apparatus (<NUM>) comprising:
a camera (<NUM>) configured to pick up an image of a measured object (<NUM>);
an array sensor (<NUM>) configured to measure a sound pressure of ultrasound originating from a direction of the measured object (<NUM>);
computing means (<NUM>) for generating a sound pressure map on the basis of sound pressure information of ultrasound acquired by the array sensor (<NUM>), and superimposing the sound pressure map and a picked-up image acquired by the camera (<NUM>) to generate a composite image; and
display means (<NUM>) for displaying the composite image,
wherein the array sensor (<NUM>) includes a total of greater than or equal to <NUM> and less than or equal to <NUM> surface mount sensors (<NUM>), and at least some of the surface mount sensors (<NUM>) are arranged on an X-axis and a Y-axis in the same plane,
wherein spacing between surface mount sensors (<NUM>) is greater than or equal to a half-wavelength of ultrasound to be measured, wherein the spacing between surface mount sensors (<NUM>) is set based on a relationship between a grating lobe boundary azimuth and a non-dimensional sensor spacing, so as to suppress the occurrence of grating lobes within the search range of the array sensor (<NUM>),
characterized in that a search range of the array sensor (<NUM>) is a range narrower than ±<NUM>° and wider than ±<NUM>° in each of horizontal and vertical directions and that the surface mount sensors (<NUM>) are arranged such that the non-dimensional sensor spacing is <NUM> or less, the non-dimensional sensor spacing being obtained by dividing the spacing between surface mount sensors (<NUM>) by a wavelength of ultrasound to be measured.