Electromagnetic wave visualization device

An electromagnetic wave visualization device includes an image acquisition unit that captures an image of a target device, a measurement unit that measures an electromagnetic wave intensity of the target device, a controller that sets a measurement range of the measurement unit and generates a composite image in which a measurement result of the measured electromagnetic wave intensity is superimposed on the captured image of the target device acquired by the image acquisition unit, and an output unit that outputs the composite image generated by the controller, in which the controller generates the composite image including the measurement range of the measurement unit and outputs the composite image to the output unit.

TECHNICAL FIELD

The present disclosure relates to an electromagnetic wave visualization device.

BACKGROUND ART

PTL 1 discloses electromagnetic wave visualization device including an emission direction separator that changes an emission direction of an electromagnetic wave according to an incidence direction of the electromagnetic wave, a plurality of sensors each of which detects energy of the electromagnetic wave emitted from the emission direction separator and outputs a detection signal with a strength corresponding to a magnitude of the detected energy, a processor that is able to receive the detection signal from each of the plurality of sensors, and outputs a display signal including information regarding an arrival direction of the electromagnetic wave correlated with the sensor that has transmitted the detection signal when the detection signal is received from the sensor, and a display that can display each of arrival directions of a plurality of electromagnetic waves, and displays the arrival directions of the electromagnetic waves when the display signal is received.

CITATION LIST

Patent Literature

SUMMARY OF THE INVENTION

The present disclosure has been devised in view of the above circumstances of the related art, and an object thereof is to provide an electromagnetic wave visualization device that efficiently displays a measurement result of a region required by a user among measurement results regarding an electromagnetic wave intensity of a target device, and thus improves the user's convenience.

According to the present disclosure, there is provided an electromagnetic wave visualization device including an image acquisition unit that captures an image of a target device; a measurement unit that measures an electromagnetic wave intensity of the target device; a controller that sets a measurement range of the measurement unit and generates a composite image in which a measurement result of the measured electromagnetic wave intensity is superimposed on the captured image of the target device acquired by the image acquisition unit; and an output unit that outputs the composite image generated by the controller, in which the controller generates the composite image including the measurement range of the measurement unit and outputs the composite image to the output unit.

According to the present disclosure, it is possible to efficiently display a measurement result of a region required by a user among measurement results regarding an electromagnetic wave intensity of a target device and thus to improve the user's convenience.

DESCRIPTION OF EMBODIMENT

Background of Details of Exemplary Embodiment

PTL 1 discloses an electromagnetic wave visualization device capable of visualizing an electromagnetic wave generation source in real time. This electromagnetic wave visualization device is configured to include an emission direction separator that emits an electromagnetic wave in an emission direction according to an incidence direction of the electromagnetic wave, a plurality of sensors each of which outputs a detection signal with a strength corresponding to a magnitude of energy of the electromagnetic wave emitted from the emission direction separator, a processor that outputs a display signal including information regarding an arrival direction of the electromagnetic wave correlated with the sensor that has transmitted the detection signal, and a display that can display each of arrival directions of a plurality of electromagnetic waves, and displays the arrival directions of the electromagnetic waves when the display signal is received. This electromagnetic wave visualization device can visualize an electromagnetic wave generation source in real time by displaying an arrival direction of the incident electromagnetic wave and outputting a detection result of the electromagnetic wave intensity.

However, in the electromagnetic wave visualization device of the related art, since the display includes a range other than the measurement range, it is not possible to display only a range of a measurement result required by a user. Therefore, in the following Exemplary Embodiment 1, a description will be made of an example of an electromagnetic wave visualization device that efficiently displays a measurement result of a region required by a user among measurement results regarding an electromagnetic wave intensity of a target device and thus improves the user's convenience.

Hereinafter, Exemplary Embodiment 1 in which a configuration and an operation of the electromagnetic wave visualization device according to the present disclosure are specifically disclosed will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters and repeated description of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art. The accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

First, electromagnetic wave visualization device100according to Exemplary Embodiment 1 will be described with reference toFIGS.1and2.FIG.1is an appearance diagram illustrating an example of electromagnetic wave visualization device100according to Exemplary Embodiment 1.FIG.2is a diagram illustrating an internal configuration example of electromagnetic wave visualization device100according to Exemplary Embodiment 1. Electromagnetic wave visualization device100according to Exemplary Embodiment 1 is, for example, a portable device that is grasped by a user and measures an electromagnetic wave intensity of target device Tg1that is an electromagnetic wave measurement target. Electromagnetic wave visualization device100includes terminal device1and measurement unit2.

Terminal device1is a portable device such as a so-called tablet PC or smartphone. Terminal device1generates a heat map image based on the electromagnetic wave intensity of target device Tg1received by measurement unit2that will be described later, further generates a composite image in which the heat map image is superimposed on a captured image of target device Tg1acquired by camera13, and displays the composite image on monitor14. Terminal device1is configured to include communicator10, processor11, memory12, camera13, and monitor14. Camera13and monitor14are not essential constituents and may be omitted.

Here, target device Tg1is an electrical/electronic device that is a measurement target of an electromagnetic wave intensity (in other words, an intensity of a noise signal generated from target device Tg1). Target device Tg1may be a device configured to include one or more conductors as generation sources of electromagnetic waves, and may be a conductor itself as a generation source of an electromagnetic wave. Target device Tg1that is selected by the user and of which the electromagnetic wave intensity is measured may be one or a plurality.

Communicator10is communicatively connected by wire to signal processor20of measurement unit2. Specifically, each of communicator10of terminal device1and signal processor20in measurement unit2has a Universal Serial Bus (USB) connector (not illustrated) and is connected by wire by using a USB cable (not illustrated). Communicator10outputs a measurement result of the electromagnetic wave intensity of target device Tg1received from signal processor20to processor11.

Communicator10may be wirelessly communicatively connected to signal processor20. The wireless communication referred to here is communication via, for example, short-range wireless communication such as Bluetooth (registered trademark) or NFC (registered trademark), or a wireless local area network (LAN) such as Wifi (registered trademark).

Processor11as an example of a controller is configured by using, for example, a central processing unit (CPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), and controls an operation of each unit of terminal device1. Processor11functions as a controller of terminal device1, and performs a control process for overall control of an operation of each unit of terminal device1, a data input/output process with each unit of terminal device1, a data calculation (computation) process, and a data storage process. Processor11operates according to a program and data stored in memory12. Processor11starts measuring the electromagnetic wave intensity of target device Tg1with setting of a measurement range of the electromagnetic wave intensity of target device Tg1that will be described later as a trigger or with input of a trigger signal from camera13as a trigger.

When it is detected that measurement unit2is attached to terminal device1, processor11detects a signal transmitted from measurement unit2. Here, since a method of detecting that measurement unit2is attached to terminal device1is a well-known technique, the details thereof will be omitted, but for example, contact may be detected mechanically or may be detected by using an electric circuit. Processor11detects (identifies) Identification (ID) information for each measurement unit2that is set in advance and stored in memory12on the basis of the detected signal. For example, processor11may collate an ID of each measurement unit2included in a signal transmitted from measurement unit2with an ID list (not illustrated) of each measurement unit2stored in memory12, and detect (identify) the ID of measurement unit2in a case where the IDs match each other. Processor11reads various types of information stored in association with the detected (identified) ID information from memory12. The various types of information referred to here are frequency bandwidth information that can be measured by an antenna (not illustrated) of measurement unit2, wave impedance characteristics (not illustrated) of the antenna, a correction coefficient table (not illustrated) for correcting a reception signal of the antenna on the basis of the wave impedance characteristics, and information regarding sensor30capable of receiving electromagnetic waves. The ID information of the measurement unit2may be automatically detected (identified) by processor11, or ID information of a measurement unit2attached by the user may be input.

On the basis of the detected ID information of measurement unit2, processor11reads and acquires information regarding sensor30included in measurement unit2(for example, a reception area where electromagnetic waves can be received, a central position, and a shape) from memory12. Processor11calculates coordinates (X2, Y2, Z2) of reference point Pt2of attached sensor30on the basis of the acquired information regarding sensor30. Processor11sets vertical vector VT3that passes through reference point Pt2on sensor30and is in a vertical direction to a plane (electromagnetic wave receiving surface) of sensor30. Processor11sets horizontal vector VT4that passes through reference point Pt2and is parallel to the plane (electromagnetic wave receiving surface) of sensor30and perpendicular to vertical vector VT3.

Similarly, processor11reads and acquires information regarding camera13(for example, an angle of view and an installation angle of camera13) from memory12. Processor11calculates coordinates (X1, Y1, Z1) of reference point Pt1with the center of a lens (not illustrated) of camera13as a reference on the basis of the acquired information regarding camera13. Processor11sets central axis vector VT1that passes through reference point Pt1that is the center of the lens of camera13and is in the same direction as the central axis of the lens, on the basis of the installation angle of camera13. Processor11sets perpendicular vector VT2that passes through reference point Pt1and indicates a direction perpendicular to central axis vector VT1in the same direction as the central axis of the lens.

Processor11calculates a distance between reference point Pt1and reference point Pt2, an angle formed between central axis vector VT1and vertical vector VT3, and an angle formed between perpendicular vector VT2and horizontal vector VT4. Specifically, processor11calculates an angle formed between central axis vector VT1indicating the central axis of the lens of camera13and vertical vector VT3indicating the vertical direction to the electromagnetic wave reception plane of sensor30, and an angle formed between perpendicular vector VT2indicating the direction perpendicular to central axis vector VT1of camera13and horizontal vector VT4indicating the horizontal direction to the electromagnetic wave reception plane of sensor30. On the basis of these calculation results, processor11calculates an offset amount for subjecting a signal received at a predetermined position (coordinates) on sensor30to position conversion to a corresponding predetermined position (coordinates) within the angle of view of camera13. Processor11stores information regarding the calculated offset amount in memory12.

Processor11starts measuring the electromagnetic wave intensity generated from target device Tg1in operation by being triggered by the start of imaging by camera13or by the user's selection of at least one target device Tg1among one or more target devices captured in an imaging region. Processor11generates a heat map image on the basis of a measurement result of the electromagnetic wave intensity. The heat map image is generated according to a range in which sensor30can measure the electromagnetic wave intensity (hereinafter, referred to as a measurement range).

Processor11executes position (coordinate) alignment between the captured image and the heat map image on the basis of the calculated offset amount (for example, position alignment between reference point Pt1and reference point Pt2), and generates a composite image in which the heat map image is superimposed on the captured image. Processor11cuts out the measurement range from the generated composite image and outputs the measurement range to monitor14. In this case, processor11maintains an aspect ratio of the cutout composite image, generates a composite image enlarged or reduced such that the composite image is displayed in the largest size on monitor14, and outputs the composite image to monitor14.

A cutout range of the composite image (that is, a range of the generated composite image to be output to monitor14) is not limited to the above example. In the following description, a cutout range of the generated composite image to be displayed on monitor14will be referred to as a display range.

For example, processor11may receive an image processing result of capturing a contour of target device Tg1from camera13, and set, as a measurement range, a range in which the range of the calculated offset amount is expanded in all directions outside the contour of target device Tg1of which the electromagnetic wave intensity is measured on the basis of the image processing result. In such a case, processor11may set a measurement range including the offset amount as a display range.

The display range may be set on the basis of a user's input operation. Hereinafter, a range set on the basis of the user's input operation will be referred to as a designated range. In such a case, processor11sets a range including the designated range and the measurement range as the display range. In a case where, after the designated range is set, a positional relationship between electromagnetic wave visualization device100and target device Tg1is changed (for example, in a case where either electromagnetic wave visualization device100or target device Tg1is moved) and thus the set designated range is moved out of the current angle of view, processor11may set the angle of view as the display range.

Processor11may set the display range to the angle of view in a case where target device Tg1is located outside the angle of view on the basis of the captured image and the image processing result received from camera13.

Consequently, electromagnetic wave visualization device100according to Exemplary Embodiment 1 can efficiently display a measurement result of a region required by a user among measurement results regarding the electromagnetic wave intensity of the target device and thus improve the user's convenience.

Memory12includes, for example, a random access memory (RAM) as a work memory used when each process of processor11is executed and a read only memory (ROM) that stores programs and data defining an operation of processor11. Data or information generated or acquired by processor11is temporarily stored in the RAM. A program defining an operation of processor11is written in the ROM. Memory12stores identification (ID) information preset for each of the plurality of measurement units2that can be attached to and detached from terminal device1, information regarding camera13, coordinate information of each of reference points Pt1and Pt2, information regarding each of central axis vector VT1, perpendicular vector VT2, vertical vector VT3, and horizontal vector VT4, information regarding the offset amount, information regarding the designated range, and the like.

Camera13as an example of an image acquisition unit and a distance measuring unit includes at least a lens (not illustrated) and an image sensor (not illustrated). The image sensor is, for example, a solid-state imaging sensor such as a charged-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and converts an optical image formed on an imaging surface into an electric signal. When the user selects at least one target device Tg1from among one or more target devices captured in the imaging region, camera13sets a measurement range including target device Tg1captured in the captured image. Camera13generates a trigger signal for starting measurement of the electromagnetic wave intensity generated during an operation of target device Tg1and outputs the trigger signal to processor11.

Camera13is provided in terminal device1, captures an image of target device Tg1, and outputs the acquired captured image to processor11.

Needless to say, an installation location of camera13is not limited to the example illustrated inFIG.1. For example, camera13may be located on a surface opposite to a surface on which monitor14is provided and at the center of terminal device1. A plurality of cameras13may be provided, and a measurement distance and direction to target device Tg1may be measured by using each of a plurality of captured images.

Monitor14as an example of an output unit is configured by using, for example, a liquid crystal display (LCD) or an organic electroluminescence (EL), and displays a captured image acquired by camera13or a composite image in which a heat map image (that is, a measurement result of the electromagnetic wave intensity) is superimposed on the captured image.

Monitor14may be implemented by, for example, a head mounted display (HMD) communicatively connected to terminal device1in a wired or wireless manner. Monitor14displays a composite image (that is, a measurement result) that is output to the outside from processor11of terminal device1.

Monitor14may be a touch interface provided in terminal device1and configured with a touch panel. Monitor14accepts the user's input operation and outputs a result of the user's input operation to processor11.

Measurement unit2receives an electromagnetic wave generated from the target device in operation and measures the electromagnetic wave intensity. Measurement unit2is configured to be able to receive electromagnetic waves in different frequency bandwidths, and is detachably attached to a surface provided with camera13. Measurement unit2illustrated inFIG.2indicates a state in which one of a plurality of antenna devices corresponding to the electromagnetic wave intensity in a predetermined frequency bandwidth is attached, and a structure for attaching and detaching the antenna device is not illustrated.

Measurement unit2is attached to terminal device1by the user according to a frequency bandwidth generated from the target device that is a measurement target. The frequency bandwidth that can be measured by using the plurality of antenna devices according to Exemplary Embodiment 1 is a frequency bandwidth of 9 kHz to 6 GHz according to the electromagnetic compatibility (EMC) standard. The frequency bandwidth is not limited to this, and may be 6 GHz or higher.

Measurement unit2illustrated inFIG.1has substantially the same size (area) as that of terminal device1except for the periphery of camera13, but needless to say, a size and a shape of measurement unit2are not limited to the example illustrated inFIG.1. The size of measurement unit2may be larger or smaller than that of monitor14, for example. A shape of measurement unit2may be, for example, a rectangular shape. Measurement unit2includes signal processor20, sensor30, and ID storage unit40.

Signal processor20performs conversion into a signal indicating the electromagnetic wave intensity generated from the target device on the basis of a reception signal intensity that has been received by sensor30. Signal processor20has a USB connector, associates the converted signal with coordinate information on sensor30, and transmits the measurement result of the electromagnetic wave intensity of target device Tg1to communicator10of terminal device1via a USB cable connected therebetween. Signal processor20may transmit the measurement result to terminal device1by using short-range wireless communication or wireless LAN communication such as Wifi (registered trademark). The short-range wireless communication referred to here is, for example, Bluetooth (registered trademark) or NFC (registered trademark).

Sensor30has, for example, a dipole antenna or one or a plurality of loop antennas, and is configured to receive electromagnetic waves in a predetermined frequency bandwidth. Sensor30may be formed as a planar antenna. Sensor30outputs a reception signal that has received the electromagnetic wave generated from target device Tg1to signal processor20.

ID storage unit40is configured with, for example, a ROM, and stores the ID information of the measurement unit2. ID storage unit40is not limited to storing the ID information, and may store information for identifying attached measurement unit2, such as a serial number.

FIG.3is a diagram illustrating an example of a use case of electromagnetic wave visualization device100according to Exemplary Embodiment 1. Electromagnetic wave visualization device100is grasped by the user or placed on a desk or the like to measure the electromagnetic wave intensity generated from target device Tg1.

Electromagnetic wave visualization device100images target device Tg1with camera13provided on the surface opposite to monitor14, and also measures electromagnetic wave intensity generated from target device Tg1in operation with measurement unit2attached to the surface opposite to monitor14. Processor11generates a heat map image on the basis of the measurement result of the electromagnetic wave intensity, generates a composite image in which the heat map image is superimposed on the captured image, and displays the composite image on monitor14. Although the measurement result of the electromagnetic wave intensity of target device Tg1is displayed as the heat map image inFIG.3, a method of displaying the measurement result is not limited to this, and may be, for example, a numerical value.

Consequently, electromagnetic wave visualization device100according to Exemplary Embodiment 1 can efficiently display an intensity of an electromagnetic wave generated during an operation of target device Tg1in the operation environment thereof and thus improve a user's convenience, without taking out a predetermined conductor that is a generation source of the electromagnetic wave.

A use case example and a display example of electromagnetic wave visualization device100will be described with reference toFIGS.4A to4C.FIG.4Ais a top view illustrating a use case example of electromagnetic wave visualization device100according to Exemplary Embodiment 1.FIG.4Bis a display example in a use case (position A) of electromagnetic wave visualization device100according to Exemplary Embodiment 1.FIG.4Cillustrates a display example in a use case (position B) of electromagnetic wave visualization device100according to Exemplary Embodiment 1.

FIG.4Aillustrates a case where the electromagnetic wave intensity of target device Tg1is measured by using electromagnetic wave visualization device100. Camera13has angle of view MM1and images target device Tg1. Sensor30has measurement range DD1and measures the electromagnetic wave intensity generated from target device Tg1in operation. Electromagnetic wave visualization device100illustrated inFIG.4Ameasures the electromagnetic wave intensity generated from target device Tg1in operation at each of positions A and B. Electromagnetic wave visualization device100illustrated inFIG.4Ais configured with terminal device1and measurement unit2, but is an example, and a use case is not limited to this.

In a case where target device Tg1is located at position A, as illustrated inFIG.4B, a measurement result (screen ScA) of which a display range is a range including angle of view MM1and measurement range DD1is displayed on monitor14. Measurement range MMA on screen ScA is a part of measurement range DD1, and a frame line as a boundary line is displayed. Consequently, a user can discriminate between inside and outside the measurement range. On the other hand, region BB1outside angle of view MM1and in measurement range DD1is outside the angle of view, and thus the captured image is not displayed therein. Although region BB1is painted black inFIG.4B, a heat map image may be displayed therein.

In a case where target device Tg1is located at position B, as illustrated inFIG.4C, monitor14displays a measurement result (screen ScB) of which a display range is a range including angle of view MM1and measurement range DD1. Measurement range MMB on screen ScA is a part of measurement range DD1, and a frame line as a boundary line is displayed. Consequently, a user can discriminate between inside and outside the measurement range.

As described above, electromagnetic wave visualization device100can efficiently display the measurement result of the region required by the user among the measurement results regarding the electromagnetic wave intensity of target device Tg1and thus improve the user's convenience.

With reference toFIG.5, an angle of view and a display range of a measurement result displayed on monitor14in a case where a measurement distance between target device Tg1and electromagnetic wave visualization device100is changed will be described.FIG.5is a diagram for describing an example of a display range for each measurement distance. A user inFIG.5grasps electromagnetic wave visualization device100to which measurement unit2is attached, and measures the electromagnetic wave intensity generated from target device Tg1in operation at each of plurality of measurement distances L1, L2, and L3. Hereinafter, a change in a display range of a measurement result in a case where the user moves from measurement distance L3to measurement distance L1will be described. The user inFIG.5is imaging target device Tg1from the same direction such that an angle between the grasped electromagnetic wave visualization device100(that is, measurement unit2) and target device Tg1differs only in an imaging distance.

The display range referred to here indicates a range displayed on monitor14in a composite image generated by superimposing a heat map image indicating a measurement result of the electromagnetic wave intensity in the measurement range on a captured image from camera13. Consequently, the user can check the measurement result indicated by the composite image in a larger image because a composite image in the range required by the user is cut out from the composite image and displayed on monitor14.

Electromagnetic wave visualization device100at measurement distance L3captures an image of target device Tg1in an imaging region indicated by angle of view Ar1, and sets measurement range M1including target device Tg1on the basis of the captured image. In electromagnetic wave visualization device100, designated range D1including target device Tg1is similarly designated by the user. In such a case, electromagnetic wave visualization device100sets measurement range M1that is a range including measurement range M1and designated range D1as a display range. In a case where measurement range M1is smaller than designated range D1, electromagnetic wave visualization device100sets the display range to designated range D1.

Electromagnetic wave visualization device100at measurement distance L2captures an image of target device Tg1in an imaging region indicated by angle of view Ar2. Angle of view Ar2at measurement distance L2includes substantially the entire target device Tg1. Measurement range M2is a range including a part of target device Tg1, and this range corresponds to a position and a size of measurement range M1at angle of view Ar1. On the other hand, designated range D1is not changed from the range indicated by angle of view Ar1at measurement distance L3regardless of the magnitude of the measurement distance, and is thus located outside angle of view Ar2at measurement distance L2. In such a case, electromagnetic wave visualization device100cannot set designated range D1desired by the user as a display range, and thus sets measurement range M2as a display range. Electromagnetic wave visualization device100may execute image processing within angle of view Ar2and set angle of view Ar2including substantially the entire target device Tg1as a display range.

Electromagnetic wave visualization device100at measurement distance L1captures an image of target device Tg1in an imaging region indicated by angle of view Ar3. Angle of view Ar3and measurement range M3at measurement distance L1include a part of target device Tg1. In the same manner as measurement range M2, measurement range M3is a range corresponding to a position and a size of measurement range M1at angle of view Ar1. Designated range D1is located outside angle of view Ar3at measurement distance L1. In such a case, electromagnetic wave visualization device100cannot set designated range D1desired by the user as the display range, and thus sets measurement range M3as a display range. Electromagnetic wave visualization device100may execute image processing within angle of view Ar3and set angle of view Ar3including target device Tg1as a display range.

Consequently, the user can efficiently check a measurement result of the region required by the user among the measurement results regarding the electromagnetic wave intensity of the target device.

Next, an operation procedure example of electromagnetic wave visualization device100will be described with reference toFIGS.6and7. With reference toFIGS.8A to12B, an example of each process described in the operation procedure example of electromagnetic wave visualization device100and a display example of monitor14will be described.FIGS.6and7are flowcharts illustrating an operation procedure example of electromagnetic wave visualization device100according to Exemplary Embodiment 1. In the operation procedure example illustrated inFIGS.6and7, an example in which electromagnetic wave visualization device100includes constituents such as camera13and monitor14will be described, but needless to say, a configuration of electromagnetic wave visualization device100is not limited to this.

Terminal device1displays a captured image acquired by camera13on monitor14. Terminal device1sets one target device Tg1among one or more target devices captured in the captured image as a target of which an electromagnetic wave is to be measured on the basis of a user's input operation (St1). The process in step St1is not essential, and in a case where there is no user's input operation, target device Tg1may be set on the basis of image processing by camera13.

Terminal device1executes image processing on the captured image and acquires a contour of target device Tg1of which the electromagnetic wave intensity is measured. Terminal device1sets a range in which sensor30can measure the electromagnetic wave intensity as a measurement range (St2).

Terminal device1displays the captured image acquired by camera13on monitor14, and sets a designated range on the basis of the user's input operation for the captured image (St3). The designated range may be larger or smaller than the measurement range.

Terminal device1measures an electromagnetic wave intensity within the measurement range set in the process in step St2(St4).

Here, terminal device1proceeds to an operation procedure for setting the display range. Terminal device1determines whether or not the set measurement range is within the designated range (St5).

In a case where the set measurement range is within the designated range in the process in step St5, (St5, YES), terminal device1sets the designated range as a display range (St6).

Here, in a case where the set measurement range is within the designated range in the process in step St5(St5, YES), a relationship between an angle of view, a designated range, and a measurement range, and a display example thereof will be described with reference toFIGS.8A and8B.

FIG.8Ais a diagram illustrating an example of a case where measurement range M4is included in designated range D4.FIG.8Bis a diagram illustrating a display example of a measurement result in the case where measurement range M4is included in designated range D4. Angle of view Ar4illustrated inFIG.8Aincludes the entire target device Tg1, designated range D4, and measurement range M4. Designated range D4includes the entire target device Tg1and the entire measurement range M4. Measurement range M4includes a part of target device Tg1.

In such a case, terminal device1sets designated range D4including the entire measurement range M4as a display range and thus sets the display range including the entire measurement range and the designated range. As a result, terminal device1generates a measurement result (screen Sc1) obtained by cutting out a composite image in the set display range from the composite image and displays the measurement result on monitor14. In measurement range M4aon screen Sc1, a frame line as a boundary line is displayed such that the inside and the outside of the measurement range can be discriminated.

On the other hand, in a case where the set measurement range is not within the designated range in the process in step St5(St5, NO), terminal device1sets a display range including the entire measurement range and the designated range (St7).

Here, in a case where the set measurement range is not within the designated range in the process in step St5(St5, NO), a relationship between an angle of view, a designated range, and a measurement range, and a display example thereof will be described with reference toFIGS.9A,9B,10A, and10B.

FIG.9Ais a diagram illustrating an example of a case where designated range D5is included in measurement range M5.FIG.9Bis a diagram illustrating a display example of a measurement result in the case where designated range D5is included in measurement range M5. Angle of view Ar5illustrated inFIG.9Aincludes the entire target device Tg1, designated range D5, and measurement range M5. The entire target device Tg1is included in designated range D5. Designated range D5is smaller than measurement range M5, and the entire range thereof is included in measurement range M5.

In such a case, terminal device1sets measurement range M5including the entire designated range D5as a display range and thus sets the display range including the entire measurement range and the designated range. As a result, terminal device1generates a measurement result (screen Sc2) obtained by cutting out a composite image in the set display range from the composite image and displays the measurement result on monitor14.

Other examples will be described with reference toFIGS.10A and10B.FIG.10Ais a diagram illustrating an example of a case where a part of designated range D6is included in measurement range M6.FIG.10Bis a diagram illustrating a display example of a measurement result in the case where a part of designated range D6is included in measurement range M6. Angle of view Ar6illustrated inFIG.10Aincludes the entire target device Tg1, designated range D6, and measurement range M6. The entire target device Tg1is included in designated range D6. Measurement range M6includes a part of designated range D6and a part of target device Tg1.

In such a case, terminal device1sets a display range including measurement range M6and designated range D6. As a result, terminal device1generates a measurement result (screen Sc3) obtained by cutting out a composite image in the set display range from the composite image and displays the measurement result on monitor14. In measurement range M6aon screen Sc3, a frame line as a boundary line is displayed such that the inside and the outside of the measurement range can be discriminated. InFIG.10B, a one-dot chain line indicating designated range D6is displayed in order to make each range included in screen Sc3easy to understand, but this is not essential and needs not be displayed.

After the processes in steps St6and St7, terminal device1further determines whether or not the designated range is within the current angle of view (St8). The process in step St8is an effective process, for example, in a case where the user reduces a measurement distance between terminal device1and target device Tg1(in other words, brings terminal device1close to target device Tg1).

In a case where the designated range is within the current angle of view in the process in step St8(St8, YES), terminal device1maintains the currently set display range and further proceeds to the process in step St10.

On the other hand, in a case where the designated range is not within the current angle of view in the process in step St8(St8, NO), terminal device1sets the angle of view as a display range (St9) and proceeds to the process in step St10.

Terminal device1determines whether or not the currently set display range matches an aspect ratio of monitor14(St10).

In a case where the currently set display range matches the aspect ratio of monitor14in the process in step St10(St10, YES), terminal device1generates a measurement result by cutting out a composite image in the set display range from the generated composite image, and displays the measurement result on monitor14(St11).

On the other hand, in a case where the display range currently set does not match the aspect ratio of monitor14in the process in step St10(St10, NO), terminal device1adjusts a magnification of the set display range in the generated composite image. Specifically, terminal device1adjusts the magnification such that a length of a long side in the composite image of the display range matches a short side of a displayable region of monitor14(St12). After the adjustment, terminal device1cuts out a composite image in the display range, generates a measurement result, and displays the measurement result on monitor14(St11).

Here, in a case where the set measurement range is not within the designated range in the process in step St10(St10, NO), a relationship between an angle of view, a designated range and a measurement range, and a display example thereof will be described with reference toFIGS.11A and11B.

FIG.11Ais a diagram illustrating an example of a case where a display range is required to be adjusted.FIG.11Bis a diagram illustrating a display example of a measurement result in the case where the display range has been adjusted. Angle of view Ar7illustrated inFIG.11Aincludes the entire target device Tg1, designated range D7, and measurement range M7. The entire target device Tg1is included in designated range D7. Designated range D7is smaller than measurement range M7, and the entire range thereof is included in measurement range M7.

In such a case, in terminal device1, measurement range M7including the entire designated range D7is set as the current display range. As a result, terminal device1generates a measurement result obtained by cutting out a composite image in the set display range from the composite image. Here, monitor14of terminal device1includes a display region capable of displaying angle of view Ar7. Therefore, terminal device1increases or reduces length W1of the long side of the display range to match length W2of the short side of monitor14in the measurement result obtained by cutting out the composite image in the set display range.

In measurement range M7aon screen Sc4, a frame line as a boundary line is displayed such that the inside and the outside of the measurement range can be discriminated. As illustrated inFIG.11B, the original composite image before being cut out may be displayed in blank region E1outside measurement range M7a.

After the process in step St11, terminal device1determines whether or not there are changes in the distance and the positional relationship between terminal device1and target device Tg1(St13).

In a case where there are changes in the distance and the positional relationship between terminal device1and target device Tg1(St13, YES), terminal device1further determines whether or not target device Tg1is within the current angle of view (St14).

On the other hand, in a case where there are no changes in the distance and the positional relationship between terminal device1and target device Tg1(St13, NO), terminal device1proceeds to the process in step St4, and after the measurement, the processes in and after step St5for setting a display range to be displayed on monitor14are executed on a measurement result of an electromagnetic wave intensity measured again.

In a case where target device Tg1is within the angle of view in the process in step St14(St14, YES), terminal device1executes the processes in and after step St5for setting a display range to be displayed on monitor14on a measurement result of the electromagnetic wave intensity.

On the other hand, in a case where target device Tg1is not within the angle of view in the process in step St14(St14, NO), terminal device1proceeds to the process in step St9.

Here, in a case where target device Tg1is not within the angle of view in the process in step St14(St14, NO), a relationship between an angle of view, a designated range, and a measurement range, and a display example thereof will be described with reference toFIGS.12A and12B.

FIG.12Ais a diagram illustrating an example of a case where designated range D8is not included in angle of view Ar8.FIG.12Bis a diagram illustrating a display example of a measurement result in the case where designated range D8is not included in angle of view Ar8. Angle of view Ar8illustrated inFIG.12Aincludes a part of target device Tg1and measurement range M8. Designated range D8includes angle of view Ar8, the entire target device Tg1, and the entire measurement range M8. Measurement range M8is included in angle of view Ar8and includes a part of target device Tg1.

In such a case, terminal device1sets angle of view Ar8as a display range. As a result, terminal device1generates a measurement result (screen Sc5) consisting of the entire composite image. In measurement range M8aon screen Sc5, a frame line as a boundary line is displayed such that the inside and the outside of the measurement range can be discriminated.

As described above, electromagnetic wave visualization device100according to Exemplary Embodiment 1 can efficiently display the measurement result of the region required by the user among the measurement results regarding the electromagnetic wave intensity of the target device and thus improve the user's convenience.

Hereinafter, a modification example of electromagnetic wave visualization device100according to Exemplary Embodiment 1 will be described.

Electromagnetic wave visualization device100according to Exemplary Embodiment 1 may further include a laser device (not illustrated) in terminal device1or measurement unit2. The laser device is controlled by processor11. The laser device irradiates and indicates, with a visible light laser, one of a designated range, a measurement range, and a display range set for target device Tg1selected by a user from among one or more target devices captured in an imaging region.

Consequently, electromagnetic wave visualization device100can irradiate (project) any one of the designated range, the measurement range, and the display range displayed on monitor14into an actual space. Therefore, the user can visually check any one of the designated range, the measurement range, and the display range displayed on a display screen of monitor14of electromagnetic wave visualization device100at hand. In a case where the electromagnetic wave intensity is measured by each of a plurality of users, it is easy for each of the plurality of users to share settings of the designated range, the measurement range, and the display range.

Electromagnetic wave visualization device100according to Exemplary Embodiment 1 may include a projector (not illustrated) in terminal device1or measurement unit2. The projector is controlled by processor11. The projector projects a heat map image as a measurement result of the electromagnetic wave intensity onto target device Tg1to enable so-called projection mapping. Consequently, electromagnetic wave visualization device100can irradiate (project) the measurement result (heat map image) of the electromagnetic wave intensity generated from target device Tg1in operation onto the actual space. Therefore, the user can visually check the measurement result (heat map image) of the electromagnetic wave intensity of target device Tg1. In a case where the electromagnetic wave intensity is measured by each of a plurality of users, each of the plurality of users can easily share the measurement result (heat map image) of the electromagnetic wave intensity of target device Tg1.

As described above, electromagnetic wave visualization device100according to Exemplary Embodiment 1 includes an image acquisition unit (camera13) that captures an image of a target device; measurement unit2that measures an electromagnetic wave intensity of target device Tg1; a controller (processor11) that generates a composite image in which a measurement result of the electromagnetic wave intensity measured by measurement unit2is superimposed on the captured image of target device Tg1acquired by the image acquisition unit; and an output unit (monitor14) that displays the composite image generated by the controller. The controller of electromagnetic wave visualization device100generates the composite image including a measurement range of measurement unit2and outputs the composite image to the output unit.

Consequently, electromagnetic wave visualization device100can efficiently display a measurement result of a region required by a user among measurement results regarding the electromagnetic wave intensity of target device Tg1and thus improve the user's convenience.

The controller of electromagnetic wave visualization device100according to Exemplary Embodiment 1 sets a designated range to be output to the output unit on the basis of a user's input operation, and generates the composite image including the designated range and a part or the whole of the measurement range. Consequently, electromagnetic wave visualization device100can generate a measurement result (composite image) of a region required by the user among the measurement results regarding the electromagnetic wave intensity of target device Tg1.

The controller of electromagnetic wave visualization device100according to Exemplary Embodiment 1 generates a composite image including the designated range and the entire measurement range in a case where a part of the measurement range there is not included in the designated range. Consequently, electromagnetic wave visualization device100can generate a measurement result (composite image) including a region (designated range) that the user wants to see and a region (measurement range) that requires the measurement result among measurement results regarding the electromagnetic wave intensity of target device Tg1.

The controller of electromagnetic wave visualization device100according to Exemplary Embodiment 1 calculates an offset amount based on a difference between coordinate positions of a position of a central axis of the image acquisition unit and a central position of measurement unit2, and generates the composite image in which the measurement result of the electromagnetic wave intensity for each coordinate of measurement unit2is superimposed on the captured image on the basis of the offset amount. Consequently, electromagnetic wave visualization device100can generate a measurement result (composite image) in which a deviation is corrected even if there is the deviation between a reference point of an angle of view of the image acquisition unit and a reference point of a reception range of measurement unit2.

The controller of electromagnetic wave visualization device100according to Exemplary Embodiment 1 maintains an aspect ratio of the composite image, and generates an enlarged or reduced composite image such that the composite image is displayed in the largest size on the output unit. Consequently, electromagnetic wave visualization device100can generate a larger and easier-to-see measurement result (composite image) and output the composite image to the output unit.

Electromagnetic wave visualization device100according to Exemplary Embodiment 1 further includes a distance measuring unit (camera13) that measures a distance and a direction from electromagnetic wave visualization device100to target device Tg1, and the controller changes a display range on the basis of a distance measurement result from the distance measuring unit. Consequently, electromagnetic wave visualization device100can efficiently display a measurement result of a region required by the user among measurement results regarding the electromagnetic wave intensity of target device Tg1.

In a case where the designated range is larger than the current angle of view, the controller of electromagnetic wave visualization device100according to Exemplary Embodiment 1 generates a composite image corresponding to the current angle of view. Consequently, electromagnetic wave visualization device100can efficiently display a measurement result of a region required by the user among measurement results regarding the electromagnetic wave intensity of target device Tg1.

Although various exemplary embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is obvious that a person skilled in the art can conceive of various changes, modifications, replacements, additions, deletions, and equivalents within the category disclosed in the claims, and it is understood that they fall within the technical scope of the present disclosure. The respective constituents in the various exemplary embodiments described above may be freely combined within the scope without departing from the concept of the invention.

INDUSTRIAL APPLICABILITY

The present disclosure is useful as an electromagnetic wave visualization device that efficiently displays a measurement result of a region required by a user among measurement results regarding an electromagnetic wave intensity of a target device and thus improves the user's convenience.

REFERENCE MARKS IN THE DRAWINGS