ELECTRONIC DEVICE, METHOD FOR CONTROLLING ELECTRONIC DEVICE, AND PROGRAM

An electronic device includes a transmission antenna, a reception antenna, and a signal processor. The transmission antenna is configured to transmit a transmission wave. The reception antenna is configured to receive a reflection wave resulting from reflection of the transmission wave. The signal processor is configured to detect an object based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflection wave. The signal processor classifies a point group representing the object in accordance with a prescribed parameter when performing clustering on detection results of the object.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority of Japanese Patent Application No. 2020-180876 filed in Japan on Oct. 28, 2020, the entire disclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic device, a method for controlling an electronic device, and a program.

BACKGROUND OF INVENTION

In fields such as industries related to automobiles, for example, technologies for measuring the distance between a host vehicle and a prescribed object are becoming increasingly important. In particular, in recent years, various studies have been conducted on radar (radio detecting and ranging ((RADAR)) technologies. In these technologies, the distance to an object is measured by transmitting radio waves, such as millimeter waves, and receiving waves reflected from an object, such as an obstacle. The importance of such technologies for measuring distances so forth is expected to further increase in the future with the development of technologies for assisting drivers in driving and technologies related to automated driving that allow part or all of the driving process to be automated.

In technologies such as radar described above, various clustering methods are known as algorithms for determining whether or not an object has been detected based on a reception signal. For example, Patent Literature 1 proposes clustering with which target identification can be performed with good accuracy. Density-based spatial clustering of applications with noise (DBSCAN) is widely used as an algorithm for clustering data in accordance with density. When making a determination for object detection, it is assumed that if clustering is not performed properly, objects cannot be detected well.

CITATION LIST

Patent Literature

Patent Literature 1: Japanese Unexamined Utility Model Registration Application Publication No. 5-59372

SUMMARY

In an embodiment, an electronic device includes a transmission antenna, a reception antenna, and a signal processor.

The transmission antenna is configured to transmit a transmission wave.

The reception antenna is configured to receive a reflection wave resulting from reflection of the transmission wave.

The signal processor is configured to detect an object based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflection wave.

The signal processor classifies a point group representing the object in accordance with a prescribed parameter when performing clustering on detection results of the object.

In an embodiment, a method of controlling an electronic device includes:transmitting a transmission wave using a transmission antenna;receiving a reflection wave generated by reflection of the transmission wave using a reception antenna;detecting an object based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflection wave, andclassifying a point group representing the object in accordance with a prescribed parameter when performing clustering on detection results of the object.

In an embodiment, provided is a program for causing a computer to execute:transmitting a transmission wave using a transmission antenna;receiving a reflection wave generated by reflection of the transmission wave using a reception antenna;detecting an object based on a transmission signal transmitted as the transmission wave and a reception signal received as the reflection wave, andclassifying a point group representing the object in accordance with a prescribed parameter when performing clustering on detection results of the object.

DESCRIPTION OF EMBODIMENTS

A technology for detecting a prescribed object well by receiving a reflection wave generated as a result of a transmitted transmission wave being reflected by the prescribed object is desirable. An object of the present disclosure is to provide an electronic device, a method of controlling an electronic device, and a program that can detect an object well. According to an embodiment, an electronic device, a method of controlling an electronic device, and a program with which objects can be well detected can be provided. Hereafter, an embodiment will be described in detail while referring to the drawings.

An electronic device according to an embodiment is installed in a vehicle (mobile object) such as an automobile and is capable of detecting a prescribed object located in the surroundings of the mobile object as a target. Accordingly, the electronic device according to the embodiment can transmit a transmission wave into the surroundings of the mobile object from a transmission antenna installed in the mobile object. In addition, the electronic device according to the embodiment can receive a reflection wave from a reception antenna installed in the mobile object, the reflection wave being generated by the transmission wave being reflected. At least one out of the transmission antenna and the reception antenna may be, for example, provided in a radar sensor or the like installed in the mobile object.

Hereinafter, as a typical example, a configuration will be described in which the electronic device according to the embodiment is mounted in an automobile such as a passenger vehicle. However, the electronic device according to the embodiment is not limited to being mounted in an automobile. The electronic device of the embodiment may be mounted in any of a variety of mobile objects such as self-driving cars, buses, taxis, trucks, taxis, motorcycles, bicycles, ships, aircraft, helicopters, agricultural equipment such as tractors, snowplows, sweepers, police cars, ambulances, and drones. Furthermore, the electronic device according to the embodiment is not necessarily limited to being mounted in mobile objects that move under their own power. For example, the mobile object in which the electronic device according to the embodiment is mounted may be a trailer part towed by a tractor. The electronic device according to the embodiment can measure the distance or the like between a sensor and a prescribed object in a situation where at least one out of the sensor and the object can move. The electronic device according to the embodiment can measure the distance or the like between the sensor and the object even when both the sensor and the object are stationary. Automobiles included in the present disclosure are not limited by overall length, width, height, displacement, capacity, or load capacity. For example, automobiles of the present disclosure also include automobiles having a displacement greater than 660 cc, and automobiles having a displacement less than or equal to 660 cc, i.e., so-called light automobiles. Automobiles included in the present disclosure also include automobiles that use electricity as part or all of their energy and utilize motors.

Configuration of Electronic Device According to Embodiment

First, an example of detection of an object performed by the electronic device according to the embodiment will be described.

FIG.1is a diagram for explaining the way in which the electronic device according to the embodiment is used.FIG.1illustrates an example in which the electronic device according to the embodiment is installed in a mobile object, the electronic device being equipped with a transmission antenna and a reception antenna.

An electronic device1according to the embodiment is installed in a mobile object100illustrated inFIG.1. The electronic device1includes a transmission antenna and a reception antenna. The electronic device1according to the embodiment may be mounted in (for example, built into) the mobile object100illustrated inFIG.1. The specific configuration of the electronic device1will be described below. As described below, the electronic device1may include, for example, at least one out of a transmission antenna and a reception antenna. The mobile object100illustrated inFIG.1may be a vehicle such as an automobile like a passenger car, but may be any suitable type of mobile object. InFIG.1, the mobile object100may, for example, be moving (traveling or slowing down) in the positive Y-axis direction (direction of travel) indicated in the figure, may be moving in another direction, or may be stationary and not moving.

As illustrated inFIG.1, the electronic device1including a transmission antenna is installed in the mobile object100. In the example illustrated inFIG.1, only one electronic device1, which includes a transmission antenna and a reception antenna, is installed at the front of the mobile object100. The position where the electronic device1is installed on or in the mobile object100is not limited to the position illustrated inFIG.1, and may be another position, as appropriate. For example, the electronic device1illustrated inFIG.1may be installed at the left side, the right side, and/or the rear of the mobile object100. The number of electronic devices1may be any suitable number of one or more depending on various conditions (or requirements) such as the range and/or accuracy of measurement in the mobile object100. The electronic device1may be installed inside the mobile object100. The inside of the mobile object100may be, for example, the space inside a bumper, the space inside the body, the space inside a headlight, or the driver's space.

The electronic device1transmits an electromagnetic wave as a transmission wave from the transmission antenna. For example, when there is a prescribed object (for example, an object200illustrated inFIG.1) in the surroundings of the mobile object100, at least part of a transmission wave transmitted from the electronic device1will be reflected by the object and become a reflection wave. The reflection wave is, for example, received by the reception antenna of the electronic device1, and in this way, the electronic device1installed in the mobile object100is able to detect the object as a target.

The electronic device1including the transmission antenna may typically be a radar (radio detecting and ranging (RADAR)) sensor that transmits and receives radio waves. However, the electronic device1is not limited to being a radar sensor. The electronic device1according to the embodiment may be a sensor based on light detection and ranging or laser imaging detection and ranging (LIDAR) technologies utilizing light waves. These kind of sensors may include patch antennas, for example. Since technologies such as RADAR and LIDAR are already well known, more detailed description thereof may be simplified or omitted as appropriate.

The electronic device1installed in the mobile object100illustrated inFIG.1receives, from the reception antenna, a reflection wave generated from a transmission wave transmitted from the transmission antenna. In this way, the electronic device1can detect the prescribed object200existing within a prescribed distance from the mobile object100as a target. For example, as illustrated inFIG.1, the electronic device1can measure a distance L between the mobile object100, which is the host vehicle, and the prescribed object200. The electronic device1can also measure the relative speed of the mobile object100, which is the host vehicle, and the prescribed object200. The electronic device1can also measure the direction (arrival angle θ) in which the reflection wave reflected from the prescribed object200arrives at the mobile object100, which is the host vehicle.

The object200may be at least one out of, for example, an oncoming vehicle traveling in a lane adjacent to the mobile object100, a car traveling next to the mobile object100, and vehicles in front of and behind and traveling in the same lane as the mobile object100. The object200may be any object that exists around the mobile object100such as a motorcycle, a bicycle, a stroller, a person such as a pedestrian, a living organism such as an animal or an insect, a guardrail, a median strip, a road sign, a sidewalk step, a wall, a manhole, or an obstacle. In addition, the object200may be in motion or stationary. For example, the object200may be an automobile that is parked or stationary in the surroundings of the mobile object100.

InFIG.1, the ratio of the size of the electronic device1to the size of the mobile object100does not necessarily represent the actual ratio. InFIG.1, a state is illustrated in which the electronic device1is installed on the outside of the mobile object100. However, in an embodiment, the electronic device1may be installed at any of various positions on or in the mobile object100. For example, in an embodiment, the electronic device1may be installed inside a bumper of the mobile object100so that the electronic device1does not appear outside the mobile object100.

Hereinafter, as a typical example, the transmission antenna of the electronic device1will be described as transmitting radio waves in a frequency band such as a millimeter wave band (greater than or equal to 30 GHz) or a quasi-millimeter wave band (for example, around 20 GHz to 30 GHz). For example, the transmission antenna of a sensor5may transmit radio waves with a frequency bandwidth of 4 GHz, such as from 77 GHz to 81 GHz.

FIG.2is a functional block diagram schematically illustrating an example configuration of the electronic device1according to the embodiment. Hereafter, an example of the configuration of the electronic device1according to the embodiment will be described.

Frequency-modulated continuous wave radar (hereinafter referred to as FMCW radar) is often used to measure distances using millimeter-wave radar. In FMCW radar, the transmission signal is generated by sweeping the frequency of the radio waves to be transmitted. Therefore, for example, in a millimeter-wave FMCW radar that uses radio waves in the 79 GHz frequency band, the frequency of the radio waves being used will have a frequency bandwidth of 4 GHz, for example, from 77 GHz to 81 GHz. Radar in the 79 GHz frequency band is characterized by having a wider usable frequency bandwidth than other millimeter/quasi-millimeter wave radars, for example, in the 24 GHz, 60 GHz, and 76 GHz frequency bands. Hereafter, such an embodiment will be described as an example.

As illustrated inFIG.2, the electronic device1according to the embodiment includes a signal processor10. The signal processor10may include a signal generation processor11, a reception signal processor12, and a communication interface13. The electronic device1according to the embodiment includes a transmission DAC21, a transmission circuit22, a millimeter wave transmission circuit23, and a transmission antenna array24as a transmission section. The electronic device1according to the embodiment further includes a reception antenna array31, a mixer32, a reception circuit33, and a reception ADC34as a reception section. The electronic device1according to the embodiment need not include all of the functional units illustrated inFIG.2and may include functional units other than those illustrated inFIG.2. The electronic device1illustrated inFIG.2may be configured using circuits that are basically the same as those used in general radars that use electromagnetic waves in the millimeter wave band or the like. However, in the electronic device1according to the embodiment, signal processing performed by the signal processor10includes processing that differs from that performed by general radars of the related art.

The signal processor10of the electronic device1according to the embodiment can control overall operation of the electronic device1including control of each functional unit constituting the electronic device1. In particular, the signal processor10performs various types of processing on the signals handled by electronic device1. The signal processor10may include at least one processor, such as a central processing unit (CPU) or a digital signal processor (DSP), in order to provide control and processing power to perform various functions. The signal processor10may be implemented collectively in a single processor, in several processors, or in individual processors. The processors may be implemented as a single integrated circuit. An integrated circuit may also be referred to as an IC. Processors may be implemented as multiple integrated circuits and discrete circuits connected so as to be able to communicate with each other. The processors may be realized based on various other known technologies. In the embodiment, the signal processor10may be configured, for example, as a CPU (hardware) and a program (software) executed by the CPU. The signal processor10may appropriately include a memory as needed for the operation of signal processor10.

The signal generation processor11of the signal processor10generates a signal to be transmitted from the electronic device1. In the electronic device1according to the embodiment, the signal generation processor11may generate a transmission signal such as a chirp signal (transmission chirp signal). In particular, the signal generation processor11may generate a signal having a frequency that varies periodically and linearly (linear chirp signal). For example, the signal generation processor11may generate a chirp signal whose frequency periodically and linearly increases from 77 GHz to 81 GHz over time. For example, the signal generation processor11may generate a signal whose frequency periodically repeatedly linearly increases (up chirp) and decreases (down chirp) from 77 GHz to 81 GHz over time. The signal generated by the signal generation processor11may be set in advance in the signal processor10, for example. The signal generated by the signal generation processor11may be stored in advance in a storage of the signal processor10, for example. Since chirp signals used in technical fields such as radar are known, detailed description thereof will be simplified or omitted as appropriate. The signal generated by the signal generation processor11is supplied to the transmission DAC21. Therefore, the signal generation processor11may be connected to the transmission DAC21.

The transmission digital-to-analog converter (DAC)21has a function of converting a digital signal supplied from the signal generation processor11into an analog signal. The transmission DAC21may include a general analog-to-digital converter. The signal generated by the analog conversion performed by the transmission DAC21is supplied to the transmission circuit22. Therefore, the transmission DAC21may be connected to the transmission circuit22.

The transmission circuit22has a function of converting the signal produced by the analog conversion performed by the transmission DAC21into a signal of an intermediate frequency (IF) band. The transmission circuit22may include a general IF band transmission circuit. A signal produced by processing performed by the transmission circuit22is supplied to the millimeter wave transmission circuit23. Therefore, the transmission circuit22may be connected to the millimeter wave transmission circuit23.

The millimeter wave transmission circuit23has a function of transmitting a signal produced by processing performed by the transmission circuit22as a millimeter wave (RF wave). The millimeter wave transmission circuit23may include a general millimeter wave transmission circuit. The signal produced by processing performed by the millimeter wave transmission circuit23is supplied to the transmission antenna array24. Therefore, the millimeter wave transmission circuit23may be connected to the transmission antenna array24. The signal produced by the processing performed by the millimeter wave transmission circuit23is also supplied to the mixer32. Therefore, the millimeter wave transmission circuit23may also be connected to the mixer32.

The transmission antenna array24is configured by arranging multiple transmission antennas in an array pattern. InFIG.2, the configuration of the transmission antenna array24is illustrated in a simplified manner. The transmission antenna array24transmits the signal produced by processing performed by the millimeter wave transmission circuit23to outside the electronic device1. The transmission antenna array24may include a transmission antenna array used in a general millimeter-wave radar.

Thus, the electronic device1according to the embodiment includes the transmission antenna array24and can transmit a transmission signal (for example, a transmission chirp signal) as a transmission wave from the transmission antenna array24.

For example, as illustrated inFIG.2, a case in which the object200exists in the surroundings of the electronic device1is assumed. In this case, at least part of the transmission wave transmitted from the transmission antenna array24is reflected by the object200. At least part of the wave reflected by object200out of the transmission wave transmitted from the transmission antenna array24may be reflected towards the reception antenna array31.

The reception antenna array31receives the reflection wave. Here, the reflection wave may be at least part of the wave reflected by the object200out of the transmission wave transmitted from the transmission antenna array24.

The reception antenna array31is configured by arranging multiple reception antennas in an array pattern. InFIG.2, the configuration of the reception antenna array31is illustrated in a simplified manner. The reception antenna array31receives a reflection wave resulting from reflection of the transmission wave transmitted from the transmission antenna array24. The reception antenna array31may include a reception antenna array used in a typical millimeter-wave radar. The reception antenna array31supplies a reception signal received as a reflection wave to the mixer32. Therefore, the reception antenna array31may be connected to the mixer32.

The mixer32converts the signal produced by processing performed by millimeter wave transmission circuit23(transmission signal) and the reception signal received by reception antenna array31into a signal of an intermediate frequency (IF) bandwidth. The mixer32may include a mixer used in a general millimeter wave radar. The mixer32supplies the resulting combined signal to the reception circuit33. Therefore, the mixer32may be connected to the reception circuit33.

The reception circuit33has a function of analog processing the signal converted to an IF band by the mixer32. The reception circuit33may include a typical reception circuit that converts a signal into an IF band. A signal produced by processing performed by the reception circuit33is supplied to the reception ADC34. Therefore, the reception circuit33may be connected to the reception ADC34.

The reception analog-to-digital converter (ADC)34has a function of converting the analog signal supplied from the reception circuit33into a digital signal. The reception ADC34may include a general analog-to-digital converter. A signal digitized by the reception ADC34is supplied to the reception signal processor12of the signal processor10. Therefore, the reception ADC34may be connected to the signal processor10.

The reception signal processor12of the signal processor10has a function of performing various types of processing on a digital signal supplied from the reception DAC34. For example, the reception signal processor12calculates the distance from the electronic device1to the object200(distance measurement) based on the digital signal supplied from the reception DAC34. The reception signal processor12calculates the velocity of the object200relative to the electronic device1(velocity measurement) based on the digital signal supplied from the reception DAC34. The reception signal processor12calculates the azimuth angle of the object200as seen from the electronic device1(angle measurement) based on the digital signal supplied from the reception DAC34. Specifically, UQ converted data may be input to the reception signal processor12. In response to input of the data, the reception signal processor12performs a fast Fourier transform (2D-FFT) in distance (Range) and velocity (Velocity) directions, respectively. After that, the reception signal processor12suppresses false alarms and makes the probability of false alarms constant by removing noise points through, for example, universal asynchronous receiver transmitter (UART) and/or constant false alarm rate (CFAR) processing. The reception signal processor12then obtains the position of the object200by, for example, performing arrival angle estimation for a point that satisfies the CFAR criteria. The information generated as a result of the distance, velocity, and angle measurements performed by reception signal processor12is supplied to communication interface13.

The communication interface13of the signal processor10includes an interface that outputs information from the signal processor10, for example, to an external controller50. The communication interface13outputs information on at least any one of the position, velocity, and angle of the object200, for example, as a controller area network (CAN) signal to outside the signal processor10. Information on at least any one of the position, velocity, and angle of the object200is supplied to the controller50via the communication interface13. Therefore, the communication interface13may be connected to the signal processor10.

As illustrated inFIG.2, the electronic device1according to the embodiment may be connected to the controller50, for example, an electronic control unit (ECU), in a wireless or wired manner. The controller50controls various operations of the mobile object100. The controller50may consist of at least one ECU.

FIG.3is a diagram for explaining an example of chirp signals generated by the signal generation processor11of the signal processor10.

FIG.3illustrates the temporal structure of one frame when a fast-chirp modulation (FCM) method is used.FIG.3illustrates an example of a reception signal of an FCM method. FCM is a method in which chirp signals, represented inFIG.3as c1, c2, c3, c4, . . . , cn, are repeated at short intervals (for example, greater than or equal to the round trip time between the radar and the object target for electromagnetic waves calculated from the maximum measurement distance). In FCM, for convenience of signal processing of reception signals, transmission and reception processing is often performed by dividing a signal into sub frame units as illustrated inFIG.3.

InFIG.3, the horizontal axis represents the passage of time and the vertical axis represents frequency. In the example illustrated inFIG.3, the signal generation processor11generates linear chirp signals whose frequency varies periodically and linearly. InFIG.3, the chirp signals are illustrated as c1, c2, c3, c4, . . . , cn. As illustrated inFIG.3, in each chirp signal, the frequency increases linearly with time.

In the example illustrated inFIG.3, several chirp signals are included illustrated as c1, c2, c3, c4, . . . , cn and make up one sub frame. That is, sub frame1, sub frame2, and so on illustrated inFIG.3are each composed of several chirp signals c1, c2, c3, c4, . . . , cn. In the example illustrated inFIG.3, several sub frames are included, such as sub frame1, sub frame2, . . . , sub frame N, and make up one frame. In other words, the one frame illustrated inFIG.3consists of N sub frames. The one frame illustrated inFIG.3may be frame1, and may be followed by frame2, frame3, . . . , and so on. Each of these frames may consist of N sub frames, similarly to frame1. A frame interval of a prescribed length may be included between the frames. The one frame illustrated inFIG.3may have a length of around 30 to 50 milliseconds, for example.

In the electronic device1according to the embodiment, the signal generation processor11may generate a transmission signal having a suitable number of frames. InFIG.3, illustration of some of the chirp signals is omitted. Thus, the relationship between the time and frequency of the transmission signal generated by signal generation processor11may be stored, for example, in a storage unit of the signal processor10.

Thus, the electronic device1according to the embodiment may transmit a transmission signal consisting of a sub frame containing multiple chirp signals. The electronic device1according to the embodiment may transmit a transmission signal consisting of a frame containing a prescribed number of sub frames.

Hereafter, the electronic device1will be described as transmitting a transmission signal having the frame structure illustrated inFIG.3. However, the frame structure illustrated inFIG.3is merely an example and, for example, the number of chirp signals included in one sub frame may be set as appropriate. In other words, in the embodiment, the signal generation processor11may generate a sub frame containing a suitable number (for example, a suitable plurality of) chirp signals. The sub frame structure illustrated inFIG.3is also merely an example and the number of sub frames included in one frame may be set as appropriate. In other words, in the embodiment, the signal generation processor11may generate a frame containing a suitable number (for example, a suitable plurality of) sub frames. The signal generation processor11may generate signals having different frequencies. The signal generation processor11may generate multiple discrete signals of bandwidths having different frequencies f.

FIG.4is a diagram illustrating part of the sub frames inFIG.3in a different manner.FIG.4illustrates samples of a reception signal resulting from reception of the transmission signal illustrated inFIG.3obtained by performing a two-dimensional fast Fourier transform (2D-FFT). The 2D-FFT is a process performed in the reception signal processor12(FIG.2) of the signal processor10.

As illustrated inFIG.4, the chirp signals c1, c2, c3, c4, . . . , cn are stored in the individual sub frames, i.e., sub frame1, . . . , sub frame N. InFIG.4, the chirp signals c1, c2, c3, c4, . . . , cn each consist of samples represented by a horizontally arrayed row of squares. The reception signal illustrated inFIG.4is subjected to 2D-FFT, CFAR, and integrated signal processing for each sub frame in the reception signal processor12illustrated inFIG.2.

FIG.5illustrates an example of a point group on a range-Doppler (distance-velocity) plane calculated by performing 2D-FFT, CFAR, and integrated signal processing of each sub frame in the reception signal processor12illustrated inFIG.2.

InFIG.5, the horizontal direction represents range (distance) and the vertical direction represents velocity. A shaded point group s1, illustrated inFIG.5, is a group of points representing a signal that exceeds the CFAR threshold process. An unshaded point group s2, illustrated inFIG.5, illustrates a bin (2D-FFT sample) that did not exceed the CFAR threshold and does not have point group. For the point groups on the range-Doppler plane calculated inFIG.5, the direction from the radar is calculated by direction estimation, and the position and velocity on a 2D plane are calculated as a point group representing the object200. Here, the direction estimation may be calculated using beamformers and/or subspace methods. Examples of typical subspace method algorithms include multiple signal classification (MUSIC) and estimation of signal parameters via rotation invariance technique (ESPRIT).

FIG.6illustrates an example of results obtained by the reception signal processor12transforming the point group coordinates from the range-Doppler plane illustrated inFIG.5to the XY plane after the direction estimation. As illustrated inFIG.6, the reception signal processor12is able to plot a point group PG on the XY plane. The point group PG is made up of individual points P. Each point P has an angle θ and a radial velocity Vr in polar coordinates.

The reception signal processor12detects an object present in the range where a transmission wave T was transmitted based on at least one out of the 2D-FFT and angle estimation results. The reception signal processor12may perform object detection by performing clustering processing, for example, based on the estimated distance information, velocity information, and angle information. For example, density-based spatial clustering of applications with noise (DBSCAN) is a well-known algorithm used for clustering of data. This is an algorithm for performing clustering based on density. In the clustering processing, for example, the average power of points making up the detected object may be calculated. The distance information, velocity information, angle information, and power information of the object detected in the reception signal processor12may be supplied to the controller50, for example. In this case, if the mobile object100is an automobile, communication may be performed through the communication interface13such as a controller area network (CAN), for example.

As described above, the electronic device1may include the transmission antenna24, the reception antenna31, and the reception signal processor10. The transmission antenna24transmits the transmission wave T. The reception antenna31receives a reflection wave R resulting from reflection of the transmission wave T. The signal processor10detects an object (for example, the object200) that reflects the transmission wave T based on a transmission signal transmitted as the transmission wave T and a reception signal received as the reflection wave R.

Clustering Performed By Electronic Device According to Embodiment

Next, in describing operation of the electronic device1according to the embodiment, first, clustering in general radar technology will be described. In particular, clustering based on DBSCAN, which is widely used in general radar technologies and so on will be described.

DB SCAN is a well-known algorithm for clustering (grouping) data. DB SCAN is widely employed for clustering (grouping) data points detected by millimeter wave radar based on reflection waves. In DBSCAN, a parameter c is introduced and a group of points for which a distance is smaller than c are classified as belonging to the same group (cluster). Therefore, for example, if the distance between point P1and point P2is smaller than £, and the distance between point P2and point P3is also smaller than £, then point P1and point P3can also be classified into the same cluster. In this case, for example, even if the distance between point P1and point P3is greater than £, point P1and point P3can be classified into the same cluster because the above conditions are satisfied. Thus, for example, as a point group becomes more numerous, two points located at a considerable distance from each other may be classified into the same cluster.

Thus, in DBSCAN, points that do not actually correspond to a single object may be clustered as one single object (strictly speaking, in DBSCAN, there are attempts to deal with the above situation by taking parameters other than c into consideration). For example, in a situation where a pedestrian is standing near a wall, the wall and the pedestrian might be clustered as a single object. Hereinafter, such characteristics of DBSCAN will be described more specifically.

FIG.7is a diagram for describing an example of general clustering. The arrow illustrated in the center ofFIG.7is supposed to conceptually represent the clustering processing based on DBSCAN. That is, the situation that exists before the DBSCAN-based clustering processing is executed is illustrated on the left side ofFIG.7. The situation that exists after the DBSCAN-based clustering processing has been executed is illustrated on the right side ofFIG.7.

As illustrated on the left side ofFIG.7, for example, a situation is assumed in which point groups have been obtained based on a radar reception signal before clustering processing. As illustrated inFIG.7, a first point group PG1and a second point group PG2and another point N1are assumed to have been obtained before the clustering processing. In this situation, clustering processing based on DB SCAN is assumed to be performed. In this case, the first point group PG1, the points of which are relatively close to each other (distances are less than ε), are classified into a first cluster C1. The second point group PG2, the points of which are relatively close to each other (distances are less than ε), are classified into a second cluster C2. The other point N1, which is relatively far away from the other point groups (distance is greater than ε), is regarded as noise and not classified into either the first cluster C1or the second cluster C2.

FIG.8is a diagram for describing another example of general clustering. The meaning of the symbols inFIG.8are substantially the same as those inFIG.7.

As illustrated on the left side ofFIG.8, for example, a situation is assumed in which point groups have been obtained based on a radar reception signal before clustering processing. As illustrated inFIG.8, a first point group PG1and a second point group PG2and another point N1are assumed to have been obtained before the clustering processing. InFIG.8, the first point group PG1and the second point group PG2are closer to each other than in the situation illustrated inFIG.7. In this situation, clustering processing based on DBSCAN is assumed to be performed. In this case, as illustrated inFIG.8, the first point group PG1and second point group PG2can be classified as the same cluster C3because the points of these groups are relatively close to each other (distances are less than ε). If the first point group PG1and second point group PG2are point groups representing a single object, then proper clustering has been performed and there is no problem. However, if the first point group PG1and the second point group PG2are point groups representing different objects, as illustrated inFIG.7, this means that proper clustering has not been performed, which may cause inconveniences.

Therefore, the electronic device1according to the embodiment does not perform clustering uniformly across the entire area, but rather, for example, classifies point groups in accordance with a prescribed parameter and performs clustering for each of the classified point groups. This operation will be further described below.

In the embodiment, the electronic device1classifies the point groups in accordance with a prescribed parameter before performing clustering on the point groups obtained based on a reception signal. The prescribed parameter may be, for example, “distance” in a prescribed direction.

For example, suppose that the point groups illustrated inFIG.9are obtained in the electronic device1based on a reception signal. For example, as illustrated inFIG.9, suppose there are multiple data points having x, y coordinates from a prescribed reference point on a plane (i.e., a distance x from the reference point and a distance y from the reference point). When the electronic device1according to the embodiment is a millimeter wave radar, the (x, y) values detected based on reflection waves reflected from various objects with the electronic device1serving as the reference point may be considered to correspond to the above data points. InFIG.9, the vertical axis represents a distance Y from the electronic device1. The distance Y may be defined as a distance in front of the electronic device1(mobile object100), similarly to the coordinates illustrated inFIG.1.

Next, the electronic device1classifies the point groups illustrated inFIG.9in accordance with the prescribed parameter. For example, in the direction of the distance Y, the point groups may be classified in accordance with the distance parameter Y, from 0 m to 10 m, from 10 m to 20 m, from 20 m to 30 m, . . . , and so on, up to a maximum value y. More specifically, the electronic device1may classify the point groups illustrated inFIG.9, for example, into a section PS1from 0 m to 10 m, a section PS2from 10 m to 20 m, a section PS3from 20 m to 30 m, . . . and so on. The point groups illustrated inFIG.9are illustrated as being classified only into the section PS1and the section PS2, but the point groups may also be classified into a section PS3and further sections.

Here, in the above example, the point groups were classified into 10-meter units in accordance with the distance parameter Y. However, the point groups may instead be classified into other units such as 8 or 12 meters. InFIG.9, a situation is assumed in which the electronic device1is a radar sensor installed in the mobile object (automobile)100as illustrated inFIG.1as an example. For example, automobiles in the opposite lane or vehicles traveling in front, ranging from regular automobiles to trucks, are assumed to have an approximate total length of not more than 10 meters. Therefore, in accordance with the distance parameter Y in the electronic device1according to the embodiment, the point groups may be classified as 10-meter units. However, in other applications, the electronic device1according to the embodiment may classify the point groups using other units. For example, the electronic device1according to the embodiment may determine the units to be used for classifying the point groups in accordance with the size (for example, total length) of the objects to be detected.

As illustrated inFIG.9, once the point groups have been classified in accordance with the prescribed parameter, for example, the electronic device1performs clustering on each of the classified point groups. For example, inFIG.9, the electronic device1may perform clustering on each of the point group classified into the section PS1and the point group classified into the section PS2.

FIG.10is a flowchart for describing operation of the electronic device1according to the embodiment.FIG.10illustrates an example of the operation of the electronic device1described above. The operation illustrated inFIG.10may begin when point groups are obtained based on the reception signal in the electronic device1. The operation illustrated inFIG.10may be performed in the signal processor10of the electronic device1according to the embodiment, more specifically, in the reception signal processor12of the signal processor10.

Once the operation illustrated inFIG.10begins, the reception signal processor12classifies the obtained point groups in accordance with a prescribed parameter (Step S1). Once the point groups have been classified in Step S1, the reception signal processor12performs clustering on each of the classified point groups (Step S2).

Thus, in the electronic device1according to the embodiment, the signal processor10may classify the point groups representing an object in accordance with a prescribed parameter when performing clustering on the results of object detection. In this case, the signal processor10may classify the point group representing the object into prescribed units, for example, units of 10 meters.

In this way, points that do not actually belong to a single object can be distinguished from each other and detected without being detected as a single object. For example, according to the electronic device1, walls and pedestrians can be clustered separately from each other, even in a situation such as where a pedestrian is standing near a wall. Therefore, according to the electronic device1of the embodiment, a prescribed object can be well detected by receiving the reflection wave generated by the transmitted transmission wave being reflected by the object.

In the embodiment described above, the parameter of the “distance” in the Y-axis direction is employed in classifying the point groups in accordance with a prescribed parameter. However, in an embodiment, parameters that can be employed in classifying point groups in accordance with prescribed parameters are not limited to distance. For example, the electronic device1according to the embodiment may classify point groups in accordance with various parameters that reflect prescribed physical properties of the objects, such as velocity, angle, weight, and so on, rather than distance. In this case as well, the electronic device1according to the embodiment may perform clustering for each of the classified point groups.

In an embodiment, when the point groups are classified in accordance with the parameter of distance, for example, the point groups may be classified in accordance with the parameter of a difference in distance. In this case, the “distance” may be a Euclidean distance, a Mahalanobis distance, and so on. In an embodiment, when the point groups are classified in accordance with the parameter of velocity, for example, the point groups may be classified in accordance with the parameter of a difference in velocity. In an embodiment, when the point groups are classified in accordance with the parameter of angle, for example, the point groups may be classified in accordance with the parameter of a difference in angle.

In the embodiment described above, a parameter such as the distance in a prescribed direction with respect to Cartesian coordinates (x, y) was employed to classify point groups in accordance with a prescribed parameter. However, in an embodiment, a parameter such as distance in a prescribed direction with respect to polar coordinates (r, θ) may be employed to classify point groups in accordance with a prescribed parameter.

Correction of Clustering Performed By Electronic Device According to Embodiment

Next, correction of the above-described embodiment will be further described.

According to the electronic device1of the above-described embodiment, the risk of detecting objects that are not actually a single object as a single object can be reduced. On the other hand, according to the above-described embodiment, objects that are actually a single object may be possibly detected as different objects.

For example, suppose that the point group illustrated inFIG.11is obtained in the electronic device1based on the reception signal. In this case, similarly to as described above, a case where classification is performed with the section PS1being from 0 m to 10 m, the section PS2being from 10 m to 20 m, . . . and so on will be considered.

In this case, the electronic device1may perform clustering on each of the point group classified into the section PS1and the point group classified into the section PS2. Therefore, the electronic device1detects the point groups illustrated inFIG.11as two separate objects. If the point group classified into section PS1and the point group classified into section PS2are point groups representing different objects, then proper clustering has been performed and there is no problem. However, if the point group classified into section PS1and the point groups classified into section PS2are point groups representing a single object, then proper clustering has not been performed, which may cause inconveniences.

Therefore, in the electronic device1according to the embodiment, the operation illustrated inFIG.10may be followed by correction performed as necessary. This operation will be further described below.

FIG.12is a flowchart for describing a correction operation of the electronic device1according to the embodiment. The operation illustrated inFIG.12may be performed immediately after the operation illustrated inFIG.10.

When the operation illustrated inFIG.12begins, the reception signal processor12calculates representative points of clusters of adjacent sections among sections of the point groups (Step S11). The sections of the point groups in Step S11may be sections of the point groups classified in Step S1inFIG.10. In the present disclosure, a representative point of a cluster may be a representative point of a clustered point group.

For example, the section PS1and the section PS2illustrated inFIG.9may be “adjacent sections” in Step S11. A representative point calculated in Step S11may be a single point if the clustered point group (cluster) consists of only one point. If the clustered point group (cluster) consists of multiple points, the representative point calculated in Step S11may be a point based on the average value, median value, or the like in a prescribed direction. For example, if the clustered point group consists of multiple points, the reception signal processor12may calculate a representative point using the average of the X coordinates of the multiple points as the X coordinate and using the average of the Y coordinates of the multiple points as the Y coordinate. For example, if the point group consists of multiple points, the reception signal processor12may calculate a representative point using the median of the X coordinates of the multiple points as the X coordinate and the median of the Y coordinates of the multiple points as the Y coordinate. As an example, the representative point of the point group of the cluster included in the section PS1illustrated inFIG.9may be the point at the position marked with a cross in PS1. As an example, the representative point of the point group of the cluster included in the section PS2illustrated inFIG.9may be the point at the position marked with a cross (x) in PS2.

Thus, in an embodiment, the signal processor10may calculate the representative point of each clustered point group included in adjacent sections classified in accordance with a prescribed parameter based on the average or median values of the coordinates of the point groups in a prescribed direction in the adjacent sections. Here, a representative point may be a point that is only found in a cluster, which is a clustered point group, and is representative of that cluster. If a cluster is linked to one car for example, a point in the cluster may be considered a representative point in the sense that the point, which is a single point, represents the position of the car. A point group before clustering simply means points distributed across the X-Y plane, and may be assumed to not be linked a particular car or the like and not have a representative point.

After the representative points of the clusters in the adjacent sections have been calculated in Step S11, the reception signal processor12determines whether the distance between the representative points of the clusters in the adjacent sections is smaller than a prescribed threshold (Step S12). The prescribed threshold used in the determination in Step S12may be set as appropriate so that objects that are actually a single object are appropriately determined to be a single object and so that actually separate objects are appropriately determined to be different objects. Here, the prescribed threshold may be set as 1 m as an example.

If the distance between the representative points of the clusters in the adjacent sections is not smaller than the prescribed threshold in Step S12, the clusters in the adjacent sections are determined to be at or more than a prescribed distance from each other. In this case, the reception signal processor12may skip the distance in Step S13and finish the operation illustrated inFIG.12. In other words, in this case, the point groups included in the adjacent sections are processed as they are (as they were classified in Step S1) as point groups of different objects.

On the other hand, if the distance between the representative points of the clusters in the adjacent sections is smaller than the prescribed threshold in Step S12, the reception signal processor12may process the point groups included in the adjacent sections as point groups of a single object (Step S13).

In Step S13, when the point groups in adjacent sections are processed as point groups of a single object, specifically, for example, one of the following two processes may be performed.

In other words, in Step S13, the reception signal processor12may recalculate the representative point while regarding the point groups included in the adjacent sections as a single point group. In Step S12ofFIG.12, it is assumed that the reception signal processor12compares all the distances of the clusters based on two adjacent sections, for example, the section from 0 m to 10 m in distance and the section from 10 m to 20 m in distance. However, in Step S12ofFIG.12, the reception signal processor12may compare the distances of clusters based on smaller sections. For example, the reception signal processor12may compare the distance between a representative point in a section from 5 m to 10 m and a representative point in the section from 10 m to 15 m.

Thus, when the distance between the representative points of the clustered point groups included in adjacent sections and classified in accordance with the prescribed parameter is smaller than the prescribed threshold, the signal processor10may calculate a representative point while treating the point groups included in the adjacent sections as point groups of a single object.

For example, in Step S13, the reception signal processor12may, for example, nullify the adjacent sections and perform the clustering processing based on DBSCAN again while treating the adjacent sections as a single section. For example, suppose that the distance between the representative points of two (or more) clusters contained in two adjacent sections, one in a section from 0 m to 10 m in distance and the other in a section from 10 m to 20 m in distance, is smaller than the prescribed threshold. In this case, the reception signal processor12may again perform clustering processing based on DBSCAN for a single section, for example, from 0 m to 20 m in distance.

Thus, when the distance between the representative points of the clusters contained in the adjacent sections classified in accordance with the prescribed parameter is smaller than the prescribed threshold, the signal processor10may cluster the point groups contained in the adjacent sections as point groups of a single object.

As described above, in an embodiment, the signal processor10may process the point groups included in adjacent sections classified in accordance with the prescribed parameter as point groups of a single object when the distance between the representative points of the clusters included in the adjacent sections is smaller than a prescribed threshold.

Selective Clustering Performed By Electronic Device According to Embodiment

The electronic device1according to the embodiment described above has been described while assuming that all the point groups obtained based on the reception signal are classified in a uniform manner in accordance with the prescribed parameter. However, the electronic device1according to the embodiment may selectively classify point groups obtained based on the reception signal in accordance with the prescribed parameter. This operation will be further described below.

FIG.13is a flowchart describing the operation of selective clustering performed by the electronic device1according to the embodiment. The operation illustrated inFIG.13may be performed instead of the operation illustrated inFIG.10, for example. In other words, it may be assumed that point groups are obtained based on the reception signal in the electronic device1at the time the operation illustrated inFIG.13begins.

When the operation illustrated inFIG.13begins, the reception signal processor12performs clustering processing based on DBSCAN, for example, on the point groups obtained based on the reception signal (Step S21). Up to the operation in Step S21, processing substantially the same as that performed in DBSCAN-based clustering of the related art may be performed. That is, in Step S21, the reception signal processor12may uniformly perform clustering based on DBSCAN for all the point groups obtained based on the reception signal.

Once clustering has been performed in Step S21, the reception signal processor12determines whether the size of each cluster obtained by the clustering is larger than a prescribed threshold (Step S22).

The “cluster size” in Step S22may be calculated in the following way, for example. For example, the “cluster size” in Step S22may be determined based on an average value dm of the distances between the representative point of the cluster and the points in the cluster, as illustrated in Equation (1) below. In Step S22, the reception signal processor12may determine that the cluster size is larger than the prescribed threshold, for example, when the average value dm exceeds a threshold of 5 m.

where N is the number of points in the cluster. In addition, (x0, y0) represents the coordinates of the representative point of the cluster. The representative point of this cluster may be calculated as described inFIG.9, for example. In addition, (xi, yi) (i=1, . . . , N) represents the x coordinate and the y coordinate (distance in x direction and distance in y direction) of a point in the cluster. The size of the cluster may be determined based on, for example, the average of the points in the cluster or the median of the points in the cluster. In the present disclosure, the size of the cluster may be the size of a clustered point group.

When the cluster size is not larger than the prescribed threshold in Step S22, the reception signal processor12may terminate the operation illustrated inFIG.13. On the other hand, when the cluster size is larger than the prescribed threshold in Step S22, the reception signal processor12may perform the processing illustrated in Step S23. In Step S23, the reception signal processor12may perform clustering based on DBSCAN, for example, to classify the point groups in that cluster in accordance with the prescribed parameter. Here, the reception signal processor12may classify the point groups in the cluster in accordance with the prescribed parameter, in the same manner as in Step S1illustrated inFIG.10, for example.

The “cluster size” in Step S22may be calculated in the following way, for example. For example, the “cluster size” in Step S22may be determined based on a maximum value dmax of the distances between the representative point of the cluster and the points in the cluster, as illustrated in Equation (2) below. In Step S22, the reception signal processor12may determine that the cluster size is larger than the prescribed threshold, for example, when the average value dmax exceeds a threshold of 10 m.

[Math⁢2]d⁢max=max1≤i≤N⁢(xi-x0)2+(yi-y0)2(2)where N is the number of points in the cluster. In addition, (x0, y0) represents the coordinates of the representative point of the cluster. In addition, (xi, yi) (i=1, . . . , N) represents the x coordinate and the y coordinate (distance in x direction and distance in y direction) of a point in the cluster.

The “cluster size” in Step S22may be calculated using another method. For example, the “cluster size” in Step S22may be determined based on the difference between the maximum values and the minimum values of the x and y coordinates of the points in the cluster. For example, the “cluster size” in Step S22may be determined based on the variance of the x and y coordinates of the points in the cluster.

In Step S23illustrated inFIG.13, the reception signal processor12may classify point groups from a minimum distance ymin in the y direction to a maximum distance ymax in the y direction, for example. In this case, the reception signal processor12may classify the point groups, for example, from ymin to ymin+10 m, from ymin+10 m to ymin+20 m, and so on. In Step S23illustrated inFIG.13, the reception signal processor12may perform clustering based on DB SCAN for the clusters classified as described above. In addition, the reception signal processor12may further perform clustering correction as described above after performing the clustering based on DBSCAN.

In Step S23illustrated inFIG.13, the reception signal processor12may determine the direction in which to classify each point group in accordance with the direction of the cluster size, for example. In this case, the reception signal processor12may calculate the difference between the maximum values and the minimum values of the distances in the x and y directions of the points in that cluster. For example, if the maximum value in the x direction of a point in the cluster is denoted as xmax and the minimum value as xmin, the difference between the maximum and minimum distance in the x direction, Δx, is xmax−xmin. If the maximum value in the y direction of the point in the cluster is denoted as ymax and the minimum value as ymin, the difference between the maximum value and the minimum value of the distance in the y direction, Δy, is ymax−ymin. Here, the reception signal processor12may classify the point groups in the x-direction and perform clustering based on DB SCAN for each of the classified clusters when Δx>Δy. On the other hand, the reception signal processor12may, for example, classify the point groups in the y direction when Δx<Δy, and perform clustering based on DB SCAN for each of the classified clusters.

As described above, in an embodiment, the signal processor10may selectively classify point groups representing objects in accordance with a prescribed parameter. In this case, the signal processor10may selectively classify point groups representing objects in accordance with the prescribed parameter when the size of the clusters obtained through clustering is greater than or equal to a prescribed threshold.

Dimensions of Clustering Performed By Electronic Device According to Embodiment

As illustrated inFIG.9, for example, in the embodiment described above, the reception signal processor12classifies the point groups in the Y direction or the X direction, i.e., the point groups are classified in one dimension. However, the reception signal processor12may classify the point groups in two or more dimensions, for example. For example, the reception signal processor12may classify the point groups in the x-direction and the y-direction (and the z-direction may also be included). In this case, the reception signal processor12may perform clustering based on DBSCAN in two or more dimensions for each of the sections classified in two or more dimensions.

The present disclosure has been described based on the drawings and examples, but note that a variety of variations and amendments may be easily made by one skilled in the art based on the present disclosure. Therefore, note that such variations and amendments are included within the scope of the present disclosure. For example, the functions included in each functional part can be rearranged in a logically consistent manner. Multiple functional parts and so forth may be combined into a single part or divided into multiple parts. Further, each embodiment according to the present disclosure described above does not need to be implemented exactly as described in the embodiment, and may be implemented with features having been combined or omitted as appropriate. A variety of variations and amendments to the content of the present disclosure can be made by one skilled in the art based on the present disclosure. Accordingly, such variations and amendments are included in the scope of the present disclosure. For example, in each embodiment, each functional part, each means, each step and so on can be added to other embodiments so long as there are no logical inconsistencies, or can be replaced with each functional part, each means, each step, and so on of other embodiments. In each embodiment, a plurality of each functional part, each means, each step, and so on can be combined into a single functional part, means, or step or divided into multiple functional parts, means, or steps. Each of the above-described embodiments of the present disclosure is not limited to faithful implementation of each of the described embodiments, and may be implemented by combining or omitting some of the features as appropriate.

The above-described embodiment is not limited to only being implemented as the electronic device1. For example, the embodiment described above may be implemented as a method of controlling a device such as the electronic device1. For example, the embodiment described above may be implemented as a program executed by a device such as the electronic device1.

REFERENCE SIGNS