Patent Description:
The proposed solution relates to an electronic device of claim <NUM>, a method of claim <NUM> and an input device of claim <NUM>. This document describes techniques and systems that enable a radar-image shaper for radar-based applications. The techniques and systems use a radar field to enable an electronic device to accurately determine a characteristic disposition of an object - in the form of an input device - in the radar field (a location, an orientation, a velocity, or a direction of the object at a particular time). The object's characteristic disposition is determined by detecting a radar signature (or radar cross-section) of a radar-image shaper that is included in the object. The radar-image shaper is a component made from a specified material and having a specific shape that produces a known signature when illuminated by the radar field. Using these techniques, the electronic device can determine a characteristic disposition of the object, which allows the object to be used to interact with the electronic device with gestures and other position-based techniques. Because the radar-image shaper enables an otherwise passive object to control applications on the electronic device, users have an interaction method with a rich library of gestures and controls that do not require additional components or a battery.

Aspects described below include an electronic device comprising a radar system, one or more computer processors, and one or more computer-readable media. The radar system is implemented at least partially in hardware and provides a radar field. The radar system also senses reflections from an object in the radar field and analyzes the reflections from the object in the radar field. The radar system further provides, based on the analysis of the reflections, radar data. The one or more computer-readable media include stored instructions that can be executed by the one or more computer processors to implement a radar-signature manager. The radar-signature manager detects, based on a first subset of the radar data, a radar signature of a radar-image shaper of the object in the radar field. The radar-signature manager also compares the detected radar signature to a benchmark radar signature that corresponds to a characteristic disposition of the radar-image shaper and determines, based on the comparison, that the detected radar signature matches the benchmark radar signature. In response to the determination that the detected radar signature matches the benchmark radar signature, the radar-signature manager determines, based on the characteristic disposition of the radar-image shaper that corresponds to the matched benchmark radar signature, a characteristic disposition of the object in the radar field.

Aspects described below also include a method implemented by an electronic device that includes a radar system. The method comprises providing, by the radar system, a radar field, and sensing, by the radar system, reflections from an object in the radar field. The method also includes analyzing the reflections from the object in the radar field and providing, based on the analysis of the reflections, radar data. The method additionally includes detecting, based on a first subset of the radar data, a radar signature of a radar-image shaper of the object and comparing the detected radar signature to a benchmark radar signature that corresponds to a characteristic disposition of the radar-image shaper. The method also includes determining, based on the comparison, that the detected radar signature matches the benchmark radar signature. The method additionally includes, responsive to determining that the detected radar signature matches the benchmark radar signature, determining a characteristic disposition of the object in the radar field, based on the characteristic disposition of the radar-image shaper that corresponds to the matched benchmark radar signature.

Aspects described below include an input device, also referred to as controller herein, comprising a housing and a radar-image shaper integrated with the housing. The radar-image shaper is configured to provide a radar signature that is detectable by a radar system, and the radar signature is effective to enable the radar system to determine a characteristic disposition of the housing.

Aspects described below also include a system comprising an electronic device that includes, or is associated with, a first means. The first means is a means for providing a radar field, sensing reflections from an object in the radar field, analyzing the reflections from the object in the radar field, and providing, based on the analysis of the reflections, radar data. The system also includes a second means. The second means is a means for detecting, based on a first subset of the radar data, a radar signature of a radar-image shaper of the object in the radar field. The second means also compares the detected radar signature to a benchmark radar signature that corresponds to a characteristic disposition of the radar-image shaper and determines, based on the comparison, that the radar signature matches the benchmark radar signature. In response to the determination that the radar signature matches the benchmark radar signature, the second means determines a characteristic disposition of the object in the radar field, based on the characteristic disposition of the radar-image shaper that corresponds to the matched benchmark radar signature.

Aspects described below also include a system comprising an electronic device and a controller, for example a stylus, wherein the electronic device implements a radar-signature manager, which is in particular configured to determine, based on a characteristic disposition of a radar-image shaper, a characteristic disposition of the controller in a radar field, and wherein the controller includes a housing integrating the radar-image shaper.

Generally, aspects of the proposed electronic device can be combined with embodiments of the proposed method, the proposed controller, and the proposed system.

This summary is provided to introduce simplified concepts concerning a radar-image shaper for radar-based applications, which is further described below in the Detailed Description and Drawings. This summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter.

The details of one or more aspects of a radar-image shaper for radar-based applications are described in this document with reference to the following drawings. The same numbers are used throughout the drawings to reference like features and components:.

This document describes techniques and systems that enable a radar-image shaper for radar-based applications. As noted, using a trackable controller can be convenient, but may be frustrating for complex tasks that require multiple gestures or that have multiple modes. Further, even when the motion-based controller is an active device with its own components and power, it can be inconvenient to change modes or interaction methods, which can be frustrating to users, especially when working in a creative or competitive environment such as content creation or gaming. Thus, users may not realize the full potential of their applications because of limitations of the input device. The described techniques and systems employ a radar-image shaper in an object, such as a controller, that provides a unique radar reflection that can be detected by a radar system to accurately determine a characteristic disposition of the object. In this case, accuracy is an increased degree of refinement, an increased conformity to truth, or both the increased degree of refinement and the increased conformity to truth. These techniques enable an increased amount of gestures and gesture combinations to be generated with a controller. Additionally, the described techniques are effective without adding electronic components or a power source to the controller. Because the radar system can accurately determine the gestures and improve the performance of the system while reducing the component count and power consumption, interactions may be more convenient and less frustrating. Further, the radar system can use other radar data (e.g., azimuth and range data) to determine a three-dimensional (3D) position of a radar-image shaper as well as movement and acceleration, in particular if at least two radar-image shapers are included in the object.

Consider a controller, such as a gaming controller, that includes one or more radar-image shapers. The controller can be used with a gaming console or other electronic device that includes a radar-signature manager and a radar system that can be used to provide a radar field near the electronic device. The radar field can detect a radar signature of the radar-image shaper and, based on the radar signature, determine the characteristic disposition of the controller. For example, a gaming controller for playing an airplane-flying game or simulator may include a radar-image shaper at each end of the controller. The radar system in the gaming console can detect radar reflections from the radar-image shapers (e.g., the radar "signature" of the radar-image shaper) and compare the detected signatures to known reference signatures of various radar-image shapers. The comparison allows the radar system to determine the characteristic disposition of the radar-image shaper and thus, the characteristic disposition of the controller. Further, the radar system can use other radar data (e.g., azimuth and range data) to determine a three-dimensional (3D) position of the radar-image shapers as well as movement and acceleration. In this way, a controller that has no electronic components and requires no dedicated power source can be used to make complex gestures that can control a game or other application.

Some conventional controllers may use cameras, accelerometers, or inertial sensors to determine the characteristic disposition of the controller. For example, the controller may include powered sensors and a communication interface that can track the movements of the controller and send the information to the gaming console. In other cases, the conventional controller may include spherical or other objects that can be tracked by a camera connected to the gaming console. These conventional techniques, however, are often less accurate in determining position, especially 3D position, and typically require both additional components and a power source, which add cost and inconvenience (e.g., replacing batteries), and may lead to reliability issues (e.g., broken, damaged, or worn-out components). Further, in this example, the conventional gaming console itself also requires additional components (e.g., cameras and communication interfaces) that may introduce similar challenges. Thus, the conventional techniques may use more power and potentially provide a lower-quality user experience.

In contrast, the described systems and techniques can improve user experience and usability in several areas while reducing power consumption and maintenance costs. For instance, in the example above, the controller may be a "passive" controller (with no internal electronics or powered components) that can be accurately detected by a gaming console with a radar system that uses significantly less power than a camera. The radar system can use the radar signature of the radar-image shapers in the controller to accurately determine the characteristic disposition or movement of the controller. In this document, the term "characteristic disposition," with reference to an object, may refer to any, or a combination, of a location, an orientation, a velocity, or a direction of the object at a particular time. For example, the location of the object may be an absolute position of the object with reference to the radar system, such as a distance from the radar system and a position in 3D space (e.g., a slant range, an azimuth, and an elevation). Additionally, the orientation may be a position of the object with reference to the radar system and relative to one or more features of the object (e.g., how the object is "pointed" at the radar system, such as having a particular feature or surface of the object facing the radar system). The velocity may include an absolute velocity of the object or a velocity relative to the radar system. The direction may refer to movement of the object toward or away from the radar system.

The characteristic disposition may also include changes in any or all of those values over a period of time. For example, a change in the characteristic disposition of the object may include a change in an absolute or relative velocity, a change in a distance between the object and the radar system (e.g., whether the object is closer to or farther from the radar system), a change in an orientation, such as the object being turned toward or away from the radar system or rotating about an axis, or a change in direction.

In this way, the described techniques and systems provide a higher-quality user experience with the controller and gaming system. The user can enjoy the advantages and conveniences that are provided by the controller, while the radar-signature manager and radar system provide additional flexibility and enhanced functionality, without excessive power consumption. Additionally, using a radar system to detect the characteristic disposition of the object can provide increased privacy and security because no video image of the user is necessary. Further, power consumption of the controller and the gaming console itself can be substantially less than some conventional techniques that may use an always-on camera (or other sensors or combinations of sensors) to control or detect the position and motion of the controller.

These are but a few examples of how the described techniques and devices may be used to enable a radar-image shaper for radar-based applications. Other examples and implementations of which are described throughout this document. The document now turns to an example environment, after which example systems, apparatuses, methods, and components are described.

<FIG> illustrates an example environment <NUM> in which techniques enabling a radar-image shaper for radar-based applications can be implemented. The example environment <NUM> includes an electronic device <NUM>, which includes, or is associated with, a radar system <NUM>, a radar-signature manager <NUM> (signature manager <NUM>), and a signature library <NUM>.

In the example environment <NUM>, the radar system <NUM> provides a radar field <NUM> by transmitting one or more radar signals or waveforms as described below with reference to <FIG>. The radar field <NUM> is a volume of space from which the radar system <NUM> can detect reflections of the radar signals and waveforms (e.g., radar signals and waveforms reflected from objects in the volume of space). The radar system <NUM> also enables the electronic device <NUM>, or another electronic device, to sense and analyze reflections from an object <NUM> in the radar field <NUM>. Some implementations of the radar system <NUM> are particularly advantageous as applied in the context of smartphones, such as the electronic device <NUM>, for which there is a convergence of issues such as a need for low power, a need for processing efficiency, limitations in a spacing and layout of antenna elements, and other issues, and are even further advantageous in the particular context of smartphones for which radar detection of fine hand gestures is desired. Although the embodiments are particularly advantageous in the described context of the smartphone for which fine radar-detected hand gestures are required, it is to be appreciated that the applicability of the features and advantages of the present invention is not necessarily so limited, and other embodiments involving other types of electronic devices may also be within the scope of the present teachings.

The object <NUM> may be any of a variety of objects. In some cases, the object <NUM> may be an object from which the radar system <NUM> can sense and analyze radar reflections, such as wood, plastic, metal, fabric, a human body, or a body part (e.g., a foot, hand, or finger of a user of the electronic device <NUM>). As shown in <FIG>, the object <NUM> is a stylus. The object <NUM> includes a radar-image shaper <NUM> that is attached to the object <NUM>. The radar-image shaper may be integrated with the object <NUM>, as shown in <FIG>, or attached to the object <NUM> in a removable manner. Based on the analysis of the reflections, the radar system <NUM> can provide radar data that includes various types of information associated with the radar field <NUM> and the reflections from the object <NUM> and the radar-image shaper <NUM>, as described with reference to <FIG> (e.g., the radar system <NUM> can pass the radar data to other entities, such as the signature manager <NUM>).

It should be noted that the radar data may be continuously or periodically provided over time, based on the sensed and analyzed reflections from the object <NUM> in the radar field <NUM>. A position of the object <NUM> can change over time (e.g., the object <NUM> may move within the radar field <NUM>) and the radar data can thus vary over time corresponding to the changed positions, reflections, and analyses. Because the radar data may vary over time, the radar system <NUM> may provide radar data that includes one or more subsets of radar data that correspond to different periods of time. For example, the radar system <NUM> may provide a first subset of the radar data corresponding to a first time-period, a second subset of the radar data corresponding to a second time-period, and so forth.

The radar-image shaper <NUM> is a component that has a recognizable radar signature (e.g., a larger radar cross-section). For example, the radar-image shaper <NUM> may include one or more corner reflectors (e.g., a shape made from two or three perpendicular intersecting flat surfaces that reflect the radar signal). The radar signature of the radar-image shaper <NUM> may vary depending on its characteristic disposition with respect to the radar system <NUM>, which can allow the radar system <NUM> to determine the characteristic disposition of the object <NUM>. Additional details of the radar-image shaper <NUM> are described with reference to <FIG> and <FIG>.

The signature manager <NUM> enables the user to interact with or control various functions of the electronic device <NUM> (e.g., play games, operate applications or other programs, and control features of the electronic device <NUM>). For example, the signature manager <NUM> can use one or more subsets of the radar data to detect the radar signature of the radar-image shaper <NUM>. As noted, the radar-image shaper <NUM> may be integrated with the object in the radar field or attached in a removable manner. The signature manager <NUM> can compare the detected radar signature to a benchmark radar signature that corresponds to a characteristic disposition of the radar-image shaper.

For example, the signature manager <NUM> may compare the detected radar signature to the benchmark radar signature by using one or more subsets of the radar data to determine various features of the radar-image shaper <NUM> (e.g., characteristics of the radar data associated with particular materials, shapes, corners, edges, surfaces, or combinations thereof). The detected features can be analyzed to determine a match to corresponding known features of the benchmark radar signature. In some implementations, the radar-signature manager may compare the detected radar signature to a plurality of benchmark radar signatures that correspond to a different characteristic disposition of the radar-image shaper <NUM>. For example, the signature manager <NUM> may compare the detected radar signature to a plurality of benchmark radar signatures stored in the signature library <NUM>.

The signature library <NUM> is a memory device that can store benchmark radar signatures and other data, such as characteristic dispositions of the object <NUM> that correspond to characteristic dispositions of the radar-image shaper <NUM>. The signature library <NUM> may be any suitable kind of memory that can be accessed and used by other components of the electronic device <NUM>, such as the signature manager <NUM>. The signature library <NUM> may be a part of the signature manager <NUM>, as shown in <FIG>. In other implementations, signature library <NUM> may be a part of the electronic device <NUM>, but separate from the signature manager <NUM>, or remote from the electronic device <NUM>.

Based on the comparison between the detected radar signature and the benchmark radar signature, the signature manager <NUM> can determine that the detected radar signature matches the benchmark radar signature. In response to the determination that the radar signature matches the benchmark radar signature, the signature manager <NUM> can determine the characteristic disposition of the object in the radar field, based on the characteristic disposition of the radar-image shaper <NUM> that corresponds to the matched benchmark radar signature. Consider an example in which the signature manager <NUM> determines a particular characteristic disposition of the radar-image shaper <NUM> with reference to the electronic device <NUM>. In this example, the signature manager <NUM> can also determine the characteristic disposition of the object <NUM> by accessing the signature library <NUM> (or another source) that stores data that includes characteristic dispositions of the object <NUM> that correspond to characteristic dispositions of the radar-image shaper <NUM>.

In this way, the signature manager <NUM> can determine the characteristic disposition of the object <NUM>, which enables the user to interact with or control the electronic device <NUM>. For example, the signature manager <NUM> can determine the characteristic disposition of the object <NUM>, as described above. As noted, determining the characteristic disposition of the object <NUM> may include determining one or more of a variety of different aspects of the characteristic disposition of the object <NUM>, including combinations of any of the aspects. The aspects may include, for example, an absolute position of the object <NUM> with reference to the electronic device <NUM>, a distance of the object <NUM> from the electronic device <NUM>, a velocity of the object <NUM>, a change in the position or distance of the object <NUM> with reference to the electronic device <NUM> (e.g., whether the object <NUM> is moving closer to or farther from the electronic device <NUM>, is turned toward or away from the electronic device <NUM>, is rotated about an axis, and so forth), or a change in the velocity of the object <NUM>.

The signature manager <NUM> can also use one or more subsets of the radar data to determine a change in the characteristic disposition of the object <NUM> (e.g., by using the radar data to determine the characteristic disposition of the object <NUM> over time). Based on the change in the characteristic disposition of the object <NUM>, the signature manager <NUM> can determine a gesture by the object <NUM>. The signature manager <NUM> can then determine a function of the electronic device that corresponds to the gesture (e.g., using a three-dimensional (3D) gesture library, such as the 3D gesture module <NUM> described below) and cause the electronic device <NUM> to provide the function that corresponds to the gesture.

Consider an example in which the object <NUM> is a flight simulator gaming controller that includes one or more radar-image shapers <NUM>. As a user holding the controller makes a gesture to turn the simulator up and to the left (e.g., a gesture that moves the controller toward the user and rotates the controller counter-clockwise). The signature manager <NUM> can determine the characteristic disposition of the gaming controller at the beginning of the gesture by determining the characteristic disposition of the radar-image shaper <NUM>, as described above, and continue to determine the characteristic disposition of the controller through the duration of the gesture. This allows the signature manager <NUM> to use the determination of the gesture (or of multiple gestures) to enable the user to use the controller with the electronic device <NUM> to operate the flight simulator.

In some implementations, the electronic device <NUM> may also include, or be associated with, one or more other modules, interfaces, or systems. As shown in <FIG>, the electronic device <NUM> includes the 3D gesture module <NUM>, which can store both information related to determining 3D gestures based on the radar data and information related to actions that correspond to the 3D gestures. As shown in <FIG>, the 3D gesture module <NUM> is depicted as part of the signature manager <NUM>. In other implementations, however, the 3D gesture module <NUM> may be a separate entity that can be part of, or separate from, the electronic device <NUM>.

A 3D gesture can be any of a variety of gestures made with the object <NUM>, including movements toward or away from the electronic device <NUM>, side-to-side movements, rotation of the object <NUM> about an axis, and so forth. In some cases, the object <NUM> may be an object worn on a user's body (e.g., on a finger or wrist) and the radar-signature manager can be used to detect 3D gestures made by the user, such as a scrolling gesture made by moving a hand above the electronic device <NUM> along a horizontal dimension (e.g., from a left side of the electronic device <NUM> to a right side of the electronic device <NUM>), a waving gesture made by the user's arm rotating about an elbow, a pushing gesture made by moving the user's hand above the electronic device <NUM> along a vertical dimension (e.g., from a bottom side of the electronic device <NUM> to a top side of the electronic device <NUM>). Other types of 3D gestures or motions may also be made, such as a reaching gesture made by moving the user's hand towards the electronic device <NUM>, a knob-turning gesture made by curling fingers of the user's hand to grip an imaginary doorknob and rotating in a clockwise or counter-clockwise fashion to mimic an action of turning the imaginary doorknob, and a spindle-twisting gesture made by rubbing a thumb and at least one other finger together. Each of these example gesture types may be detected by the radar system <NUM>.

Based on the radar data, or on one or more subsets of the radar data, the signature manager <NUM> can detect the 3D gesture by the object <NUM> and determine (e.g., using the 3D gesture module <NUM>) that the gesture corresponds to a particular function or action of the electronic device <NUM>. The particular function or action may be any of a variety of functions or actions, such as interacting with an application (e.g., browse for, select, or open the application), control a user interface for a game, media player, or another application, and so forth. In this way, the radar system <NUM> can provide touch-free control of the electronic device <NUM>. Exemplary 3D gestures and corresponding actions are described with additional detail below.

As described with reference to <FIG>, the radar system <NUM> can use the radar field <NUM> to sense and analyze reflections from objects in the radar field <NUM> in ways that enable high resolution and accuracy for gesture recognition. Further, the 3D gestures may be predefined, selected from a list, or customized (e.g., the user may interact with the signature manager <NUM> and the radar system <NUM> to define unique gestures, or combination of gestures, as corresponding to particular actions).

In more detail, consider <FIG>, which illustrates an example implementation <NUM> of the electronic device <NUM> (including the radar system <NUM>, the signature manager <NUM>, the signature library <NUM>, and optionally, the 3D gesture module <NUM>) that can implement a radar-image shaper for radar-based applications. The electronic device <NUM> of <FIG> is illustrated with a variety of example devices, including a smartphone <NUM>-<NUM>, a stylus <NUM>-<NUM>, a laptop <NUM>-<NUM>, a desktop computer <NUM>-<NUM>, a computing watch <NUM>-<NUM>, a tablet <NUM>-<NUM>, a gaming system <NUM>-<NUM>, a home-automation and control system <NUM>-<NUM>, and a remote control <NUM>-<NUM>. The electronic device <NUM> can also include other devices, such as televisions, entertainment systems, audio systems, automobiles, drones, trackpads, drawing pads, netbooks, e-readers, home security systems, and other home appliances. Note that the electronic device <NUM> can be wearable, non-wearable but mobile, or relatively immobile (e.g., desktops and appliances).

It should be noted that exemplary overall lateral dimensions of the electronic device <NUM> can be, for example, approximately eight centimeters by approximately fifteen centimeters. Exemplary footprints of the radar system <NUM> can be even more limited, such as approximately four millimeters by six millimeters with antennas included. The requirement of such a limited footprint for the radar system <NUM>, which is needed to accommodate the many other desirable features of the electronic device <NUM> in such a space-limited package (e.g., a fingerprint sensor, other non-radar sensors, and so forth) combined with power and processing limitations, can lead to compromises in the accuracy and efficacy of radar gesture detection, at least some of which can be overcome in view of the teachings herein.

The electronic device <NUM> also includes one or more computer processors <NUM> and one or more computer-readable media <NUM>, which includes memory media and storage media. Applications and/or an operating system (not shown) implemented as computer-readable instructions on the computer-readable media <NUM> can be executed by the computer processors <NUM> to provide some or all of the functionalities described herein. The electronic device <NUM> may also include a network interface <NUM>. The electronic device <NUM> can use the network interface <NUM> for communicating data over wired, wireless, or optical networks. By way of example and not limitation, the network interface <NUM> may communicate data over a local-area-network (LAN), a wireless local-area-network (WLAN), a personal-area-network (PAN), a wide-area-network (WAN), an intranet, the Internet, a peer-to-peer network, point-to-point network, or a mesh network.

Various implementations of the radar system <NUM> can include a System-on-Chip (SoC), one or more Integrated Circuits (ICs), a processor with embedded processor instructions or configured to access processor instructions stored in memory, hardware with embedded firmware, a printed circuit board with various hardware components, or any combination thereof. The radar system <NUM> operates as a monostatic radar by transmitting and receiving its own radar signals. In some implementations, the radar system <NUM> may also cooperate with other radar systems <NUM> that are within an external environment to implement a bistatic radar, a multistatic radar, or a network radar. Constraints or limitations of the electronic device <NUM>, however, may impact a design of the radar system <NUM>. The electronic device <NUM>, for example, may have limited power available to operate the radar, limited computational capability, size constraints, layout restrictions, an exterior housing that attenuates or distorts radar signals, and so forth. The radar system <NUM> includes several features that enable advanced radar functionality and high performance to be realized in the presence of these constraints, as further described below with respect to <FIG>. Note that in <FIG>, the radar system <NUM> and the signature manager <NUM> are illustrated as part of the electronic device <NUM>. In other implementations, either or both of the radar system <NUM> and the signature manager <NUM> may be separate or remote from the electronic device <NUM>.

These and other capabilities and configurations, as well as ways in which entities of <FIG> act and interact, are set forth in greater detail below. These entities may be further divided, combined, and so on. The environment <NUM> of <FIG> and the detailed illustrations of <FIG> illustrate some of many possible environments and devices capable of employing the described techniques. <FIG> describe additional details and features of the radar system <NUM>. In <FIG>, the radar system <NUM> is described in the context of the electronic device <NUM>, but as noted above, the applicability of the features and advantages of the described systems and techniques are not necessarily so limited, and other embodiments involving other types of electronic devices may also be within the scope of the present teachings.

<FIG> illustrates an example implementation <NUM> of the radar system <NUM> that can be used to enable a radar-image shaper for radar-based applications. In the example <NUM>, the radar system <NUM> includes at least one of each of the following components: a communication interface <NUM>, an antenna array <NUM>, a transceiver <NUM>, a processor <NUM>, and a system media <NUM> (e.g., one or more computer-readable storage media). The processor <NUM> can be implemented as a digital signal processor, a controller, an application processor, another processor (e.g., the computer processor <NUM> of the electronic device <NUM>) or some combination thereof.

The system media <NUM>, which may be included within, or be separate from, the computer-readable media <NUM> of the electronic device <NUM>, includes one or more of the following modules: an attenuation mitigator <NUM>, a digital beamformer <NUM>, an angle estimator <NUM>, or a power manager <NUM>. These modules can compensate for, or mitigate the effects of, integrating the radar system <NUM> within the electronic device <NUM>, thereby enabling the radar system <NUM> to recognize particular radar signatures (e.g., particular radar cross-sections or frequency responses), recognize small or complex gestures, distinguish between different characteristic dispositions of the electronic device <NUM>, another object (e.g., the object <NUM>), or the user, continuously monitor an external environment, or realize a target false-alarm rate. With these features, the radar system <NUM> can be implemented within a variety of different devices, such as the devices illustrated in <FIG>.

Using the communication interface <NUM>, the radar system <NUM> can provide radar data to the signature manager <NUM>. The communication interface <NUM> may be a wireless or wired interface based on the radar system <NUM> being implemented separate from, or integrated within, the electronic device <NUM>. Depending on the application, the radar data may include raw or minimally processed data, in-phase and quadrature (I/Q) data, range-Doppler data, processed data including target location information (e.g., range, azimuth, elevation), clutter map data, and so forth. Generally, the radar data contains information that is usable by the signature manager <NUM> to implement or enable a radar-image shaper for radar-based applications.

The antenna array <NUM> includes at least one transmitting antenna element (not shown) and at least two receiving antenna elements (as shown in <FIG>). In some cases, the antenna array <NUM> may include multiple transmitting antenna elements to implement a multiple-input multiple-output (MIMO) radar capable of transmitting multiple distinct waveforms at a time (e.g., a different waveform per transmitting antenna element). The use of multiple waveforms can increase a measurement accuracy of the radar system <NUM>. The receiving antenna elements can be positioned in a one-dimensional shape (e.g., a line) or a two-dimensional shape for implementations that include three or more receiving antenna elements. The one-dimensional shape enables the radar system <NUM> to measure one angular dimension (e.g., an azimuth or an elevation) while the two-dimensional shape enables two angular dimensions to be measured (e.g., both azimuth and elevation). Example two-dimensional arrangements of the receiving antenna elements are further described with respect to <FIG>.

<FIG> illustrates example arrangements <NUM> of receiving antenna elements <NUM>. If the antenna array <NUM> includes at least four receiving antenna elements <NUM>, for example, the receiving antenna elements <NUM> can be arranged in a rectangular arrangement <NUM>-<NUM> as depicted in the middle of <FIG>. Alternatively, a triangular arrangement <NUM>-<NUM> or an L-shape arrangement <NUM>-<NUM> may be used if the antenna array <NUM> includes at least three receiving antenna elements <NUM>.

Due to a size or layout constraint of the electronic device <NUM>, an element spacing between the receiving antenna elements <NUM> or a quantity of the receiving antenna elements <NUM> may not be ideal for the angles at which the radar system <NUM> is to monitor. In particular, the element spacing may cause angular ambiguities to be present that make it challenging for conventional radars to estimate an angular position of a target. Conventional radars may therefore limit a field of view (e.g., angles that are to be monitored) to avoid an ambiguous zone, which has the angular ambiguities, and thereby reduce false detections. For example, conventional radars may limit the field of view to angles between approximately -<NUM> degrees to <NUM> degrees to avoid angular ambiguities that occur using a wavelength of <NUM> millimeters (mm) and an element spacing of <NUM> (e.g., the element spacing being <NUM>% of the wavelength). Consequently, the conventional radar may be unable to detect targets that are beyond the <NUM>-degree limits of the field of view. In contrast, the radar system <NUM> includes the digital beamformer <NUM> and the angle estimator <NUM>, which resolve the angular ambiguities and enable the radar system <NUM> to monitor angles beyond the <NUM>-degree limit, such as angles between approximately -<NUM> degrees to <NUM> degrees, or up to approximately -<NUM> degrees and <NUM> degrees. These angular ranges can be applied across one or more directions (e.g., azimuth and/or elevation). Accordingly, the radar system <NUM> can realize low false-alarm rates for a variety of different antenna array designs, including element spacings that are less than, greater than, or equal to half a center wavelength of the radar signal.

Using the antenna array <NUM>, the radar system <NUM> can form beams that are steered or un-steered, wide or narrow, or shaped (e.g., as a hemisphere, cube, fan, cone, or cylinder). As an example, the one or more transmitting antenna elements (not shown) may have an un-steered omnidirectional radiation pattern or may be able to produce a wide beam, such as the wide transmit beam <NUM>. Either of these techniques enable the radar system <NUM> to illuminate a large volume of space. To achieve target angular accuracies and angular resolutions, however, the receiving antenna elements <NUM> and the digital beamformer <NUM> can be used to generate thousands of narrow and steered beams (e.g., <NUM> beams, <NUM> beams, or <NUM> beams), such as the narrow receive beam <NUM>. In this way, the radar system <NUM> can efficiently monitor the external environment and accurately determine arrival angles of reflections within the external environment.

Returning to <FIG>, the transceiver <NUM> includes circuitry and logic for transmitting and receiving radar signals via the antenna array <NUM>. Components of the transceiver <NUM> can include amplifiers, mixers, switches, analog-to-digital converters, filters, and so forth for conditioning the radar signals. The transceiver <NUM> can also include logic to perform in-phase/quadrature (I/Q) operations, such as modulation or demodulation. The transceiver <NUM> can be configured for continuous wave radar operations or pulsed radar operations. A variety of modulations can be used to produce the radar signals, including linear frequency modulations, triangular frequency modulations, stepped frequency modulations, or phase modulations.

The transceiver <NUM> can generate radar signals within a range of frequencies (e.g., a frequency spectrum), such as between <NUM> gigahertz (GHz) and <NUM>, between <NUM> and <NUM>, or between <NUM> and <NUM>. The frequency spectrum can be divided into multiple sub-spectra that have a similar bandwidth or different bandwidths. The bandwidths can be on the order of <NUM> megahertz (MHz), <NUM>, <NUM>, and so forth. As an example, different frequency sub-spectra may include frequencies between approximately <NUM> and <NUM>, <NUM> and <NUM>, or <NUM> and <NUM>. Multiple frequency sub-spectra that have a same bandwidth and may be contiguous or non-contiguous may also be chosen for coherence. The multiple frequency sub-spectra can be transmitted simultaneously or separated in time using a single radar signal or multiple radar signals. The contiguous frequency sub-spectra enable the radar signal to have a wider bandwidth while the non-contiguous frequency sub-spectra can further emphasize amplitude and phase differences that enable the angle estimator <NUM> to resolve angular ambiguities. The attenuation mitigator <NUM> or the angle estimator <NUM> may cause the transceiver <NUM> to utilize one or more frequency sub-spectra to improve performance of the radar system <NUM>, as further described with respect to <FIG> and <FIG>.

A power manager <NUM> enables the radar system <NUM> to conserve power internally or externally within the electronic device <NUM>. In some implementations, the power manager <NUM> communicates with the signature manager <NUM> or the smartphone power-management interface <NUM> to conserve power within either or both of the radar system <NUM> or the electronic device <NUM>. Internally, for example, the power manager <NUM> can cause the radar system <NUM> to collect data using a predefined power mode or a specific duty cycle. In this case, the power manager <NUM> dynamically switches between different power modes such that response delay and power consumption are managed together based on the activity within the environment. In general, the power manager <NUM> determines when and how power can be conserved, and incrementally adjusts power consumption to enable the radar system <NUM> to operate within power limitations of the electronic device <NUM>. In some cases, the power manager <NUM> may monitor an amount of available power remaining and adjust operations of the radar system <NUM> accordingly. For example, if the remaining amount of power is low, the power manager <NUM> may continue operating in a lower-power mode instead of switching to a higher-power mode.

The lower-power mode, for example, may use a lower duty cycle on the order of a few hertz (e.g., approximately <NUM> or less than <NUM>), which reduces power consumption to a few milliwatts (mW) (e.g., between approximately <NUM> mW and <NUM> mW). The higher-power mode, on the other hand, may use a higher duty cycle on the order of tens of hertz (Hz) (e.g., approximately <NUM> or greater than <NUM>), which causes the radar system <NUM> to consume power on the order of several milliwatts (e.g., between approximately <NUM> mW and <NUM> mW). While the lower-power mode can be used to monitor the external environment or detect an approaching user, the power manager <NUM> may switch to the higher-power mode if the radar system <NUM> determines the user is starting to perform a gesture. Different triggers may cause the power manager <NUM> to switch between the different power modes. Example triggers include motion or the lack of motion, appearance or disappearance of the user, the user moving into or out of a designated region (e.g., a region defined by range, azimuth, or elevation), a change in velocity of a motion associated with the user, or a change in reflected signal strength (e.g., due to changes in radar cross-section). In general, the triggers that indicate a lower probability of the user interacting with the electronic device <NUM> or a preference to collect data using a longer response delay may cause a lower-power mode to be activated to conserve power.

The power manager <NUM> can also conserve power by turning off one or more components within the transceiver <NUM> (e.g., a voltage-controlled oscillator, a multiplexer, an analog-to-digital converter, a phase lock loop, or a crystal oscillator) during inactive time periods. These inactive time periods occur if the radar system <NUM> is not actively transmitting or receiving radar signals, which may be on the order of microseconds (µs), milliseconds (ms), or seconds (s). Further, the power manager <NUM> can modify transmission power of the radar signals by adjusting an amount of amplification provided by a signal amplifier. Additionally, the power manager <NUM> can control the use of different hardware components within the radar system <NUM> to conserve power. If the processor <NUM> comprises a lower-power processor and a higher-power processor (e.g., processors with different amounts of memory and computational capability), for example, the power manager <NUM> can switch between utilizing the lower-power processor for low-level analysis (e.g., implementing the idle mode, detecting motion, determining a location of a user, or monitoring the environment) and the higher-power processor for situations in which high-fidelity or accurate radar data is requested by the signature manager <NUM> (e.g., for implementing the attention mode or the interaction mode, gesture recognition or user orientation).

In addition to the internal power-saving techniques described above, the power manager <NUM> can also conserve power within the electronic device <NUM> by activating or deactivating other external components or sensors that are within the electronic device <NUM>. These external components may include speakers, a camera sensor, a global positioning system, a wireless communication transceiver, a display, a gyroscope, or an accelerometer. Because the radar system <NUM> can monitor the environment using a small amount of power, the power manager <NUM> can appropriately turn these external components on or off based on where the user is located or what the user is doing. In this way, the electronic device <NUM> can seamlessly respond to the user and conserve power without the use of automatic shut-off timers or the user physically touching or verbally controlling the electronic device <NUM>. The described power management techniques can thus be used to provide various implementations of the idle mode, the attention mode, and the interaction mode, as described herein.

<FIG> illustrates additional details of an example implementation <NUM> of the radar system <NUM> within the electronic device <NUM>. In the example <NUM>, the antenna array <NUM> is positioned underneath an exterior housing of the electronic device <NUM>, such as a glass cover or an external case. Depending on its material properties, the exterior housing may act as an attenuator <NUM>, which attenuates or distorts radar signals that are transmitted and received by the radar system <NUM>. The attenuator <NUM> may include different types of glass or plastics, some of which may be found within display screens, exterior housings, or other components of the electronic device <NUM> and have a dielectric constant (e.g., relative permittivity) between approximately four and ten. Accordingly, the attenuator <NUM> is opaque or semi-transparent to a radar signal <NUM> and may cause a portion of a transmitted or received radar signal <NUM> to be reflected (as shown by a reflected portion <NUM>). For conventional radars, the attenuator <NUM> may decrease an effective range that can be monitored, prevent small targets from being detected, or reduce overall accuracy.

Assuming a transmit power of the radar system <NUM> is limited, and re-designing the exterior housing is not desirable, one or more attenuation-dependent properties of the radar signal <NUM> (e.g., a frequency sub-spectrum <NUM> or a steering angle <NUM>) or attenuation-dependent characteristics of the attenuator <NUM> (e.g., a distance <NUM> between the attenuator <NUM> and the radar system <NUM> or a thickness <NUM> of the attenuator <NUM>) are adjusted to mitigate the effects of the attenuator <NUM>. Some of these characteristics can be set during manufacturing or adjusted by the attenuation mitigator <NUM> during operation of the radar system <NUM>. The attenuation mitigator <NUM>, for example, can cause the transceiver <NUM> to transmit the radar signal <NUM> using the selected frequency sub-spectrum <NUM> or the steering angle <NUM>, cause a platform to move the radar system <NUM> closer or farther from the attenuator <NUM> to change the distance <NUM>, or prompt the user to apply another attenuator to increase the thickness <NUM> of the attenuator <NUM>.

Appropriate adjustments can be made by the attenuation mitigator <NUM> based on pre-determined characteristics of the attenuator <NUM> (e.g., characteristics stored in the computer-readable media <NUM> of the electronic device <NUM> or within the system media <NUM>) or by processing returns of the radar signal <NUM> to measure one or more characteristics of the attenuator <NUM>. Even if some of the attenuation-dependent characteristics are fixed or constrained, the attenuation mitigator <NUM> can take these limitations into account to balance each parameter and achieve a target radar performance. As a result, the attenuation mitigator <NUM> enables the radar system <NUM> to realize enhanced accuracy and larger effective ranges for detecting and tracking the user that is located on an opposite side of the attenuator <NUM>. These techniques provide alternatives to increasing transmit power, which increases power consumption of the radar system <NUM>, or changing material properties of the attenuator <NUM>, which can be difficult and expensive once a device is in production.

<FIG> illustrates an example scheme <NUM> implemented by the radar system <NUM>. Portions of the scheme <NUM> may be performed by the processor <NUM>, the computer processors <NUM>, or other hardware circuitry. The scheme <NUM> can be customized to support different types of electronic devices and radar-based applications (e.g., the signature manager <NUM>), and also enables the radar system <NUM> to achieve target angular accuracies despite design constraints.

The transceiver <NUM> produces raw data <NUM> based on individual responses of the receiving antenna elements <NUM> to a received radar signal. The received radar signal may be associated with one or more frequency sub-spectra <NUM> that were selected by the angle estimator <NUM> to facilitate angular ambiguity resolution. The frequency sub-spectra <NUM>, for example, may be chosen to reduce a quantity of sidelobes or reduce an amplitude of the sidelobes (e.g., reduce the amplitude by <NUM> dB, <NUM> dB, or more). A quantity of frequency sub-spectra can be determined based on a target angular accuracy or computational limitations of the radar system <NUM>.

The raw data <NUM> contains digital information (e.g., in-phase and quadrature data) for a period of time, different wavenumbers, and multiple channels respectively associated with the receiving antenna elements <NUM>. A Fast-Fourier Transform (FFT) <NUM> is performed on the raw data <NUM> to generate pre-processed data <NUM>. The pre-processed data <NUM> includes digital information across the period of time, for different ranges (e.g., range bins), and for the multiple channels. A Doppler filtering process <NUM> is performed on the pre-processed data <NUM> to generate range-Doppler data <NUM>. The Doppler filtering process <NUM> may comprise another FFT that generates amplitude and phase information for multiple range bins, multiple Doppler frequencies, and for the multiple channels. The digital beamformer <NUM> produces beamforming data <NUM> based on the range-Doppler data <NUM>. The beamforming data <NUM> contains digital information for a set of azimuths and/or elevations, which represents the field of view for which different steering angles or beams are formed by the digital beamformer <NUM>. Although not depicted, the digital beamformer <NUM> may alternatively generate the beamforming data <NUM> based on the pre-processed data <NUM> and the Doppler filtering process <NUM> may generate the range-Doppler data <NUM> based on the beamforming data <NUM>. To reduce a quantity of computations, the digital beamformer <NUM> may process a portion of the range-Doppler data <NUM> or the pre-processed data <NUM> based on a range, time, or Doppler frequency interval of interest.

The digital beamformer <NUM> can be implemented using a single-look beamformer <NUM>, a multi-look interferometer <NUM>, or a multi-look beamformer <NUM>. In general, the single-look beamformer <NUM> can be used for deterministic objects (e.g., point-source targets having a single phase center). For non-deterministic targets (e.g., targets having multiple phase centers), the multi-look interferometer <NUM> or the multi-look beamformer <NUM> are used to improve accuracies relative to the single-look beamformer <NUM>. Humans are an example of a non-deterministic target and have multiple phase centers <NUM> that can change based on different aspect angles, as shown at <NUM>-<NUM> and <NUM>-<NUM>. Variations in the constructive or destructive interference generated by the multiple phase centers <NUM> can make it challenging for conventional radars to accurately determine angular positions. The multi-look interferometer <NUM> or the multi-look beamformer <NUM>, however, perform coherent averaging to increase an accuracy of the beamforming data <NUM>. The multi-look interferometer <NUM> coherently averages two channels to generate phase information that can be used to accurately determine the angular information. The multi-look beamformer <NUM>, on the other hand, can coherently average two or more channels using linear or non-linear beamformers, such as Fourier, Capon, multiple signal classification (MUSIC), or minimum variance distortionless response (MVDR). The increased accuracies provided via the multi-look beamformer <NUM> or the multi-look interferometer <NUM> enable the radar system <NUM> to recognize small gestures or distinguish between multiple portions of the user.

The angle estimator <NUM> analyzes the beamforming data <NUM> to estimate one or more angular positions. The angle estimator <NUM> may utilize signal processing techniques, pattern matching techniques, or machine learning. The angle estimator <NUM> also resolves angular ambiguities that may result from a design of the radar system <NUM> or the field of view the radar system <NUM> monitors. An example angular ambiguity is shown within an amplitude plot <NUM> (e.g., amplitude response).

The amplitude plot <NUM> depicts amplitude differences that can occur for different angular positions of the target and for different steering angles <NUM>. A first amplitude response <NUM>-<NUM> (illustrated with a solid line) is shown for a target positioned at a first angular position <NUM>-<NUM>. Likewise, a second amplitude response <NUM>-<NUM> (illustrated with a dotted-line) is shown for the target positioned at a second angular position <NUM>-<NUM>. In this example, the differences are considered across angles between -<NUM> degrees and <NUM> degrees.

As shown in the amplitude plot <NUM>, an ambiguous zone exists for the two angular positions <NUM>-<NUM> and <NUM>-<NUM>. The first amplitude response <NUM>-<NUM> has a highest peak at the first angular position <NUM>-<NUM> and a lesser peak at the second angular position <NUM>-<NUM>. While the highest peak corresponds to the actual position of the target, the lesser peak causes the first angular position <NUM>-<NUM> to be ambiguous because it is within some threshold for which conventional radars may be unable to confidently determine whether the target is at the first angular position <NUM>-<NUM> or the second angular position <NUM>-<NUM>. In contrast, the second amplitude response <NUM>-<NUM> has a lesser peak at the second angular position <NUM>-<NUM> and a higher peak at the first angular position <NUM>-<NUM>. In this case, the lesser peak corresponds to the target's location.

While conventional radars may be limited to using a highest peak amplitude to determine the angular positions, the angle estimator <NUM> instead analyzes subtle differences in shapes of the amplitude responses <NUM>-<NUM> and <NUM>-<NUM>. Characteristics of the shapes can include, for example, roll-offs, peak or null widths, an angular location of the peaks or nulls, a height or depth of the peaks and nulls, shapes of sidelobes, symmetry within the amplitude response <NUM>-<NUM> or <NUM>-<NUM>, or the lack of symmetry within the amplitude response <NUM>-<NUM> or <NUM>-<NUM>. Similar shape characteristics can be analyzed in a phase response, which can provide additional information for resolving the angular ambiguity. The angle estimator <NUM> therefore maps the unique angular signature or pattern to an angular position.

The angle estimator <NUM> can include a suite of algorithms or tools that can be selected according to the type of electronic device <NUM> (e.g., computational capability or power constraints) or a target angular resolution for the signature manager <NUM>. In some implementations, the angle estimator <NUM> can include a neural network <NUM>, a convolutional neural network (CNN) <NUM>, or a long short-term memory (LSTM) network <NUM>. The neural network <NUM> can have various depths or quantities of hidden layers (e.g., three hidden layers, five hidden layers, or ten hidden layers) and can also include different quantities of connections (e.g., the neural network <NUM> can comprise a fully-connected neural network or a partially-connected neural network). In some cases, the CNN <NUM> can be used to increase computational speed of the angle estimator <NUM>. The LSTM network <NUM> can be used to enable the angle estimator <NUM> to track the target. Using machine learning techniques, the angle estimator <NUM> employs non-linear functions to analyze the shape of the amplitude response <NUM>-<NUM> or <NUM>-<NUM> and generate angular probability data <NUM>, which indicates a likelihood that the user or a portion of the user is within an angular bin. The angle estimator <NUM> may provide the angular probability data <NUM> for a few angular bins, such as two angular bins to provide probabilities of a target being to the left or right of the electronic device <NUM>, or for thousands of angular bins (e.g., to provide the angular probability data <NUM> for a continuous angular measurement).

Based on the angular probability data <NUM>, a tracker module <NUM> produces angular position data <NUM>, which identifies an angular location of the target. The tracker module <NUM> may determine the angular location of the target based on the angular bin that has a highest probability in the angular probability data <NUM> or based on prediction information (e.g., previously-measured angular position information). The tracker module <NUM> may also keep track of one or more moving targets to enable the radar system <NUM> to confidently distinguish or identify the targets. Other data can also be used to determine the angular position, including range, Doppler, velocity, or acceleration. In some cases, the tracker module <NUM> can include an alpha-beta tracker, a Kalman filter, a multiple hypothesis tracker (MHT), and so forth.

A quantizer module <NUM> obtains the angular position data <NUM> and quantizes the data to produce quantized angular position data <NUM>. The quantization can be performed based on a target angular resolution for the signature manager <NUM>. In some situations, fewer quantization levels can be used such that the quantized angular position data <NUM> indicates whether the target is to the right or to the left of the electronic device <NUM> or identifies a <NUM>-degree quadrant the target is located within. This may be sufficient for some radar-based applications, such as user proximity detection. In other situations, a larger number of quantization levels can be used such that the quantized angular position data <NUM> indicates an angular position of the target within an accuracy of a fraction of a degree, one degree, five degrees, and so forth. This resolution can be used for higher-resolution radar-based applications, such as gesture recognition, or in implementations of the attention mode or the interaction mode as described herein. In some implementations, the digital beamformer <NUM>, the angle estimator <NUM>, the tracker module <NUM>, and the quantizer module <NUM> are together implemented in a single machine learning module.

These and other capabilities and configurations, as well as ways in which entities of <FIG> act and interact, are set forth below. The described entities may be further divided, combined, used along with other sensors or components, and so on. In this way, different implementations of the electronic device <NUM>, with different configurations of the radar system <NUM> and non-radar sensors, can be used to implement a radar-image shaper for radar-based applications. The example operating environment <NUM> of <FIG> and the detailed illustrations of <FIG> illustrate but some of many possible environments and devices capable of employing the described techniques.

<FIG> and <FIG> depict example implementations of the radar-image shaper <NUM>, which can be used to enable a radar-image shaper for radar-based applications. <FIG> depicts an example implementation <NUM> of a radar-image shaper that is an octahedron comprising eight trihedral corner reflectors <NUM>. Generally, a trihedral corner reflector is a shape consisting of three perpendicular intersecting flat surfaces. This shape, when made from a material that reflects radar signals, will reflect the signal back toward the source. In the example implementation <NUM>, the individual trihedral corner reflectors <NUM>-<NUM> through <NUM>-<NUM> are made from triangular surfaces, but other shapes may also be used, as described with reference to <FIG>.

<FIG> illustrates generally, at <NUM>, example implementations <NUM> and <NUM> of a radar-image shaper. In the example radar-image shaper <NUM>, the individual trihedral corner reflectors <NUM> are made from rectangular surfaces. In the example radar-image shaper <NUM>, the individual trihedral corner reflectors <NUM> are made from quarter-circle-shaped surfaces. While the radar-image shapers <NUM>, <NUM>, <NUM>, and <NUM> are shown in <FIG> and <FIG> as being symmetrical with reference to one or more axes (e.g., an axis of an x-y-z coordinate system with an origin at a center of the radar-image shaper), asymmetrical implementations of the described shapes may also be used. Asymmetrical shapes may be used to determine the characteristic disposition of an object (e.g., the object <NUM>). For example, an asymmetric radar-image shaper <NUM> may have a radar signature that allows the radar system <NUM> to determine the orientation (or another aspect of the characteristic disposition) of the object when only one radar-image shaper <NUM> is used with the object <NUM>. Other symmetrical or asymmetrical shapes (not illustrated in <FIG> or <FIG>) may also be used for the radar-image shaper. For example a sphere or ellipsoidal solid, or a sphere or ellipsoidal solid with trihedral or spherical indentations (dimples).

The example radar-image shapers described with reference to any or all of <FIG>, <FIG>, or <FIG> may be made from any suitable material that reflects radar signals, such as aluminum or an aluminum alloy. Generally, the radar-image shaper <NUM> has an edge length that is a multiple of the wavelength of the radar signal. Thus, for radar signals with a sub-millimeter (mm) wavelength, the corner-reflectors that comprise the radar-image shaper may have an edge length (e.g., a longest edge length) of a multiple of the wavelength (e.g., between <NUM> and <NUM>, such as <NUM> or <NUM>). In other cases, with different wavelengths of the radar signal, the edge length of the radar-image shaper may be a different length.

Additionally, different materials absorb and reflect different frequencies of a radar signal, and the signature manager <NUM> may determine a radar signature of the radar-image shaper <NUM> based on a proportion of the radar signal that is reflected in a particular frequency range. For example, the signature library <NUM> may contain benchmark radar signatures for different shapes of radar-image shapers and different materials for some or all of the shapes. In some implementations, the radar-image shaper may be made of more than one material, which allows the signature manager <NUM> to distinguish between multiple radar-image shapers <NUM> of the same shape.

Consider an example in which the radar-image shaper has a first portion that is made from a first material (e.g., an aluminum alloy) and a second portion that is made from a second material (e.g., another type of aluminum alloy). The first material may absorb radar signals within a particular range of frequencies, and the second material may absorb radar signals within a second range of frequencies. Assume, in this example, that at least a part of the second range of frequencies is not included in the first range of frequencies. In this way, the signature manager <NUM> can distinguish between the two portions of the radar-image shaper <NUM>, which may allow the signature manager <NUM> to determine the characteristic disposition of the radar-image shaper <NUM>, and of a corresponding object <NUM>, to a higher degree of accuracy.

Further, as noted, the radar-image shaper <NUM> may be attached to, or integrated with, an object (e.g., the object <NUM>) and used to control a system or device, such as the electronic device <NUM> by determining the characteristic disposition of the radar-image shaper <NUM> and a corresponding characteristic disposition of the object. Because the object can be made from a material that is at least partially transparent to radar signals, such as the radar field <NUM>, the radar-image shaper <NUM> may be encased in a solid (and opaque) material, which protects the radar-image shaper <NUM> from damage and prevents a user from being injured by any sharp edges or corner on the radar-image shaper <NUM>. In contrast, conventional methods for controlling a system with a remote object often use cameras or infrared signals, which cannot be encased. Thus, the radar-image shaper for radar-based applications can enable more choices for design (shapes, materials, colors, and so forth) while still providing accurate measurements with lower power consumption, which can lead to a higher-quality user experience.

<FIG> and <FIG> depict example method <NUM>, which enables a radar-image shaper for radar-based applications. The method <NUM> can be performed with an electronic device that uses a radar system to provide a radar field. The radar field is used to determine a presence of an object in the radar field. The radar field can also be used to determine an intention level of the object, and the intention level can be used to determine whether the object intends to interact with the electronic device. Based on the determination of the object's intention, the electronic device can enter and exit different modes of functionality and power usage.

The method <NUM> is shown as a set of blocks that specify operations performed but are not necessarily limited to the order or combinations shown for performing the operations by the respective blocks. Further, any of one or more of the operations may be repeated, combined, reorganized, or linked to provide a wide array of additional and/or alternate methods. In portions of the following discussion, reference may be made to the example operating environment <NUM> of <FIG> or to entities or processes as detailed in <FIG>, reference to which is made for example only. The techniques are not limited to performance by one entity or multiple entities operating on one device.

At <NUM>, a radar field is provided. This radar field can be provided by any of a variety of electronic devices (e.g., the electronic device <NUM> described above), that include, or are associated with, a radar system (e.g., the radar system <NUM>) and an radar-signature manager (e.g., the signature manager <NUM>, which may also include either or both of the signature library <NUM> and the 3D gesture module <NUM>). Further, the radar field may be any of a variety of types of radar fields, such as the radar field <NUM> described above.

At <NUM>, reflections from an object in the radar field are sensed by the radar system. The object may be any of a variety of objects, such as wood, plastic, metal, fabric, or organic material (e.g., a gaming controller or a stylus, such as the object <NUM> described above, or a body part of a person). The object in the radar field includes, or is attached to, at least one radar-image shaper, such as the radar-image shaper <NUM> described above and with reference to <FIG> and <FIG>.

At <NUM>, the reflections from the object in the radar field are analyzed. The analysis may be performed by any of a variety of entities (e.g., the radar system <NUM>, the signature manager <NUM>, or another entity) and may include various operations or determinations, such as those described with reference to <FIG>.

At <NUM>, based on the analysis of the reflections, radar data is provided (e.g., the radar data described with reference to <FIG>). The radar data may be provided by any of a variety of entities, such as the radar system <NUM>, the signature manager <NUM>, or another entity. In some implementations, the radar system may provide the radar data and pass the radar data to other entities (e.g., any of the described radar-based applications, libraries, or modules). The description of the method <NUM> continues in <FIG>, as indicated by the letter "A" after block <NUM> of <FIG>, which corresponds to the letter "A" before block <NUM> of <FIG>.

At <NUM>, the radar system detects a radar signature of the radar-image shaper, using one or more subsets of the radar data. For example, the radar system <NUM> can generate radar data the signature manager <NUM> uses to detect the radar signature of the radar-image shaper <NUM>.

At <NUM>, the detected radar signature is compared to a benchmark radar signature that corresponds to a characteristic disposition of the radar-image shaper. For example, the signature manager <NUM> may compare the detected radar signature to the benchmark radar signature by using one or more subsets of the radar data to determine various features of the radar-image shaper <NUM> (e.g., characteristics of the radar data associated with particular materials, shapes, corners, edges, surfaces, or combinations thereof), and the detected features can be analyzed to determine a match to corresponding known features of the benchmark radar signature. As noted with reference to <FIG>, in some implementations, the radar-signature manager may compare the detected radar signature to a plurality of benchmark radar signatures that correspond to different characteristic dispositions of the radar-image shaper. For example, the signature manager <NUM> may compare the detected radar signature to a plurality of benchmark radar signatures (e.g., benchmark radar signatures that are stored in a memory location such as the signature library <NUM>).

At <NUM>, based on the comparison of the detected radar signature to the benchmark radar signature, it is determined that the radar signature matches (or does not match) the benchmark radar signature. For example, the signature manager <NUM> can determine that the detected radar signature matches the benchmark radar signature.

At <NUM>, in response to determining that the radar signature matches the benchmark radar signature, the characteristic disposition of the object in the radar field is determined, based on the characteristic disposition of the radar-image shaper that corresponds to the matched benchmark radar signature. For example, the signature manager <NUM> can determine the characteristic disposition of the object in the radar field, based on the characteristic disposition of the radar-image shaper <NUM> that corresponds to the matched benchmark radar signature. As noted, the signature manager <NUM> may determine a particular characteristic disposition of the radar-image shaper <NUM> with reference to the electronic device <NUM>. For example, using a signature library such as the signature library <NUM>, which can store data that includes characteristic dispositions of the object <NUM> that correspond to characteristic dispositions of the radar-image shaper <NUM>, the signature manager <NUM> can also determine the characteristic disposition of object <NUM>.

In some implementations, the radar-signature manager can also use one or more subsets of the radar data to determine a change in the characteristic disposition of the object in the radar field (e.g., by using the radar data to determine the characteristic disposition of the object over time). The radar-signature manager can also determine a gesture by the object, based on one or more changes in the characteristic disposition of the object. The radar-signature manager can then determine a function of the electronic device that corresponds to the gesture (e.g., using a three-dimensional (3D) gesture library, such as the 3D gesture module <NUM> described below) and cause the electronic device to provide the function that corresponds to the gesture.

Consider, for example, <FIG>, which illustrate example implementations of objects and devices that can implement additional details of the radar-image shaper for radar-based applications. <FIG> depicts an example implementation <NUM> of the object <NUM> (in this case, a stylus <NUM>), which can be used to interact with an electronic device, such as the electronic device <NUM>. As shown in <FIG>, the stylus <NUM> has a housing and includes a radar-image shaper (e.g., the radar-image shaper <NUM>) integrated within the stylus. The radar-image shaper <NUM> has a radar signature (e.g., reflections of radar signals from the radar field <NUM> or another source), which the radar system <NUM> can use to determine the characteristic disposition of the radar-image shaper <NUM> and thereby determine the characteristic disposition of the stylus <NUM>. As noted, in some implementations, another number of radar-image shapers <NUM> (e.g., two or three) may be attached to the object <NUM>, and the radar-image shapers <NUM> may be in other locations on or within the stylus <NUM>.

For example, <FIG> illustrates another example implementation <NUM> of the object <NUM> (in this case another stylus <NUM>). The stylus <NUM> includes a housing and has two radar-image shapers (e.g., two radar-image shapers <NUM>) integrated within the housing of the stylus <NUM>. As shown, the stylus <NUM> includes a radar-image shaper <NUM> that is integrated nearer to one end of the stylus housing and another radar-image shaper <NUM> that is integrated nearer to another end of the stylus housing. In some implementations, the radar-image shapers may be different shapes, made from different materials, or both. As shown in <FIG>, the radar-image shaper <NUM> is spherical with dimples and the other radar-image shaper <NUM> is made from corner reflectors arranged as an octahedron similar to the radar-image shaper <NUM> described with reference to <FIG> (e.g., an octahedron made from eight trihedral corner reflectors). While the styluses <NUM> and <NUM> are shown as generally cylindrical, other shapes and cross-sections may be used (e.g., elliptical).

In some implementations with multiple radar-image shapers, the radar-image shapers are spaced apart based on the wavelength of the radar signal (e.g., the radar field <NUM>). For example, a distance between the multiple radar-image shapers may be based on a multiple of the wavelength (e.g., two, four, or six times the wavelength). In other cases, the distance between multiple radar-image shapers may be fixed, such as three centimeters (cm), five cm, seven cm, or ten cm. Further, the number of radar-image shapers can affect what aspects of the characteristic disposition, or an amount of detail related to the characteristic disposition, can be detected by the radar system. Thus, a single radar-image shaper allows the radar system to detect a point and determine its characteristic disposition, two radar-image shapers allow the radar system to detect a segment and determine its characteristic disposition, and so forth.

<FIG> depicts another example implementation <NUM> of the object <NUM> (in this case, a gaming controller <NUM>), which can be used to interact with an electronic device, such as the electronic device <NUM>. As shown in <FIG>, the gaming controller <NUM> has a housing and includes two radar-image shapers <NUM> and <NUM> (e.g., two of the radar-image shapers <NUM>) integrated within the housing. The radar-image shaper <NUM> is an octahedron made from eight trihedral corner reflectors, and the radar-image shaper <NUM> is a sphere with dimples. Because they are different shapes, the radar-image shaper <NUM> and the radar-image shaper <NUM> have different radar signatures (e.g., reflections of radar signals from the radar field <NUM> or another source). Having different radar signatures allows the radar system <NUM> to distinguish between the radar-image shaper <NUM> and the radar-image shaper <NUM>, and the radar system <NUM> can use the different radar signatures to determine characteristic dispositions of the radar-image shapers <NUM> and <NUM> and thereby determine a characteristic disposition of the gaming controller <NUM>. Other examples implementations of the object <NUM> (not illustrated) include a smartphone case (e.g., with a radar-image shaper <NUM> in one or more locations), a remote control for a device or appliance, and so forth.

Additionally, because the radar system <NUM> (and the signature manager <NUM>) can determine the characteristic dispositions of the object <NUM> (e.g., the stylus <NUM>, the stylus <NUM>, and the gaming controller <NUM>), the object <NUM> can be used to make 3D gestures, as described with respect to <FIG>. Consider, for example, a stylus, such as either of the styluses <NUM> or <NUM>, and an electronic device (e.g., the electronic device <NUM>) that use radar signals (e.g., the radar field <NUM>) to detect 3D gestures that can be used to control the electronic device <NUM> or provide additional functionality. In this example, a user may make a variety of gestures that provide additional functionality or make existing functionality easier and more intuitive. For example, in a radar-based drawing application, a user may rotate the stylus between a thumb and a finger, or between two fingers, to increase or decrease a line thickness or brush size. The user may use a "shaking" gesture to pick a different brush or change from a brush or pen to an eraser. Similarly, in a radar-based drawing application, the user may draw or sketch in 2½ D or in full 3D. Further, in a radar-based application with editing functions, a user may draw on a screen or other surface and use the 3D gestures with the stylus to create 3D volumes from 2D drawings (e.g., select a corner or other perimeter point on a 2D square or circle and lift the stylus off of the screen to create a cube or sphere). Once a 3D object exists, 3D gestures may be used to rotate, cut, or otherwise manipulate the 3D object.

It should be noted that the described techniques and apparatuses for the radar-image shaper for radar-based applications have other uses as well. For example, users may be able to use a 3D printer, or another device, to create a customized control that has a particular predefined radar signature. Consider a customized knob or dial control, that can be used (e.g., by users with limited strength or dexterity) as an analog control for radar-based home automation systems, video/audio equipment, and so forth. In this way, users can have custom remote controls that can control different hardware, software, and applications, without the need for additional electronics.

Further, a customized stylus or other control may be used for authentication purposes. For example, a user may have a custom key fob or other device that can be used to make a 3D gesture that authenticates the user. It should be noted that these techniques for a radar-image shaper for radar-based applications may be more private and secure than other techniques. Not only are 3D gestures not typically obtainable by an unauthorized person (unlike, for example, a password), but also because a radar image of the user, even if it includes the user's body or face, does not visually identify the user like a photograph or video (e.g., when a camera is used to track and detect a controller or gestures).

Even so, further to the descriptions above, the user may be provided with controls allowing the user to make an election as to both whether and when any of the systems, programs, modules, or features described in this document may enable collection of user information (e.g., information about a user's social network, social actions or activities, profession, a user's preferences, or a user's current location), and whether the user is sent content or communications from a server. In addition, certain data may be treated in one or more ways before it is stored or used, so that personally identifiable information is removed. For example, a user's identity may be treated so that no personally identifiable information can be determined for the user, or a user's geographic location may be generalized where location information is obtained (such as to a city, zip code, or state level), so that a particular location of the user cannot be determined. Thus, the user may have control over what information is collected about the user, how that information is used, and what information is provided to or about the user.

<FIG> illustrates various components of an example computing system <NUM> that can be implemented as any type of client, server, and/or electronic device as described with reference to the previous <FIG> to implement a radar-image shaper for radar-based applications.

The computing system <NUM> includes communication devices <NUM> that enable wired and/or wireless communication of device data <NUM> (e.g., radar data, 3D gesture data, authentication data, reference data, received data, data that is being received, data scheduled for broadcast, and data packets of the data). The device data <NUM> or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with an object or a user of the device (e.g., an identity of a person within a radar field, customized gesture data, or a radar signature of a radar-image shaper,). Media content stored on the computing system <NUM> can include any type of radar, biometric, audio, video, and/or image data. The computing system <NUM> includes one or more data inputs <NUM> via which any type of data, media content, and/or inputs can be received, such as human utterances, interactions with a radar field, touch inputs, user-selectable inputs (explicit or implicit), messages, music, television media content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source. The data inputs <NUM> may include, for example, the signature manager <NUM>, the signature library <NUM>, or the 3D gesture module <NUM>.

The computing system <NUM> also includes communication interfaces <NUM>, which can be implemented as any one or more of a serial and/or parallel interface, a wireless interface, any type of network interface, a modem, and as any other type of communication interface. The communication interfaces <NUM> provide a connection and/or communication links between the computing system <NUM> and a communication network by which other electronic, computing, and communication devices communicate data with the computing system <NUM>.

The computing system <NUM> includes one or more processors <NUM> (e.g., any of microprocessors, controllers, or other controllers) that can process various computer-executable instructions to control the operation of the computing system <NUM> and to enable techniques for, or in which can be implemented, a radar-image shaper for radar-based applications. Alternatively or additionally, the computing system <NUM> can be implemented with any one or combination of hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits, which are generally identified at <NUM>. Although not shown, the computing system <NUM> can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.

The computing system <NUM> also includes computer-readable media <NUM>, such as one or more memory devices that enable persistent and/or non-transitory data storage (i.e., in contrast to mere signal transmission), examples of which include random access memory (RAM), non-volatile memory (e.g., any one or more of a read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device. A disk storage device may be implemented as any type of magnetic or optical storage device, such as a hard disk drive, a recordable and/or rewriteable compact disc (CD), any type of a digital versatile disc (DVD), and the like. The computing system <NUM> can also include a mass storage media device (storage media) <NUM>.

The computer-readable media <NUM> provides data storage mechanisms to store the device data <NUM>, as well as various device applications <NUM> and any other types of information and/or data related to operational aspects of the computing system <NUM>. For example, an operating system <NUM> can be maintained as a computer application with the computer-readable media <NUM> and executed on the processors <NUM>. The device applications <NUM> may include a device manager, such as any form of a control application, software application, signal-processing and control modules, code that is native to a particular device, an abstraction module, a gesture recognition module, and other modules. The device applications <NUM> may also include system components, engines, or managers to implement a radar-image shaper for radar-based applications, such as the radar system <NUM>, the signature manager <NUM>, the signature library <NUM>, or the 3D gesture module <NUM>. The computing system <NUM> may also include, or have access to, one or more machine learning systems.

Claim 1:
An electronic device, comprising:
a radar system (<NUM>), implemented at least partially in hardware, configured to:
provide a radar field (<NUM>);
sense reflections from an input device (<NUM>, <NUM>, <NUM>, <NUM>) in the radar field (<NUM>) to control applications on the electronic device (<NUM>);
analyze the reflections from the input device (<NUM>, <NUM>, <NUM>, <NUM>) in the radar field (<NUM>); and
provide, based on the analysis of the reflections, radar data;
one or more computer processors (<NUM>, <NUM>); and
one or more computer-readable media (<NUM>, <NUM>) having instructions stored thereon that, responsive to execution by the one or more computer processors (<NUM>, <NUM>), implement a radar-signature manager (<NUM>) configured to:
detect, based on a first subset of the radar data, a radar signature of a radar-image shaper (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) of the input device (<NUM>, <NUM>, <NUM>, <NUM>) in the radar field (<NUM>), the radar-image shaper (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) being a component of the input device (<NUM>, <NUM>, <NUM>, <NUM>) producing a known radar signature when illuminated by the radar field (<NUM>);
compare the detected radar signature to a benchmark radar signature that corresponds to a characteristic disposition of the radar-image shaper (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>);
determine, based on the comparison, that the detected radar signature matches the benchmark radar signature; and
responsive to the determination that the detected radar signature matches the benchmark radar signature, determine, based on the characteristic disposition of the radar-image shaper (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) that corresponds to the matched benchmark radar signature, a characteristic disposition of the input device (<NUM>, <NUM>, <NUM>, <NUM>) in the radar field (<NUM>).