Patent Description:
Korean patent application <CIT> discloses adjusting and switching a beam using image information and position information. <CIT> teaches determining the position of a peripheral vehicle in real time, tracking the position of the peripheral vehicle, and synchronizing formation of the beam pattern with the position of the peripheral vehicle in real time. International patent application <CIT> discloses acquiring an image of a user wearing a head-mounted display and determining, from among a plurality of candidates, a main beam direction for communication with the head-mounted display.

In some aspects, a method of wireless communication, performed by a wireless communication device, is provided according to claim <NUM>. Preferred embodiments are subject of the dependent claims.

In some aspects, a wireless communication device is provided according to claim <NUM>. Preferred embodiments are subject of the dependent claims.

In some aspects, a non-transitory computer-readable medium storing one or more instructions for wireless communication is provided according to claim <NUM>. Preferred embodiments are subject of the dependent claims.

Aspects generally include a method, apparatus, system, computer program product, non-transitory computer-readable medium, user equipment, base station, wireless communication device, and processing system as substantially described herein with reference to and as illustrated by the accompanying drawings and specification.

In some aspects, the base station <NUM> and/or the UE <NUM> may be capable of communicating (e.g., transmitting and/or receiving) using millimeter waves. To improve millimeter wave communication, the base station <NUM> and/or the UE <NUM> may use beamforming to focus a directional millimeter wave beam. The base station <NUM> and/or the UE <NUM> may use such beams to establish initial millimeter wave links, for control communications, for data communications (e.g., steady state data rate communications, peak data rate communications, and/or the like), and/or the like. Beamforming may be achieved using antenna arrays (e.g., having a size of 16x4, 32x4, 32x8, 64x4, 64x8, 128x16, and/or the like) by combining antenna elements in an antenna array such that signals at particular angles experience constructive interference while signals at other angles experience destructive interference. The base station <NUM> and/or the UE <NUM> may use millimeter wave beams to communicate with other devices (e.g., via BS-to-UE communication, UE-to-UE communication, BS-to-BS communication, and/or the like). Additionally, or alternatively, the base station <NUM> and/or the UE <NUM> may use millimeter wave radar to track objects in the vicinity of the base station <NUM> and/or the UE <NUM>, such as by transmitting a millimeter wave signal via one or more beams and monitoring for a return signal.

At base station <NUM>, a transmit processor <NUM> may receive data from a data source <NUM> for one or more UEs, select one or more modulation and coding schemes (MCS) for each UE based at least in part on channel quality indicators (CQIs) received from the UE, process (e.g., encode and modulate) the data for each UE based at least in part on the MCS selected for the UE, and provide data symbols for all UEs.

Controller/processor <NUM> of base station <NUM>, controller/processor <NUM> of UE <NUM>, and/or any other component(s) of <FIG> may perform one or more techniques associated with using image processing to assist with beamforming, as described in more detail elsewhere herein. For example, controller/processor <NUM> of base station <NUM>, controller/processor <NUM> of UE <NUM>, and/or any other component(s) of <FIG> may perform or direct operations of, for example, process <NUM> of <FIG> and/or other processes as described herein. Memories <NUM> and <NUM> may store data and program codes for base station <NUM> and UE <NUM>, respectively.

In some aspects, base station <NUM> and/or UE <NUM> may include means for determining a location of an object relative to a wireless communication device (e.g., the base station <NUM> and/or the UE <NUM>), wherein the location is determined based at least in part on a result of processing one or more images that include the object; means for configuring at least one of a beam or a beam scan characteristic used to identify the beam to be used by the wireless communication device based at least in part on the location of the object relative to the wireless communication device; means for communicating using the beam; and/or the like. In some aspects, such means may include one or more components of base station <NUM> and/or UE <NUM> described in connection with <FIG>.

<FIG> shows an example frame structure <NUM> for FDD in a telecommunications system (e.g., NR). Each radio frame may have a predetermined duration and may be partitions into a set of Z (Z ≥ <NUM>) subframes (e.g., with indices of <NUM> through Z-<NUM>). Each subframe may include a set of slots (e.g., two slots per subframe are shown in <FIG>). For example, each slot may include seven symbol periods (e.g., as shown in <FIG>), fifteen symbol periods, and/or the like. In a case where the subframe includes two slots, the subframe may include <NUM> symbol periods, where the <NUM> symbol periods in each subframe may be assigned indices of <NUM> through <NUM>-<NUM>. In some aspects, a scheduling unit for the FDD may frame-based, subframe-based, slot-based, symbol-based, and/or the like.

Similarly, in some aspects, one or more SS blocks of the SS burst may be transmitted in consecutive radio resources (e.g., consecutive symbol periods) during one or more subframes.

The base station may transmit system information, such as system information blocks (SIBs) on a physical downlink shared channel (PDSCH) in certain subframes. The base station may transmit control information/data on a physical downlink control channel (PDCCH) in C symbol periods of a subframe, where B may be configurable for each subframe. The base station may transmit traffic data and/or other data on the PDSCH in the remaining symbol periods of each subframe.

<FIG> shows an example subframe format <NUM> with a normal cyclic prefix. Each resource block may cover a set to of subcarriers (e.g., <NUM> subcarriers) in one slot and may include a number of resource elements. In some aspects, subframe format <NUM> may be used for transmission of SS blocks that carry the PSS, the SSS, the PBCH, and/or the like, as described herein.

An interlace structure may be used for each of the downlink and uplink for FDD in certain telecommunications systems (e.g., NR). For example, Q interlaces with indices of <NUM> through Q - <NUM> may be defined, where Q may be equal to <NUM>, <NUM>, <NUM>, <NUM>, or some other value. Each interlace may include subframes that are spaced apart by Q frames. In particular, interlace q may include subframes q, q + Q, q + 2Q, etc., where q ∈ {<NUM>,.

Each radio frame may include <NUM> subframes with a length of <NUM>. Consequently, each subframe may have a length of <NUM>. Each subframe may indicate a link direction (e.g., DL or UL) for data transmission and the link direction for each subframe may be dynamically switched. Each subframe may include DL/UL data as well as DL/UL control data.

<FIG> is a diagram illustrating an example <NUM> of wireless communication via one or more beams, in accordance with various aspects of the present disclosure.

As shown in <FIG>, a first apparatus <NUM> (e.g., shown as a UE <NUM> in example <NUM>, but which may be a base station <NUM>) may communicate with a second apparatus <NUM> (e.g., shown as a base station in example <NUM>, but which may be a UE <NUM>) using one or more beams (e.g., that operate in a millimeter wave radio frequency band). The first apparatus <NUM> and/or the second apparatus <NUM> may include one or more wireless communication devices, such as a base station <NUM>, a UE <NUM>, and/or the like. The first apparatus <NUM> and/or the second apparatus <NUM> may use beamforming for directional signal transmission and/or reception via a beam, such as by combining elements in an antenna array such that signals at particular angles experience constructive interference while signals at other angles experience destructive interference. Beamforming may be used to improve performance of millimeter wave communications that are vulnerable to propagation loss and diffraction, which may be mitigated by narrowly focusing millimeter wave beams.

In some aspects, the first apparatus <NUM> and the second apparatus <NUM> may communicate using an active beam <NUM>. In some aspects, the first apparatus <NUM> and the second apparatus <NUM> may also be capable of communicating via one or more candidate beams <NUM>. In some aspects, an active beam <NUM> may be selected from a set of candidate beams <NUM> by comparing beam parameters (e.g., RSRP, RSRQ, RSSI, and/or the like) of the set of candidate beams <NUM>, which may be determined by performing a beam scan to determine the beam parameters of multiple beams. For example, an active beam <NUM> may be the beam that has the best beam parameters among all beams in the set of candidate beams <NUM> scanned during a beam scan.

However, determining an active beam <NUM> to be used for communication (e.g., in a particular direction) may be a time-consuming and power-intensive process that consumes a large amount of device resources (e.g., memory resources, processing resources, antenna resources, and/or the like) and network resources (e.g., over-the-air time resources, frequency resources, and/or the like). For example, the base station <NUM> and/or the UE <NUM> may be required to perform beam scanning in a wide range of directions to determine a beam to be used as the active beam <NUM>. Some techniques and apparatuses described herein use computer vision and/or image processing to assist with beamforming (e.g., determining an active beam <NUM>). In this way, device resources and/or network resources may be conserved, such as by reducing a number of directions in which beam scanning needs to be performed, permitting a beam direction to be determined faster, and/or the like.

<FIG> is a diagram illustrating an example <NUM> of using image processing to assist with beamforming, in accordance with various aspects of the present disclosure. Example <NUM> is an example where a base station <NUM> uses image processing to assist with beamforming a beam to be used to communicate with a UE <NUM> associated with a vehicle.

As shown in <FIG>, a base station <NUM> may communicate with a UE <NUM>. As further shown, the base station <NUM> may be in communication with a camera <NUM> and/or an image processor <NUM>. The camera <NUM> may include, for example, a video camera, a still camera, an infra-red camera, a conventional camera, and/or another type of video capture device or image capture device. The camera <NUM> may obtain one or more images <NUM> (e.g., a sequence of images that form a video, one or more frames of a video, and/or the like), and may provide the one or more images <NUM> to the image processor <NUM>. The image processor <NUM> may process the one or more images <NUM> to identify one or more objects in the image(s) <NUM>, and/or may determine a location of an object in an image <NUM> (e.g., a vehicle, a person, a UE <NUM>, and/or the like). In some aspects, the camera <NUM> and/or the image processor <NUM> may be integrated into and/or co-located with the base station <NUM> (e.g., mounted on the base station <NUM>). In some aspects, the camera <NUM> and/or the image processor <NUM> may be separate from the base station <NUM> and/or may not be co-located with the base station <NUM>.

As shown by reference number <NUM>, the base station <NUM> may determine a location of an object relative to the base station <NUM>. The location of the object may be determined based at least in part on a result of processing one or more images <NUM> that include the object. In some aspects (e.g., when the base station <NUM> includes the image processor <NUM>), the base station <NUM> may determine the location based at least in part on performing image processing on the one or more images <NUM> to determine a result of the image processing. In some aspects (e.g., when the base station <NUM> does not include the image processor <NUM>), the base station <NUM> may determine the location based at least in part on receiving a result of image processing from another device (e.g., a device that includes image processor <NUM>). As described in more detail below, the location of the object associated with the UE <NUM> may be used to assist with identifying and/or configuring a beam to be used to communicate with the UE <NUM>.

In some aspects, the object may be associated with a UE <NUM> with which the base station <NUM> is to communicate (e.g., using a beam identified and/or configured based at least in part on the location of the object). For example, the object may include a vehicle (e.g., a car, a truck, a bus, a watercraft, an aircraft, and/or the like), in which case the UE <NUM> may be integrated into the vehicle, in communication with a communication system of the vehicle, attached to the vehicle, carried inside of the vehicle, and/or the like. Additionally, or alternatively, the object may include a person, in which case the UE <NUM> may be carried by the person, worn by the person (e.g., internally or externally), associated with a subscription of the person, and/or the like. Additionally, or alternatively, the object may include the UE <NUM> (e.g., which may have different forms depending on a type of the UE <NUM>). In example <NUM>, the object is a vehicle, but other types of objects are possible.

As shown by reference number <NUM>, in some aspects, the base station <NUM> may signal, to the UE <NUM>, a capability of the base station <NUM> to use a location of the UE <NUM> to assist with beamforming. For example, the capability may be signaled in a master information block (MIB), a system information block (SIB), a group common PDCCH, a radio resource control (RRC) message, downlink control information (DCI), sidelink control information (SCI), and/or the like.

Additionally, or alternatively, the base station <NUM> may request, from the UE <NUM>, tracking information associated with the UE <NUM> to assist with determining a location of the UE <NUM> from an image <NUM>. The tracking information may indicate, for example, a location of the UE <NUM> (e.g., using global positioning system (GPS) data and/or the like), a speed at which the UE <NUM> is moving, an acceleration of the UE <NUM>, a direction in which the UE <NUM> is moving, a visible characteristic of the UE <NUM> and/or the object associated with the UE <NUM>, a time at which the tracking information was obtained and/or transmitted, and/or the like. The visible characteristic may include, for example, a color of a vehicle associated with the UE <NUM>, a make of the vehicle, a model of the vehicle, a license plate number of the vehicle, a visible code (e.g., a barcode, a QR code, and/or the like) associated with the vehicle, a picture of a person associated with the UE <NUM>, a color of clothing worn by the person, and/or the like. The tracking information may be used to identify the object in an image <NUM>, and/or to associate the object with the UE <NUM> so that beamforming can be performed by tracking the object.

As shown by reference number <NUM>, the UE <NUM> may transmit, and the base station <NUM> may receive, the tracking information. In some aspects, the base station <NUM> may use the tracking information to determine and/or store an association between the object and the UE <NUM> with which the base station <NUM> is to communicate using a beam. For example, the base station <NUM> may use a location reported by the UE <NUM> and a location of an object in an image <NUM> (e.g., at a particular time or within a time period) to determine that the object is associated with the UE <NUM> (e.g., because the object and the UE <NUM> were located at the same location or within a threshold proximity of the same location at the same time or within a threshold time period). Similarly, the base station <NUM> may use a speed, an acceleration, and/or a direction of movement reported by the UE <NUM> and a speed, acceleration, and/or direction of movement determined for an object (e.g., using image processing across multiple images <NUM> over time) to determine that the object is associated with the UE <NUM>. Additionally, or alternatively, the base station <NUM> may use a visible characteristic of an object, reported by the UE <NUM>, and a visible characteristic of an object, observed in an image <NUM>, to determine that the object is associated with the UE <NUM>. The base station <NUM> may use a single factor described above or a combination of factors described above to associate an object and a UE <NUM>.

As shown by reference number <NUM>, the base station <NUM> may configure at least one of a beam or a beam scan characteristic used to identify the beam to be used by the base station <NUM> based at least in part on the location of the object relative to the base station <NUM>. In some aspects, the base station <NUM> may configure a beam based at least in part on the location of the object relative to the base station <NUM>. For example, the base station <NUM> may configure a beam by forming a beam, selecting an active beam from a plurality of candidate beams, switching to a different beam, configuring and/or modifying one or more beam parameters of a beam (e.g., a transmission power of one or more antenna elements, a phase at which a signal is transmitted by one or more antenna elements, an amplitude at which a signal is transmitted by one or more antenna elements, a transmission direction of an antenna array, and/or the like), configuring and/or modifying a direction of a beam, and/or the like. In some aspects, the base station <NUM> may configure a transmission (Tx) beam to be used by the base station <NUM> to transmit information (e.g., to a UE <NUM>). Additionally, or alternatively, the base station <NUM> may configure a reception (Rx) beam to be used by the base station <NUM> to receive information (e.g., from a UE <NUM>).

In some aspects, the base station <NUM> may configure a beam to improve speed, quality, reliability, and/or the like of communications with a UE <NUM> via the beam. For example, the base station <NUM> may configure a beam in the direction of the UE <NUM> (to point to a location of the UE <NUM> and/or a location where the UE <NUM> is predicted to be according to a speed, acceleration, direction of movement, and/or the like) based at least in part on determining the location of the object, associated with the UE <NUM>, relative to the base station <NUM>. In this way, communications between the UE <NUM> and the base station <NUM> may be improved.

In some aspects, the base station <NUM> may further improve communication by signaling, to the UE <NUM>, a beam configuration to be used by the UE <NUM> to communicate with the base station <NUM>. The base station <NUM> may determine the beam configuration to be used by the UE <NUM> based at least in part on the location of an object, associated with the UE <NUM>, relative to the base station <NUM>. In some aspects, signaling the beam configuration may include indicating an active beam to be selected from a plurality of candidate beams, indicating a beam to be switched to, indicating one or more beam parameters to be used for a beam, indicating a direction to be used for a beam, and/or the like. In some aspects, the base station <NUM> may transmit a beam configuration for a transmission (Tx) beam to be used by the UE <NUM> to transmit information (e.g., to the base station <NUM>). Additionally, or alternatively, the base station <NUM> may transmit a beam configuration for a reception (Rx) beam to be used by the UE <NUM> to receive information (e.g., from the base station <NUM>).

In some aspects, the base station <NUM> may configure a beam scan characteristic based at least in part on the location of the object relative to the base station <NUM>. The beam scan characteristic may be used to identify a beam to be used by the base station <NUM>. For example, the beam scan characteristic may include a first range of directions to be scanned, a second range of directions not to be scanned, a frequency with which beams are to be scanned in one or more directions, and/or the like. In some aspects, the base station <NUM> may determine a location of an object, and may scan beams more frequently in a first direction that is toward the location, and may scan beams less frequently in a second direction that is not toward the location. In some aspects, the base station <NUM> may scan beams more frequently in directions that are toward objects identified in an image <NUM>, and may scan beams less frequently in directions that are not toward any objects identified in an image <NUM>. In this way, the base station <NUM> may reduce an amount of time required to identify a beam, may conserve device resources and network resources associated with beamforming and/or beam scanning, and/or the like.

In some aspects, the base station <NUM> may communicate using the beam. For example, the base station <NUM> may communicate with the UE <NUM> via the beam. This communication may include, for example, transmitting information to the UE <NUM> via the beam and/or receiving information from the UE <NUM> via the beam. By using image processing to determine a location of an object associated with a UE <NUM>, and using the location to assist with beamforming, the base station <NUM> and the UE <NUM> may quickly establish communication via a beam, may improve a speed, quality, and/or reliability of communications, may conserve device resources (e.g., of base station <NUM> and/or UE <NUM>) associated with beamforming, and/or the like.

In some aspects, the base station <NUM> may reconfigure a beam and/or a beam scan characteristic (e.g., after an initial configuration) by performing one or more operations described herein. For example, the base station <NUM> may reconfigure a beam and/or a beam scan characteristic as a UE <NUM> and/or an object associated with the UE <NUM> moves. In this case, the base station <NUM> may, for example, determine an updated location of the object, and may reconfigure the beam and/or the beam scan characteristics based at least in part on the updated location, in a similar manner as described above. In this way, the base station <NUM> may efficiently configure beams to maintain a connection with the UE <NUM>.

<FIG> is a diagram illustrating an example <NUM> of using image processing to assist with beamforming, in accordance with various aspects of the present disclosure. Example <NUM> is an example where a base station <NUM> uses image processing to assist with beamforming a beam to be used to communicate with a UE <NUM> associated with a person.

As shown in <FIG>, a base station <NUM> may communicate with a UE <NUM>. As further shown, the base station <NUM> may be in communication with a camera <NUM> and/or an image processor <NUM> that captures and/or analyzes one or more images <NUM>, as described above in connection with <FIG>.

As shown by reference number <NUM>, the base station <NUM> may determine a location of an object relative to the base station <NUM>, as described above in connection with <FIG>. In example <NUM>, the object is a person, but other types of objects are possible.

In some aspects, the base station <NUM> may signal, to the UE <NUM>, a capability of the base station <NUM> to use a location of the UE <NUM> to assist with beamforming, as described above in connection with <FIG>. Additionally, or alternatively, the base station <NUM> may request, from the UE <NUM>, tracking information associated with the UE <NUM> to assist with determining a location of the UE <NUM> from an image <NUM>, as described above in connection with <FIG>. In some aspects, the UE <NUM> may transmit, and the base station <NUM> may receive, the tracking information, as described above in connection with <FIG>.

As shown by reference number <NUM>, the base station <NUM> may configure at least one of a beam or a beam scan characteristic based at least in part on the location of the object relative to the base station <NUM>, as described above in connection with <FIG>. Additionally, or alternatively, the base station <NUM> may signal, to the UE <NUM>, a beam configuration to be used by the UE <NUM> to communicate with the base station <NUM>, as described above in connection with <FIG>.

As shown by reference number <NUM>, the base station <NUM> may communicate using the beam, as described above in connection with <FIG>. By using image processing to determine a location of an object associated with a UE <NUM>, and using the location to assist with beamforming, the base station <NUM> and the UE <NUM> may quickly establish communication via a beam, may improve a speed, quality, and/or reliability of communications, may conserve device resources (e.g., of base station <NUM> and/or UE <NUM>) associated with beamforming, and/or the like.

In some aspects, the base station <NUM> may reconfigure a beam and/or a beam scan characteristic, as described above in connection with <FIG>. In this way, the base station <NUM> may efficiently configure beams to maintain a connection with the UE <NUM>.

<FIG> is a diagram illustrating an example <NUM> of using image processing to assist with beamforming, in accordance with various aspects of the present disclosure. Example <NUM> is an example where a first UE <NUM> uses image processing to assist with beamforming a beam to be used to communicate with a second UE <NUM>. In example <NUM>, the first UE <NUM> and the second UE <NUM> are associated with vehicles. In some aspects, the first UE <NUM> and/or the second UE <NUM> may be associated with another type of object, such as a person.

As shown in <FIG>, a first UE <NUM> may communicate with one or more other UEs <NUM>, which may include a second UE <NUM>. As further shown, the first UE <NUM> may be in communication with a camera <NUM> and/or an image processor <NUM>. The camera <NUM> may include, for example, a video camera, a still camera, an infra-red camera, a conventional camera, and/or another type of video capture device or image capture device. The camera <NUM> may obtain one or more images <NUM> (e.g., a sequence of images that form a video, one or more frames of a video, and/or the like), and may provide the one or more images <NUM> to the image processor <NUM>. The image processor <NUM> may process the one or more images <NUM> to identify one or more objects in the image(s) <NUM>, and/or may determine a location of an object in an image <NUM> (e.g., a vehicle, a person, a UE <NUM>, and/or the like). In some aspects, the camera <NUM> and/or the image processor <NUM> may be integrated into and/or co-located with the first UE <NUM> and/or an object associated with the first UE <NUM> (e.g., mounted on the first UE <NUM> and/or the object, such as a vehicle). In some aspects, the camera <NUM> and/or the image processor <NUM> may be separate from the first UE <NUM> and/or may not be co-located with the first UE <NUM> and/or the object associated with the first UE <NUM>.

As shown by reference number <NUM>, the first UE <NUM> may determine a location of an object relative to the first UE <NUM>, in a similar manner as described above in connection with <FIG>. In some aspects (e.g., when the first UE <NUM> includes the image processor <NUM>), the first UE <NUM> may determine the location based at least in part on performing image processing on the one or more images <NUM> to determine a result of the image processing. In some aspects (e.g., when the first UE <NUM> does not include the image processor <NUM>), the first UE <NUM> may determine the location based at least in part on receiving a result of image processing from another device (e.g., a device that includes image processor <NUM>). In some aspects, the object may be associated with a second UE <NUM> with which the first UE <NUM> is to communicate. For example, the object may include a vehicle, a person, the second UE <NUM>, and/or the like, as described above in connection with <FIG>. In example <NUM>, the object is a vehicle, but other types of objects are possible.

In some aspects, the first UE <NUM> may signal, to the second UE <NUM>, a capability of the first UE <NUM> to use a location of the second UE <NUM> to assist with beamforming, in a similar manner as described above in connection with <FIG>. Additionally, or alternatively, the first UE <NUM> may request, from the second UE <NUM>, tracking information associated with the second UE <NUM> to assist with determining a location of the second UE <NUM> from an image <NUM>, in a similar manner as described above in connection with <FIG>. In some aspects, the second UE <NUM> may transmit, and the first UE <NUM> may receive, the tracking information, in a similar manner as described above in connection with <FIG>.

As shown by reference number <NUM>, the first UE <NUM> may configure at least one of a beam or a beam scan characteristic based at least in part on the location of the object relative to the first UE <NUM>, in a similar manner as described above in connection with <FIG>. Additionally, or alternatively, the first UE <NUM> may signal, to the second UE <NUM>, a beam configuration to be used by the second UE <NUM> to communicate with the first UE <NUM>, in a similar manner as described above in connection with <FIG>.

The first UE <NUM> may communicate using the beam, in a similar manner as described above in connection with <FIG>. By using image processing to determine a location of an object associated with a second UE <NUM>, and using the location to assist with beamforming, the first UE <NUM> and the second UE <NUM> may quickly establish communication via a beam, may improve a speed, quality, and/or reliability of communications, may conserve device resources (e.g., of the first UE <NUM> and/or the second UE <NUM>) associated with beamforming, and/or the like.

In some aspects, the first UE <NUM> may reconfigure a beam and/or a beam scan characteristic, in a similar manner as described above in connection with <FIG>. In this way, the first UE <NUM> may efficiently configure beams to maintain a connection with the second UE <NUM>.

<FIG> is a diagram illustrating an example <NUM> of using image processing to assist with beamforming, in accordance with various aspects of the present disclosure. Example <NUM> is an example where a UE <NUM> uses image processing to assist with beamforming a beam to be used for millimeter wave radar.

As shown in <FIG>, a UE <NUM> may use millimeter wave radar to detect one or more objects (e.g., for collision avoidance, steering control, and/or the like). As further shown, the UE <NUM> may be in communication with a camera <NUM> and/or an image processor <NUM> that captures and/or analyzes one or more images <NUM>, in a similar manner as described above in connection with <FIG>.

As shown by reference number <NUM>, the UE <NUM> may determine a location of an object relative to the UE <NUM>, in a similar manner as described above in connection with <FIG>. In some aspects, the object may include a vehicle, a person, an animal, a stationary object (e.g., a building, a traffic sign, a traffic signal, and/or the like), and/or the like. In example <NUM>, the object is a person, but other types of objects are possible.

As shown by reference number <NUM>, the UE <NUM> may configure at least one of a beam or a beam scan characteristic based at least in part on the location of the object relative to the UE <NUM>. In some aspects, the beam is a millimeter wave radar beam used for millimeter wave radar. For example, the UE <NUM> may use millimeter wave radar to track objects in the vicinity of the UE <NUM>, such as by transmitting a millimeter wave signal via one or more beams and monitoring for a return signal.

In this case, the UE <NUM> may configure the beam and/or the beam scan characteristic by configuring a rate of transmission of the millimeter wave radar beam. For example, the UE <NUM> may configure millimeter wave radar beam transmissions to occur more frequently in one or more directions toward the location of the object, and/or may configure millimeter wave radar beam transmissions to occur less frequently in one or more directions that are not toward the location of the object. In this way, the UE <NUM> may respond faster to objects (e.g., for collision avoidance).

Additionally, or alternatively, the UE <NUM> may configure the beam and/or the beam scan characteristic by configuring a width of the millimeter wave radar beam. For example, the UE <NUM> may configure narrower millimeter wave radar beams in one or more directions toward the location of the object, and/or may configure wider millimeter wave radar beam transmissions in one or more directions that are not toward the location of the object. In this way, the UE <NUM> may obtain more accurate radar images in a location of interest (e.g., for collision avoidance).

Additionally, or alternatively, the UE <NUM> may configure the beam and/or the beam scan characteristic by configuring a direction of the millimeter wave radar beam. For example, the UE <NUM> may configure transmission of millimeter wave radar beams in one or more directions toward the location of the object, and/or may not configure transmission of a millimeter wave radar beams in one or more directions that are not toward the location of the object. In this way, the UE <NUM> may focus a millimeter wave radar beam toward a location of interest (e.g., for collision avoidance). Furthermore, resources of the UE <NUM> (e.g., processor resources, memory resources, battery power, and/or the like) may be conserved by configuring millimeter wave radar beams in fewer than all directions.

Additionally, or alternatively, the UE <NUM> may configure the beam and/or the beam scan characteristic by configuring a signal characteristic and/or a signal frequency of the millimeter wave radar beam. For example, the UE <NUM> may configure a millimeter wave radar beam with different frequencies for different types of objects (e.g., a first frequency for a person, a second frequency for a car, a third frequency for a truck, and/or the like), which may result in better radar imaging. Additionally, or alternatively, the UE <NUM> may configure a millimeter wave radar beam with different phases, different amplitudes, and/or the like for different types of objects, which may result in better radar imaging.

The UE <NUM> may communicate using the millimeter wave radar beam, such as by transmitting one or more millimeter wave signals via the millimeter wave radar beam and monitoring for a return signal. By using image processing to determine a location of an object, and using the location to assist with beamforming and/or transmission of millimeter wave radar beams, the UE <NUM> may improve a speed, quality, and/or reliability of millimeter wave radar, may conserve device resources (e.g., of the UE <NUM>) associated with beamforming and/or transmitting millimeter wave radar beams, may improve collision avoidance, and/or the like.

<FIG> is a diagram illustrating an example process <NUM> performed, for example, by a wireless communication device, in accordance with various aspects of the present disclosure. Example process <NUM> is an example where a wireless communication device (e.g., a base station <NUM>, a UE <NUM>, and/or the like) uses image processing to assist with beamforming.

As shown in <FIG>, in some aspects, process <NUM> may include determining a location of an object relative to a wireless communication device, wherein the location is determined based at least in part on a result of processing one or more images that include the object (block <NUM>). For example, the wireless communication device (e.g., using controller/processor <NUM>, controller/processor <NUM>, and/or the like) may determine a location of an object relative to the wireless communication device, as described above in connection with <FIG>. In some aspects, the location is determined based at least in part on a result of processing one or more images that include the object.

As further shown in <FIG>, in some aspects, process <NUM> may include configuring at least one of a beam or a beam scan characteristic used to identify the beam to be used by the wireless communication device based at least in part on the location of the object relative to the wireless communication device (block <NUM>). For example, the wireless communication device (e.g., using controller/processor <NUM>, controller/processor <NUM>, and/or the like) may configure at least one of a beam or a beam scan characteristic used to identify the beam to be used by the wireless communication device based at least in part on the location of the object relative to the wireless communication device, as described above in connection with <FIG>.

As further shown in <FIG>, in some aspects, process <NUM> may include communicating using the beam (block <NUM>). For example, the wireless communication device (e.g., using transmit processor <NUM>, TX MIMO processor <NUM>, MOD/DEMOD <NUM>, antenna <NUM>, MIMO detector <NUM>, receive processor <NUM>, controller/processor <NUM>, antenna <NUM>, MOD/DEMOD <NUM>, MIMO detector <NUM>, receive processor <NUM>, transmit processor <NUM>, TX MIMO processor <NUM>, controller/processor <NUM>, and/or the like) may communicate using the beam, as described above in connection with <FIG>.

Process <NUM> may include additional aspects, such as any single aspect or any combination of aspects described below.

In some aspects, the object is associated with a user equipment with which the wireless communication device is to communicate via the beam. In some aspects, the beam is a millimeter wave radar beam used for millimeter wave radar. In some aspects, configuring at least one of the beam or the beam scan characteristic comprises at least one of: configuring a rate of transmission of the millimeter wave radar beam, configuring a width of the millimeter wave radar beam, configuring a direction of the millimeter wave radar beam, configuring a signal characteristic of the millimeter wave radar beam, configuring a signal frequency of the millimeter wave radar beam, or some combination thereof.

In some aspects, the wireless communication device may signal, to a user equipment (UE) associated with the object, a capability of the wireless communication device to use a location of the UE to assist with beamforming. In some aspects, the wireless communication device may determine an association between the object and a user equipment (UE) with which the wireless communication device is to communicate via the beam. In some aspects, the association is determined based at least in part on at least one of: the location of the object and a location reported by the UE, a speed of the object and a speed reported by the UE, an acceleration of the object and an acceleration reported by the UE, a direction in which the object is moving and a direction reported by the UE, a visible characteristic detected for the object in the one or more images and an indication, reported by the UE, of a visible characteristic of the object, or some combination thereof. In some aspects, the location reported by the UE includes global positioning system data.

In some aspects, the wireless communication device may determine an updated location associated with the object and reconfigure at least one of the beam or the beam scan characteristic based at least in part on the updated location. In some aspects, communicating using the beam includes transmitting information to a user equipment (UE) or receiving information from the UE via the beam. In some aspects, the wireless communication device may signal a beam configuration for the UE based at least in part on the location of the object relative to the wireless communication device.

In some aspects, the location is determined based at least in part on at least one of: global positioning system (GPS) data received from a user equipment associated with the object, a speed associated with the object, an acceleration associated with the object, a direction in which the object is moving, a visible characteristic of the object, or some combination thereof. In some aspects, the object includes at least one of: a user equipment, a vehicle, a person, or some combination thereof.

In some aspects, the one or more images are one or more frames of a video. In some aspects, the one or more images are processed by the wireless communication device. In some aspects, the result of processing the one or more images is received by the wireless communication device from another device that processes the one or more images.

In some aspects, configuring at least one of the beam or the beam scan characteristic comprises at least one of: modifying one or more beam parameters, modifying a direction of the beam, modifying a rate of radar transmissions transmitted in a direction of the beam, switching to a different beam, or some combination thereof. In some aspects, configuring at least one of the beam or the beam scan characteristic comprises scanning beams more frequently in a first direction that is toward the location as compared to a second direction that is not toward the location.

In some aspects, the wireless communication device is a base station. In some aspects, the wireless communication device is a user equipment.

Even though particular combinations of features are recited in the claims and/or disclosed in the specification, these combinations are not intended to limit the disclosure of possible aspects. Although each dependent claim listed below may directly depend on only one claim, the disclosure of possible aspects includes each dependent claim in combination with every other claim in the claim set.

Claim 1:
A method of wireless communication performed by a wireless communication device (<NUM>, <NUM>), comprising:
requesting, from a user equipment, UE (<NUM>), with which the wireless communication device is to communicate, tracking information indicating a location of the UE (<NUM>);
receiving, from the UE, the tracking information;
determining (<NUM>; <NUM>; <NUM>; <NUM>) a location of an object relative to the wireless communication device, wherein the location is determined based at least in part on a result of processing one or more images (<NUM>; <NUM>; <NUM>; <NUM>) that include the object;
determining an association between the object and the UE based at least in part on the location of the object and the tracking information;
configuring (<NUM>; <NUM>; <NUM>; <NUM>) at least one of a beam or a beam scan characteristic used to identify the beam to be used by the wireless communication device based at least in part on the location of the object relative to the wireless communication device (<NUM>, <NUM>); and
communicating (<NUM>; <NUM>) with the UE (<NUM>) using the beam.