Patent Description:
The drone industry is rapidly growing, and drones such as urban air mobility (UAM) vehicles, unmanned aircraft systems (UAS), and other unmanned aerial vehicles (UAVs), have a need for technological improvements that provide for safe landings in case of an emergency.

In some cases, marker based landing (MBL) systems and pads are being used by various companies for drone deliveries. However, when these marker based landing systems and pads are used for emergency landings, the landing pad can be unrecognizable from the drone camera when it is dark, under shadow, or when the light is too bright. <CIT> discloses systems, methods and apparatuses for managing aerial drone parcel transfers.

According to this disclosure there is provided a smart landing pad and method as recited by claims <NUM> and <NUM>. A smart landing pad comprises a flexible display including a display surface configured to show one or more images or patterns, and a protective layer over the display surface. The protective layer is configured to allow an unmanned aerial vehicle (UAV) to land on the smart landing pad without damaging the flexible display. One or more locator and range finder devices are operatively coupled to the flexible display and are operative to communicate with the UAV, such that the flexible display is self-locatable based on a three-dimensional location communicated to the UAV during a landing approach. One or more communication devices are operatively coupled to the flexible display and are operative for wireless communications with a computer or mobile computational device that is operative to provide on-demand user functions, which allow for dynamically changing or customizing in real time the one or more images or patterns that are shown on the display surface.

The one or more images or patterns comprise a background area configurable to show changeable images that match an environment where the smart landing pad is placed for use as a landing site for the UAV, and a target landing area that is surrounded by the background area. The target landing area includes: a changeable insensitive, contrast portion that allows the target landing area to be more recognizable from the UAV under bright light, in darkness at nighttime, or due to poor visibility from inclement weather or dusty environmental conditions; and one or more changeable marker pattern portions having changeable colors and/or shapes that provide for ease of pattern recognition from the UAV. The one or more images also include one or more changeable quick response (QR) codes on the target landing area, with the one or more QR codes operative as fiducial points or for communications. The flexible display is Internet of things (IoT) enabled so that data from the smart landing pad is remotely cloud accessible, allowing the data to be changed, logged, or processed.

Features of the present disclosure will be apparent to those skilled in the art from the following description with reference to the drawings. Understanding that the drawings depict only typical embodiments and are not therefore to be considered limiting in scope, the embodiments will be described with additional specificity and detail through the use of the drawings, in which:.

In the following detailed description, reference is made to the accompanying drawings, in which is shown by way of illustration various exemplary embodiments. It is to be understood that other embodiments may be utilized. The following detailed description is, therefore, not to be taken in a limiting sense.

A marker based, smart landing pad system and method are described herein. The smart landing pad system is useful for the landing of an unmanned aerial vehicle (UAV), including various drones, such as urban air mobility (UAM) vehicles, unmanned aircraft systems (UAS), and the like.

In one embodiment, a smart landing pad for marker based landing of a UAV includes a flexible display, which is drivable by a computer or mobile computational device in operative communication with the flexible display through one or more communication devices operatively coupled to the flexible display. This provides for on demand user functions, which allow for dynamically changing or customizing in real time what is shown on the flexible display. For example, a user can provide on demand changes to various images or patterns shown on the flexible display, such as quick response (QR) codes, landing surface properties, as well as display intensity according to the exposure setting of UAV onboard cameras, and a backlighted display screen so the UAV can recognize the smart landing pad at nighttime. The QR codes are on demand changeable for fiducial-based navigation and communication purposes.

In addition, one or more locator and range finder devices are operatively coupled to the flexible display and are configured to communicate with a UAV, such that the flexible display is self-locatable based on a three-dimensional location communicated to the UAV during a landing approach. For example, a laser range finder embedded in the flexible display can be used to detect latitude/longitude/altitude (LLA), angle, and distance from the smart landing pad to the UAV. The distance can be used as an altitude from the UAV to the landing surface, and data from the laser range finder can be relayed to the UAV via a long range (LoRa) radio coupled to the flexible display.

The smart landing pad can also be Internet of Things (IoT) enabled, such that data from the smart landing pad is remotely cloud accessible by a user. For example, the flexible display can be embedded with a cloud connection such that the smart landing pad is IoT enabled. This allows a user to remotely monitor or control the functions of the smart landing pad over the cloud connection.

Further details of various embodiments are described hereafter with reference to the drawings.

<FIG> illustrates a marker based smart landing pad <NUM>, according to one embodiment. The smart landing pad <NUM> includes a flexible display <NUM> having a display surface <NUM> (screen) configured to show one or more images or patterns. A protective layer <NUM> is formed over display surface <NUM>. In addition, flexible display <NUM> can be mounted on a flexible backing layer <NUM>.

In example embodiments, flexible display <NUM> can be rollable, conformable, foldable, or shapeable. For example, flexible display <NUM> can be a flexible organic liquid crystal display (OLCD) display, a flexible organic light emitting diode (OLED) display, or the like.

The protective top surface <NUM> can be a layer of coated hard material, such as a layer of tempered glass or an acrylic sheet (e.g., plexiglass). The protective top surface <NUM> allows a UAV to safely land on smart landing pad <NUM> without damaging flexible display <NUM>. The protective top surface <NUM> is also configured to be water and dust resistant.

The flexible backing layer <NUM> can be composed of flexible polymer material, for example. The flexible backing layer <NUM> provides protection for flexible display <NUM> when placed on the ground where a UAV is to land.

The smart landing pad <NUM> is configured to allow for on demand changes to what is shown on flexible display <NUM>. For example, flexible display <NUM> has a changeable background area <NUM> that is configured to show various background images. These images can be tailored to match the actual environment where smart landing pad <NUM> is placed for use as a landing site for a UAV. Nonlimiting examples of images that can be shown in background area <NUM> include images of sand, gravel, loose rock, grasses, concrete, or the like.

The flexible display <NUM> also has a target landing area <NUM> that is surrounded by background area <NUM>. The target landing area <NUM> has a changeable insensitive, contrast portion <NUM> that makes target landing area <NUM> more recognizable from the UAV under bright light, in the dark at nighttime, or due to poor visibility from inclement weather or dusty environmental conditions.

The target landing area <NUM> also has changeable marker pattern portions <NUM>, whose color and/or shape can be changed to provide for ease of object/pattern recognition from the UAV. For example, while target area <NUM> is shown with circular marker boundary lines (solid and dashed) and a central target marker ("V" shape), these can be changed to other geometric shapes or patterns as desired. The target landing area <NUM> also is configured to display one or more changeable quick response (QR) codes <NUM>, which serve as fiducial points or for communication purposes.

The smart landing pad <NUM> can also include one or wireless communication devices, which provide short range and/or cloud communications with a computer or mobile computational device. This allows for on-demand user functions, which allow for dynamically changing or customizing in real time what is shown on flexible display <NUM>. The smart landing pad can also include one or more locator, range finder, and long range communication devices, which operatively communicate with a UAV for landing purposes. Examples of such devices are described in further detail hereafter.

<FIG> illustrates an exemplary system <NUM> for implementing use of a marker based smart landing pad <NUM>, which includes features similar to those described above for smart landing pad <NUM>. Accordingly, smart landing pad <NUM> includes a flexible display <NUM> having a display surface <NUM> configured to show one or more images or patterns. A protective layer <NUM> is formed over display surface <NUM>. In addition, flexible display <NUM> can be mounted on a flexible backing layer.

The flexible display <NUM> can be rollable, conformable, foldable, or shapeable. For example, flexible display <NUM> can be a flexible OLCD display, a flexible OLED display, or the like. The protective layer <NUM> can be a layer of coated hard material, and is configured such that a UAV <NUM> is able to safely land on smart landing pad <NUM> without damaging flexible display <NUM>.

The smart landing pad <NUM> is configured to allow for on demand changes to what is shown on flexible display <NUM>. For example, flexible display <NUM> has a changeable background area <NUM> that is configured to show various background images, which can be tailored to match the actual environment where smart landing pad <NUM> is placed for use as a landing site for UAV <NUM>. The flexible display <NUM> also has a target landing area <NUM> that is surrounded by background area <NUM>. The target landing area <NUM> has a changeable insensitive, contrast portion <NUM> that makes target landing area <NUM> more recognizable from UAV <NUM> under bright light or in the dark at nighttime.

The target landing area <NUM> also has changeable marker pattern portions <NUM>, whose color and/or shape can be changed to provide for ease of object/pattern recognition from UAV <NUM>. The target landing area <NUM> also is configured to display one or more changeable QR codes <NUM>, which serve as fiducial points or for communication purposes. For example, QR codes <NUM> can have special meanings that are defined by the operation, such as suggested UAV camera exposure settings, slope of the landing surface, condition of the landing surface, type of landing surface, good to land, abort landing process, or the like.

The smart landing pad <NUM> also includes one or wireless communication devices, which provide for short range and/or cloud communications with a computer or mobile computational device operated by a user. For example, flexible display <NUM> can be embedded with a short range device <NUM>, which provides for short range communications (e.g., WiFi, Bluetooth) with a computer <NUM> such as a laptop, or with a mobile computational device such as a smartphone, operated by a user <NUM>. The computer <NUM> (or mobile computational device) is operative to provide on demand user functions, which allow user <NUM> to dynamically change or customize in real time what is shown on flexible display <NUM>.

In addition, flexible display <NUM> can be Internet of Things (IoT) enabled, such that data from smart landing pad <NUM> is remotely cloud accessible. This allows smart landing pad <NUM> to be remotely monitored or controlled over a cloud connection. For example, a remote cloud server can be used to log and store landing data for auditing purposes or future data analysis. In addition, the cloud connection can be used to provide weather condition data, wind speed data, and the like to the descending UAV through communications with the smart landing pad, as well as go/no go decisions for landing the UAV.

In one embodiment, a Long Term Evolution (LTE) cloud connection <NUM> can be embedded in flexible display <NUM> to IoT enable smart landing pad <NUM>. This allows data to be changed, logged, or processed, such as from a remote location. For example, a remote user <NUM> in a supervisory capacity can manually override a landing situation for smart landing pad <NUM> using a computer <NUM> (or mobile computational device) over a cloud connection <NUM>.

The smart landing pad <NUM> also includes one or more locator, range finder, and long range communication devices, which operatively communicate with UAV <NUM> for landing purposes. These devices allow smart landing pad <NUM> to be self-locatable based on a three-dimensional location communicated to UAV <NUM>, so that UAV <NUM> can successfully land on target landing area <NUM>.

For example, flexible display <NUM> can have an embedded a Global Navigation Satellite System (GNSS) device, such as a Global Positioning System (GPS) device <NUM> or other locator device, which provides latitude/longitude/altitude (LLA) data for self-locating purposes. The flexible display <NUM> can also have an embedded laser range finder <NUM> to detect the proximity of UAV <NUM> during its descent toward smart landing pad <NUM>.

In addition, a long range (LoRa) communication and ranging device <NUM> can be embedded in flexible display <NUM> to provide distance measurements to determine the proximity and altitude from UAV <NUM> to smart landing pad <NUM>. The LoRa is a low-power wide-area network (LPWAN) protocol, which can be implemented with LoRa enabled devices. For example, a LoRa radio with a ranging engine can be used as a distance finder. The distances measured by the range finders are used by the UAV to confirm accuracy for landing purposes.

A proprietary data communication channel <NUM> can be provided that relays the location data of smart landing pad <NUM> to UAV <NUM>. The location data can be used to provide the coordinates for landing of UAV <NUM> on smart landing pad <NUM>.

The UAV <NUM> includes a sensor payload <NUM>, which allows UAV <NUM> to track and communicate with smart landing pad <NUM>. For example, sensor payload <NUM> can include image capturing devices (cameras), a laser range sensor, a proximity sensor, a LoRa and time of flight (ToF) range sensing device, and the like.

<FIG> is a flow diagram for a method <NUM> of using a marker based smart landing pad, such as those described above. Initially, a smart landing pad, placed at a given location, receives a landing request signal issued by a nearby UAV (block <NUM>). The smart landing pad then starts to broadcast its location and send all landing site data to the UAV (block <NUM>). The UAV computes the angle of arrival and distance to the smart landing pad, based on the received landing site location and data, and the UAV then proceeds with the descending process toward the smart landing pad (block <NUM>). The UAV captures images of the smart landing pad, scans QR codes shown on the display surface of the smart landing pad, and then starts a fiducial-based navigation landing process (block <NUM>). The UAV then lands on the smart landing pad (block <NUM>).

A computer or processor used in the present systems and methods can be implemented using software, firmware, hardware, or any appropriate combination thereof, as known to one of skill in the art. These may be supplemented by, or incorporated in, specially-designed application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs). The computer or processor can also include functions with software programs, firmware, or other computer readable instructions for carrying out various process tasks, calculations, and control functions used in the present systems and methods.

The present methods can be implemented by computer executable instructions, such as program modules or components, which are executed by at least one processor. Generally, program modules include routines, programs, objects, data components, data structures, algorithms, and the like, which perform particular tasks or implement particular abstract data types.

Instructions for carrying out the various process tasks, calculations, and generation of other data used in the operation of the methods described herein can be implemented in software, firmware, or other computer- or processor-readable instructions. These instructions are typically stored on any appropriate computer program product that includes a computer readable medium used for storage of computer readable instructions or data structures. Such a computer readable medium can be any available media that can be accessed by a general purpose or special purpose computer or processor, or any programmable logic device.

Suitable processor-readable media may include storage or memory media such as magnetic or optical media. For example, storage or memory media may include conventional hard disks, compact discs, DVDs, Blu-ray discs, or other optical storage media; volatile or nonvolatile media such as Random Access Memory (RAM); Read Only Memory (ROM), Electrically Erasable Programmable ROM (EEPROM), flash memory, and the like; or any other media that can be used to carry or store desired program code in the form of computer executable instructions or data structures.

From the foregoing, it will be appreciated that, although specific embodiments have been described herein for purposes of illustration, various modifications may be made without deviating from the scope of the invention, as defined by the claims.

Claim 1:
A smart landing pad (<NUM>), comprising:
a flexible display (<NUM>) including a display surface (<NUM>) configured to show one or more images or patterns;
a protective layer (<NUM>) over the display surface, wherein the protective layer is configured to allow an unmanned aerial vehicle (UAV) (<NUM>) to land on the smart landing pad without damaging the flexible display;
one or more locator and range finder devices (<NUM>, <NUM>) operatively coupled to the flexible display and operative to communicate with the UAV, such that the flexible display is self-locatable based on a three-dimensional location communicated to the UAV during a landing approach; and
one or more communication devices (<NUM>, <NUM>) operatively coupled to the flexible display and operative for wireless communications with a computer or mobile computational device (<NUM>, <NUM>) that is operative to provide on-demand user functions, which allow for dynamically changing or customizing in real time the one or more images or patterns that are shown on the display surface;
wherein the one or more images or patterns comprise:
a background area (<NUM>) configurable to show changeable images that match an environment where the smart landing pad is placed for use as a landing site for the UAV;
a target landing area (<NUM>) that is surrounded by the background area, the target landing area including:
a changeable insensitive (<NUM>), contrast portion that allows the target landing area to be more recognizable from the UAV under bright light, in darkness at nighttime, or due to poor visibility from inclement weather or dusty environmental conditions; and
one or more changeable marker pattern portions (<NUM>) having changeable colors and/or shapes that provide for ease of pattern recognition from the UAV; and
one or more changeable quick response (QR) codes (<NUM>) on the target landing area, the one or more QR codes operative as fiducial points or for communications;
wherein the flexible display is Internet of things (IoT) enabled so that data from the smart landing pad is remotely cloud accessible, allowing the data to be changed, logged, or processed.