Patent Description:
An avionics lower level device (LLD) simulator is provided as defined by claim <NUM>.

In some embodiments, the at least one touchscreen display device may further include one or more of a backlight, a support structure, or a support plate. The display stack assembly may be positioned proximate to the one or more of the backlight, the support structure, or the support plate.

In some embodiments, the at least one touchscreen display device may include an instrument panel touchscreen display device configured to display at least one GUI or GUI icon representing an aircraft instrument.

In some embodiments, the at least one touchscreen display device may include a windshield touchscreen display device configured to display at least one GUI or GUI icon representing an actual or emulated environmental condition.

In some embodiments, the at least one touchscreen display device may include a primary flight control touchscreen display device configured to display at least one GUI or GUI icon representing a primary flight control.

In some embodiments, the at least one touchscreen display device may include a secondary control touchscreen display device configured to display at least one GUI or GUI icon representing a secondary aircraft control.

In some embodiments, the at least one touchscreen display device may include a side console touchscreen display device configured to display at least one GUI or GUI icon representing a side console aircraft control.

In some embodiments, the mechanical component including a button, knob, switch, or lever installed in the cockpit of the aircraft.

In some embodiments, the at least one cockpit section may include at least one of a main chassis, an upper chassis, a center console, an overhead chassis, or a side console.

Various embodiments or examples ("examples") of the inventionare disclosed in the following detailed description and the accompanying drawings. In the drawings:.

Before explaining one or more embodiments of the invention in detail, it is to be understood the embodiments are not limited in their application to the details of construction and the arrangement of the components or steps or methodologies set forth in the following description or illustrated in the drawings.

<FIG> generally illustrate advanced haptics in touchscreen avionics lower level device simulators, in accordance with one or more embodiments of the disclosure.

Companies may use simulators to assist a user to train in the operation of commercial or military transportation vehicles such as aircraft. The simulators may be classified as providing different levels of simulation. For example, a full-flight or high-level simulator may include entire cockpit assemblies including, but not limited to, panels including toggles (e.g., buttons, knobs, switches, levers, or the like), seats, and other components installed within a cockpit.

Where cost and/or space is an issue, the simulators may be lower level devices (LLD) configured to provide only basic training such as familiarization training or procedure training. For example, the LLD may include, but are not limited to, part-cockpit or part-task trainers. By way of another example, the LLD may include, but are not limited to, a desktop computer build.

For purposes of saving cost and/or space, the LLD may not include dedicated panels and/or mechanical components corresponding to actual components of a cockpit that are within a full-flight or high-level simulator. Instead, the LLD may include off-the-shelf touchscreen display devices. In addition, the LLD may include components of the desktop computer build including, but not limited to, monitors, a keyboard, and/or a mouse. Neither the off-the-shelf touchscreen display device or the components of the desktop computer build, however, may provide the tactile feedback that comes with training with the dedicated panels and/or mechanical components corresponding to actual components of a cockpit that are within a full-flight or high-level simulator.

It is noted herein the tactile feedback may allow a user to understand they have successfully interacted with the simulator. This may be especially important in simulations directed to select stages of flight or environments. For example, simulations of select stages of flight may allow a user the time to visually confirm a selection having been made on the touchscreen display device following the interaction with the touchscreen display device by the user. However, other simulations of more time-constrained scenarios (e.g., during a maneuver, during an emergency, or other stages of flight) may not provide the user with adequate time to visually confirm the selection, instead having to rely on touch.

It is noted that select touchscreen display devices may include basic haptic feedback. Although these select touchscreen display devices may be configured for haptic feedback, ambient and/or environment vibration may give an incorrect indication about whether a user has successfully interacted with the touchscreen display device.

As such, it would be beneficial to provide advanced haptics in touchscreen avionics lower level device simulators. The advanced haptics should mimic a physical response observed following an operation of the mechanical components in full-flight or high-level simulators which, in turn, may mimic a physical response observed following an operation of the mechanical components of installed in a cockpit of the aircraft.

<FIG> in general illustrate an avionics lower level device (LLD) simulator <NUM>, in accordance with one or more embodiments of the disclosure.

The LLD simulator <NUM> may be configured in accordance with guidelines and/or standards put forth by, but not limited to, the Federal Aviation Administration (FAA), the European Aviation Safety Agency (EASA) or any other flight certification agency or organization; the American National Standards Institute (ANSI), Aeronautical Radio, Incorporated (ARINC), or any other standards setting organization or company; the Radio Technical Commission for Aeronautics (RTCA) or any other guidelines agency or organization; or the like. For example, the LLD simulator <NUM> may be designed in accordance with guidelines and/or standards put forth in ARINC <NUM>, GUIDANCE FOR DESIGN AND INTEGRATION OF AIRCRAFT AVIONICS EQUIPMENT IN SIMULATORS, as last published February <NUM>, <NUM>.

The LLD simulator <NUM> may include a main chassis or body <NUM>. For example, the main chassis or body <NUM> may represent a flight deck of a cockpit. The LLD simulator <NUM> may include or be coupled to one or more instrument panel touchscreen display devices <NUM> coupled to the main chassis or body <NUM>.

The LLD simulator <NUM> may include an upper chassis or body <NUM>. The LLD simulator <NUM> may include or be coupled to one or more windshield or other line-of-sight touchscreen display devices <NUM> coupled to the upper chassis or body <NUM>. For example, the one or more windshield or other line-of-sight touchscreen display devices <NUM> may be configured to display actual or emulated environmental conditions.

The LLD simulator <NUM> may include a center console <NUM>. For example, the center console <NUM> may represent a pedestal of the cockpit. The LLD simulator <NUM> may include or be coupled to one or more primary flight control touchscreen display devices <NUM> coupled to the center console <NUM>. For example, the one or more primary flight control touchscreen display devices <NUM> may include primary flight controls directly involved in flying an aircraft.

The LLD simulator <NUM> may include an overhead chassis or body <NUM>. The LLD simulator <NUM> may include or be coupled to one or more secondary control touchscreen display devices <NUM>. For example, the one or more secondary control touchscreen display devices <NUM> may include secondary aircraft controls not directly involved in flying an aircraft.

The LLD simulator <NUM> may include one or more side consoles <NUM>. The LLD simulator <NUM> may include or be coupled to one or more side console touchscreen display devices <NUM>. For example, the one or more side console touchscreen display devices <NUM> may include controls for communication instruments, documentation, or the like.

It is noted herein the main chassis or body <NUM>, the upper chassis or body <NUM>, the center console <NUM>, the overhead chassis or body <NUM>, and/or the one or more side consoles <NUM> may be considered cockpit sections emulated by or within a select arrangement or build of the LLD simulator <NUM>, for purposes of the present disclosure.

Although embodiments of the disclosure illustrate separate cockpit sections <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, it is noted herein one or more of the cockpit sections <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be combined or integrated into a single component. Therefore, the above description should not be interpreted as a limitation on the disclosure but merely an illustration.

Although embodiments of the disclosure illustrate select touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> coupled to corresponding cockpit sections <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, it is noted herein the disclosure is not limited to the particular arrangement. For example, the select touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> coupled to different or multiples of the different cockpit sections <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. By way of another example, the LLD simulator <NUM> may be limited in the number of select touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> coupled to corresponding cockpit sections <NUM>, <NUM>, <NUM>, <NUM>, <NUM> (e.g., where the LLD simulator <NUM> is a table-top simulator such as a desktop computer build). Therefore, the above description should not be interpreted as a limitation on the disclosure but merely an illustration.

Although not illustrated, the LLD simulator <NUM> may include components (e.g., physical or imaged components) for a joystick, yoke, seat, headset, helmet, rudder pedals / brake pedals, footrests, or the like.

It is noted herein the LLD simulator <NUM> may be dimensioned for floor or platform installation or usage (e.g., as illustrated in <FIG>), such that the LLD simulator <NUM> may emulate a cockpit of an aircraft. In addition, is noted herein the LLD simulator <NUM> may be dimensioned for table-top installation or usage (e.g., as illustrated in <FIG> and <FIG>).

<FIG> in general illustrate cross-sectional diagrams of a portion of a touchscreen display device <NUM> of the LLD simulator <NUM>. The examples shown in <FIG> are not within the scope of the invention as claimed and are included for background only. The example of <FIG> is an embodiment of the invention as defined by the claims.

The touchscreen display device <NUM> may include, but is not limited to, a capacitive touchscreen display device such as, but not limited to, a Projected Capacitive Touch (PCT) touchscreen display device (e.g., a mutual capacitance PCT touchscreen display device, a self-capacitance PCT touchscreen display device, or the like). The touchscreen display device <NUM> may include, but is not limited to, a resistive touchscreen display device. The touchscreen display device <NUM> may include, but is not limited to, a beam interrupt touchscreen display device (e.g., such as an infrared grid touchscreen device). The touchscreen display device <NUM> may include, but is not limited to, an optical touchscreen display device. The touchscreen display device <NUM> may include, but is not limited to, a touchscreen display device configured to detect piezoelectricity in glass due to a touch.

The touchscreen display device <NUM> may include a display stack assembly <NUM>. The display stack assembly <NUM> may include may include one or more touchscreen sensors <NUM>. The one or more touchscreen sensors <NUM> may be configured to sense a touch or near touch (such as a finger or apparatus (e.g., a stylus or glove) in proximity to a user-interfaceable surface of the touchscreen display device <NUM>) of the touchscreen display device <NUM>. For example, where the touchscreen display device <NUM> is a capacitive touchscreen display device, the one or more touchscreen sensors <NUM> may include a transparent conductor layer (such as indium tin oxide (ITO)) deposited on an insulator substrate (such as glass), which results in a measurable change in capacitance when the surface of the one or more touchscreen sensors <NUM> is touched or nearly touched. By way of another example, where the touchscreen display device <NUM> is a beam interrupt touchscreen display device, the one or more touchscreen sensors <NUM> may include an array (e.g., an X-Y grid) of pairs of beam emitters (e.g., light emitting diodes (LEDs)) and sensors (e.g., photodetectors) configured to detect a disruption of a beam or beam pattern during the occurrence of a touch or near touch of the touchscreen display device <NUM>. The one or more touchscreen sensors <NUM> may be configured to output data (e.g., touch location information as signals or a change in electrical properties) to a controller, a processor, or other computing device as described throughout the disclosure.

The display stack assembly <NUM> may include an adhesive layer <NUM>. The display stack assembly <NUM> may include a display <NUM>. The adhesive layer <NUM> may include a transparent adhesive positioned between the display <NUM> and the one or more touchscreen sensors <NUM>. The adhesive layer <NUM> may bond the display <NUM> to a substrate of the one or more touchscreen sensors <NUM>. In some embodiments, the adhesive layer <NUM> may be omitted. In some embodiments, another adhesive layer may bond a bottom surface of the display <NUM> to a rigid or substantially rigid substrate below the display <NUM>.

The display <NUM> may be implemented as display element configured to impart an image for presentation to user. For example, the display <NUM> is implemented as a transmissive display element, an emissive display element, as well as other types of display elements. For instance, the display <NUM> may be transmissive display element implemented as a liquid crystal display (LCD) element. In addition, the display <NUM> may be implemented as an organic light-emitting diode (OLED) display element, such as active-matrix OLEDs (AMOLEDs), passive-matrix OLEDs (PMOLEDs), light-emitting electrochemical cells (LECs), or the like. Further, the display <NUM> may be implemented as an in-cell or on-cell LCD display element such that the LCD display element and the touchscreen sensor <NUM> are implemented in a single layer.

It is noted herein the display stack assembly <NUM> may include a rigid or substantially rigid substrate.

The touchscreen display device <NUM> may include a display bezel <NUM> The display stack assembly <NUM> may be positioned proximate to the display bezel <NUM>. For example, the display bezel <NUM> may fully or partially surround an edge of the display stack assembly <NUM>. For instance, the display bezel <NUM> may be positioned on top of the display stack assembly <NUM>. In addition, the display bezel <NUM> may at least partially enclose (e.g., cover a portion of a side) of the display stack assembly <NUM>.

The touchscreen display device <NUM> may include one or more force sensors <NUM> positioned proximate to the display stack assembly <NUM>. The one or more force sensors <NUM> may be configured to detect an amount of force (e.g., compressive force) acting on (e.g., applied by a user when the user is touching a user-interfaceable surface of the touchscreen display device <NUM>) on the force sensor <NUM>. For example, the one or more force sensors <NUM> may be implemented as conductive polymer force sensors, piezoelectric force sensors, other suitable force sensors, or a combination of the above.

The one or more force sensors <NUM> may be configured to output data (e.g., touch force information as signals or a change in electrical properties) to a controller, a processor, or other computing device as described throughout the disclosure. The one or more force sensors <NUM> may be opaque, may be transparent, or may be a combination of opaque force sensors and transparent force sensors.

The one or more force sensors <NUM> may be positioned below the display <NUM> and along the edges of the display <NUM>. It is noted herein, however, that the one or more force sensors <NUM> may be implemented in any of various suitable locations and/or configurations. For example, the one or more force sensors <NUM> may be positioned below, above, or within the display stack assembly <NUM>. By way of another example, a single force sensor <NUM> may be implemented as a ring (e.g., rectangular ring) located below or above the display <NUM> and in proximity to the edges of the display <NUM>. By way of another example, the one or more force sensors <NUM> may be implemented as strips, where each strip is located along an edge of the display <NUM>. By way of another example, the one or more force sensors <NUM> may be arranged in an array (e.g., rows, columns, a grid of rows and columns, arranged in a pattern of concentric circles, or the like) of transparent force sensors arranged across (e.g., in a plane above, below, or within the display stack assembly <NUM>) the display <NUM> (e.g. a transmissive display). Therefore, the above description should not be interpreted as a limitation on the disclosure but merely an illustration.

The touchscreen display device <NUM> may include a support structure <NUM>. The display stack assembly <NUM> may be positioned proximate to the support structure <NUM>. For example, the support structure <NUM> may include, but is not limited to, a support frame, such as a display stack support frame.

The touchscreen display device <NUM> may include a support plate <NUM> positioned proximate to the support structure <NUM>. The display stack assembly <NUM> may be positioned proximate to the support plate <NUM>.

The touchscreen display device <NUM> may include a backlight <NUM>. The display stack assembly <NUM> may be positioned proximate to the backlight <NUM>.

The touchscreen display device <NUM> may include one or more advanced haptic feedback components <NUM> positioned proximate to the display stack assembly <NUM>. For example, the one or more advanced haptic feedback components <NUM> may include, but are not limited to, components fabricated from piezoelectric technologies and/or components with piezoelectric functions or operations.

The touchscreen display device <NUM> may include one or more other components such as, but not limited to, a cover transparent substrate, light control films, polarizing films, a gap, a diffuser, a housing, communicative coupling elements (e.g., wires, cables, connectors, etc.), connectivity ports, a power supply, a processor, a circuit board (e.g., printed circuit board (PCB)), a controller, memory, storage, an antenna, or the like. Some or all of the components of the touchscreen display device <NUM> may be communicatively coupled.

In the arrangement of <FIG>, for background only, the display stack assembly <NUM> may be positioned between a display bezel <NUM> and one or more force sensors <NUM>. The display bezel <NUM> may be positioned above the display stack assembly <NUM>. The display stack assembly <NUM> may be positioned between the display bezel <NUM>, on the top side, and the one or more force sensors <NUM> and the backlight <NUM>, on the bottom side. The one or more force sensors <NUM> may be positioned between the display stack assembly <NUM> and the support structure <NUM>, and the one or more force sensors <NUM> are positioned under the edges of the display stack assembly <NUM>. The backlight <NUM> may be positioned under the display stack assembly <NUM> and between the support structure <NUM>.

In the arrangement of <FIG>, for background only, the display bezel <NUM> may be positioned above one or more force sensors <NUM> and the display stack assembly <NUM>. The one or more force sensors <NUM> may be positioned between the display bezel <NUM> and the display stack assembly <NUM> along the edges of the display stack assembly <NUM>. The display stack assembly <NUM> may be positioned between the display bezel <NUM> and one or more force sensors <NUM>, on the top side, and one or more additional force sensors <NUM> and the backlight <NUM>, on the bottom side. The one or more additional force sensors <NUM> may be positioned between the display stack assembly <NUM> and the support structure <NUM>, and the one or more additional force sensors <NUM> may be positioned under the edges of the display stack assembly <NUM>. The backlight <NUM> may be positioned under the display stack assembly <NUM> and between the support structure <NUM>.

In the arrangement of <FIG>, for background only, the touchscreen sensor <NUM> may be implemented in the display <NUM> within the display stack assembly <NUM>. For example, no adhesive layer <NUM> may be required where the touchscreen sensor <NUM> is implemented in the display <NUM>. The display stack assembly <NUM> may be positioned between a display bezel <NUM> and one or more force sensors <NUM>. The display bezel <NUM> may be positioned above the display stack assembly <NUM>. The display stack assembly <NUM> may be positioned between the display bezel <NUM>, on the top side, and the one or more force sensors <NUM> and the backlight <NUM>, on the bottom side. The one or more force sensors <NUM> may be positioned between the display stack assembly <NUM> and the support structure <NUM>, and the one or more force sensors <NUM> are positioned under the edges of the display stack assembly <NUM>. The backlight <NUM> may be positioned under the display stack assembly <NUM> and between the support structure <NUM>.

In the arrangement of <FIG>, for background only, the display bezel <NUM> may be positioned above the display stack assembly <NUM>. The display stack assembly <NUM> may be positioned between the display bezel <NUM>, on the top side, the one or more force sensors <NUM>, and the one or more advanced haptic feedback components <NUM> on the bottom side. The one or more force sensors <NUM> may be positioned between the display stack assembly <NUM> and the support structure <NUM>, and the one or more force sensors <NUM> are positioned under the edges of the display stack assembly <NUM>. The one or more advanced haptic feedback components <NUM> may be positioned between the display stack assembly <NUM> and the support plate <NUM>, and the one or more advanced haptic feedback components <NUM> may be generally positioned under the viewable portion of the display <NUM>. The support plate <NUM> may be positioned under the one or more advanced haptic feedback components <NUM> and between the support structure <NUM>. The backlight <NUM> may be positioned under the display stack assembly <NUM> and between the support structure <NUM>.

In the arrangement of <FIG>, for background only, the display bezel <NUM> may be positioned above the one or more force sensors <NUM> and the display stack assembly <NUM>. The one or more force sensors <NUM> may be positioned between the display bezel <NUM> and the display stack assembly <NUM> along the edges of the display stack assembly <NUM>. The display stack assembly <NUM> may be positioned between the display bezel <NUM> and the one or more force sensors <NUM>, on the top side, the one or more additional force sensors <NUM>, and the one or more advanced haptic feedback components <NUM> on the bottom side. The one or more additional force sensors <NUM> may be positioned between the display stack assembly <NUM> and the support structure <NUM>, and the one or more additional force sensors <NUM> may be positioned under the edges of the display stack assembly <NUM>. The one or more advanced haptic feedback components <NUM> may be positioned between the display stack assembly <NUM> and the support plate <NUM>, and the one or more advanced haptic feedback components <NUM> may be generally positioned under the viewable portion of the display <NUM>. The support plate <NUM> may be positioned under the one or more advanced haptic feedback components <NUM> and between the support structure <NUM>. The backlight <NUM> may be positioned under the display stack assembly <NUM> and between the support structure <NUM>.

As illustrated in <FIG>, the display bezel <NUM> may be positioned above the one or more force sensors <NUM>, the one or more advanced haptic feedback components <NUM>, and the display stack assembly <NUM>. The one or more force sensors <NUM> and the one or more advanced haptic feedback components <NUM> may be positioned between the display bezel <NUM> and the display stack assembly <NUM> along the edges of the display stack assembly <NUM>. The display stack assembly <NUM> may be positioned between the display bezel <NUM>, the one or more force sensors <NUM>, and the one or more advanced haptic feedback components <NUM>, on the top side, the one or more additional force sensors <NUM>, and one or more additional advanced haptic feedback components <NUM> on the bottom side. The one or more additional force sensors <NUM> may be positioned between the display stack assembly <NUM> and the support structure <NUM>, and the one or more additional force sensors <NUM> may be positioned under the edges of the display stack assembly <NUM>. The one or more advanced haptic feedback components <NUM> may be positioned between the display stack assembly <NUM> and the support plate <NUM>, and the one or more advanced haptic feedback components <NUM> may be generally positioned under the viewable portion of the display <NUM>. The support plate <NUM> may be positioned under the one or more advanced haptic feedback components <NUM> and between the support structure <NUM>. The backlight <NUM> may be positioned under the display stack assembly <NUM> and between the support structure <NUM>. It is noted herein, however, that the backlight <NUM> may not be included in the embodiment illustrated in <FIG>. While <FIG> depicts one embodiment having an exemplary arrangement of components of the touchscreen display device <NUM>, other embodiments may include any suitable arrangements of the same or other components.

<FIG> illustrates the avionics LLD simulator <NUM>, in accordance with one or more embodiments of the disclosure. <FIG> in general illustrate methods or processes for generating advanced haptics in touchscreen avionics lower level device simulators, in accordance with one or more embodiments of the disclosure.

It is noted herein the embodiments illustrated in <FIG> with respect to the touchscreen display device <NUM> should be understood to be applicable to the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> illustrated in <FIG>. For example, it should be understood the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> as illustrated in <FIG> may include one or more of the display stack assembly <NUM> with the one or more touchscreen sensors <NUM>, the adhesive layer <NUM>, and/or the display <NUM>, the display bezel <NUM>, the one or more force sensors <NUM>, the one or more support structures <NUM>, the support plate <NUM>, the backlight <NUM>, and/or the one or more advanced haptic feedback components <NUM>.

In general, the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be configured to display one or more graphical user interfaces (GUIs) and/or GUI icons related to an operation of one or more internal components or external components on an aircraft. For example, the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be generally configured to display electronic maps, aircraft performance parameters, aircraft performance parameter predictions, sensor readings, aircraft data, flight data, communications, alerts, and the like.

In general, the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may include, but are not limited to, one or more primary flight display devices and/or one or more multi-function display devices that are viewable by a user. It is noted herein, however, that the LLD simulator <NUM> may include any number of touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> (e.g., one, two, three, or more touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) including one or more primary flight display devices, secondary flight display devices, and/or multi-function display devices.

The one or more instrument panel touchscreen display devices <NUM> may be configured to display one or more GUIs and/or GUI icons related to or representing one or more aircraft instruments <NUM>. For example, the one or more aircraft instruments <NUM> may include, but are not limited to, a primary flight display, a secondary flight display, a multi-function flight display, an airspace indicator, an altitude indicator, an artificial horizon indicator, a direction finder (e.g., directional gyroscope), a turn and/or tilt indicator, a vertical velocity indicator, a bank of navigation controls, a systems information display, marker beacons, an automatic direction finder (ADF), a distance measurement equipment (DME), a transponder, a radar display, a Global Positioning System (GPS), or the like.

The one or more windshield or other line-of-sight touchscreen display devices <NUM> may be configured to display one or more GUIs and/or GUI icons related to or representing actual or emulated environmental conditions <NUM>. For example, the one or more environmental conditions <NUM> may include, but are not limited to, a runway, a hanger, an obstacle, sky, water, land, or the like.

The one or more center console touchscreen display devices <NUM> may be configured to display one or more GUIs and/or GUI icons related to or representing one or more primary aircraft controls <NUM>. For example, the one or more primary aircraft controls <NUM> may include, but are not limited to, engine and navigation controls <NUM> coupled to the center console <NUM>. For instance, the primary aircraft controls <NUM> may include, but are not limited to, throttle levers, user input devices (e.g., keyboards, or the like) for various navigational systems displayed on the one or more instrument panels touchscreen display devices <NUM> and/or various communication systems displayed on the one or more side console touchscreen display devices <NUM>, or the like.

The one or more secondary control touchscreen display devices <NUM> may be configured to display one or more GUIs and/or GUI icons related to or representing one or more secondary aircraft controls <NUM>. For example, the one or more secondary aircraft controls <NUM> may include, but are not limited to, anti-ice controls, air conditioning controls, cabin pressurization controls, oxygen controls, or the like.

The one or more side console touchscreen display devices <NUM> may be configured to display one or more GUIs and/or GUI icons related to or representing one or more side console aircraft controls or documentation <NUM>. For example, the one or more side console aircraft controls <NUM> may include, but not limited to, communication instrument controls, documentation, or the like.

The LLD simulator <NUM> may be configured to generate one or more advanced haptic feedback responses via the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> coupled to corresponding cockpit sections <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. For example, the one or more feedback responses may include one or more advanced haptic feedback responses (e.g., an advanced tactile response and/or an advanced kinesthetic response). By way of another example, the one or more feedback responses may include one or more visual feedback responses (e.g., one or more lights). By way of another example, the one or more feedback responses may include one or more auditory feedback responses (e.g., one or more sounds). By way of another example, the one or more feedback responses may include one or more graphical feedback responses (e.g., one or more displayed icons). It is noted herein the LLD simulator <NUM> may be configured to generate one or more feedback response of multiple types (e.g., advanced haptic feedback responses and visual feedback responses, or any other combination).

In an example embodiment, interaction with the one or more GUIs and/or GUI icons related to the controls <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be configured to provide a user with one or more advanced haptic responses. The one or more advanced haptic responses may be feedback beyond a simple vibration. The one or more advanced haptic responses may be specific to and/or otherwise dependent on the input received via the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> following an interaction of the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> by a user, such that different inputs received may result in different advanced haptic responses. For example, the advanced haptic responses may be defined by one or more metrics including, but not limited to, a pattern, a relief or texture, a wavelength, a rate of flash, a duration, intensity, elasticity, or other metric that defines an operation of a mechanical component. For instance, the one or more metrics may be constant or variable. In addition, the one or more metrics may be pre-set (e.g., stored within program instructions of one or more controllers installed in or coupled to the one or more LLD simulator <NUM>) or may be adjustable. In this regard, the one or more advanced haptic responses may be a more efficient indication of successful interaction with the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> by the user (e.g., than may be possible via a binary on/off pairing for any type of relayed information such as a call-and-response vibration).

For example, the advanced haptic responses may provide an advanced mimicry of a button resistance (e.g., as might be generated by a membrane or spring) when transitioning to a depressed state, and a return of the button to an original state upon release.

By way of another example, the advanced haptic responses may provide an advanced mimicry of a toggle switch snap, which may represent a resistance of a toggle switch between a first state and an intermediate transition point and a reduced resistance of the toggle switch between the intermediate transition point and a second state.

By way of another example, the advanced haptic responses may provide an advanced mimicry of a knob click, which may represent a resistance of a knob between a first state between a first state and an intermediate transition point and a reduced resistance of the knob between the intermediate transition point and a second state.

It is noted herein the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> with the advanced haptic feedback components <NUM> may be configured for multi-touch. Where multi-touch is enabled, the advanced haptic responses may be local (e.g., at the location of the controls <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) such that each advanced haptic response may be separate and distinct from other advanced haptic responses with respect to the one or more above-defined metrics. In addition or in the alternative, the advanced haptic responses may be partially or fully global across the entire respective touchscreen display device <NUM>, <NUM>, <NUM>, <NUM>, <NUM> such that the advanced haptic responses may be similar with respect to the one or more above-defined metrics.

In this regard, the advanced haptic responses may provide a user using the LLD simulator <NUM> with a more advanced haptic response to their interactions with the one or more GUIs and/or GUI icons related to the controls <NUM>, <NUM>, <NUM>, <NUM>, <NUM> on the touchscreen display device <NUM>, <NUM>, <NUM>, <NUM>, <NUM> of the LLD simulator <NUM> during one or more training procedures beyond a simple vibration. The advanced haptic responses may allow for the LLD simulator <NUM> to be constructed with the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> instead of mechanical components while still providing an advanced haptic feedback similar to that provided by mechanical components, leading a reduced cost and/or size of footprint of the LLD simulator <NUM> as compared to a full-flight or high-level simulator.

Interacting with the displayed GUIs and/or GUI icons related to the controls <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may cause changes in the displayed GUIs and/or GUI icons on the respective touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. For example, interacting with the one or more instruments <NUM> displayed on the one or more instrument panel touchscreen display devices <NUM> may cause a change in what is being displayed for the one or more instruments <NUM> on the one or more instrument panel touchscreen display devices <NUM>.

Interacting with the displayed GUIs and/or GUI icons related to the controls <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may cause changes in the displayed GUIs and/or GUI icons on different touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. For example, interacting with a primary aircraft control <NUM> (e.g., a keyboard, or the like) displayed on the one or more center console touchscreen display devices <NUM> may cause a change in what is being displayed for the one or more instruments <NUM> on the one or more instrument panel touchscreen display devices <NUM>.

<FIG> illustrates a method or process <NUM> for generating advanced haptics in touchscreen avionics lower level device simulators, in accordance with one or more embodiments of the disclosure.

In a step <NUM>, a user input may be received from a touchscreen display device. The user input may be received from the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> installed on an LLD simulator <NUM>. For example, the user input may be with respect to the controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> displayed on the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM>, where the controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> are related to a simulated function or operation of an aircraft.

In a step <NUM>, an advanced haptic response signal may be generated. The advanced haptic response signal may be configured to cause an advanced haptic feedback mimicking a physical response observed following an operation of mechanical components installed within a cockpit of an aircraft, the mechanical components being related to the controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> displayed on the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM>. For instance, the advanced haptic response signal may generate an advanced haptic response defined by one or more metrics of a physical response observed following an operation of mechanical components.

In a step <NUM>, the advanced haptic response signal may be transmitted to one or more advanced haptic feedback components. The one or more advanced haptic feedback components <NUM> may be installed in the same touchscreen display device <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> on which the interacted-with controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> are displayed. The one or more advanced haptic feedback components <NUM> may be installed in different touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> from the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> on which the interacted-with controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> are displayed.

In a step <NUM>, a user input may be transmitted. The user input may be transmitted to one or more controllers installed in an LLD simulator <NUM>, either directly or within one or more touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> installed on the LLD simulator <NUM>.

In a step <NUM>, an advanced haptic response signal may be received. The advanced haptic response signal may be configured to cause an advanced haptic feedback mimicking the operation of mechanical components related to the controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> displayed on the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM>. For instance, the advanced haptic response signal may generate an advanced haptic response defined by one or more metrics that mimic an operation of a mechanical component within the one or more advanced haptic feedback components <NUM>.

In a step <NUM>, advanced haptic feedback may be generated based on the advanced haptic response signal. The one or more advanced haptic feedback components <NUM> may be installed in the same touchscreen display device <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> on which the interacted-with controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> are displayed. The one or more advanced haptic feedback components <NUM> may be installed in different touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> from the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> on which the interacted-with controls <NUM>, <NUM>, <NUM>, <NUM>, and/or <NUM> are displayed.

It is noted herein the methods or processes <NUM> or <NUM> are not limited to the steps and/or sub-steps provided. The methods or processes <NUM> or <NUM> may include more or fewer steps and/or sub-steps. The methods or processes <NUM> or <NUM> may perform the steps and/or sub-steps simultaneously. The methods or processes <NUM> or <NUM> may perform the steps and/or sub-steps sequentially, including in the order provided or an order other than provided. Therefore, the above description should not be interpreted as a limitation on the scope of the disclosure but merely an illustration.

Referring again to <FIG>, the LLD simulator <NUM> may include one or more controllers <NUM>. The one or more controllers <NUM> may include one or more processors <NUM> and memory <NUM>. The memory <NUM> may store one or more sets of program instructions. The one or more processors <NUM> may be configured to execute the one or more sets of program instructions to carry out one or more of the various steps described throughout the disclosure.

The one or more controllers <NUM> may include one or more communication interfaces. For example, the one or more communication interfaces may include via wired means or via wireless means (e.g., via Bluetooth, Wi-Fi, Near Field Communication (NFC), or the like), where the one or more communication interfaces may be configured to receive data, transmit data, transmit power, or otherwise interact with the other controllers in the LLD simulator <NUM>.

The LLD simulator <NUM> may include one or more touchscreen display device controllers <NUM>. The one or more touchscreen display device controllers <NUM> may include one or more processors and memory. The memory may store one or more sets of program instructions. The one or more processors may be configured to execute the one or more sets of program instructions to carry out one or more of the various steps described throughout the disclosure. The one or more controllers <NUM> may include one or more communication interfaces.

The one or more controllers <NUM> may be coupled (e.g., physically, electrically, and/or communicatively coupled) to the one or more touchscreen display device controllers <NUM>. The one or more controllers <NUM> may transmit power, control signals, data, or the like (e.g., one or more signals) to the one or more touchscreen display device controllers <NUM>. The one or more controllers <NUM> may receive power, control signals, data, or the like (e.g., the one or more signals) from the one or more components in the one or more touchscreen display device controllers <NUM>.

The one or more processors <NUM> may include any one or more processing elements known in the art. In this sense, the one or more processors <NUM> may include any microprocessor device configured to execute algorithms and/or program instructions. In general, the term "processor" may be broadly defined to encompass any device having one or more processing elements, which execute a set of program instructions from a non-transitory memory medium (e.g., the memory <NUM>), where the one or more sets of program instructions are configured to cause the one or more processors <NUM> to carry out any of one or more process steps.

The memory <NUM> may include any storage medium known in the art suitable for storing the one or more sets of program instructions executable by the associated one or more processors <NUM>. For example, the memory <NUM> may include a non-transitory memory medium. For instance, the memory <NUM> may include, but is not limited to, a read-only memory (ROM), a random access memory (RAM), a magnetic or optical memory device (e.g., disk), a magnetic tape, a solid state drive, and the like. The memory <NUM> may be configured to provide display information to the one or more touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM>. In addition, the memory <NUM> may be configured to store user input information from one or more user input devices. The memory <NUM> may be housed in a common controller housing with the one or more processors <NUM>. The memory <NUM> may, alternatively or in addition, be located remotely with respect to the spatial location of the processors <NUM>, the one or more controllers <NUM> and/or the one or more touchscreen display device controllers. For instance, the one or more processors <NUM>, the one or more controllers <NUM>, and/or the one or more touchscreen display device controllers may access a remote memory <NUM> (e.g., server), accessible through a network (e.g., internet, intranet, and the like) via one or more communication interfaces.

The one or more communication interfaces may be operatively configured to communicate with one or more components of the one or more controllers <NUM> and/or the one or more components of the one or more touchscreen display device controllers. For example, the one or more communication interfaces may also be coupled (e.g., physically, electrically, and/or communicatively) with the one or more processors <NUM> to facilitate data transfer between components of the one or more components of the one or more controllers <NUM> and/or the one or more components of the one or more touchscreen display device controllers and the one or more processors <NUM>. For instance, the one or more communication interfaces may be configured to retrieve data from the one or more processors <NUM>, or other devices, transmit data for storage in the memory <NUM>, retrieve data from storage in the memory <NUM>, or the like. By way of another example, the one or more touchscreen display device controllers and/or one or more offboard controllers may be configured to receive and/or acquire data or information from other systems or tools by a transmission medium that may include wireline and/or wireless portions. By way of another example, the one or more touchscreen display device controllers and/or the one or more offboard controllers may be configured to transmit data or information (e.g., the output of one or more procedures of the inventive concepts disclosed herein) to one or more systems or tools by a transmission medium that may include wireline and/or wireless portions (e.g., a transmitter, receiver, transceiver, physical connection interface, or any combination). In this regard, the transmission medium may serve as a data link between the one or more touchscreen display device controllers and/or the one or more offboard controllers and the other subsystems (e.g., of the aircraft <NUM>). In addition, the one or more touchscreen display device controllers and/or the one or more offboard controllers may be configured to send data to external systems via a transmission medium (e.g., network connection).

Although the disclosure is directed to the one or more controllers <NUM> and the one or more touchscreen display device controllers being separate, it is noted herein the one or more controllers <NUM> and the one or more touchscreen display device controllers may be the same and/or share select components. Therefore, the above description should not be interpreted as a limitation on the disclosure but merely an illustration.

Although the disclosure is directed to the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> including the one or more touchscreen display device controllers <NUM>, it is noted herein, however, that the one or more touchscreen display device controllers <NUM> may be not present, and that the one or more controllers <NUM> may have direct control over the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM> and/or components of the touchscreen display devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM>.

Claim 1:
An avionics lower level device, LLD, simulator, comprising:
at least one touchscreen display device (<NUM>), the at least one touchscreen display device comprising:
a display stack assembly (<NUM>) including at least one touchscreen sensor (<NUM>) and a display (<NUM>); and characterized by:
at least one advanced haptic feedback component (<NUM>) positioned proximate to the display stack assembly; and
at least one force sensor (<NUM>) positioned proximate to the at least one advanced haptic feedback component and being configured to sense a compressive force;
the at least one advanced haptic feedback component and the at least one force sensor positioned between a display bezel of the at least one touchscreen display device and the display stack assembly;
the at least one touchscreen display device configured to display at least one GUI or GUI icon, the at least one GUI or GUI icon related to an operation of an aircraft,
the at least one advanced haptic feedback component configured to provide at least one advanced haptic feedback response following an interaction with the at least one GUI or GUI icon displayed on the at least one touchscreen display device, the advanced haptic feedback response includes at least one of an advanced tactile response or an advanced kinesthetic response,
the at least one advanced haptic feedback response configured to mimic a physical response observed following an operation of a mechanical component installed within a cockpit of the aircraft.