Patent Description:
Various embodiments of the disclosure relate to control of a media display device based on eye gaze of a user. More specifically, various embodiments of the disclosure relate to an apparatus and a method for control of the media display device based on the eye gaze on an electronic device coupled to the media display device.

Recent advancements in the field of media content reproduction have led to development of various techniques to control media display devices (for example, televisions). Generally, a remote control may be utilized by a user to control functionalities of the media display devices, such as, to switch channels on the media display device, to control volume of the media display device, and so forth. In certain situations, the media display device may be accessed by a user with a physical disability such as a neurodevelopmental disorder, for example, a motor disorder. The user may experience difficulty in controlling the functionalities of the media display device, for example, via the remote control. Thus, the user may require assistance to control the media display device.

Further limitations and disadvantages of conventional and traditional approaches will become apparent to one of skill in the art, through comparison of described systems with some aspects of the present disclosure, as set forth in the remainder of the present application and with reference to the drawings. Prior art is disclosed in <CIT>, <CIT>, <CIT> and <CIT>.

An electronic device, a non-transitory computer-readable medium and a method of control of a media display device via an electronic device based on eye gaze, are defined by the independent claims. These and other embodiments are provided substantially as shown in, and/or described in connection with, at least one of the figures, as set forth more completely in the claims.

These and other features and advantages of the present disclosure may be appreciated from a review of the following detailed description of the present disclosure, along with the accompanying figures in which like reference numerals refer to like parts throughout.

The following described implementations may be found in the disclosed electronic device and method to control a media display device based on an eye gaze of a user as a user input. Exemplary aspects of the disclosure provide an electronic device (for example, an electronic tablet or a smart phone) accessible by a user (for example, a user with or without a physical disability). The electronic device may include a first display screen to display a plurality of user interface (UI) elements (for example, but not limited to, control icons such as a power control icon and volume control icons, navigation icons, or numeric icons). The electronic device may control a media display device (for example, a television) communicably coupled to the electronic device based on a selection of each of the plurality of UI elements by the user. The electronic device may be configured to control an image capturing device (for example, an in-built front camera of the electronic tablet) to capture a first image of the user of the electronic device. The first image of the user may include an image of at least a face of the first user. The electronic device may be configured to determine a position of an eye gaze of the user on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user. The first UI element may be, for example, the control icon such as a "volume increase icon", which when selected, may increase a volume of a media content currently rendered on the media display device communicably coupled to the electronic device. The electronic device may further be configured to select the first UI element of the plurality of UI elements based on the determination of the position of the eye gaze on the first UI element for a time interval. For example, the time interval may be a few seconds (such as equal to or more than three seconds). In an example, the selection of the first UI element of the plurality of UI elements may be based on the eye gaze at the first UI element for the time interval of three seconds.

The electronic device may further be configured to transmit a first control signal to the media display device, based on the selection of the first UI element of the plurality of UI elements. The first control signal may correspond to an activation of a functionality (such as a volume increase) that may be associated with the media display device upon selection of the first UI element of the plurality of UI elements. In an example, the first control signal may correspond to a short distance radio wave signal indicative of increase in the volume of the media content rendered on the media display device, upon the selection of the first UI element such as the "volume increase icon". The electronic device may further be configured to receive a feedback image from the media display device, based on the transmitted first control signal. The received feedback image may indicate the control of the media display device based on the transmitted first control signal. In accordance with an embodiment, the received feedback image may correspond to the currently rendered media content and a UI icon that indicates an increase in the volume of the rendered media content displayed on the media display device. The electronic device may be further configured to control the first display screen to display the received feedback image with the displayed plurality of UI elements.

In an exemplary implementation, the electronic device may be placed at a position where the user may gaze at the plurality of UI elements of the electronic device to control the media display device. The electronic device may allow the user to select different UI elements of the plurality of UI elements on the electronic device to control different functionalities associated with the media display device. The electronic device of the present disclosure may provide the user (for example, the user with or without a physical disability) with the capability to control the media display device based on the eye gaze as the user input. The electronic device therefore allows the user to control the media display device based on the eye gaze, and thus, allows the user to control the media display device without any assistance from another user.

Further, the electronic device may concurrently display the plurality of UI elements and the received feedback image that may include a portion of the media content. In some embodiments, the feedback image may also include the UI icon corresponding to the selected first UI element. The concurrent display of the feedback image and the plurality of UI elements on the electronic device may allow the user to focus the eye gaze on the selected first UI element while viewing the media content and/or the UI icon, thereby eliminating a need to switch the position of eye gaze between the electronic device and the media display device while controlling the media display device, via the electronic device. The disclosed electronic device thus allows the user (for example with physical disability) to control the media display device, while continuing to view the media content on the electronic device, by concurrent display of the feedback image (corresponding to currently rendered portion of the media content) and the plurality of UI elements on the electronic device.

Further, the disclosed electronic device may control the media display device using short distance radio wave signal or using a wireless local network, to thereby allow the user to control the media display device without any requirement of a connection of the electronic device to an external network (for example, the internet).

<FIG> is a block diagram that illustrates an exemplary network environment for control of a media display device based on eye gaze as a user input, in accordance with an embodiment of the disclosure. With reference to <FIG>, there is shown a network environment <NUM>. The network environment <NUM> may include an electronic device <NUM>. The electronic device <NUM> may include a first display screen <NUM> and an image capturing device <NUM>. The first display screen <NUM> may display a plurality of UI elements <NUM> and a feedback image <NUM>. The plurality of UI elements <NUM> may include a first UI element 106A, a second UI element 106B, and an Nth UI element 106N. The network environment <NUM> may further include a media display device <NUM>. The media display device <NUM> may include a second display screen <NUM>. The second display screen <NUM> may render a media content <NUM>. The network environment <NUM> may further include a user <NUM>, a server <NUM>, and a communication network <NUM>. The electronic device <NUM>, the media display device <NUM>, and the server <NUM> may be communicably coupled to each other, via the communication network <NUM>. In some scenarios, the user <NUM> may be for example, a user with a physical disability, such as a user with neurodevelopmental disorders (for example, a motor disorder), who may require a wheelchair for physical movement. In such a scenario, the electronic device <NUM> may be mounted on a hand-rest of the wheelchair and/or a piece of furniture in a field of view of the user <NUM> to control the media display device <NUM>, via the electronic device <NUM>.

The electronic device <NUM> may include suitable logic, circuitry, and interfaces that may be configured to control the media display device <NUM>. The electronic device <NUM> may be further configured to control the media display device <NUM> by utilization of the eye gaze of the user <NUM> as the user input. Examples of the electronic device <NUM> may include, but are not limited to, an electronic tablet, a smartphone, a computing device, a cellular phone, a mobile phone, a gaming device, a mainframe machine, a server, a computer work-station, and/or a consumer electronic (CE) device. It may be noted that a shape and an arrangement of the electronic device <NUM> as shown in <FIG> is presented merely as an example. The present disclosure may be also applicable to other shapes and arrangements of the electronic device <NUM>, without deviation from the scope of the disclosure.

The first display screen <NUM> may include suitable logic, circuitry, and interfaces that may be configured to display the plurality of UI elements <NUM> and the feedback image <NUM>. The first display screen <NUM> of the electronic device <NUM> may be configured to receive the user input in form of the eye gaze of the user <NUM>. Further, the first display screen <NUM> may be a touch screen which may enable the user <NUM> to provide the user input in the form of touch input via the first display screen <NUM>. The touch screen may be at least one of a resistive touch screen, a capacitive touch screen, or a thermal touch screen. The first display screen <NUM> may be realized through several known technologies such as, but not limited to, at least one of a Liquid Crystal Display (LCD) display, a Light Emitting Diode (LED) display, a plasma display, or an Organic LED (OLED) display technology, or other display devices. In accordance with an embodiment, the first display screen <NUM> may refer to a display screen of a head mounted device (HMD), a smart-glass device, a see-through display, a projection-based display, an electro-chromic display, or a transparent display.

The plurality of UI elements <NUM> may correspond to control icons (for example, user-selectable options) for the control of the media display device <NUM>. For example, each of the plurality of UI elements <NUM> may represent a user-selectable icon, such as control icons of a remote control which may be used to control the media display device <NUM> (such as a television). The plurality of UI elements <NUM> may be configured to allow the user <NUM> to control the different functionalities associated with the media display device <NUM> via selection of the plurality of UI elements <NUM> based on the eye gaze of the user <NUM>. Examples of the plurality of UI elements <NUM> may include, but are not limited to, the control icons corresponding to a power setting of the media display device <NUM>, a home screen setting on the media display device <NUM>, audio settings (such as volume control settings) of the media content rendered on the media display device <NUM>, video display settings (such as display characteristics adjustment, video mode selection) of the media content rendered on the media display device <NUM>, a network setting of the media display device <NUM>, a security setting of the media display device <NUM>, or an accessibility setting of the media display device <NUM>. In accordance with an embodiment, the home screen setting on the media display device <NUM> may correspond to a preference related to an arrangement of menus or icons on a home screen of the media display device <NUM>. Further, the security setting may include, but is not limited to, a user-privacy setting, parental control setting, and a user account setting of media display device <NUM>. In addition, the accessibility settings may include, but is not limited to, a voice guide setting, a voice-based scene description setting, a closed caption setting, video description setting, and a color inversion setting of the media display device <NUM>.

The image capturing device <NUM> may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to capture one or more images of the users, such as the user <NUM>. In accordance with an embodiment, the image capturing device <NUM> may capture the one or more images that may include at least a face of the user <NUM> to determine a position of the eye gaze of the user <NUM> on the first UI element of the plurality of UI elements <NUM>. Examples of the image capturing device <NUM> may include, but are not limited to, an image sensor, a wide-angle camera, a <NUM>-degree camera, an action camera, a closed-circuit television (CCTV) camera, a camcorder, a digital camera, camera phones, a time-of-flight camera (ToF camera), a night-vision camera, and/or other image capture devices. Although in <FIG>, the image capturing device <NUM> is shown integrated with the electronic device <NUM>, the disclosure is not so limited. In some embodiments, the image capturing device <NUM> may be separated from the electronic device <NUM>, without a deviation from the scope of the disclosure.

The media display device <NUM> may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to render the media content as per viewer's preferences (for example, preferences of the user <NUM>). In an example, the media display device <NUM> may be configured to communicate with the server <NUM> to receive the media content. In another example, the media display device <NUM> may be configured to receive broadcast content or streaming content as the media content. In accordance with an embodiment, the media display device <NUM> may be further configured to store the media content received from the server <NUM>. The media display device <NUM> may be further configured to receive the first control signal, via the electronic device <NUM> for the control of the media display device <NUM> based on the plurality of UI elements <NUM>, which are selected based on the eye gaze of the user <NUM> as the user input. Examples of the media display device <NUM> may include, but are not limited to, a television, a laptop, a personal computer, a mobile phone, a smart phone, a tablet computing device, a gaming console, a media player, a sound system with display capabilities, a home theatre system, a digital camera, an automotive electronic device, an electronic musical instrument, or other consumer electronic device with media rendering capability. It may be noted that a shape and an arrangement of the media display device <NUM> as shown in <FIG> is presented merely as an example. The present disclosure may be also applicable to other shapes and arrangements of the media display device <NUM>, without deviation from the scope of the disclosure.

The second display screen <NUM> may include suitable logic, circuitry, and interfaces that may be configured to display the media content. The second display screen <NUM> may be realized through several known technologies such as, but not limited to, at least one of an LCD display, an LED display, a plasma display, or an OLED display technology, or other display devices. In accordance with an embodiment, the second display screen <NUM> may refer to a display screen of a smart-glass device, a see-through display, a projection-based display, an electro-chromic display, or a transparent display. In accordance with an embodiment, the second display screen <NUM> may be a touch screen which may enable the user <NUM> to provide the user input in form of touch via the second display screen <NUM>. The touch screen may be at least one of a resistive touch screen, a capacitive touch screen, or a thermal touch screen.

The rendered media content <NUM> may correspond to a currently rendered content on the second display screen <NUM> of the media display device <NUM>. Examples of the media content <NUM> may include, but is not limited to, the home screen of the media display device <NUM>, a home screen of an application rendered on the media display device <NUM>, image content, video content (for example, a video recording, broadcast content, streaming content) rendered on the media display device <NUM>, a gaming application interface, or device settings interface of the media display device <NUM>.

The feedback image <NUM> of the electronic device <NUM> may correspond to a duplicate image of a portion of the currently rendered media content <NUM> on the media display device <NUM>. In some embodiments, the feedback image <NUM> may correspond to an image of a UI icon displayed on the second display screen <NUM> that may be indicative of the selection of any of the plurality of UI elements <NUM>. In one embodiment, the feedback image <NUM> may be a set of images (for example, a video stream) of the media content <NUM> received from the media display device <NUM>. In an exemplary scenario, the feedback image <NUM> may correspond to a movie being currently rendered on the second display screen <NUM> of the media display device <NUM> along with the UI icon that may indicate the increase in the volume of the rendered media content (for example, the movie) displayed on the media display device <NUM>.

The server <NUM> may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to communicate with the media display device <NUM> via the communication network <NUM>. The server <NUM> may be configured to store the media content for distribution to the media display device <NUM>. The server <NUM> may receive a content request from the media display device <NUM>, and may provide the stored media content to the media display device <NUM> based on the received content request. Examples of the server <NUM> may include, but are not limited to, an application server, a media content server, a cloud server, a mainframe server, a database server, a file server, a web server, or other types of servers.

The communication network <NUM> may include a wireless communication channel through which the media display device <NUM>, the electronic device <NUM> and the server <NUM> may communicate with each other, in a wireless manner. Examples of the communication network <NUM> may include, but are not limited to, short range communication technologies, such as a Wireless Fidelity (Wi-Fi) network, a near field communication (NFC) channel, or a Bluetooth® (BT) communication network. Various entities in the network environment <NUM>, such as the electronic device <NUM> may be configured to connect to the communication network <NUM>, in accordance with various wireless communication protocols. Examples of such wireless communication protocols may include, but are not limited to, at least one of wireless device-to-device communication protocols, or Bluetooth® communication protocols. In some embodiments, the communication network <NUM> may include a communication medium through which the media display device <NUM> and the server <NUM> may communicate with each other. Examples of wired and wireless communication protocols of the communication network <NUM> through which the media display device <NUM> and the server <NUM> may communicate may include, but are not limited to, at least one of a Transmission Control Protocol and Internet Protocol (TCP/IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), Zig Bee, EDGE, IEEE <NUM>, light fidelity (Li-Fi), <NUM>, IEEE <NUM>, IEEE <NUM>, multi-hop communication and wireless access point (AP).

In operation, the electronic device <NUM> may be configured to display a plurality of user interface (UI) elements to control different functionalities of the media display device <NUM>. The electronic device <NUM> may be configured to control the image capturing device <NUM> to capture the first image of the user <NUM> of the electronic device <NUM>. The first image may include at least the image of the face of the user <NUM> in order to track the eye gaze of the user <NUM>. In some embodiments, the electronic device <NUM> may be mounted on the wheelchair of the user (such as the user <NUM> with physical disability), and may control the image capturing device <NUM> to capture the first image of the user <NUM>. The electronic device <NUM> may be further configured to determine the position of the eye gaze of the user <NUM> on the first UI element 106A of the displayed plurality of UI elements <NUM>, based on the captured first image of the user <NUM>. The details of the determination of the position of the eye gaze of the user <NUM> on the first UI element 106A of the displayed plurality of UI elements <NUM> are further described, for example, in <FIG>. In accordance with an embodiment, each UI element of the plurality of UI elements <NUM> may be associated with a different functionality associated with the media display device <NUM>. The electronic device <NUM> may be further configured to select the first UI element 106A of the plurality of UI elements <NUM> based on the determination of the position of the eye gaze on the first UI element 106A for a time interval. The time interval may be preset, for example, in a range of a few seconds (such as <NUM> to <NUM> seconds), or may be set based on user input. In an exemplary embodiment, the selection of the first UI element 106A may be based on other eye gestures, for example, blinking of the eyes of the user <NUM>, or the eye gaze followed by the blinking. Thus, the electronic device <NUM> may determine the blinking of the eye of the user <NUM> at the determined position of the eye gaze on the first UI element 106A as the user input to select the first UI element 106A. In an example, the first UI element 106A may correspond to a "move up" navigation icon that may be used to navigate through different icons (for example, settings icon, applications icon, games icon) of the home screen of the media display device <NUM>.

The electronic device <NUM> may be further configured to transmit the first control signal to the media display device <NUM>, based on the selection of the first UI element 106A of the plurality of UI elements <NUM>. For example, the transmitted first control signal may enable navigation between UI icons. Details of the navigation between UI icons based on the selection of the first UI element 106A are provided, for example, at <FIG>. The electronic device <NUM> may be further configured to receive the feedback image <NUM> from the media display device <NUM>, based on the transmitted first control signal. In an exemplary embodiment, the feedback image <NUM> may be an image of the home screen of the media display device <NUM> that shows the selection of an UI icon of the home screen of the media display device <NUM>. The electronic device <NUM> may be further configured to control the first display screen <NUM> to display the received feedback image <NUM> with the displayed plurality of UI elements <NUM>. Therefore, the electronic device <NUM> may allow the user <NUM> to control the media display device <NUM> via the eye gaze as the user input provided to the electronic device <NUM>. The control of the media display device <NUM> via the eye gaze of the user <NUM> allows the user <NUM> to view and control different functionalities of the media display device <NUM> without the assistance from other users. The electronic device <NUM> may be further configured to control the first display screen <NUM> to display at least a portion of the media content <NUM>, being played on the media display device <NUM>, as part of the received feedback image <NUM>. Therefore, the electronic device <NUM> may allow the user <NUM> to control the media display device <NUM> while being able to continuously view the media content <NUM>. As a result, the user <NUM> does not miss a frame or a portion of the media content <NUM> played on the media display device <NUM> (such as a television), during the provision of the user input to control the media display device <NUM>. Thus, a seamless viewing experience may be achieved for the user <NUM>.

In accordance with an embodiment, the electronic device <NUM> may be configured to control a movement of a cursor on the plurality of UI elements <NUM> of the electronic device <NUM> corresponding to a change in the position of the eye gaze of the user <NUM> on the plurality of UI elements <NUM>. For example, the electronic device <NUM> may move the cursor to the first UI element 106A, upon determination of the position of the eye gaze of the user <NUM> on the first UI element 106A and further move the cursor to the second UI element 106B, upon determination of the position of the eye gaze of the user <NUM> on the second UI element 106B. In some embodiments, the electronic device <NUM> may be configured to highlight the first UI element 106A based on the selection of the first UI element 106A of the plurality of UI elements <NUM> by the user <NUM>. Details of the movement of the cursor and highlight of the first UI element 106A are further described, for example, in <FIG>.

In accordance with an embodiment, the feedback image <NUM> received from the media display device <NUM> may correspond to the UI icon to indicate the control of the media display device <NUM> based on the transmitted first control signal. Examples of the UI icon may include, but are not limited to, a "volume up" icon, a "volume down" icon, a "brightness control" icon, or a "mode selection" icon. Details of the receipt of the UI icon as the feedback image <NUM> are further described, for example, in <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>.

In accordance with an embodiment, the electronic device <NUM> may be further configured to control the first display screen <NUM> to display the plurality of UI elements <NUM> on a first portion of the first display screen <NUM>, and display the received feedback image <NUM> on a second portion of the first display screen <NUM>. The details of the display the plurality of UI elements <NUM> on the first portion and the received feedback image <NUM> on the second portion of the first display screen <NUM> are further described, for example, in <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>.

In accordance with an embodiment, the feedback image <NUM> received from the media display device <NUM> may correspond to the media content <NUM> displayed on the second display screen <NUM> of the media display device <NUM> based on the transmitted first control signal. The details of the receipt of the media content <NUM> (or a portion of the media content <NUM>) as the feedback image <NUM> are further described, for example, in <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>.

In accordance with an embodiment, the electronic device <NUM> may be further configured to control an overlay of the displayed plurality of UI elements <NUM> on the displayed feedback image <NUM> that may correspond to the media content <NUM> displayed on the second display screen <NUM> of the media display device <NUM>. Furthermore, the electronic device <NUM> may be configured to control an opacity level of the displayed plurality of UI elements <NUM> that are overlaid on the displayed feedback image <NUM>, such that the user <NUM> may easily view the rendered media content <NUM> during control of the media display device <NUM>, on the electronic device <NUM>. The details of the plurality of UI elements <NUM> that are overlaid on the displayed feedback image <NUM> and the control of the opacity level of the displayed plurality of UI elements <NUM> are further described, for example, in <FIG>.

In accordance with an embodiment, the electronic device <NUM> may be further configured to control the first display screen <NUM> to display information, related to the media content <NUM> displayed on the second display screen <NUM> of the media display device <NUM>, based on a selection of one or more UI elements of the plurality of UI elements <NUM>. For example, the display information may correspond to a short description of the media content <NUM> being rendered on the media display device <NUM>. The details of the control the first display screen <NUM> to display information related to the media content <NUM> are further described, for example, in <FIG>.

In accordance with an embodiment, the electronic device <NUM> may be further configured to render guidance information for the user <NUM>, to control one or more configuration settings of the media display device <NUM> through one or more UI elements of the plurality of UI elements <NUM> displayed on the first display screen <NUM>. In an exemplary embodiment, the guidance information for the user <NUM> may be, for example, information on the operation associated with one or more UI elements of the plurality of UI elements <NUM>. The details of the guidance information for the user <NUM> are further described, for example, in <FIG>.

In accordance with an embodiment, the electronic device <NUM> may be further configured to control the first display screen <NUM> to display a set of UI elements of the plurality of UI elements <NUM> on the first display screen <NUM>, based on the received feedback image <NUM>. In an example, the set of UI elements of the plurality of UI elements <NUM> may be associated with control settings of the media content <NUM> of the media display device <NUM>. The details of the display of the set of UI elements are further described, for example, in <FIG>.

<FIG> is a block diagram that illustrates an exemplary electronic device of <FIG>, in accordance with an embodiment of the disclosure. With reference to <FIG>, there is shown a block diagram <NUM> of the electronic device <NUM>. The electronic device <NUM> may include circuitry <NUM>, a memory <NUM>, and a network interface <NUM>. The electronic device <NUM> may further include the first display screen <NUM>. The first display screen <NUM> may display the plurality of UI elements <NUM>. The electronic device <NUM> may further include the image capturing device <NUM>. The detailed description of the first display screen <NUM>, the image capturing device <NUM>, and the communication network <NUM> has been made with reference to <FIG>, and has been omitted here for the sake of brevity.

The circuitry <NUM> may include suitable logic, circuitry, and/or interfaces, that may be configured to execute program instructions associated with different operations to be executed by the electronic device <NUM>. For example, some of the operations may include the determination of the position of the eye gaze of the user118 on the first UI element 106A, the selection of the first UI element 106A based on the determination of the position of the eye gaze of the user <NUM>, the transmission of the first control signal to the media display device112, the reception of a feedback image from the media display device <NUM>, and the control of the first display screen <NUM> to display the feedback image <NUM> with the plurality of UI elements <NUM>. The circuitry <NUM> may include one or more specialized processing units, which may be implemented as a separate processor. In an embodiment, the one or more specialized processing units may be implemented as an integrated processor or a cluster of processors that perform the functions of the one or more specialized processing units, collectively. The circuitry <NUM> may be implemented based on a number of processor technologies known in the art. Examples of implementations of the circuitry <NUM> may be an X86-based processor, a Graphics Processing Unit (GPU), a Reduced Instruction Set Computing (RISC) processor, an Application-Specific Integrated Circuit (ASIC) processor, a Complex Instruction Set Computing (CISC) processor, a microcontroller, a central processing unit (CPU), and/or other control circuits.

The memory <NUM> may include suitable logic, circuitry, interfaces, and/or code that may be configured to store the one or more instructions to be executed by the circuitry <NUM>. The memory <NUM> may be configured to store information corresponding to the functionalities associated with each of the UI element of the plurality of UI elements <NUM>. In some embodiments, the memory <NUM> may be configured to store the user input associated with the user <NUM>. Examples of implementation of the memory <NUM> may include, but are not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Hard Disk Drive (HDD), a Solid-State Drive (SSD), a CPU cache, and/or a Secure Digital (SD) card.

The network interface <NUM> may comprise suitable logic, circuitry, and/or interfaces that may be configured to facilitate communication between the media display device <NUM> and the electronic device <NUM> via the communication network <NUM>. The network interface <NUM> may be implemented by use of various known technologies to support wired or wireless communication of the electronic device <NUM> with the communication network <NUM>. The network interface <NUM> may include, but is not limited to, an antenna, a radio frequency (RF) transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a coder-decoder (CODEC) chipset, a subscriber identity module (SIM) card, or a local buffer circuitry.

A person of ordinary skill in the art will understand that the electronic device <NUM> in <FIG> may also include other suitable components or systems, in addition to the components or systems which are illustrated herein to describe and explain the function and operation of the present disclosure. A detailed description for the other components or systems of the electronic device <NUM> has been omitted from the disclosure for the sake of brevity. The operations of the circuitry <NUM> are further described, for example, in <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>.

<FIG> and <FIG> are diagrams which collectively illustrate exemplary scenarios for control of the media display device <NUM> of <FIG>, in accordance with an embodiment of the disclosure. <FIG> and <FIG> are explained in conjunction with elements from <FIG> and <FIG>. With reference to <FIG>, there is shown an exemplary scenario 300A that includes the electronic device <NUM> (for example, the electronic tablet or smartphone), the first display screen <NUM>, the plurality of UI elements <NUM>, the image capturing device <NUM> (for example, the in-built front camera), the media display device <NUM> (for example, the television), the second display screen <NUM>, and the user <NUM> of <FIG>. Furthermore, in the exemplary scenario 300A, there is further shown a first UI element <NUM> (such as a "volume up" UI element) among the plurality of UI elements <NUM> (for example, "volume control" UI elements, "power" UI element, "source" UI element, "playback control" UI elements, "navigation" UI elements, "home" UI element, "numeric" UI elements, "information" UI element, "return" UI element, and "exit" UI element). In the exemplary scenario 300A there is further shown a received feedback image <NUM>, a cursor <NUM>, a first portion <NUM> of the first display screen <NUM>, and a second portion <NUM> of the first display screen <NUM>. Furthermore, there is further shown a media content <NUM> and a "volume up" UI icon 302a on the second display screen <NUM> of the media display device <NUM>.

With respect to <FIG>, the media display device <NUM> may be configured to render the media content <NUM>, such as, a movie on the second display screen <NUM>. In an exemplary embodiment, the user <NUM> may need to increase a volume of the media content <NUM> rendered on the media display device <NUM>. In such a case, the user <NUM> may gaze towards the plurality of UI elements <NUM> of the electronic device <NUM> to select the first UI element <NUM> (such as the "volume up" UI element) to increase the volume of the media content <NUM> rendered on the media display device <NUM>. The circuitry <NUM> of the electronic device <NUM> may be configured to control the image capturing device <NUM> to capture a first image of the user <NUM>. The image capturing device <NUM> may capture the first image of the user <NUM> based on a field of view (FOV) of the image capturing device <NUM>. The FOV of the image capturing device <NUM> may be predefined such that the first image of the user <NUM> (or image of the face of the user <NUM>) may be captured accurately. The electronic device <NUM> may be positioned in such a manner that the image capturing device <NUM> may clearly capture the first image of the face of the user <NUM>. For example, the electronic device <NUM> may be mounted near the user <NUM> or may be present in a hand of the user <NUM>. In another example, the electronic device <NUM> may be mounted on the wheelchair (such as on a hand-rest or armrest of the wheelchair) of the user <NUM>. It may be noted that the mounting location or position of the electronic device <NUM> on which the image capturing device <NUM> is disposed, as shown in <FIG>, is presented merely as an example. The image capturing device <NUM> may be disposed on other positions, location or surfaces of the electronic device <NUM> without deviation from the scope of the disclosure, such that the FOV of the image capturing device <NUM> may capture the first image of the user <NUM> clearly. Other positions, locations, or surfaces of the electronic device <NUM> at which the image capturing device <NUM> may be disposed are omitted from the disclosure for the sake of brevity.

The circuitry <NUM> of the electronic device <NUM> may be further configured to extract an image portion from the captured first image of the face of the user <NUM>. The image portion may indicate eyes of the face of the user <NUM>. The circuitry <NUM> may extract the image portion (e.g. which may include sub-image or pixels for the eyes) from the captured first image based on different image processing techniques, known in the art. The circuitry <NUM> may be further configured to track the movement of the eyes of the user <NUM> based on the extracted image portion. In some embodiments, the circuitry <NUM> may control the image capturing device <NUM> over a period of time to capture multiple images of the face of the user <NUM> and further track the movement of the eyes of the user <NUM> based on analysis of the image portion in each of the captured multiple images. The movement of the eyes may indicate where the user <NUM> might be gazing (for example, towards the electronic device <NUM> or elsewhere).

The circuitry <NUM> of the electronic device <NUM> may be further configured to determine the position of the eye gaze of the user <NUM> on the first UI element <NUM> (such as the "volume up" UI element) of the plurality of UI elements <NUM> of the electronic device <NUM>, based on the tracked movement of the eyes of the user <NUM>. In some embodiments, the circuitry <NUM> may determine the position of the eye gaze on any UI element of the plurality of UI elements <NUM> of the electronic device <NUM> based on the captured first image.

In accordance with an embodiment, the circuitry <NUM> may further control a movement of the cursor <NUM> on the plurality of UI elements <NUM> corresponding to the change in the position of the eye gaze of the user <NUM> on the plurality of UI elements <NUM>. The circuitry may control the movement of the cursor <NUM> to a UI element at which the user <NUM> may be currently looking, as the eye gaze of the user <NUM> moves to different positions on the first portion <NUM> of the first display screen <NUM> corresponding to different UI elements of the plurality of UI elements <NUM>. For example, the circuitry <NUM> may locate the cursor <NUM> at a "move up" navigation UI element when the circuitry <NUM> determines that the eye gaze of the user <NUM> is on the "move up" navigation UI element. Further, the circuitry <NUM> may move the cursor <NUM> to the "volume up" UI element <NUM>, when the circuitry <NUM> determines that the eye gaze of the user <NUM> is on the first UI element <NUM> (such as the "volume up" UI element). The movement of the cursor <NUM> on the plurality of UI elements <NUM> may help the user <NUM> to visually confirm the position of the eye gaze of the user <NUM> on the electronic device <NUM>.

The circuitry <NUM> of the electronic device <NUM> may further select the first UI element <NUM> (such as the "volume up" UI element) upon determination of the eye gaze of the user <NUM> on the first UI element <NUM> (such as the "volume up" UI element) for a certain time interval (such as for a few seconds). In an exemplary implementation, the circuitry <NUM> may select the first UI element <NUM> (such as a "volume up" UI element) of the plurality of UI elements <NUM> based on other eye gestures. For example, the circuitry <NUM> may be configured to select the "volume up" UI element <NUM> based on a detection of "blinking" of the eyes by the user <NUM> while the eye gaze is determined to be on the first UI element <NUM> (such as the "volume up" UI element). In some embodiments, the circuitry <NUM> may be configured to determine at least one of a facial expression of the user <NUM> (for example, a smile) or a gesture associated with a head (for example, tilt of the head of the user <NUM> in a direction) of the user <NUM>, as the user input to select the first UI element <NUM> (such as the "volume up" UI element) of the plurality of UI elements <NUM> displayed on the first display screen <NUM>.

In accordance with an embodiment, the circuitry <NUM> may further highlight the first UI element <NUM> (such as the "volume up" UI element) as shown in <FIG> as a confirmation of the selection of the first UI element <NUM> (i.e. "volume up" UI element) from the plurality of UI elements <NUM>. The highlighting of the first UI element <NUM> (i.e. "volume up" UI element) may help the user <NUM> to identify the selected first UI element <NUM>. In one or more embodiments, the circuitry <NUM> may be configured to control (for example, increase) a size of the selected first UI element <NUM> (i.e. "volume up" UI element) for ease of viewing of the selected UI icon for the user <NUM>. In an example, the circuitry <NUM> may be further configured to display the selected first UI element <NUM> as a "pop up" UI element on the first display screen <NUM>.

The circuitry <NUM> may be further configured to transmit the first control signal to the media display device <NUM> based on the selection of the first UI element <NUM> (i.e. "volume up" UI element) by the user <NUM>. The circuitry <NUM> may be further configured to transmit the first control signal using a short distance radio wave signal (for example, Bluetooth) or using a wireless local network (for example, Wi-Fi Direct). The first control signal may cause the media display device <NUM> to increase the volume of the media content <NUM> rendered on the second display screen <NUM> of the media display device <NUM>, when the first control signal (i.e. related to the "volume up" UI element) is received by the media display device <NUM> from the electronic device <NUM>. Thus, the circuitry <NUM> may allow the user <NUM> to control the volume of the media content <NUM> rendered on the media display device <NUM>, via the electronic device <NUM> by utilizing the eye gaze of the user <NUM>.

As shown in <FIG>, the media display device <NUM> may display the "volume up" UI icon 302a on the second display screen <NUM> that may be indicative of the increase in the volume of the media content <NUM> rendered on the media display device <NUM> based on the user input. It may be noted that a position of the "volume up" UI icon 302a as shown in <FIG>, is presented merely as an example. The "volume up" UI icon 302a may be positioned on any portion of the second display screen <NUM> without deviation from the scope of the disclosure.

The circuitry <NUM> of the electronic device <NUM> may be further configured to receive the feedback image <NUM> from the media display device <NUM>, based on the transmitted first control signal. The feedback image <NUM> may correspond to an image of the "volume up" UI icon 302a as displayed on the second display screen <NUM>. For example, when the user <NUM> is gazing at the electronic device <NUM> to control the volume of the media content <NUM>, the user <NUM> may need to switch the eye gaze between the electronic device <NUM> and the media display device <NUM> to confirm the change in the volume as indicated by the "volume up" UI icon 302a on the media display device <NUM>. Thus, the circuitry <NUM> of the electronic device <NUM> may display the "volume up" UI icon 302a as the feedback image <NUM> on the electronic device <NUM>, such that the user <NUM> may confirm the increase of the volume by the feedback image <NUM>, without any requirement to switch the eye gaze back and forth between the electronic device <NUM> and the media display device <NUM> to confirm the increase in the volume.

The circuitry <NUM> may be further configured to control the first display screen <NUM> to display the received feedback image <NUM> along with the displayed plurality of UI elements <NUM>. In accordance with an embodiment, the circuitry <NUM> may be further configured to control the first display screen <NUM> to display the plurality of UI elements <NUM> on the first portion <NUM> of the first display screen <NUM>, and display the received feedback image <NUM> on the second portion <NUM> of the first display screen <NUM>. The display of the plurality of UI elements <NUM> and the feedback image <NUM> on different portions, such as the first portion <NUM> and the second portion <NUM> respectively, may allow the user <NUM> to view an image of the UI icon, for example, the image of the "volume up" UI icon 302a while controlling the volume of the media content <NUM> rendered on the media display device <NUM>. It may be noted here that a position of the feedback image <NUM> on the second portion <NUM> of the first display screen <NUM>, as shown in <FIG>, is presented merely as an example. The feedback image <NUM> may be present at a different position on the second portion <NUM> of the first display screen <NUM> without deviating from the scope of the disclosure. Moreover, a size and a position of the first portion <NUM> and the second portion <NUM> of the first display screen <NUM> as shown in <FIG>, are presented merely as an example. The size and the position of the first portion <NUM> and the second portion <NUM> of the first display screen <NUM> may be presented in a different manner without deviation from the scope of the disclosure. For example, the first portion <NUM> may be present below the second portion <NUM> on the first display screen <NUM>. The disclosed electronic device <NUM> may thus enable the user <NUM> to effectively control the media display device <NUM> based on the eye gaze as the user input without assistance from another user. The disclosed electronic device <NUM> may also enable the user <NUM> to effectively control the media display device <NUM> based on the eye gaze as the user input without requiring the electronic device <NUM> to connect to an external network (for example, the internet).

With reference to <FIG>, there is shown an exemplary scenario 300B. In the exemplary scenario 300B, there is shown a media content <NUM>, a feedback image <NUM>, a "move left" navigation UI element <NUM>, a "program guide" UI icon <NUM>, and a corresponding image <NUM> of the "program guide" UI icon <NUM>.

The media display device <NUM> may display the home screen of the media display device <NUM> as the media content <NUM> on the second display screen <NUM> based on a user input of the user <NUM>. The user <NUM> may need to navigate through a set of UI icons present on the home screen of the media display device <NUM>. The set of UI icons may include for example, an "applications" UI icon, a "games" UI icon, a "playlist" UI icon, a "settings" UI icon, a "search" bar, an "information" icon, and so forth. Thus, the circuitry <NUM> of the electronic device <NUM> may determine the position of the eye gaze of the user <NUM> on the navigation UI elements of the plurality of UI elements <NUM>. The circuitry <NUM> may determine the position of the eye gaze of the user <NUM> on the first UI element (i.e. "move left" navigation UI element <NUM>) of the plurality of UI elements <NUM>. The circuitry <NUM> may select the "move left" navigation UI element <NUM> based on the determination of the position of the eye gaze of the user <NUM> on the "move left" navigation UI element <NUM>.

The circuitry <NUM> may further transmit the first control signal to the media display device <NUM> to navigate to a UI icon (on the second display screen <NUM>) that may be present at a left side of a currently selected UI icon of the set of UI icons. For example, the first control signal may enable the selection of the "program guide" UI icon <NUM> by navigation from the "applications" UI icon of the set of UI icons present on a right side of the home screen to the "program guide" UI icon <NUM> present on a left side of the home screen.

The circuitry <NUM> may be further configured to receive the feedback image <NUM> based on the transmitted first control signal. The received feedback image <NUM> may correspond to an image associated with the media content <NUM> (for example, the home screen image shown in <FIG>) of the media display device <NUM>. The feedback image <NUM> may depict the selection of the "program guide" UI icon <NUM> by highlighting the corresponding image <NUM> of the "program guide" UI icon <NUM>. Thus, the electronic device <NUM> may enable the user <NUM> to efficiently navigate the set of UI icons of the media content <NUM> (for example, the home screen) without a need to switch the eye gaze back and forth between the electronic device <NUM> and the media display device <NUM>. Therefore, the electronic device <NUM> may allow the user <NUM> to control the media display device <NUM> while being able to continuous view the media content <NUM>. As a result, the user <NUM> does not miss a frame or a portion of the media content <NUM> played on the media display device <NUM> (such as a television), during the provision of the user input to control the media display device <NUM>. Thus, a seamless viewing experience may be achieved for the user <NUM>.

<FIG> and <FIG> are diagrams which collectively illustrate other exemplary scenarios for control of the media display device <NUM> of <FIG>, in accordance with an embodiment of the disclosure. <FIG> and <FIG> are explained in conjunction with elements from <FIG> and <FIG>. With reference to <FIG>, there is shown an exemplary scenario 400A. In the exemplary scenario 400A, there is shown a media content <NUM>, a feedback image <NUM>, and a first UI element <NUM> (such as a "volume up" UI element). It may be noted that the function of the first UI element <NUM> (such as the "volume up" UI element) may be same as the function of the "volume up" UI element (shown as the first UI element <NUM>) described, for example, in <FIG>.

The circuitry <NUM> may determine the position of the eye gaze of the user <NUM> on the first UI element <NUM> (such as the "volume up" UI element) of the plurality of UI elements <NUM>. The circuitry <NUM> may further transmit the first control signal to control the volume of the media content <NUM>, based on the determination of the position of the eye gaze of the user <NUM> on the first UI element <NUM> (such as the "volume up" UI element). Moreover, the circuitry <NUM> may receive the feedback image <NUM> from the media display device <NUM>, such that the feedback image <NUM> may include an image of the "volume up" UI icon 402a overlaid on the media content <NUM> as shown in <FIG>.

In accordance with an embodiment, the circuitry <NUM> of the electronic device <NUM> may control the overlay of the displayed plurality of UI elements <NUM> on the displayed feedback image <NUM>. The circuitry <NUM> may control the first display screen <NUM> to display the plurality of UI elements <NUM> over the feedback image <NUM> on a same portion of the first display screen <NUM> of the electronic device <NUM>, as shown in <FIG>.

In one or more embodiments, the circuitry <NUM> may control the opacity level of the displayed plurality of UI elements <NUM> that are overlaid on the displayed feedback image <NUM>. The circuitry <NUM> may, for example, decrease an amount of the opacity level of the displayed plurality of UI elements <NUM>, such that the media content <NUM> of the received feedback image <NUM> may be easily viewable through the displayed plurality of UI elements <NUM>. For example, the opacity level of the displayed plurality of UI elements <NUM> may be reduced to a level of <NUM>% opacity, such that display of the media content <NUM> of the feedback image <NUM> may be visible to the user <NUM>. Such an arrangement of the plurality of UI elements <NUM> with the reduced opacity level overlaid on the feedback image <NUM> may allow the user <NUM> to view the feedback image <NUM> concurrently with the plurality of UI elements <NUM>, while controlling the media display device <NUM> via the eye gaze of the user <NUM>. Moreover, such arrangement may provide the user <NUM> to view the plurality of UI elements <NUM> as well as the feedback image <NUM> on a full screen (or on a particular portion) of the first display screen <NUM>. In an alternate embodiment, the plurality of UI elements <NUM> may be overlaid on the feedback image <NUM>, such that the opacity level of the feedback image <NUM> is controlled (for example, reduced) instead of the control of the opacity level of the plurality of UI elements <NUM>. The electronic device <NUM> thus allows the user to control the media display device <NUM>, while continuously viewing the media content <NUM> on the electronic device <NUM>, due to concurrent display of the feedback image <NUM> and the plurality of UI elements <NUM> on the electronic device <NUM>.

With reference to <FIG>, there is shown an exemplary scenario 400B. In the exemplary scenario 400B, there is shown a media content <NUM>, an "information" UI element <NUM> (such as the first UI element) of the plurality of UI elements <NUM>, a feedback image <NUM>, first information <NUM>, and a third portion <NUM> of the first display screen <NUM> of the electronic device <NUM>.

In some embodiments, the user <NUM> may require information about the media content, for example, the media content <NUM> rendered on the media display device <NUM>. For example, the media display device <NUM> may render a documentary as the media content <NUM>. The user <NUM> may require information about content of the documentary, for example, a name or summary of the documentary, and move the position of the eye gaze on the "information" UI element <NUM> (i.e. the first UI element) of the plurality of UI elements <NUM>. In such a case, the circuitry <NUM> may determine the position of the eye gaze of the user <NUM> on the "information" UI element <NUM>.

The circuitry <NUM> may further select the "information" UI element <NUM> of the plurality of UI elements <NUM>, based on the determination of the position of the eye gaze of the user <NUM> on the "information" UI element <NUM>. As a result, the circuitry <NUM> may transmit the first control signal to the media display device <NUM> to receive the information, for example, the first information <NUM>, related to the media content <NUM> displayed on the media display device <NUM>. In an example, the first information <NUM> may be the information about the documentary rendered on the media display device <NUM>. In an embodiment, the circuitry <NUM> may further receive the feedback image, for example, the feedback image <NUM> corresponding to the media content <NUM> with the first information <NUM> from the media display device <NUM>. In some embodiments, the circuitry <NUM> may receive the first information <NUM> related to the media content <NUM> from the server <NUM> (shown in <FIG>).

In accordance with an embodiment, the circuitry <NUM> may be configured to control the first display screen <NUM> to display the information, for example, the first information <NUM>, related to the media content <NUM> displayed on the second display screen <NUM> of the media display device <NUM>. The circuitry <NUM> may control the first display screen <NUM> to display the first information <NUM>, based on the selection of the "information" UI element <NUM> of the plurality of UI elements <NUM> by the eye gaze of user <NUM>. In an embodiment, the circuitry <NUM> may display the first information <NUM> on the third portion <NUM> (i.e. different from the first portion <NUM> and the second portion <NUM> shown in <FIG>) of the first display screen <NUM>. Furthermore, the circuitry <NUM> may further control the first display screen <NUM> to display the feedback image <NUM> on the first display screen <NUM> of the electronic device <NUM>. It may be noted here that a position of the third portion <NUM> on the first display screen <NUM> shown in <FIG> is presented merely as an example. The present disclosure may be also applicable to other positions of the third portion <NUM> on the first display screen <NUM>, without deviation from the scope of the disclosure.

In one or more embodiments, the plurality of UI elements <NUM>, the feedback image <NUM>, and the first information <NUM> may be displayed on three different portions of the first display screen <NUM>. In an exemplary embodiment, the display positions of the plurality of UI elements <NUM>, the feedback image <NUM>, and the first information <NUM> may be preset. In another exemplary embodiment, the display positions of the plurality of UI elements <NUM>, the feedback image <NUM>, and the first information <NUM> may be set based on user input. In an exemplary embodiment, the plurality of UI elements <NUM> may be overlaid on the feedback image <NUM> and the first information <NUM>, such that the plurality of UI elements <NUM> may be displayed with the controlled opacity level, for example, a reduced opacity level over the feedback image <NUM> and the first information <NUM>, as described with reference to <FIG>.

<FIG> and <FIG> are diagrams which collectively illustrate other exemplary scenarios for control of the media display device <NUM> of <FIG>, in accordance with an embodiment of the disclosure. <FIG> and <FIG> are explained in conjunction with elements from <FIG> and <FIG>. With reference to <FIG>, there is shown an exemplary scenario 500A. In the exemplary scenario 500A, there is shown a "home" UI element <NUM> (i.e. first UI element) of the plurality of UI elements <NUM>, guidance information <NUM>, and media content <NUM>. The media content <NUM> may relate to a content related to news rendered on the media display device <NUM>, as shown in <FIG>.

In accordance with an embodiment, the media display device <NUM> may render the media content <NUM> (for example, news content). The user <NUM> may require viewing the home screen of the media display device <NUM> to switch to another media content on the media display device <NUM>, and may further gaze at the "home" UI element <NUM>. The circuitry <NUM> of the electronic device <NUM> may be configured to render the guidance information <NUM> (for example, information about the operation of the UI element such as "home" UI element <NUM>) for the user <NUM> to view the home screen (for example, a main page) of the media display device <NUM>, based on the determination of the position of the eye gaze of the user <NUM> on the "home" UI element <NUM> of the plurality of UI elements <NUM>. Thus, circuitry <NUM> may select the "home" UI element <NUM> based on the eye gaze of the user <NUM> on the "home" UI element <NUM> to display the home screen (not shown in <FIG>) on the second display screen <NUM> of the media display device <NUM>. Furthermore, the guidance information <NUM> may be rendered to control one or more configuration settings of the media display device <NUM> through one or more UI elements of the plurality of UI elements <NUM> displayed on the first display screen <NUM>. For example, the guidance information <NUM> may provide the user <NUM> with information to configure specific settings (for example, but not limited to, adjustment of color, adjustment of aspect ratio) of the media display device <NUM>. In an embodiment, the plurality of UI elements <NUM> and the guidance information <NUM> may be provided at different portions of the first display screen <NUM> of the electronic device <NUM>. It may be noted here that a position of the guidance information <NUM> on the first display screen <NUM> shown in <FIG> is presented merely as an example. The present disclosure may be also applicable to other positions of the guidance information <NUM> on the first display screen <NUM>, without deviation from the scope of the disclosure.

In some embodiments, the circuitry <NUM> may be configured to render the guidance information <NUM> for the user <NUM> by determination of the eye gaze of the user <NUM> on the "information" UI element <NUM> (shown in <FIG>). In an exemplary embodiment, the first information <NUM> of <FIG> may be the information about the operation of each UI element of the plurality of UI elements <NUM> or the information about the media content <NUM> currently rendered on the media display device <NUM>. Thus, the guidance information <NUM> may assist the user <NUM> to select an appropriate UI element to control the one or more configuration settings or different functionalities of the media display device <NUM>.

With reference to <FIG>, there is shown an exemplary scenario 500B. In the exemplary scenario 500B, there is shown media content <NUM>, a feedback image <NUM>, and a "playback control" UI element (for example, "rewind" UI element <NUM>) of the plurality of UI elements <NUM>. The media content <NUM> may include a movie rendered on the media display device <NUM>.

In accordance with an embodiment, the media display device <NUM> may render the media content <NUM>, for example, a movie. The circuitry <NUM> of the electronic device <NUM> may be configured to control the first display screen <NUM> to display a set of UI elements <NUM> (i.e. which may be a subset of the plurality of UI elements <NUM> on the first display screen <NUM> of <FIG>), based on the received feedback image <NUM>. For example, the set of UI elements <NUM> may include a "power" UI element, a "home" UI element, an "information" UI element, a "volume up" UI element, a "volume down" UI element, the "rewind" UI element <NUM>, a "pause" UI element, a "play" UI element, and a "forward" UI element as shown in <FIG>. The set of UI elements <NUM> may be displayed based on a type of media content <NUM> displayed on the media display device <NUM> and the feedback image <NUM> received by the electronic device <NUM>. The circuitry <NUM> may further hide or omit unessential UI elements from the plurality of UI elements <NUM> based on the rendered media content <NUM>, such that the screen real estate of the first display screen <NUM> in <FIG> is relatively less cluttered compared to the first display screen <NUM> of <FIG>. As a result, the circuitry <NUM> may efficiently determine the position of the eye gaze of the user <NUM> on any particular UI element (i.e. first UI element) of the set of UI elements <NUM>. In an example, the circuitry <NUM> may hide or omit UI elements such as the "navigation" UI elements, the "numeric" UI elements, and so forth, during the playback of the movie. As shown in <FIG>, the circuitry <NUM> may control the first display screen <NUM> to display the set of UI elements <NUM> that may be required by the user <NUM> to control playback of the media content <NUM> (for example, the movie) on the media display device <NUM>.

In an exemplary embodiment, the user <NUM> may require rewinding the media content <NUM> rendered on the media display device <NUM>. The circuitry <NUM> may further determine the position of the eye gaze of the user <NUM> on the "rewind" UI element <NUM> (i.e. first UI element) of the set of UI elements <NUM> for a certain time interval (for example for few seconds). The circuitry <NUM> may select the "rewind" UI element <NUM>, based on the determination of the eye gaze of the user <NUM> on the "rewind" UI element <NUM>. The circuitry <NUM> may further transmit the first control signal to the media display device <NUM> to rewind the media content <NUM> on the media display device <NUM> based on the eye gaze as the user input. Further, the circuitry <NUM> may receive the feedback image <NUM>, including an image of the media content <NUM>, from the media display device <NUM>, based on the transmitted first control signal. The set of UI elements <NUM> and the feedback image <NUM> may be displayed on different portions of the first display screen <NUM>. In some embodiments, the set of UI elements <NUM> may be overlaid on the feedback image <NUM> on the first display screen <NUM>. Therefore, the circuitry <NUM> may allow the user <NUM> to efficiently control the rendering of the media content <NUM> on the media display device <NUM>, by using the set of UI elements <NUM>. It may be noted that the set of UI elements <NUM> shown in <FIG> are presented merely as an example. The present disclosure may be also applicable to other set of UI elements on the first display screen <NUM>, without deviation from the scope of the disclosure.

<FIG> is a flowchart that illustrates an exemplary method for control of the media display device, via the electronic device, in accordance with an embodiment of the disclosure. <FIG> is described in conjunction with elements from <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>. With reference to <FIG>, there is shown a flowchart <NUM>. The operations of the flowchart <NUM> may be executed by a computing system, such as the electronic device <NUM> or the circuitry <NUM>. The operations may start at <NUM> and proceed to <NUM>.

At <NUM>, the image capturing device <NUM> may be controlled to capture a first image of a user of the electronic device <NUM>. In one or more embodiments, the circuitry <NUM> of the electronic device <NUM> may be configured to control the image capturing device <NUM> of the electronic device <NUM> to capture the first image of the user <NUM> of the electronic device <NUM> as described, for example, in <FIG>.

At <NUM>, a position of an eye gaze of the user <NUM> may be determined on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user <NUM>. In one or more embodiments, the circuitry <NUM> othe electronic device <NUM> may be configured to determine the position of the eye gaze of the user <NUM> on the first UI element 106A of the displayed plurality of UI elements <NUM>, based on the captured first image of the user <NUM> as described, for example, in <FIG>.

At <NUM>, the first UI element 106A of the plurality of UI elements <NUM> may be selected based on the determination of the position of the eye gaze on the first UI element 106A for a time interval. In one or more embodiments, the circuitry <NUM> of the electronic device <NUM> may be configured to select the first UI element 106A of the plurality of UI elements <NUM> based on the determination of the position of the eye gaze on the first UI element 106A for the time interval as described, for example, in <FIG>. In some embodiments, the time interval may be a few seconds (such as at least <NUM> seconds).

At <NUM>, a first control signal may be transmitted to the media display device <NUM>, based on the selection of the first UI element 106A of the plurality of UI elements <NUM>. In one or more embodiments, the circuitry <NUM> of the electronic device <NUM> may be configured to transmit the first control signal to the media display device <NUM>, based on the selection of the first UI element 106A of the plurality of UI elements <NUM> as described, for example, in <FIG>.

At <NUM>, a feedback image may be received from the media display device <NUM>, based on the transmitted first control signal. In one or more embodiments, the circuitry <NUM> of the electronic device <NUM> may be configured to receive the feedback image <NUM> from the media display device <NUM>, based on the transmitted first control signal as described, for example, in <FIG>. The received feedback image <NUM> may indicate the control of the media display device <NUM> based on the transmitted first control signal.

At <NUM>, a first display screen may be controlled to display the received feedback image <NUM> with the displayed plurality of UI elements <NUM>. In one or more embodiments, the circuitry <NUM> of the electronic device <NUM> may be configured to control the first display screen <NUM> to display the received feedback image <NUM> with the displayed plurality of UI elements <NUM> as described, for example, in <FIG>. The control may pass to end.

Although the flowchart <NUM> is illustrated as discrete operations, such as <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>, the disclosure is not so limited. Accordingly, in certain embodiments, such discrete operations may be further divided into additional operations, combined into fewer operations, or eliminated, depending on the particular implementation without detracting from the essence of the disclosed embodiments.

Various embodiments of the disclosure may provide a non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by an electronic device (the electronic device <NUM>) which includes an image capturing device (such as the image capturing device <NUM>) and a first display screen (such as the first display screen <NUM>), causes the electronic device <NUM> to execute operations. The operations may include control of the first display screen to display a plurality of user interface (UI) elements. A selection of each of the plurality of UI elements controls a media display device (such as the media display device <NUM>) communicably coupled to the electronic device. The operations further include control of the image capturing device to capture a first image of a user of the electronic device. The operations further include determination of a position of an eye gaze of the user on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user. The operations further include selection of the first UI element of the plurality of UI elements based on the determination of the position of the eye gaze on the first UI element for a time interval. The operations further include transmission of a first control signal to the media display device, based on the selection of the first UI element of the plurality of UI elements. The operations further include reception of a feedback image from the media display device, based on the transmitted first control signal. The received feedback image indicates the control of the media display device based on the transmitted first control signal. The operations further include control of the first display screen to display the received feedback image with the displayed plurality of UI elements.

Exemplary aspects of the disclosure may include an electronic device (such as the electronic device <NUM>). The electronic device <NUM> may include an image capturing device (such as the image capturing device <NUM>) and a first display screen (such as the first display screen <NUM>) that may be configured to display a plurality of user interface (UI) elements (such as the plurality of UI elements <NUM>). A selection of each of the plurality of UI elements <NUM> may control a media display device (such as the media display device <NUM>) communicably coupled to the electronic device <NUM>. The electronic device <NUM> may further include circuitry (such as the circuitry <NUM>) coupled to the image capturing device <NUM> and the first display screen <NUM>. The circuitry <NUM> may be configured to control the image capturing device <NUM> to capture a first image of a user (for example, the user <NUM>) of the electronic device <NUM>. The circuitry <NUM> may be further configured to determine a position of an eye gaze of the user <NUM> on a first UI element (for example the first UI element 106A) of the displayed plurality of UI elements <NUM>, based on the captured first image of the user <NUM>. The circuitry <NUM> may be further configured to select the first UI element 106A of the plurality of UI elements <NUM> based on the determination of the position of the eye gaze on the first UI element 106A for a time interval. The circuitry <NUM> may be further configured to transmit a first control signal to the media display device <NUM>, based on the selection of the first UI element 106A of the plurality of UI elements <NUM>. The circuitry <NUM> may be further configured to receive a feedback image (for example, the feedback image <NUM>) from the media display device <NUM>, based on the transmitted first control signal. The received feedback image <NUM> may indicate the control of the media display device <NUM> based on the transmitted first control signal. The circuitry <NUM> may be further configured to control the first display screen <NUM> to display the received feedback image <NUM> with the displayed plurality of UI elements <NUM>.

In accordance with an embodiment, each UI element of the plurality of UI elements <NUM> may be associated with a different functionality associated with the media display device <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to control a movement of a cursor (such as the cursor <NUM>) on the plurality of UI elements <NUM> corresponding to a change in the position of the eye gaze of the user <NUM> on the plurality of UI elements <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to highlight the first UI element 106A based on the selection of the first UI element 106A of the plurality of UI elements <NUM>.

In accordance with an embodiment, the feedback image <NUM> received from the media display device <NUM> may correspond to a UI icon (such as the UI icon 302a) to indicate the control of the media display device <NUM> based on the transmitted first control signal.

In accordance with an embodiment, the feedback image <NUM> received from the media display device <NUM> may correspond to media content (such as the media content <NUM>) displayed on a second display screen (such as the second display screen <NUM>) of the media display device <NUM> based on the transmitted first control signal.

In accordance with an embodiment, the circuitry <NUM> may be further configured to control an overlay of the displayed plurality of UI elements <NUM> on the displayed feedback image <NUM> that may correspond to the media content <NUM> displayed on the second display screen <NUM> of the media display device <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to control an opacity level of the displayed plurality of UI elements <NUM> that are overlaid on the displayed feedback image <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to control the first display screen <NUM> to display information (such as the first information <NUM>), related to the media content <NUM> displayed on the second display screen <NUM> of the media display device <NUM>, based on a selection of one or more UI elements of the plurality of UI elements <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to control the first display screen <NUM> to display the plurality of UI elements <NUM> on a first portion (such as the first portion <NUM>) of the first display screen <NUM>, and display the received feedback image <NUM> on a second portion (such as the second portion <NUM>) of the first display screen <NUM>. The first portion <NUM> may be different from the second portion <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to determine at least one of a gesture associated with facial expression of the user <NUM> or a gesture associated with a head of the user <NUM>, to select the first UI element 106A of the plurality of UI elements <NUM> displayed on the first display screen <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to render guidance information (for example, the guidance information <NUM>) for the user <NUM>, to control one or more configuration settings of the media display device <NUM> through one or more UI elements of the plurality of UI elements <NUM> displayed on the first display screen <NUM>.

In accordance with an embodiment, the circuitry <NUM> may be further configured to control the first display screen <NUM> to display a set of UI elements <NUM> of the plurality of UI elements <NUM> on the first display screen <NUM>, based on the received feedback image <NUM>.

The present disclosure may be realized in hardware, or a combination of hardware and software. The present disclosure may be realized in a centralized fashion, in at least one computer system, or in a distributed fashion, where different elements may be spread across several interconnected computer systems. A computer system or other apparatus adapted to carry out the methods described herein may be suited. A combination of hardware and software may be a general-purpose computer system with a computer program that, when loaded and executed, may control the computer system such that it carries out the methods described herein. The present disclosure may be realized in hardware that comprises a portion of an integrated circuit that also performs other functions.

The present disclosure may also be embedded in a computer program product, which comprises all the features that enable the implementation of the methods described herein, and which when loaded in a computer system is able to carry out these methods. Computer program, in the present context, means any expression, in any language, code or notation, of a set of instructions intended to cause a system with information processing capability to perform a particular function either directly, or after either or both of the following: a) conversion to another language, code or notation; b) reproduction in a different material form.

Claim 1:
An electronic device (<NUM>), comprising:
an image capturing device (<NUM>);
a first display screen (<NUM>) configured to display a plurality of user interface (UI) elements, wherein a selection of each of the plurality of UI elements controls a media display device communicably coupled to the electronic device; and
circuitry (<NUM>) coupled to the image capturing device (<NUM>) and the first display screen (<NUM>), wherein the circuitry is configured to:
control the image capturing device to capture a first image of a user of the electronic device;
determine a position of an eye gaze of the user on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user;
select the first UI element of the plurality of UI elements based on the determination of the position of the eye gaze on the first UI element for a time interval;
transmit a first control signal to the media display device, based on the selection of the first UI element of the plurality of UI elements;
receive a feedback image from the media display device, based on the transmitted first control signal, wherein the received feedback image indicates the control of the media display device based on the transmitted first control signal; and
control the first display screen to display the received feedback image with the displayed plurality of UI elements
wherein the feedback image received from the media display device corresponds to media content displayed on a second display screen of the media display device based on the transmitted first control signal,
wherein the circuitry is further configured to control an overlay of the displayed plurality of UI elements on the displayed feedback image that corresponds to the media content displayed on the second display screen of the media display device; and control an opacity level of the displayed plurality of UI elements that are overlaid on the displayed feedback image.