A Computer Software Module Arrangement, a Circuitry Arrangement, and Arrangement and a Method for Improved User Interface

A visual data presenting arrangement (100) comprising an image presenting device (110) arranged to display visual data comprising graphical objects (105A-D) in a first manner and a controller (101) configured to: receive (510) a determination of eyewear (210) presence from a non-visual eyewear detector (112); and in response thereto adapt (540) a user interface of the visual data presenting arrangement (100) by displaying one or more of the graphical objects (105A-D) in a second manner.

TECHNICAL FIELD

The present invention relates to an arrangement, an arrangement comprising computer software modules, an arrangement comprising circuits, a device and a method for providing an improved user interface, and in particular to an arrangement, an arrangement comprising computer software modules, an arrangement comprising circuits, a device and a method for providing an improved user interface adaptable to visual impairments.

BACKGROUND

Contemporary devices such as smartphones, tablet computers, wearables (watches for example) are becoming more and more advanced providing more and more functionalities to user. At the same time, the size of such devices are limited for practical reasons, thereby putting restraints on the data being presented on such devices, primarily as it relates to visual data.

In order to accommodate more and more content, the designers are enabling smaller and smaller icons or other visual representations to be used. However, this has the disadvantage that users with visual impairments may not be able to take part of the content being displayed as it is just too small.

Traditionally, there are functions available for setting the font size so that a user can set a font size or display size, i.e. resolution, that the user is comfortable with.

There are also solutions that propose to adapt contrast or brightness of the content being displayed in response to detecting that sunglasses are being worn. However, such solutions are not able to account for visual impairments and does not adapt the user interface, only the display settings of the device. Furthermore, such solutions operate based on a camera image being used to recognize whether the user is wearing sunglasses or not, and as such, are not suitable for devices that are not equipped with a camera or where the camera may not be at a user's face during operation, such as smartwatches for example.

However, as the inventors have realized, users that do not have perfect vision might have different needs. For example, some users need reading glasses when reading, especially when reading small texts. Other users might need reading glasses or terminal glasses depending on the distance from the text (a book is typically viewed closer than a computer screen). Some users need glasses for nearsightedness (below referred to as distance glasses), but as they get older they typically need to remove these to read (the stage before they actually need reading glasses).

One problem that the inventors have realized is that the setting chosen may not be usable in all circumstances. For a user that needs correction, may not need the same correction at all distances or in all circumstances. For example a nearsighted user may not have set the device to show a larger font as it is not necessary for the user being able to see well at short distances. However, the same user, when for example driving a car would wear corrective eyewear, which could possibly alter the user's vision so that the user is no longer able to see equally well at shorter distances, favoring longer distances for the safe operation of the car. In such a case, the user would need to switch glasses while driving if a navigation app for instance was to be used on the user's smartphone. As the person is being busy with their hands, this might be problematic.

Such problems are especially prominent for users above 45 years as they start to need vision compensation that might differ for different usage (distance, computer, reading). Although there are glasses being bifocal (for example distance plus reading), these can sometimes be less practical to use in certain situations and not all people feel comfortable with such glasses. Such glasses are also expensive and many times not suitable for some types of corrective eyewear. Furthermore, due to cost restrictions a user may have different prescription corrections in different eyewear. For example a user's main glasses may be bifocals while the user's sunglasses may be of a single prescription.

Other problematic situations occur, for example, during sports, when a smartwatch is being used, it might be less practical to wear certain types of glasses which would impact the overhead of using the watch. This could for example be while sailing, swimming, running, doing gymnastics, etc.

Furthermore, as the font size is increased less content may be displayed which limits the amount of content that a user can take part of or consume even in situations where the user is able to see the screen and the content. Additionally, a too large font size may be noticeable to others and thus be a source of embarrassment to a user.

Simply adapting the font size is thus not a sufficiently good solution for enabling a user to see and partake of content, especially visual, being presented on a smart device or other arrangement arranged to present visual data.

SUMMARY

An object of the present teachings is to overcome or at least reduce or mitigate the problems discussed in the background section.

According to one aspect a visual data presenting arrangement is provided, the visual data presenting arrangement comprising an image presenting device arranged to display visual data comprising graphical objects in a first manner and a controller configured to: receive a determination of eyewear presence from a non-visual eyewear detector; and in response thereto adapt a user interface of the visual data presenting arrangement by displaying one or more of the graphical objects in a second manner. The eyewear detector is non-visual in that it is not based on an image analysis.

In some embodiment the eye-wear detector is visual, and possibly based on an image analysis, especially embodiments in combinations with a second visual data presenting arrangement.

The solution may be implemented as a software solution, a hardware solution or a mix of software and hardware components.

In one embodiment the controller is further configured to register the eyewear.

In one embodiment the eyewear detector is configured to determine the presence of the eyewear by receiving an indicating signal.

In one embodiment the indicating signal is received from an identifying component on the eyewear.

In one embodiment the eyewear comprises a storage container arranged with the identifying component.

In one embodiment the indicating signal is received from another visual data presenting arrangement.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by one or more of: adapting the number of one or more of the graphical objects being displayed; adapting the nature of one or more of the graphical objects being displayed; adapting a text of one or more of the graphical objects being displayed; adapting the arrangement of one or more of the graphical objects being displayed; by adapting the visual characteristics of one or more of the graphical objects being displayed or adapting the visual characteristics of one or more of the graphical objects being displayed.

In one embodiment the controller is further configured to adapt the text of one or more of the graphical objects being displayed by displaying an abbreviated form of the text, displaying keywords of the text, displaying the text in a different format; or any combination thereof.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by adapting an audio component.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by adapting a vibrator.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by displaying the graphical objects in a corrective display.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by adapting a device paired with the visual data presenting arrangement.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by adapting a user interface of another visual data presenting arrangement.

In one embodiment the controller is further configured to adapt the user interface of the visual data presenting arrangement by adapting a user interface of another visual data presenting arrangement so that the user interface of another visual data presenting arrangement supplements the user interface of the visual data presenting arrangement.

In one embodiment the visual data presenting arrangement is a smartphone or a tablet computer.

According to another aspect there is provided a method for adapting a user interface of a visual data presenting arrangement comprising an image presenting device arranged to display visual data comprising graphical objects in a first manner, wherein the method comprises: receiving a determination of eyewear presence from a non-visual eyewear detector; and in response thereto adapting a user interface of the visual data presenting arrangement by displaying one or more of the graphical objects in a second manner.

According to another aspect there is provided a computer-readable medium carrying computer instructions that when loaded into and executed by a controller of a visual data presenting arrangement enables the visual data presenting arrangement to implement the method according to herein.

According to another aspect there is provided a software component arrangement for adapting a user interface in a visual data presenting arrangement, wherein the software component arrangement comprises a user interface of a visual data presenting arrangement comprising an image presenting device arranged to display visual data comprising graphical objects in a first manner, wherein the software component arrangement comprises: a software component for receiving a determination of eyewear presence from a non-visual eyewear detector; and a software component for adapting the user interface of the visual data presenting arrangement100by displaying one or more of the graphical objects in a second manner in response thereto.

For the context of the teachings herein a software component may be replaced or supplemented by a software module.

According to another aspect there is provided an arrangement comprising circuitry for presenting visual data according to an embodiment of the teachings herein. The arrangement comprising circuitry for presenting visual data is adapted to be used in a visual data presenting arrangement as taught herein for providing adaptation of a user interface and corresponds to the operation of the visual data presenting arrangement as discussed in the above. The visual data presenting arrangement comprising an image presenting device arranged to display visual data comprising graphical objects in a first manner and circuitry for adapting a user interface comprising: circuitry for receiving a determination of eyewear presence from a non-visual eyewear detector; and circuitry for adapting the user interface of the visual data presenting arrangement100by displaying one or more of the graphical objects in a second manner in response thereto.

Further embodiments and advantages of the present invention will be given in the detailed description. It should be noted that the teachings herein find use in smartphones, smartwatches, tablet computers, media devices, and even in vehicular displays.

DETAILED DESCRIPTION

FIG.1Ashows a schematic view of a visual data presenting arrangement100according to an embodiment of the present invention. The visual data presenting arrangement100comprises a controller101, an eyewear detector112, a memory102and an image presenting device110. In one embodiment, the visual data presenting arrangement100also comprises a communication interface103.

The controller101is configured to control the overall operation of the visual data presenting arrangement100. In one embodiment, the controller101is a general purpose controller. As a skilled person would understand there are many alternatives for how to implement a controller, such as using Field-Programmable Gate Arrays circuits, ASIC, GPU, etc. in addition or as an alternative. For the purpose of this application, all such possibilities and alternatives will be referred to simply as the controller101.

It should also be noted that in one embodiment, parts of or all of the processing of the controller is performed remotely, where a local controller101is configured to provide input data to a remote processing unit, such as in a cloud server, causing the remote processing unit to perform the processing and receiving the results of such processing as output from the remote processing unit. For the purpose of this application, such possibilities and alternatives will also be referred to simply as the controller101, the controller thus representing both the local controller and the remote processing unit.

The memory102is configured to store graphics data, User Interface (UI) settings and computer-readable instructions that when loaded into the controller101indicates how the visual data presenting arrangement100is to be controlled. The memory102may comprise several memory units or devices, but they will be perceived as being part of the same overall memory102. There may be one memory unit for the image presenting device storing graphics data, one memory unit for the eyewear detector storing settings, one memory for the communications interface (if such is present) for storing settings, and so on. As a skilled person would understand there are many possibilities of how to select where data should be stored and a general memory102for the visual data presenting arrangement100is therefore seen to comprise any and all such memory units for the purpose of this application. As a skilled person would understand there are many alternatives of how to implement a memory, for example using non-volatile memory circuits, such as EEPROM memory circuits, or using volatile memory circuits, such as RAM memory circuits. For the purpose of this application all such alternatives will be referred to simply as the memory102.

The image presenting device110is in one embodiment a display arrangement comprising one or more displays arranged to present visual data, predominantly through images. In one such embodiment, the image presenting device110is a touch screen thereby enabling for user input to be provided to and received by the visual data presenting arrangement100. The visual data is related to the user interface of the visual data presenting arrangement and to the content being presented by the visual data presenting arrangement100. The visual data presenting arrangement100is thereby arranged to present (visual) content through a (graphical) user interface in a manner controller by the controller101.

The eyewear detector112is arranged to detect eyewear (not shown inFIG.1A, but referenced210inFIG.2Afor example) that is (to be) worn by a user. In one embodiment, the eyewear detector is a camera module arranged to provide an image (or stream of images) of the user as the user is utilizing the visual data presenting arrangement100, wherein the images of the user may be analyzed using image analysis techniques known in the art, to determine whether the user is wearing eyewear or not. However, such an embodiment requires that the camera is arranged to face the user and able to capture a clear image of the user's face. This thus requires a special camera to be installed and that also environmental factors are optimal for capturing a good-enough image to be analyzed of the user's face.

To overcome such shortcomings the inventors are proposing to utilize an active identifying manner. The inventors are thus proposing to utilize a non-visual eye-wear detector to overcome such shortcomings, i.e. a sensor or such not relying on visual inputs such as an image to be analyzed. In one embodiment, the eyewear detector112is a detector arranged to detect an identifying signal being transmitted from the eyewear. Based on the identifying signal, the eyewear detector112is arranged to determine whether the user is wearing eyewear or not. In one embodiment the eyewear detector112is arranged based on a communication standard. In one such embodiment, the eyewear detector112is arranged based on a close-range communication standard, such as Bluetooth™, RFI™ (Radio Frequency Identifier), ZigBee™ to mention a few examples or other non-standard interfaces.

As a skilled person would understand the visual data presenting arrangement100may comprise one controller101and the eyewear detector112may comprise one controller, but for the purpose of the teachings herein, they will be considered to be the same controller101in order to cover all possible variations of exactly where the determination whether the user is wearing eyewear or not takes place.

In one embodiment, as illustrated inFIG.1A, the eyewear detector112is comprised within the smart device100. In an alternative embodiment the eyewear detector112is arranged remotely to the smart device100, but being comprised in the smart device100, by being connected to the smart device100.

The controller101is configured to receive a determination that the user is wearing (or about to wear) eyewear, and in response thereto adapt the manner in which the (visual) content is presented through the (graphical) user interface.

It should be noted that the visual data presenting arrangement100may comprise a single device or may be distributed across several devices and apparatuses.

It should be noted that the teachings herein find use in visual data presenting arrangements100in many areas of image presentation for example smart phones, tablet computers, smart watches, media devices (such as smart TVs) or even vehicular displays to mention a few examples. In one embodiment the visual data presenting arrangement100is a smart device.

FIG.1Bshows a schematic view of a visual data presenting arrangement100being a smart device100according to an embodiment of the present invention. In this embodiment, the smart device100is a smartphone or a tablet computer. In such an embodiment, the smart device100comprises a touchscreen110arranged to display visual content105. The smart device100also comprises one or more input elements. The input elements may be physical such as keys or buttons104. Alternatively or additionally, the input elements are virtual, such as visual icons105that are displayed and selectable on the touchscreen110.

In one embodiment the smart device100is also arranged with an audio interface115. The audio interface115comprises a loudspeaker for providing audio output, such as presenting visual data by reading it out loud, for example through so-called text-to-speech (TTS) synthesis. The audio interface115may also comprise a microphone for providing audio input, such as voice commands.

In one embodiment the smart device100is also arranged with a vibrator116. The vibrator116may be utilized to provide information such as alerts or status information to the user.

FIG.1Cshows a schematic view of a visual data presenting arrangement being smart device100according to an embodiment of the present invention. In this example, the smart device100is a smart watch to be worn by a user. Typically, the display arrangement110of a smart watch is smaller than the display arrangement110of a smart phone, the smart watch thus being more limited in what visual content that may be displayed. The smart watch100also comprises one or more input elements. The input elements may be physical such as keys or buttons104. Alternatively or additionally, the input elements are virtual, such as visual icons105that are displayed and selectable on display arrangement being a touchscreen110.

The visual data presenting arrangement100as exemplified in either ofFIGS.1A,1B or1Cmay be arranged with a communication interface103. The communication interface103is arranged to enable communication with other devices, such as other smart devices100or a server (not shown) for receiving content, instructions and/or settings or other data.

The communication interface103may be wired and/or wireless. The communication interface may comprise several interfaces.

In one embodiment the communication interface103comprises a USB (Universal Serial Bus) interface. In one embodiment the communication interface103comprises a HDMI (High Definition Multimedia Interface) interface. In one embodiment the communication interface103comprises a Display Port interface. In one embodiment the communication interface103comprises an Ethernet interface. In one embodiment the communication interface103comprises a MIPI (Mobile Industry Processor Interface) interface. In one embodiment the communication interface comprises an analog interface, a CAN (Controller Area Network) bus interface, an I2C (Inter-Integrated Circuit) interface, or other interface.

In one embodiment the communication interface103comprises a radio frequency (RF) communications interface. In one such embodiment the communication interface103comprises a Bluetooth™ interface, a WiFi™ interface, a ZigBee™ interface, a RFID™ (Radio Frequency IDentifier) interface, Wireless Display (WiDi) interface, Miracast interface, and/or other RF interface commonly used for short range RF communication. In an alternative or supplemental such embodiment the communication interface103comprises a cellular communications interface such as a fifth generation (5G) cellular communication interface, an LTE (Long Term Evolution) interface, a GSM (Global Systeme Mobile) interface and/or other interface commonly used for cellular communication. In one embodiment the communication interface103is configured to communicate using the UPnP (Universal Plug n Play) protocol. In one embodiment the communication interface103is configured to communicate using the DLNA (Digital Living Network Appliance) protocol.

In one embodiment, the communication interface103is configured to enable communication through more than one of the example technologies given above. As an example, a wired interface, such as MIPI could be used for establishing an interface between the display arrangement, the controller and the user interface, and a wireless interface, for example WiFi™ could be used to enable communication between the visual data presenting arrangement100and an external host device (not shown).

The communications interface103may be configured to enable the visual data presenting arrangement100to communicate with other devices, such as other visual data presenting arrangements100and/or smartphones, Internet tablets, computer tablets or other computers, media devices, such as television sets, gaming consoles, video viewer or projectors (not shown), or eyewear detectors for receiving data.

In embodiments where the eyewear detector112is arranged based on a communication standard, the eyewear detector may be part of the communication interface103.

In the following, simultaneous reference will be made to the visual data presenting arrangements100ofFIGS.1A,1B and1C.

FIG.2Ashows a schematic view of a visual data presenting system200according to the teachings herein. The visual data presenting system200comprises one or more visual data presenting arrangements100. In this example one visual data presenting arrangement100is shown exemplified by a smart device100as disclosed in relation toFIG.2B, being a smartphone100. The smartphone100is in this example arranged to present visual data comprising four graphical objects (such as icons)105A,105B,105C,105D. As would be understood, the nature, the number, the extent and the arrangement of the displayed graphical objects as shown inFIG.2Ais only for illustrative purposes and may vary greatly as regards the nature, the number, the extent and the arrangement of the displayed graphical objects. The graphical objects105A-D are thus displayed in a first (original) manner). For the purpose of this example and for illustrative purposes, the graphical objects data105are considered to provide a graphical user interface for the smartphone100.

Also shown inFIG.2Ais eyewear210to be or being worn by a user. In the example ofFIG.2A, the user is wearing the eyewear210.

As discussed in relation toFIG.1A, the visual data presenting arrangement100, i.e. the smartphone100is arranged through the eyewear detector112to determine whether there are eyewear (worn or to be worn) present or not. In the illustrative example ofFIG.2Athis is indicated by the dotted lines reaching from the eyewear detector112to the eyewear210.

As is also discussed in relation toFIG.1A, the eyewear detector112may determine whether eyewear210is worn by the user through image analysis of images captured by the eyewear detector being a camera112. Alternatively or additionally, the eyewear detector112may determine whether eyewear210is worn by the user through receiving an identifying signal identifying the eyewear210. In one embodiment, the identifying signal is received from an identifying component215arranged on or in the eyewear210through a communication standard. In such an embodiment, the identifying component215is arranged based on a matching communication standard as the eyewear detector112. The eyewear detector112may thus operate both on an image analysis and on a received signal.

In one embodiment the identifying component215is arranged to determine that the eyewear210is being worn through sensors being activated, the sensors considered as part of the identifying component215. In one example the sensor(s) is a proximity sensor, such as a capacitive sensor or a pressure sensor.

As it has been determined that eyewear210is worn (or to be worn) by the user, which from now on will be referred to as eyewear being present, the controller is configured to adapt the manner in which the graphical objections105are displayed or presented, or, in other words, to adapt the (graphical) user interface105of the smart phone100.

It should be noted that the controller may not only configured to adapt the (graphical) user interface105of the smart phone100when eyewear is present. In one embodiment the controller is configured to adapt the (graphical) user interface105of the smart phone100when eyewear is not present. This enables the smart device100to switch between two (or more) user interfaces (for example a first and a second user interface) depending on whether the user is wearing (or about to wear) eyewear or not. The controller is thus configured to determine the present eyewear status or that the presence of eyewear has changed and adapt the user interface accordingly.

FIG.2Bshows a schematic view of the visual data presenting system200ofFIG.2Awherein the (graphical) user interface105has been adapted according to the teachings herein. As is noted above, and as would be understood, the nature, the number, the extent and the arrangement of the displayed graphical objects105as shown inFIG.2Bis only for illustrative purposes and may vary greatly as regards the nature, the number, the extent and the arrangement of the displayed graphical objects. However, as is illustrated inFIG.2AandFIG.2Band as is apparent from a comparison of the two figures, the (graphical) user interface105has been adapted and is not the same. For example, the smartphone100ofFIG.2Adisplays four graphical objects105A-D, whereas the smartphone100ofFIG.2Bdisplays only two graphical objects105A-B. Furthermore, the smartphone100ofFIG.2Bdisplays the two graphical objects105A-B as having a larger extent than the corresponding graphical objects105A-B ofFIG.2A. By reducing the number of graphical objects to be displayed, space is freed up allowing the graphical objects105to be displayed at a size or extent that is larger than an unadapted or original size. By thus adapting the (graphical) user interface so that only the most important or most prioritized objects105are displayed, the user interface is enabled to ensure that the user is at least made aware of those graphical objects105.

The graphical objects are thus displayed in a second (adapted) manner.

The controller is, in one embodiment, configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the number of the graphical objects105being displayed.

The controller is, in one alternative or additional embodiment, configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the nature of the graphical objects105being displayed, i.e. to adapt what types of graphical objects that are to be displayed and which graphical objects that are to be displayed. For example, the structure of a menu system could be altered depending on the eye wear being worn.

The controller is, in one alternative or additional embodiment, configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the extent (form or size) of the graphical objects105being displayed. In relation to adapting the extent of a graphical object105, any text displayed within the graphical object or as part of the graphical object105may also be adapted in a corresponding manner. In one embodiment, the text is adapted by changing its size to correspond to the change in the extent of the graphical object. In one embodiment, the text is adapted by changing the actual text, i.e. changing the content of the text. If a graphical object is displayed with a text (for example: “Meeting on Thursday at 10:00 am with Jane Doe, Jim Smith and Jeff Hart”), the text may be adapted so that only the initial part is displayed (for example: “Meeting”), that an abbreviated form (where abbreviations are used to replace original wording) is displayed (for example: “Meet Thu 10 am J Doe, J Smith J Hart”), that only keywords are displayed (for example: “Meeting Thu 10 am Jane Doe et al”) or a combination of any, some or all of these options and possibly other variations of shortening a text (for example: “Th 10 am J Doe”). The shortening of the text may be based on a semantic analysis of the text for providing a shorter text that is equal as it comes to content. The shortening of the text may also be adapted by adapting a color scheme or other display property of the graphical icon. For example, a “To Do” application arranged to display graphical icons for meetings (for example: “Meeting on Thursday at 5:00 pm with Jane Doe, Jim Smith and Jeff Hart”), tasks (for example: “Review P809765-X”) and deadlines (for example: “File P809765-X by 20201212”), may adapt the graphical object105and the text by changing the color scheme of the graphical object to indicate the type of text displayed thereby conveying the same information but with a shorter text. In the examples given different colors (of text, for a frame of the graphical object or other part of the graphical object, possibly all of the graphical object105) could be used to indicate type of notification, wherein the texts become [GREEN]“Thu 17 J Doe”, [BLUE]“P809765-X”) and [RED]“File P809765-X 12/12”). As can be seen in these examples, the controller may be further configured to adapt the formatting of the text to be displayed. In these examples the time “5:00 pm” has been changed to a 24 hour format; “17”, and the date “20201212” has been changed to the shorter format “12/12” leaving out the year assuming that the user knows which year the deadline relates to. If not, the user can always get all information by selecting and opening the graphical object105, so no information is lost.

The controller is, in one alternative or additional embodiment, configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the arrangement (placement) of the graphical objects105being displayed.

The controller is, in one alternative or additional embodiment, configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the visual characteristics (color, brightness, contrast, background, intensity to name a few examples) of the graphical objects105being displayed.

In one embodiment, where the smart device100is arranged with an audio interface115, the controller is further configured to provide audio output corresponding to one or more of the graphical objects105A-D. The audio output may correspond to a previously displayed graphical object105C,105D and/or it may relate to a currently displayed graphical object105A,105B. The audio output may be to read out data displayed in the graphical object105A-D or to provide a status indicated by the graphical object105A-D.

In one such embodiment, where the smart device100is arranged with an audio interface115, the controller is further configured to enable (or alternatively to disable) audio input for commands (i.e. voice control) as it is determined that the presence of eyewear has changed. The graphical user interface is thus changed to not only being graphical, but to also being audio-based (or vice-versa).

The controller is thus configured to adapt an audio component115of the user interface depending on the determination of the eyewear presence.

In one embodiment, where the smart device100is arranged with a vibrator116, the controller is further configured to provide vibrating output corresponding to one or more of the graphical objects105A-D for conveying some of the data of the graphical object105A-D. The vibrating output may provide a status indicated by the graphical object105A-D.

The controller is thus configured to adapt a vibrator116of the user interface depending on the determination of the eyewear presence.

The controller is, in one alternative or additional embodiment where at least one of the graphical objects105A-D relate to a virtual keyboard or keypad (considered to be different types of keyboards for the context of this application), configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the arrangement of the virtual keyboard. In one such embodiment, the virtual keyboard is adapted to be of a different type, for example switching from a QWERTY style keyboard to an ITU-T keypad. In one alternative or additional such embodiment, the virtual keyboard is adapted to be displayed partially, wherein a user is enabled to scroll the keyboard to reveal the parts not presently displayed.

The controller is, in one alternative or additional embodiment, configured to adapt the (graphical) user interface in the second (adapted) manner by adapting the manner in which the graphical objects105are being displayed to display the graphical objects in a so-called corrective display. Corrective displays are arranged to display graphics in a manner that compensates for any visual impairment so that the user perceives the content correctly even when not wearing the prescribed eyewear.

As discussed above, the inventors have further realized that a user may have different eyewear that may have different prescriptions. An adaptation suitable for one eyewear may thus not be suitable for another eyewear.

FIG.2Cshows a schematic view of the visual data presenting system200ofFIG.2Aand possibly ofFIG.2Bwherein the user is wearing a second pair of eyewear210′ having a different prescription (compared to the eyewear ofFIGS.2A and2B) and wherein the (graphical) user interface105has been adapted according to the teachings herein. In an embodiment as inFIG.2C, eyewear detector112is thus configured to not only determine a presence of eyewear, but also determine an identity or type of the eyewear for which the presence is determined, wherein the controller101is configured to adapt the user interface according to an identity of the eyewear210.

In one such embodiment, the eyewear detector112is configured to determine the type of eyewear based on an image analysis. Such an image analysis is beneficial in differentiating between two visually different eyewear, such as for example daylight glasses and sunglasses.

In an alternative or additional such embodiment, the eyewear detector112is configured to determine the type of eyewear based on the received signal, wherein the received signal indicates the identity and/or the type of eyewear.

As can be seen inFIG.2Ccompared toFIGS.2A and2B, the user interface has been adapted in a different manner, wherein the visual appearance as well as the size of the graphical objects105A-B is different inFIG.2Ccompared toFIG.2B.

In the above, the focus of the eyewear has been on glasses, but as the inventors have realized, the same problems are present also for other types of eyewear, such as contact lenses, which presence may be more difficult to determine.

FIG.3shows a schematic view of the visual data presenting system200similar to those ofFIGS.2A,2B and2C, wherein the eyewear210is contact lenses and wherein the (graphical) user interface105has been adapted according to the teachings herein. In this example the eyewear210comprises the actual eyewear (i.e. the contact lenses)210A and a case or storage container210B for the eyewear.

As contact lenses are difficult to detect through image analysis (other than colored contact lenses), the eyewear detector112is configured to determine the presence of the eyewear210by receiving a signal from an identifying component215arranged on or in the storage container210B. To enable detection or determination of the actual presence of the eyewear210it is not sufficient to detect a presence of the storage container210B, but also—as the inventors have realized—to determine whether the contact lenses (or other eyewear being stored therein)210A has been retrieved (or put back) by determining whether the storage container210B is being opened. The identifying component215is therefore arranged on the storage container210B so that it emits the signal as the storage container is being opened (and/or being closed).

For disposable lenses it is easy to determine that the lenses are present when the storage container is opened.

For non-disposable lenses, the determination may be based on keeping account of each time the storage container is opened (and/or closed) to keep track of if the lenses have been retrieved or put back.

In one embodiment, where the identifying component215is made very small, the identifying component215may be arranged on the actual contact lenses215A. For example a small marker may be comprised in the contact lens, such as through printing or molding. Electronic markers are also foreseeable to be utilized in contact lenses and may be used for identifying them as for any type of eye wear.

For implementations where the identifying component215is unable to generate a signal strong enough to be emitted to the eyewear detector112, the identifying component215may comprise two parts, one arranged on the contact lenses and one on the storage container215B, the part arranged on the storage container210B then being arranged to detect the presence of the contact lenses210A based on the signal received from the part of the identifying component215arranged on the contact lenses210A and to forward such a signal to the eyewear detector112.

As indicated above in relation toFIG.1A, the memory102is arranged to store settings. The memory may thus be arranged to store settings for how to adapt the user interface for a determined eyewear, such as by storing settings for an identified eyewear210. A default setting is also stored for use when no eyewear is present. Vice versa, a default setting may be stored for use when eyewear is present, and the adaptation is performed when the default eyewear is not present.

In one embodiment, the eyewear210comprises a combination of eyewear, for example a pair of sunglasses210′ worn over contact lenses210A or reading glasses over contact lenses. The eyewear detector112is thus, in one embodiment, arranged to determine the presence of one or more eyewears210. The presence of one eyewear210may be determined in one of the manners disclosed herein, while the presence of another eyewear210A may be determined in another of the manners disclosed herein. The controller may thus be arranged to receive two identities of eyewear from the eyewear detector112, and to adapt the (graphical) user interface105accordingly. In one embodiment a combination of two or more eye wears would be considered to be an eye wear of its own.

In one embodiment, the user interface105is adapted according to a combined identity for which a stored setting is available. In an alternative or additional embodiment, the user interface105is adapted according to a combination of stored settings that are available for the identities.

FIG.4Ashows a schematic view of a visual data presenting system200, such as those ofFIGS.2A,2B,2C and3, wherein the visual data presenting system200comprises a further smart device100B according to herein. The visual data presenting system200ofFIG.4thus comprises a first smart device100A, possibly as inFIGS.2A,2B,2C and3, and a second smart device100B. The second smart device100B may be any type of smart device as discussed in relation toFIGS.1A,1B and1C. In the example ofFIG.4A, the second smart device100B is a smart watch as disclosed in relation toFIG.1C. In the example ofFIG.4A, the first smart device is displaying four graphical objects105A-D. So is the second smart device100B. However, it should be noted that this is only an illustrative example and the first and second smart devices need not display the same graphical objects105A-D.

In the example ofFIG.4A, the first smart device100A determines that eyewear210is present by the eyewear detector112of the first device100A detecting the eyewear210. The eyewear detector112may detect the eyewear through any manner disclosed herein for example through receiving a signal and/or through image analysis. The second smart device100B also determines that eyewear210is present by the eyewear detector112of the second device100B detecting the eyewear210. However, assuming that the eyewear is out of range and/or out of sight for the eyewear detector112of the second smart device100B, the eyewear detector112of the second smart device100B may determine the presence of the eyewear210by receiving a signal thereto from the first smart device100A. This is indicated by the dotted line between the first smart device100A and the second smart device100B inFIG.4A.

The controller101of the first smart device100A is thus configured to transmit a signal indicating the detected or determined presence of eyewear as such presence is determined. The controller101is in one embodiment configured to transmit the signal to other smart devices100(or other devices) that it is paired to, if paired to any. In such an embodiment the controller101is thus configured to determine if the smart device100A is paired to another device, possibly a smart device100, and if so, transmit the signal to the paired device(s). In an alternative or additional embodiment the controller101is in one embodiment configured to transmit the signal to other smart devices100by broadcasting the signal.

In one embodiment, the signal indicates the identity (or type) of the eyewear210for which the presence is determined and the controller of the smart device receiving the signal, in this example the second smart device100B thus adapts the user interface as if the second smart device determined the presence of the eyewear210itself.

In one embodiment, the signal indicates the adaptations to be performed for the determine eyewear, wherein the controller of the smart device receiving the signal, in this example the second smart device100B, thus adapts the user interface as indicated by the signal received from the sending smart device, in this example the first smart device100A. The controller101is thus further configured in such an embodiment, to determine how the (graphical) user interface105of another smart device105is also to be adapted.

The two smart devices100A,100B ofFIG.4Aare thus in a communicative connection with each other. This allows for the user interfaces105of the two (or more) smart devices100to be adapted in a manner so that they supplement each other. For such an embodiment where the controller101of the first smart device100A determines how the user interface105of the second smart device100B is to be adapted, the controller101(simply) adapts the two user interfaces105so that they supplement each other. For an embodiment, where the controller101of the first smart device100A adapts the user interface of the first smart device100A and the controller101of the second smart device100B adapts the user interface of the second smart device100B, the controllers101of the two smart devices may cooperate to generate settings for how to adapt the user interfaces105so that they supplement each other.

As a skilled person would understand the two smart devices100A,100B may also adapt their respective user interfaces independently of one another.

FIG.4Bshows a schematic view of the visual data presenting arrangement system ofFIG.4Awherein the user interfaces105have been adapted according to one embodiment of the teachings herein. As discussed above, in the example ofFIG.4A, the both the first smart device100A and the second smart device100B are displaying four graphical objects105A-D. However, in the example ofFIG.4B, the first smart device100A has adapted its (graphical) user interface105to display two graphical objects105A,105B. The manner in which these graphical objects are displayed has also been adapted as indicated inFIG.4B. The adaptation may be in any manner as disclosed herein. Furthermore, in the example ofFIG.4B, the second smart device100B has also adapted its (graphical) user interface105to display two graphical objects105A,105C. The displayed user interfaces ofFIG.4Bis thus simplified and irrelevant objects may have been removed to more clearly convey important or relevant information more clearly. The manner in which these graphical objects are displayed has also been adapted as indicated inFIG.4B. The adaptation may be in any manner as disclosed herein. In this example, the first smart device100A are assumingly displaying the most used (or other manner of prioritizing objects) first and second graphical objects105A and105B. Assuming that also the third graphical object105C is a prioritized graphical object105, but there is no room for displaying it o the first smart device100A, the teachings taught herein provides for a manner of displaying it still, by adapting the (graphical) user interface105of the second smart device100B so that it supplements the (graphical) user interface105of the first smart device100A. In this example the (graphical) user interface105of the second smart device100B has been adapted to display the third graphical object105C, thereby supplementing the (graphical) user interface105of the first smart device100A. Assuming further that the first graphical object105A is the most prioritized graphical object, the (graphical) user interface105of the second smart device100B has been further adapted to also display the first graphical object105A.

It should be noted that the (graphical) user interface105of the second smart device100B could also have been further adapted to also display the fourth graphical object105D.

The two (or more) smart devices100A and100B are thus configured to adapt their user interfaces individually or to supplement each other. In embodiments where they are arranged to supplement each other, they may be arranged to share the graphical objects to be displayed, or to selectively display graphical objects according to some sort of prioritization in a manner that supplements each other.

As is seen inFIGS.4A and4Bfor example, the user interfaces may be adapted to be simplified by reducing the complexity for the alternative UI (when reading glasses are not worn for example), which could in one embodiment be done by removing irrelevant icons (i.e. the actual notification content might be more or less intact, but irrelevant objects be removed) or by simplifying the message being shown (less text, less information, no or simplified image, etc.). When the complete content is not shown, this could be indicated by a graphical indicator, for example a red border on the display to indicate to the user that there is more information—if the user changes the eyewear setting (e.g. lifting the distance glasses or taking on reading glasses) the user will be enabled to see more info as the user interface may adapt accordingly. Then the user is offered an opportunity in a non-intrusive manner. For example, if the user is swimming, the user might choose to wait or ignore the content. If the user is walking on the street, and the content seems important, the user might stop to put on reading glasses.

In one example one device may be adapted to show graphic content, while another device may be adapted to show textual content. A user may thus chose which content to view by choosing to view a certain device.

As can also be seen in the example ofFIG.4B, the visual data presenting system200may comprise further devices, such as a device220. The further devices220are devices to be paired with one of the smart devices100, and may thus be seen as parts or components of such smart devices. In this example the device220is a headset, for example a Bluetooth™ headset paired with the first smart device100A.

The controller101of the first smart device100A is thus, in one embodiment, configured to adapt the (graphical) user interface105, by adapting the operation of such devices220. The adaptation is in one embodiment achieved by the first smart device100A signaling commands to the device220, the commands to be executed by the device220. InFIG.4Bthis is indicated by the dotted line between the first smart device100A and the device220.

In this example, where the device220is a Bluetooth™ headset, the (graphical) user interface105of the first smart device100A may thus be configured by activating(/deactivating) audio input (and/or output) through the Bluetooth™ headset220. The command may simply be to wake up the Bluetooth™ headset220. In this example, the Bluetooth™ headset220may be seen as part of the audio component115of the smart device100.

As various such devices are commonly known and as they may be seen as part of the smart device they are paired with, they need no further description.

The user interface105is referenced as partially graphical herein (indicated by “graphical” being within parenthesis) as the user interface is mainly graphical—at least the adaptations are mainly to the graphical aspects of the user interface. However, as some of the adaptations are related to using non-graphical parts of the user interface, the user interface is considered to mainly relate to the graphical aspects but also include such components that are adapted to supplement the graphical user interface, such as the audio component.

The identity of the eyewear may be an identifier for the actual eyewear. The identity may alternatively or additional be an indicator of which type of eyewear is determined. For the context of the teachings herein the identifier will be considered an identifier of the corresponding settings to be used for the determined eyewear. For an embodiment wherein the identifier identifies a unique eyewear, the controller may be arranged to adapt the user interface for a user differently depending on exactly which eyewear is being worn.

It should be noted that the adaptation of the (graphical) user interface is not simply changing a font size, but a more complete reworking of the user interface.

FIG.5shows a general flowchart for a method according to the teachings herein. The method corresponds to the operation of the visual data presenting arrangement100as discussed in the above.

Initially an eyewear210may be registered510for the smart device100. If the eyewear is determined520to be new or of a new type (such as a new prescription) settings are received and added525for the eyewear210. The settings may be received through the user interface from the user. Alternatively, the settings may be received from a server or other remote storage. The settings for the eyewear210are stored in the memory102(locally or remotely for later retrieval). A default setting may be used for specific types of eyewear and the registration of the eyewear is thus optional as indicated by the dashed lines.

During use, a change in presence for the eyewear210is determined530by the eyewear detector112. In response thereto the settings are optionally retrieved535(optional as possibly a default setting is already at hand) and the interface of the smart device100is adapted540. As part of the adaptation of the interface, the interface of additional devices (smart or not) may also be adapted as discussed above.

Should a new eyewear presence be determined, the method repeats as indicated by the dashed arrow going from adapting the interface540to the determination of the eyewear presence530.

FIG.6shows a component view for a software component or module arrangement600according to an embodiment of the teachings herein. The software component arrangement600is adapted to be used in a visual data presenting arrangement100as taught herein for providing adaptation of a user interface as taught herein and corresponds to the operation of the visual data presenting arrangement100as discussed in the above. The software component arrangement600comprises a user interface of a visual data presenting arrangement100comprising an image presenting device110arranged to display visual data comprising graphical objects105A-D in a first manner, wherein the software component arrangement600comprises: a software component for receiving610a determination of eyewear210presence from a non-visual eyewear detector112; and a software component for adapting640the user interface of the visual data presenting arrangement100by displaying one or more of the graphical objects105A-D in a second manner in response thereto.

For the context of the teachings herein a software component may be replaced or supplemented by a software module.

FIG.7shows a component view for an arrangement comprising circuitry for presenting visual data700according to an embodiment of the teachings herein. The arrangement comprising circuitry for presenting visual data700is adapted to be used in a visual data presenting arrangement100as taught herein for providing adaptation of a user interface and corresponds to the operation of the visual data presenting arrangement100as discussed in the above. The visual data presenting arrangement700ofFIG.7comprising an image presenting device110arranged to display visual data comprising graphical objects105A-D in a first manner and circuitry for adapting a user interface comprising: circuitry for receiving710a determination of eyewear210presence from a non-visual eyewear detector112; and circuitry for adapting740the user interface of the visual data presenting arrangement100by displaying one or more of the graphical objects105A-D in a second manner in response thereto.

FIG.8shows a schematic view of a computer-readable medium120carrying computer instructions121that when loaded into and executed by a controller of a visual data presenting arrangement100enables the visual data presenting arrangement100to implement the teachings herein.

The computer-readable medium120may be tangible such as a hard drive or a flash memory, for example a USB memory stick or a cloud server. Alternatively, the computer-readable medium120may be intangible such as a signal carrying the computer instructions enabling the computer instructions to be downloaded through a network connection, such as an internet connection.

In the example ofFIG.8, a computer-readable medium120is shown as being a computer disc120carrying computer-readable computer instructions121, being inserted in a computer disc reader122. The computer disc reader122may be part of a cloud server123—or other server—or the computer disc reader may be connected to a cloud server123—or other server. The cloud server123may be part of the internet or at least connected to the internet. The cloud server123may alternatively be connected through a proprietary or dedicated connection. In one example embodiment, the computer instructions are stored at a remote server123and be downloaded to the memory102of the visual data presenting arrangement100for being executed by the controller101.

The computer disc reader122may also or alternatively be connected to (or possibly inserted into) a visual data presenting arrangement100for transferring the computer-readable computer instructions121to a controller of the visual data presenting arrangement100(presumably via a memory of the visual data presenting arrangement100).

FIG.8shows both the situation when a visual data presenting arrangement100receives the computer-readable computer instructions121via a server connection and the situation when another visual data presenting arrangement100receives the computer-readable computer instructions121through a wired interface. This enables for computer-readable computer instructions121being downloaded into a visual data presenting arrangement100thereby enabling the visual data presenting arrangement100to operate according to and implement the invention as disclosed herein.