DISPLAY OPTIMIZATION ASSOCIATED WITH A TRY ON DEVICE FOR VIRTUAL SAMPLING OF A WEARABLE ACCESSORY THERETHROUGH

A method includes capturing, through a video sensor of a try on device, a video frame of a user of the try on device in real-time, and capturing, through another sensor of the try on device, one or more real-time parameter(s) related to an environment of a user of the try on device and the try on device external thereto, and/or a proximity of the user to a display device associated with the try on device. The method also includes modifying, through the try on device and/or a server communicatively coupled to the try on device, a parameter of the display device based on the captured one or more real-time parameter(s) to optimize the capturing of the video frame of the user.

FIELD OF TECHNOLOGY

This disclosure relates generally to try on devices and, more particularly, to a method, a device and/or a system of display optimization associated with a try on device for virtual sampling of a wearable accessory therethrough.

BACKGROUND

A try on device may be a device that enables a user thereof to virtually sample a wearable accessory (e.g., eyewear, jewelry, hats, clothes, belts, watches) on a body part of the user via a display screen of a display device associated therewith. The user may select a particular design of the wearable accessory through a user interface of the try on device. The particular design may not fit the body part of the user properly even though said particular design is highly preferred and desired by the user. Also, an environment of the user and the try on device external and internal thereto may not be suitable for the user to try out another particular design of the wearable accessory through the try on device.

SUMMARY

Disclosed are a method, a device and/or a system of display optimization associated with a try on device for virtual sampling of a wearable accessory therethrough.

In one aspect, a method includes capturing, through a video sensor of a try on device, a video frame of a user of the try on device in real-time. The try on device enables the user to virtually sample a number of designs of a wearable accessory on a body part thereof via a display screen of a display device associated with the try on device. The method also includes capturing, through another sensor of the try on device, one or more real-time parameter(s) related to an environment of a user of the try on device and the try on device external thereto, and/or a proximity of the user to the display device, and modifying, through the try on device and/or a server communicatively coupled to the try on device, a parameter of the display device based on the captured one or more real-time parameter(s) to optimize the capturing of the video frame of the user.

In another aspect, a try on device configured to enable a user to virtually sample a number of designs of a wearable accessory on a body part thereof is disclosed. The try on device includes a memory, a processor communicatively coupled to the memory, a video sensor communicatively coupled to the processor, and another sensor communicatively coupled to the processor. The video sensor is configured to capture a video frame of the user in real-time via a display screen of a display device associated with the try on device. The another sensor is configured to capture one or more real-time parameter(s) related to an environment of the user and the try on device external thereto, and/or a proximity of the user to the display device. The processor is configured to execute instructions to enable, through the try on device and/or a server communicatively coupled thereto, modification of a parameter of the display device based on the captured one or more real-time parameter(s) to optimize the capturing of the video frame of the user.

In yet another aspect, a system includes a try on device configured to enable a user to virtually sample a number of designs of a wearable accessory on a body part thereof, and a server communicatively coupled to the try on device. The try on device includes a video sensor configured to capture a video frame of the user in real-time via a display screen of a display device associated with the try on device, and another sensor configured to capture one or more real-time parameter(s) related to an environment of the user and the try on device external thereto, and/or a proximity of the user to the display device. The server and/or the try on device is configured to modify a parameter of the display device based on the captured one or more real-time parameter(s) to optimize the capturing of the video frame of the user.

The methods and systems disclosed herein may be implemented in any means for achieving various aspects, and may be executed in a form of a machine-readable medium embodying a set of instructions that, when executed by a machine, causes the machine to perform any of the operations disclosed herein.

Other features will be apparent from the accompanying drawings and from the detailed description that follows.

DETAILED DESCRIPTION

Example embodiments, as described below, may be used to provide a method, a device and/or a system of display optimization associated with a try on device for virtual sampling of a wearable accessory therethrough. Although the present embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the various embodiments.

FIG. 1shows an eyewear system100, according to one or more embodiments. In one or more embodiments, eyewear system100may include an eyewear device102communicatively coupled to a server104through a computer network106(e.g., a wired and/or a wireless network, a Local Area Network (LAN), a Wide Area Network (WAN), Internet, a direct connection). In one or more embodiments, eyewear device102may be a smart device including a processor122communicatively coupled to a memory124(e.g., volatile memory and/or non-volatile memory). In one or more embodiments, memory124may include storage locations addressable through processor122.

In one or more embodiments, eyewear device102may enable a customer150(example user) of an entity152(e.g., a business) associated with eyewear device102(e.g., as owner and/or manufacturer of eyewear device102, as a purchaser of eyewear device102) to virtually try out and test eyeglass designs1261-Nstored (e.g., pre-stored) in memory124. For the aforementioned purpose, customer150may stand in front of eyewear device102, and may scroll a list of eyeglass designs1261. N provided thereto through a user interface provided on eyewear device102. Customer150may also select a particular eyeglass design1261-Nthat then is applied onto a real-time video frame thereof on a display for customer150to check for suitability, desirability and/or fit.

FIG. 2shows interaction of customer150with eyewear device102, according to one or more embodiments. In an example scenario, customer150may walk into a store (e.g., that of entity152) and may be guided to eyewear device102by a staff thereof. Eyewear device102may, in one example, include a display screen202of a display device204(display device204may be communicatively coupled to processor122, in one or more embodiments) onto which a real-time video frame206of customer150is rendered. To capture real-time video frame206, eyewear device102may include a video sensor208(e.g., a video camera). Customer150may scroll eyeglass designs1261-Nprovided through a user interface210of eyewear device102, as shown inFIG. 2, and select a particular eyeglass design1261-N(e.g., eyeglass design1261, as shown inFIG. 2).

Upon the selection of eyeglass design1261by customer150, eyewear device102may apply eyeglass design1261onto real-time video frame206to create overlaid real-time video frame212. Overlaid real-time video frame212may be the real-time video frame/image of customer150with the selected eyeglass design1261applied thereto. In one or more embodiments, processor122may have capabilities built therein via software engines (e.g., sets of instructions) to detect a face of customer150and apply the selected eyeglass design1261at appropriate positions thereof. In one or more embodiments, overlaid real-time video frame212may be rendered real-time through display device204. In certain embodiments, display device204may be part of eyewear device102, as shown inFIG. 2, and, in certain other embodiments, display device204may be distinct (e.g., in the case of a television coupled to eyewear device102; here, display screen202may be the screen of the television) from eyewear device102; in the distinct embodiments, display device204may be communicatively coupled (e.g., connected, wired) to eyewear device102.

FIG. 2shows server104communicatively coupled to eyewear device102through computer network106, according to one or more embodiments. In some embodiments, eyewear device102may not be a device with significant computing capabilities. In these embodiments, server104may take care of the face detection of customer150discussed above. Alternately, in one or more other embodiments, eyewear device102may take care of the aforementioned face detection and server104may provide other functionalities (to be discussed below).

As shown inFIG. 2, server104may include a processor252(e.g., one or more microprocessors, a cluster of processors, a distributed network of processors) communicatively coupled to a memory254(e.g., a volatile memory and/or a non-volatile memory). In one or more embodiments, memory254may include an optimization engine256(e.g., a set or sets of instructions) stored therein; said optimization engine256may be configured to be executable through processor252to realize functionalities thereof. It should be noted that all of the functionalities of optimization engine256may additionally or alternately be realized through eyewear device102(e.g., through processor122).

FIG. 3shows optimization engine256, according to one or more embodiments. In one or more embodiments, optimization engine256may include facial detection algorithms302to detect facial features304of customer150in order to apply eyeglass design1261onto real-time video frame206. Again, as discussed above, optimization engine256and/or facial detection algorithms302may be executed by eyewear device102in certain embodiments.FIG. 2shows optimization engine256as part of memory254of server104merely for example purposes. Facial detection algorithms302are well known to one skilled in the art. Detailed discussion thereof has, therefore, been skipped for the sake of convenience, brevity and clarity.

In one or more embodiments, optimization engine256may also include a sensor input processing engine306configured to receive inputs from one or more sensor(s) (e.g., sensor(s)2901-Mincluding video sensor208) of optimization engine256.FIG. 2shows sensor(s)2901-Mas part of eyewear device102. Here, sensor(s)2901-Mmay be shown as interfaced with processor122of eyewear device102. In one or more embodiments, inputs from video sensor208may be received at sensor input processing engine306; as the selection of eyeglass design1261may result in facial detection algorithms302being triggered to enable optimization engine256to overlay eyeglass design1261on real-time video frame206to effect overlaid real-time video frame212, said facial detection algorithms302may be refined (e.g., parameters thereof modified based on video frame inputs from a number of customers (e.g., including customer150)) based on inputs from a number of customers; in other words, sensor input processing engine306may optimize facial detection algorithms302based on customer inputs from video sensor208.

Additionally, in one or more embodiments, optimization engine256may enable scaling of eyeglass designs1261-Nbased on customer inputs from video sensor208. In other words, optimization engine256may modify (e.g., increase and/or decrease) dimensions of eyeglass designs1261-Nbased on real-time video frames (e.g., real-time video frame206) of customers (e.g., including customer150). These functionalities may result in optimization engine256offering more exact superimposition of eyeglass design1261onto real-time video frame206based on increased inputs from a bunch of customers (e.g., including customer150).FIG. 3shows customers3121-Pincluding customer150whose inputs (e.g., inputs from video sensor208) are taken for optimization through optimization engine256.

However, the abovementioned functionalities may not take into account additional factor(s) such as a distance of customer150from display device204, an ambience in which customer150stands (or, sits) in front of eyewear device102to give inputs thereto, an angle at which customer150is positioned in front of eyewear device102/display device204with respect to display screen202and so on. For the aforementioned purpose, in one or more embodiments, sensors2901-Mmay include a light sensor, a proximity sensor and other such types.FIG. 2shows sensor2901as video sensor208, sensor2902as the light sensor and sensor2903as the proximity sensor. It should be noted that exemplary embodiments subsume all scenarios involving video sensor208/sensor2901and at least one other sensor (e.g., sensor2902, the light sensor, and/or sensor2903, the proximity sensor).

FIG. 4shows the functionalities of sensor2902, the light sensor, and sensor2903, the proximity sensor, according to one or more embodiments. Here, sensor2902may be configured to capture a light intensity and/or a light color of an environment402of customer150real-time. In one or more embodiments, environment402may be external to both customer150and eyewear device102. Sensor2903may be configured to capture a distance of customer150from display device204Sensor2903may also be configured to capture an angle of customer150with respect to display screen202of display device204. For example, pixel data of a face of customer150may vary more in intensity across the face compared to a reference data of customer150(or, another customer) whose face is approximately parallel to display screen202. These may help sensor input processing engine306refine eyeglass design1261and/or pixels of real-time video frame206to optimize real-time video frame206.

FIG. 4shows pixel data452(e.g., stored in memory254of server104; not shown inFIG. 2but shown inFIG. 4) of customer150and eyeglass design1261being refined based on distance data454(e.g., distance of customer150from display device204; shown as stored in memory254of server104), angle data456(e.g., angle of customer150with respect to screen; shown as stored in memory254of server104) and/or environment light data458(e.g., a light intensity and/or a light color of environment402; shown as stored in memory254of server104) obtained through sensor2902and sensor2903. It is obvious that exemplary embodiments also cover scenarios where only pixel data452or eyeglass design1261is refined. For example, based on one or more of the additional sensor data (e.g., data from sensor2902and/or sensor2903), pixel data452may be scaled to fit a pre-stored eyeglass design1261. Alternately, pixel data related to eyeglass design1261may be refined based on the one or more of the sensor data discussed above.

It should be noted that the refinement of pixel data452may include modifying a size of an image of customer150in real-time video frame206, modifying one or more pixel characteristic(s) (e.g., pixel intensity, color) of pixel data452, extrapolating pixels to convert an angled image of customer150into an image parallel to display screen202such that eyeglass design1261may be neatly superimposed onto real-time video frame206and so on. Refinement of pixel data related to eyeglass design1261may involve scaling pixels of eyeglass design1261, rotating eyeglass design1261to fit an angled image of customer150, modifying one or more pixel characteristics (e.g., pixel intensity, color) of pixel data relevant to eyeglass design1261and so on. In one or more embodiments, the aforementioned refinement(s) may modify real-time video frame206, eyeglass design1261and/or overlaid real-time video frame212. In other words, a modified version of real-time video frame206may be superimposed with eyeglass design1261, real-time video frame206may be overlaid with a modified version of eyeglass design1261or the modified version of real-time video frame206may be overlaid with the modified version of eyeglass design1261. It should be noted that more complex processing operations are within the scope of the exemplary embodiments discussed herein.

In one or more embodiments, the constant refinement of pixel data452and/or eyeglass design1261may also be fed back as input to optimization engine256(e.g., facial detection algorithms302). In one or more embodiments, a modified version of eyeglass design1261may be stored as an eyeglass design1261-N(e.g., in memory254of server104and/or memory124of eyewear device102); the corresponding pixel data452, distance data454, angle data456and/or environment light data458may be stored (e.g., in memory254of server104and/or memory124of eyewear device102) therewith, as discussed above. Referring back toFIG. 3, optimization engine256may include a decision engine308to which a bunch of personnel are provided access to.

FIG. 5shows communication with decision engine308, according to one or more embodiments. In one or more embodiments, the refined pixel data452and/or the refined eyeglass design1261-Nmay be fed as input to decision engine308. As seen inFIG. 5, decision engine308may be communicatively coupled to a number of client devices5021-Q(e.g., data processing devices such as laptops, desktops, mobile phones, smart devices) through computer network106. One client device5021may be associated with an eyewear designer and another client device5022may be associated with an eyewear manufacturer, as shown inFIG. 5. In one or more embodiments, decision engine308may enable multiple stakeholders take decisions on outputs thereof. For example, the eyewear designer may design new eyewear (e.g., new sizes) based on inputs from decision engine308. The eyewear manufacturer may manufacture said new eyewear directly based on inputs from decision engine308or, alternately, based on communication from the eyewear designer.

In one or more embodiments, decision engine308may increase or decrease outputs from one or more of the above stakeholders, thereby impacting the supply chain (e.g., of which client devices5021-Qmay be part of) in an effective manner and increasing efficiency and accuracy therewithin. Moreover, the real-time inputs from customers3121-Pmay increase “market readiness” of eyeglass designs1261-N. Thus, exemplary embodiments discussed herein may provide for increased efficiency of eyewear system100and optimization therewithin. It should be noted that exemplary embodiments discussed herein are not merely limited to eyewear. Concepts discussed herein are reasonably extensible to other wearable accessories (e.g., jewelry, clothing, belts, hats, watches) with devices that enable customer150to virtually “try on” said wearable accessories; said wearable accessories are wearable on one or more body parts of customer150. Eyewear device102discussed above may be an example of a try-on device that enables customer150to try on eyeglass design1261(can also be extended to contact lens designs).

In one or more embodiments, pixel data452(or, inputs from video sensor208/sensor2901) and/or inputs from sensor2902and sensor2903(to generalize, sensors2902-M; example inputs may be distance data454, angle data456and environment light data458) may also be leveraged through optimization engine256(e.g., implemented through eyewear device102and/or server104) to modify a display control parameter (e.g., resolution, brightness level, addition of display devices and/or switching between display devices in case of display device204including multiple display devices; other display parameters are within the scope of the exemplary embodiments discussed herein) of display device204.

For example, based on distance data454(representing distance of customer150to display screen202/display device204), angle data456(representing an angle at which customer150faces display screen202/display device204; the angle may cause shadows to fall on the face of customer150), environment light data458(representing data relevant to lighting of environment402) and/or pixel data452(e.g., representing a skin tone, a skin color, clothing color (here, pixel data452may take into account features other than facial features of customer150)), optimization engine256may trigger modification of one or more display parameter(s) of display device204by way of modification of a display resolution of display device204, modification of a brightness level of display screen202of display device204, controlling a number of display devices within display device204and/or switching between display devices within display device204. Other forms of modification of display parameter(s) are within the scope of the exemplary embodiments discussed herein.

FIG. 6shows control of display parameters6021-Hof display device204through optimization engine256, according to one or more embodiments.FIG. 6shows display device204as including a number of display devices6041-Z. Obviously, said display devices6041-Zmay be communicatively coupled to processor122of eyewear device102asFIG. 2shows display device204communicatively coupled to processor122.FIG. 6also shows display parameters6021-Hstored in memory124of eyewear device102. In one or more embodiments, display parameters6021-Hmay also be stored in memory254of server104and may be controlled through optimization engine256.

In one or more embodiments, display parameters6021-Hmay represent control of display device204/display devices6041-Zby way of modifying a display resolution thereof, modifying a brightness level of display screen202, controlling a number of display devices6041-Zturned ON and/or switching therebetween. In other words, modifying display parameters6021-Hmay modify a display resolution of display device204, a brightness level of display screen202, control a number of display devices6041-Zturned ON and/or enable switching therebetween. Thus, in one or more embodiments, based on distance data454, angle data456, environment light data458and/or pixel data452, optimization engine256may trigger modification of display parameters6021-H(e.g., even distance between display screen202/display device204and customer150, for example, by way of control of the aforementioned distance through a motor (not shown) associated with display device204) to effect a change in user experience of customer150. In one or more embodiments, the contextual modification of display parameters6021-Hdiscussed above may result in eyeglass designs1261-Nbeing virtually sampled (or, real-time video frame206captured) in optimal conditions (e.g., display parameters6021-Hmay be modified to better suit the distance of customer150to display screen202/display device204, better suit the angle thereof and/or better suit pixel data452), leading to better user experience for customer150. All concepts related toFIGS. 1-5are also applicable to the discussion related toFIG. 6and control of display parameters6021-H.

It should be noted that, in some embodiments, the modification of display parameters6021-Hmay occur seamlessly in real-time. All reasonable variations are within the scope of the exemplary embodiments discussed herein. Also, it should be noted that all operations discussed above may be performed through eyewear device102(e.g., through processor122) and/or server104(e.g., processor252). All advantages of decision engine308and other components discussed above (e.g., with respect toFIGS. 1-5) are applicable acrossFIG. 6and related discussion thereof.

Further, it should be noted that the modification of display parameters6021-Hof display device204discussed above need not involve sensor(s)2902-M. In one or more embodiments, sensor2901or video sensor208alone may suffice for the aforementioned purpose. For example, pixel data452of customer150alone may reflect skin tone, skin color, clothing color and/or other relevant characteristics. As discussed above, in one or more embodiments, pixel data452of captured real-time video frame206may be utilized to effect the modification of display parameters6021-H. In one example scenario, pixel data452may be analyzed to determine display parameters6021-Hmost suited to the clothing color/skin color of customer150extracted therefrom. In one or more embodiments, display parameters6021-Hof display device204may, thus, be modified to optimize user experience (e.g., for virtually sampling one or more eyeglass designs1261-N) of customer150. Additional data capturing through sensors2902-Mand optimization of user experience of customer150based on said additional data capturing may be optional/additional.

Further, instructions associated with optimization engine256may be tangibly embodied in a non-transitory medium (e.g., a Compact Disc (CD), a Digital Video Disc (DVD), a Blu-ray Disc®, a hard drive) readable through a data processing device/system (e.g., eyewear device102, server104, client devices5021-Q) configured to execute the aforementioned instructions. All reasonable implementations and variations therein are within the scope of the exemplary embodiments discussed herein.

FIG. 7shows a process flow diagram detailing the operations involved in display optimization associated with a try on device (e.g., eyewear device102) for virtual sampling of a wearable accessory therethrough, according to one or more embodiments. In one or more embodiments, operation702may involve capturing, through a video sensor (e.g., video sensor208) of the try on device, a video frame (e.g., real-time video frame206) of a user (e.g., customer150) of the try on device in real-time. In one or more embodiments, the try on device may enable the user to virtually sample a number of designs (e.g., eyeglass designs1261-N) of a wearable accessory on a body part thereof via a display screen (e.g., display screen202) of a display device (e.g., display device204) associated with the try on device.

In one or more embodiments, operation704may involve capturing, through another sensor (e.g., a sensor2902-M) of the try on device, one or more real-time parameter(s) related to an environment (e.g., environment402; environment light data458is an example parameter captured) of a user (e.g., customer150) of the try on device and the try on device external thereto and/or a proximity (e.g., distance data454, angle data456) of the user to the display device. In one or more embodiments, operation706may then involve modifying, through the try on device and/or a server communicatively coupled to the try on device, a parameter (e.g., display parameters6021-H) of the display device based on the captured one or more real-time parameter(s) to optimize the capturing of the video frame of the user.

In addition, it will be appreciated that the various operations, processes, and methods disclosed herein may be embodied in a machine-readable medium and/or a machine accessible medium compatible with a data processing system (e.g., eyewear device102, server104, client devices5021-Q). Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.