Patent Description:
Skin imaging methods have been widely used to study different phenotypes of skin aging. Numerous image analysis techniques and algorithms have been proposed in literature to characterize aging skin particularly focusing on aging phenotypes such as wrinkles, spots and sagging. It is known that appearance of skin aging related phenotypes is a continuous process over time. For example, uneven pigmentation may first cause visually imperceivable spots, which eventually may become visible over time. As such, a younger consumer (e.g., less than <NUM> years of age) generally does not have classic visible skin aging related phenotypes and therefore has the impression that there are no pressing needs to prevent, delay, and/or mitigate such visibly imperceivable phenotypes of aging, until it is too late.

<CIT> ("the '<NUM> Publication") relates to a skin color evaluation method for evaluating skin color from an input image including a face region. The '<NUM> Publication describes dividing a face region of the image into predetermined regions according to first feature points formed of at least <NUM> areas that are set beforehand and second feature points that are set by using the first feature points. The '<NUM> Publication further describes performing a skin color distribution evaluation by generating a skin color distribution based on average values using at least one of L*, a*, b*, Cab*, and hab of a L*a*b* color system, tri-stimulus values X, Y, Z of an XYZ color system and the values of RGB, hue H, lightness V, chroma C, melanin amount, and hemoglobin amount, followed by performing evaluation based on measured results with respect to the regions that are divided and displaying the measured results or evaluation results on a screen. However, the '<NUM> Publication is focusing on visible skin color distribution and it fails to describe skin aging related phenotypes, and therefore does not describe any method for evaluating visually imperceivable skin aging related phenotypes.

Document <CIT> discloses a method of obtaining a measurement of the extent of telangectasia in an area of skin. Initially an image of an area of skin to be analyzed is obtained. The obtained image is then processed to determine blood distribution data indicative of the distribution of blood in an imaged area of skin. This blood distribution data is then converted using a Discrete Fourier Transform and the converted blood distribution data is then processed to obtain a measurement of the extent features in a determined distribution of blood correspond to structures of a predetermined size. The obtained measurement of the extent of telangectasia can then be combined with other measurements of the effects of photo-damage such as measurements of melanin disorder and collagen degradation to obtain a measurement of the extent of photo-damage.

Document <CIT> discloses systems, methods, apparatuses and program products for analyzing and/or monitoring the condition of skin. Various embodiments provide for accessing images of the skin, analyzing the characteristics of skin conditions as represented by the images, and providing outputs useful for analyzing and/or monitoring conditions of the skin. Certain embodiments provide for automated analysis of skin conditions such as moles and/or wrinkles. The automated analysis may include for example characterization of a skin condition and comparison to similar skin conditions of a patient or of other patients.

Document <CIT> discloses a method for easily and accurately discriminating a skin by finding skin property values usable for the discrimination of the skin and its treatment means and to allow anyone to easily, objectively and quantitatively discriminate the skin by providing a method for evaluating the beauty of the skin especially, and a device and a program for executing it. This skin discrimination method is characterized in evaluating the beauty of the skin using an entropy of the distribution of the skin property values as an index.

Accordingly, there is a need for a method for determining cosmetic skin attributes of a person so as to enable pro-active skincare treatment at an earlier stage, which method is more advanced than the known methods.

The present invention relates to a method in accordance with claim <NUM>. Dependent claims <NUM> to <NUM> define further elaborations.

The present invention also relates to an apparatus in accordance with claim <NUM>.

It is known that when the skin is subjected to stress (caused by UV, aging, mental, environmental factors), skin will be damaged at various levels including DNA level, cellular level and tissue level. Such damages to the skin can result in skin imperfections. Presence of these skin imperfections significantly impact on optics of the skin such as described in the following examples:.

The above skin imperfections manifest as visually imperceivable signals of poor skin quality to the consumers eye. Consumers may consider these imperfections as impurities at a subconscious level, but are not able to take action to improve the imperfections because of lack of conscious knowledge. If the skin is subject to chronic stress and/or untreated, these visually imperceivable impurities may eventually lead to visible and perceivable phenotypes (pigmented spots, wrinkles, sagging).

The present invention relates to a method, apparatus and system for determining at least one cosmetic skin attribute of a subject and a graphical user interface. The method comprises the steps as provided by claim <NUM>.

It has been surprisingly found that entropy values obtained by analyzing a color channel image comprising at least one portion of skin of a person can be used determine cosmetic skin attributes that are visually perceivable as well as visually imperceivable cosmetic skin attributes.

As explained below, if a cosmetic skin attribute of a person can be determined based on an entropy value that is obtained by analyzing a color channel image comprising at least one portion of skin of a person using entropy statistics, useful information can be inferred (e.g. condition of the cosmetic skin attribute) so that the person can seek proactive skincare treatment to improve the condition of the cosmetic skin attribute. Specifically, as described hereinafter, a color channel image having at least one portion of skin of a person may have a region of interest on the at least one portion of skin that is having a lower entropy value relative to other regions of interest. A lower entropy value in the region of interest shows less intensity variation which is indicative of a better cosmetic skin attribute condition. Accordingly, a higher entropy value in other regions of interest show more intensity variation which is indicative of a poorer cosmetic skin attribute condition. A further advantage is that the proactive skincare treatment can be targeted to a specific region of interest.

Prior to describing the present invention in detail, the following terms are defined and terms not defined should be given their ordinary meaning as understood by a skilled person in the relevant art.

"Entropy" as used herein refers to a Shannon entropy (E) of a discrete random distribution (p(x)) and is defined by the following equation: <MAT> wherein p(x) is the distribution of grey levels
E(p) represents the amount of information in a digital image or a color channel image in a color system after conversion of the digital image to the color channel image. "Entropy statistics" as used herein refers to a statistical method that uses entropy as a descriptive statistic for analysing digital images or color channel images. In a non-limiting example wherein the digital image is an RGB image, entropies (entropy values) for each R (red), G(green) and B(blue) channel can be calculated separately. The entropy value of an image can be calculated by calculating at each pixel position (i,j) the entropy value of the pixel-values within a <NUM>-dimensional region centered at (i,j). The <NUM>-dimensional region may be a part of a color channel image. Programming software packages such as Python may be used to calculate the entropy value.

"Cosmetic skin attribute" as used herein includes all skin attributes that provide a visual/aesthetic effect on an area of the human body or impact skin appearance and/or feel. Some non-limiting examples of a cosmetic skin attribute may include skin purity, skin age, skin topography, skin tone, skin pigmentation, skin pores, skin inflammation, skin hydration, skin sebum level, acne, moles, skin radiance, skin shine, skin dullness, uneven tone, or skin barrier. It will be appreciated by a skilled person that the above cosmetic skin attributes are standard terms, and a corresponding definition of the cosmetic skin attribute may be found in the following published references namely, "<NPL>", "<NPL>", "<NPL>". Cosmetic skin attributes do not include skin attributes related to medical conditions or underlying medical conditions.

"Imperceivable cosmetic skin attribute" as used herein refers to a cosmetic skin attribute that cannot be perceived or is imperceptible by the perceiver, i.e. a person, a user, or a human subject. Perceive derives from the word "Perception" which refers to the organization, identification, and interpretation of sensory information in order to represent and understand the presented information, or the environment. All perception involves signals that go through the nervous system, which in turn result from physical or chemical stimulation of the sensory system. For example, vision involves light striking the retina of the eye, smell is mediated by odor molecules, and hearing involves pressure waves. Perception is not only the passive receipt of these signals, but it is also shaped by the recipient's learning, memory, expectation, and attention. Perception can be split into two processes, i.e. process (<NUM>) that relates to processing the sensory input, which transforms these low-level information to higher-level information (e.g., extracts shapes for object recognition), and process (<NUM>) that relates processing which is connected with a person's concepts and expectations (or knowledge), restorative and selective mechanisms (such as attention) that influence perception. For example, a perceiver may see an object in process (<NUM>) but does not have the knowledge to perceive and recognize what the object represents/mean in process (<NUM>), and therefore may regard the object to be visually imperceivable.

"Visually imperceivable cosmetic skin attribute" as used herein includes all cosmetic skin attributes which are not detectable by an unaided eye or a cosmetic skin attribute detectable visually by a consumer but the consumer does not understand the cosmetic skin attribute, and therefore regarded as imperceivable cosmetic skin attributes. Some nonlimiting examples of a visually imperceivable cosmetic skin attribute that is not detectable visually by the unaided eye include cosmetic skin inflammation, skin sebum level, or any underlying cosmetic skin attribute.

"Unaided" as used herein means without assistance from diagnostic equipment.

"Tile" as used herein includes an unit, such as for example a pixel, that form a part of a digital image and accordingly "Tiles" form the whole of the digital image.

"Digital image data" as used herein includes image data obtained from an image obtaining device including but not limited to a digital camera, a photo scanner, a computer readable storage medium capable of storing digital images, and any electronic device including picture taking capabilities. Digital image data may also include color channel images which are converted from a RGB image into a color channel image in a color system.

"Single degree of indicium" as used herein includes all electronic visual representations including but not limited to a graphical symbol, a numerical value, a color code, illumination techniques and combinations thereof.

"Skin Attribute Index" as used herein refers to a score that can be calculated based on a mathematical formula or a model derived from statistical methods and data or a lookup table (an array of information). The Skin Attribute Index may be generated as a probability value indicative of a condition of the cosmetic skin attribute of the at least one portion of skin of the person relative to a defined population of people, preferably the Skin Attribute Index is generated as a function of the entropy value defined by F(Entropy Value), wherein said function is determined by a model established upon a training dataset wherein the training dataset comprises: (i) a plurality of color channel images of a the defined population of people, wherein each of the plurality of color channel images comprises facial skin of a person in the defined population of people, wherein the facial skin comprises the cosmetic skin attribute; (ii) an associated class definition based on the cosmetic skin attribute.

"L*a*b*" as used herein, refers to the commonly recognized color space specified by the International Commission on Illumination ("CIE"). The three coordinates represent (i) the lightness of the color (i.e., L*=<NUM> yields black and L*=<NUM> indicates diffuse white), (ii) the position of the color between magenta and green (i.e. negative a*values indicate green while positive a*values indicate magenta) and (iii) the position of the color between yellow and blue (i.e. negative b* values indicate blue and positive b* values indicate yellow).

"Chromophore mapping" as used herein, refers to the commonly recognized chromophore space for melanin and hemoglobin mapping and determining melanin or hemoglobin concentration which may be used as an indicator of overall skin tone. Mean melanin or hemoglobin may be calculated from the chromophore map data. Additionally, skin tone evenness can be determined by melanin or hemoglobin evenness (e.g. standard deviation) which also may be calculated from the chromophore map data.

"Skin purity" as used herein, appearance of the absence of skin imperfections in at least of portion of skin of a person. The skin imperfections include cosmetic skin attributes which impact irregular or non-uniform spectral properties composed of the surface reflection of the skin topographical morphology and/or the sub-surface reflection of skin chromophores such as melanin, haemoglobin and/or keratinocyte and fibroblast oriented cellular metabolites, and include but are not limited to skin radiance, skin tone or the like.

"Skin age" as used herein, means apparent age which refers to the age of skin of a person that is visually estimated or perceived to be, compared to norm age skin appearances, based on the physical appearances, preferably a face of the person, preferably at least a portion of a face of the person, more preferably, at least one region of interest (ROI) of the at least a portion of a face of the person, even more preferably, the at least one ROI is selected from the group consisting of: a skin region around the eye ("eye region"), a skin region around the cheek ("cheek region"), a skin region around the mouth ("mouth region"), and combinations thereof.

"Skin tone" as used herein, generally refers to the overall appearance of basal skin color or color evenness. Skin tone is typically characterized over a larger area of the skin. The area may be more than <NUM> mm2, but larger areas are envisioned such as the entirety of the facial skin or other bodily skin surfaces (e.g. arms, legs, back, hands, neck).

"Skin wrinkle" as used herein, generally refers to a fold, ridge or crease in the skin and includes but is not limited to fine lines, super fine lines, fine wrinkles, super fine wrinkles, wrinkles, lines. Skin wrinkle may be measured in terms of, for example, density and/or length.

"Skin radiance" as used herein, generally refers to an amount of light that the skin reflects, and may be referred to as skin shine.

"Skin texture" as used herein, generally refers to the topology or roughness of the skin surface.

"Skin tension" as used herein, generally refers to the firmness or elasticity of the skin.

"Skin sebum level" as used herein, generally refers to an amount of sebum which is an oily or waxy matter secreted by ssebaceous glands in the skin.

"Skin spots" as used herein, generally refers discoloration or uneven pigmentation (e.g. hyperpigmentation, blotchiness) of the skin. Skin spots may be evaluated in terms of, e.g. density, size, and/or degree of discoloration.

"Skin care product" as used herein, refers to a product that includes a skin care active and regulates and/or improves skin condition.

"Digital image" as used herein, refers to a digital image formed by pixels in an imaging system including but not limited to standard RGB, or the like and under images obtained under different lighting conditions and/or modes. Non-limiting examples of a digital image include color images (RGB), monochrome images, video, multispectral image, hyperspectral image or the like. Non-limiting light conditions include white light, blue light, UV light, IR light, light in a specific wavelength, such as for example light source emitting lights from <NUM> to <NUM>, from <NUM> to <NUM>, from <NUM> to <NUM> or different combinations of the upper and lower limits described above or combinations of any integer in the ranges listed above. The digital image may be obtained from an image obtaining device including but not limited to a digital camera, a photo scanner, a computer readable storage medium capable of storing digital images, and any electronic device including picture taking capabilities.

In the following description, the method described is a method for determining a cosmetic skin attribute. According, the apparatus described is an apparatus for determining a cosmetic skin attribute. The apparatus may also be configured for generating for display, on a display, entropy statistics of digital image data of at least a portion of a face of a subject, and the graphical user interface described is a graphical user interface for displaying entropy statistics of the digital image data of at least a portion of a face of the subject. The system described is an entropy-based system for determining a cosmetic skin attribute. In an exemplary embodiment, the system is a stand-alone imaging system (shown in <FIG>) that is located at a retail cosmetics counter for the purpose of analyzing and recommending cosmetic and skin care products. However, it is contemplated that the system and the method may be configured for use anywhere, such as for example as shown in <FIG>, through an electronic portable device comprising an image obtaining unit/device and a display, wherein the electronic portable device is connected to an apparatus for generating for display on a display, a graphical user interface for visualizing entropy value of a cosmetic skin attribute through a network.

<FIG> is a schematic diagram illustrating a system <NUM> for visualizing a cosmetic skin attribute according to the present invention. The system <NUM> may include a network <NUM>, which may be embodied as a wide area network (such as a mobile telephone network, a public switched telephone network, a satellite network, the internet, etc.), a local area network (such as wireless-fidelity, Wi-Max, ZigBee™, Bluetooth™, etc.), and/or other forms of networking capabilities. Coupled to the network <NUM> are a portable electronic device <NUM>, and an apparatus <NUM> for generating for display on a display, a graphical user interface for visualizing a cosmetic skin attribute. The apparatus <NUM> is remotely located and connected to the portable electronic device through the network <NUM>. The portable electronic device <NUM> may be a mobile telephone, a tablet, a laptop, a personal digital assistant and/or other computing device configured for capturing, storing, and/or transferring a digital image such as a digital photograph. Accordingly, the portable electronic device <NUM> may include an input device 12a for receiving a user input, an image obtaining device <NUM> such as a digital camera for obtaining images and an output device 12b for displaying the images. The portable electronic device <NUM> may also be configured for communicating with other computing devices via the network <NUM>. The portable electronic device <NUM> may further comprise an image processing device (not shown) coupled with said imaging obtaining device <NUM> for analyzing the obtained at least one color channel image using entropy statistics to obtain an entropy value and determining the cosmetic skin attribute of the at least one portion of skin of the person based on the entropy value. The image processing device preferably comprises a processor with computer-executable instructions. The portable electronic device <NUM> may further comprise a display generating unit (not shown, such as an electronic LED/LCD display) for generating a display to display content data describing the determined cosmetic skin attribute.

The apparatus <NUM> may include a non-transitory computer readable storage medium 14a (hereinafter "storage medium"), which stores image obtaining logic 144a, image analysis logic 144a and graphical user interface (hereinafter "GUI") logic 144c. The storage medium 14a may comprise random access memory (such as SRAM, DRAM, etc.), read only memory (ROM), registers, and/or other forms of computing storage hardware. The image obtaining logic 144a, image analysis logic 144b and the GUI logic 144c define computer executable instructions. A processor 14b is coupled to the storage medium 14a, wherein the processor 14b is configured to, based on the computer executable instructions, for implementing a method <NUM> for determining a cosmetic skin attribute of a subject according to the present invention as described herein after with respect to the block diagram of <FIG> and the flowchart of <FIG>. The cosmetic skin attribute may be a visually imperceivable cosmetic skin attribute, wherein the visually imperceivable cosmetic skin attribute is a cosmetic skin attribute which is not detectable by an unaided eye, or a cosmetic skin attribute detectable visually by a consumer but the consumer does not understand the cosmetic skin attribute. An advantage of determining visually imperceivable cosmetic skin attributes is to enable consumers to make informed decisions and take pro-active action to improve the condition of the visually imperceivable cosmetic skin attributes.

Referring to <FIG>, when the processor 14b is initiated, the processor 14b causes at least one color channel image <NUM> comprising at least one portion of skin of the person to be obtained in step <NUM>, e.g. via conversion of a digital image into a color channel image in a color system which will be described hereinafter with reference to <FIG>. The at least one color channel image <NUM> is analyzed in step <NUM> using entropy statistics to obtain an analysis output <NUM> wherein the analysis output <NUM> comprises an entropy value. In step <NUM>, the cosmetic skin attribute of the at least one portion of skin of the person is determined based on the entropy value. At least one color channel image may be an image in a color system selected from the group consisting of L*a*b* color system, RGB color system, HSL/HSV color system, and CMYK color system.

Table <NUM> below sets out each entropy value with a corresponding color channel image and corresponding cosmetic skin attributes to be determined based on the entropy value. The color channel image described in Table <NUM> is an image in the L*a*b* color system selected from the group consisting of a L channel image, an a-channel image, a b-channel image, a c-channel image, and combinations thereof.

Determining the cosmetic skin attribute may comprise generating a Skin Attribute Index as a probability value indicative of a condition of the cosmetic skin attribute of the at least one portion of skin of the person relative to a defined population of people. Specifically, in a visual perception study, consumers may be asked to rank digital images (e.g. photographs) of the defined population of people for a cosmetic skin attribute based on a predetermined scale. The ranked digital images may be stored as a database so as to be analyzed according to the method <NUM> to determine an entropy value that has the highest correlation with the cosmetic skin attribute.

In accordance with the present invention, the Skin Attribute Index is generated as a function of the entropy value defined by a function, F(Entropy Value), wherein said function is determined by a model established upon a training dataset. The training dataset comprises: (i) a plurality of color channel images of a defined population of people, wherein each of the plurality of color channel images comprises facial skin of a person in the defined population of people, wherein the facial skin comprises the cosmetic skin attribute; (ii) an associated class definition based on the cosmetic skin attribute. Techniques for building training datasets are known to a person skilled in the field of image processing methods and will not be further described.

The model may be a regression model or a classification model, preferably a linear regression model, more preferably a machine learning linear regression model, most preferably a machine learning support vector regression (SVR) model. The SVR model is a specific example of a Support Vector Machine (SVM) model. A machine learning model may also be a support vector classification model or a random forest regression model.

Using a SVR model enables the advantages of accuracy, reproducibility, speed in the performance of the method when implemented as a native application on a portable electronic device. In particular, the weight of a SVR model allows the native application to have a smaller hardware footprint, and consequently the methods according to the present invention may be easily deployed in portable electronic devices such as mobile phones with mobile phone operating systems (OS) including but not limited to iOS for the Apple™ phone or Android OS for Android phones.

The classification model may be used to classify consumers into a plurality of groups, each group having different degrees of a condition of the same cosmetic skin attribute, preferably two groups, more preferably three groups so as to define an associated class definition based on the numerical value of the Skin Attribute Index. For example, the method may display a heat map configured to classify regions of the skin into a high level of a cosmetic skin attribute condition or a low level of a cosmetic skin attribute condition based on thresholds assigned to each of the groups.

The the at least one color channel image are images selected from the group consisting of a L color channel image, an a-channel image, a b-channel image from the L*a*b* color system and a blue-channel image from the RGB color system and wherein the entropy values are selected from the group consisting of a L-entropy value, an a-entropy value, and a b-entropy value, from the L*a*b* channel images, and a c-entropy value from the blue-channel image; and wherein the function has the following formula: <MAT> wherein A, B, C, D, and E are constants; wherein at least one of B, C, D, and E is not <NUM>.

It will be appreciated that the constants A, B, C, D, and E may vary based on the size and content of the training dataset, and may be any numerical value generated by the model based on the training dataset.

Specifically, each one of the entropy values above may be used alone or in combination with another one of the entropy values. For example using a single entropy value may result in faster computing speed which enables small devices with very basic hardware to be used, thereby resulting in a more efficient and cost effective product.

The at least one color channel image may be a L channel image; wherein the entropy value is a L-entropy value; wherein C, D, E each has a value of <NUM>; and wherein the generated Skin Attribute Index is indicative of skin purity, skin tone or skin radiance.

The above skin imperfections manifest as imperceivable signals of skin quality to the consumers eye. Consumers may consider these imperfections as impurities, but are not able to take action to improve the imperfections because of lack of knowledge. If the skin is subject to chronic stress and/or untreated, these imperceivable impurities may eventually lead to visible and perceivable phenotypes (pigmented spots, wrinkles, sagging).

It has been surprisingly found that a L-entropy value of a L color channel image has the highest correlation to skin purity.

A technical effect of selecting L-channel image as the at least one color channel image for a analyzing step to obtain a L-entropy value and to determine skin purity based on the L-entropy value according to methods according to the present invention is because L-entropy value has the highest correlation (r = <NUM>) to skin purity relative to other entropy values based on analyzing the color channel images. Below is data generated based on correlation with results from a visual perception study using statistical analysis using Pearson correlation coefficient (r). The correlation results are shown below in Table <NUM> below.

A higher Pearson correlation coefficient (r) means that the entropy value is a factor that contributes more to the condition of the cosmetic skin attribute that is studied in the visual perception study. Specifically, the visual perception study is conducted based on a predetermined number of panelists = <NUM>, age of the panelists = <NUM>-<NUM>. The panelists are asked rank photographs of people for skin purity (as an example of the cosmetic skin attribute) on a scale of <NUM> to <NUM>. Based on the visual perception study results and above correlation results, it has been found that L channel entropy value of the filtered image (by frequency filter) has the highest correlation with the skin purity attribute. Therefore, use of the L-entropy value of the L channel to determine skin purity of at least a portion of skin of a person in a digital image can be used to transform skin purity from a visually imperceivable cosmetic skin attribute into an explainable cosmetic skin attribute in a consumer relevant way to consumers.

The at least one color channel image may be an a-channel image; wherein the entropy value is an a-entropy value; wherein B, D, E each has a value of <NUM>; and wherein the generated Skin Attribute Index is indicative of skin inflammation.

The at least one color channel image may be a b-channel image; wherein the entropy value is a b-entropy value; wherein B, C, E each has a value of <NUM>; and wherein the generated Skin Attribute Index is indicative of skin pigmentation or skin dullness.

The at least one color channel image may be a c-channel image; wherein the entropy value is a c-entropy value; wherein B, C, D each has a value of <NUM>; and wherein the generated Skin Attribute Index is indicative of skin topography, which is preferably selected from the group consisting of: pores, fine lines, wrinkles, sagging, skin elasticity, and combinations thereof.

The color channel image 60a, 60b, 60c may be obtained from a digital image <NUM> as described hereinafter with reference to FIGS. 5A, 5B, 5C and <FIG>. Referring to <FIG>, the network <NUM> may be used to acquire digital images from the portable electronic device <NUM> and transmitting the digital images to the apparatus <NUM> to be used in a method <NUM> for determining a cosmetic skin attribute according to the present invention. The input device 12a may be coupled to or integral with the portable electronic device <NUM> for receiving a user input for initiating the processor 14b. The portable electronic device <NUM> may comprise an output device 12b for displaying the plurality of tiles, each having uniquely assigned single degree of indicium. The input device 12a may include but is not limited to a mouse, a touch screen display, or the like.

Referring to <FIG>, 5A and <FIG>, when the processor 14b is initiated, the processor 14b causes a digital image <NUM> of at least a portion of a face of the subject to be obtained, e.g. via image obtaining logic 144a in step <NUM>. The obtained digital image <NUM> may be a RGB XP digital image or a RGB shine digital image. The digital image <NUM> in RGB system is converted from an RGB image to a digital image data, such as a color channel image in a different color system. The processor 14b further causes at least one color channel image 60a, 60b, 60c to be extracted, e.g. via image analysis logic 144b, from the obtained digital image <NUM> in step <NUM>. The at least one color channel may be a color channel image that is obtained by further processing of RGB color channels based on an equation, for example, <NUM>. 1R + <NUM> + <NUM>. The at least one color channel image 60a, 60b, 60c may be selected from any one of color channels 60a, 60b, 60c in a color system. In step <NUM>, the extracted at least one color channel image 60a, 60b, 60c is filtered using a frequency filter. The filtered at least one color channel image 61a, 61b, 61c is analysed using entropy statistics in step <NUM> to determine the cosmetic skin attribute of the person. Use of a frequency filter in step <NUM> removes noise from the extracted at least one color channel image 60a, which increases sensitivity of the analysis in step <NUM>, thereby resulting in higher accuracy in an analysis output from step <NUM> relative to analysing a non-filtered color channel image. However, analysing a non-filtered color channel image may be advantageous to reduce usage in computing hardware, such as reducing hardware footprint, data storage space or processing capability in the event that only very minimal and basic hardware is available for implementing the methods according to the present invention.

Optionally, the method <NUM> may further comprise applying an image correction factor to the filtered color channel for optimizing parameters in the filtered color channel prior to analyzing the filtered color channel. The parameters may include illumination correction, blur correction, rotation correction or the like.

A technical effect of determining at least one skin attribute using the method <NUM>, <NUM> according to the present invention is that it provides quick and accurate analysis of the cosmetic skin attributes. Table <NUM> below describes an age correlation with commonly used imaging end points and the correlation for entropy statistics have a better correlation (<NUM>) relative to the other imaging end points. Imaging end points may also be described as imaging methods for analyzing skin features.

The method <NUM>, <NUM> may be performed in less than <NUM> seconds, preferably from <NUM> second to <NUM> seconds, more preferably from <NUM> seconds to <NUM> second, or different combinations of the upper and lower limits described above or combinations of any integer in the ranges listed above. As the method <NUM>, <NUM> can be performed in less than <NUM> second, the method <NUM> may be implemented in commercially available hardware such as a portable handheld electronic device including but not limited to a mobile phone which is commercially advantageous because of its scalability to a wider network of consumers.

The color system may be an L*a*b color system and the at least one color channel image may be a red color channel 60a, a yellow color channel 60b or a blue color channel 60c corresponding a texture channel as shown in FIG. 5C shows the filtered color channel images 61a, 61b, 61c, each filtered color channel image is analyzed to obtain entropy values describing the analyzed color channel image. An entropy value of the filtered red color channel 61a may be defined as a-entropy, an entropy value of the filtered yellow color channel 61b may be defined as b-entropy and an entropy value of the filtered blue color channel 61c may be defined as c-entropy.

The color system may be a chromophore mapping space as described hereinbefore and the at least one color channel image may be a hemoglobin channel image or a melanin channel image.

The frequency filter may be a Fast Fourier transformation filter, a Wavelet transformation filter or a Difference of Gaussian (DoG) filter. More preferably, the frequency filter is a DoG filter. The DoG filter has a Gaussian filter <NUM> and a Gaussian filter <NUM>. The Gaussian filter <NUM> may comprise a standard deviation from <NUM> to <NUM>, from <NUM> to <NUM>, from <NUM> to <NUM>, different combinations of the upper and lower limits described above or combinations of any integer in the ranges listed above. The Gaussian filter <NUM> may comprise a standard deviation from <NUM> to <NUM>, from <NUM> to <NUM>, from <NUM> to <NUM>, different combinations of the upper and lower limits described above or combinations of any integer in the ranges listed above. Non-limiting examples of combinations of Gaussian filter <NUM> and Gaussian filter <NUM> of the DoG filter are described in Table <NUM> below.

The output device 12b may include but is not limited to a touch screen display, a non-touch screen display, a printer, a projector for projecting the plurality of tiles each having uniquely assigned single degree of indicium on a display surface such as for example a mirror as described hereinafter with respect to <FIG>.

<FIG> is a perspective view of the system <NUM> configured as a stand-alone imaging system that is located at a retail cosmetics counter for the purpose of visualizing at least one cosmetic skin attribute and recommending cosmetic and skin care products based on the visualized at least one cosmetic skin attribute. <FIG> is a block diagram of the system <NUM> of <FIG>. Referring to <FIG>, the system <NUM> comprises a housing <NUM> for the apparatus <NUM> of <FIG> connected to an image obtaining device <NUM> for acquiring a digital image of a subject for visualizing at least one cosmetic skin attribute. Referring to <FIG>, the system <NUM> may comprise a mirror <NUM>, and the image obtaining device <NUM> may be mounted behind the mirror <NUM> within the housing <NUM> so that the image obtaining device <NUM> may be hidden from view. The image obtaining device <NUM> may be a digital camera, an analog camera connected to a digitizing circuit, a scanner, a video camera or the like. The system <NUM> may include lights <NUM> such as LED lights arranged about the housing <NUM> to form an LED lighting system for assisting in generating a digital image of a subject. The system <NUM> has an input device 112a for receiving a user input. The system <NUM> may further comprise an output device 112b such as a projector configured to receive and project the facial map <NUM> for display on the mirror <NUM>. The projector is not shown in <FIG> as it may be a peripheral component that is separate from the housing <NUM> but coupled to the apparatus <NUM> to form the system <NUM>. The system <NUM> may further comprise a second output device 112c such as one or more speakers optionally coupled to an amplifier for generating audio guidance output to complement and/or enhance an overall consumer experience.

Preferably obtaining at least one color channel may comprise obtaining at least two color channels, more preferably three color channels. In particular, the red color channel, the yellow color channel and the blue color channel may be described as follows. When the red color channel is in the L*a*b* color system, a-entropy is an entropy value of the filtered red color channel. When the yellow color channel is in the L*a*b* color system, b-entropy is an entropy value of the filtered yellow color channel. When the blue color channel corresponds to a texture channel, c-entropy is an entropy value of the blue color channel.

The method <NUM> may further comprise a step of comparing at least one cosmetic attribute to a pre-defined dataset to assign an index. The index may be described as a Skin Attribute Index of the analyzed visually imperceivable consumer skin attribute, wherein the assigning a single degree of indicium uniquely to each tile is based on the assigned index. The plurality of tiles each having a uniquely assigned index may be displayed in a further step after the step of comparing.

The present invention also relates to a method of visualizing entropy statistics or entropy values of at least one cosmetic skin attribute of at least a portion of a face of a subject in a digital image. The method is described with reference to <FIG> which is a series of process flow diagrams illustrating how the entropy values are visualized, and <FIG> is a flow chart of a method <NUM> of visualizing entropy statistics or entropy values of at least one cosmetic skin attribute of at least a portion of a face of a subject in a digital image.

A digital image <NUM> of at least a portion of the face is illustrated in <FIG>. The digital image <NUM> includes an area of the at least a portion of the face <NUM> defined by a boundary line <NUM> and comprises a plurality of tiles <NUM> across the digital image <NUM>, each of the plurality of tiles <NUM> having at least one cosmetic skin attribute analyzed using entropy statistics. An outer periphery <NUM> envelopes the boundary line <NUM> surrounding the first digital image <NUM>. The first digital image <NUM> is formed by a total number of pixels, for example, the first digital image <NUM> may have a number of pixels defining an overall image size of the first digital image <NUM>. For example, if the tile size is set at <NUM> by <NUM> pixels to <NUM> by <NUM> pixels, accordingly, the number of tiles <NUM> that form the plurality of the tiles <NUM> across the first digital image <NUM> will be obtained by dividing the overall image size by the specified tile size. It will be appreciated that a size of the tile <NUM> may be defined by a number of pixels on a horizontal side (tile width, W) and a number of pixels on a vertical side (tile height, H). Each tile may comprise a tile size of not greater than <NUM> by <NUM> pixels, from <NUM> by <NUM> pixels to <NUM> by <NUM> pixels, from <NUM> by <NUM> pixels to <NUM> by <NUM> pixels, from <NUM> by <NUM> pixels to <NUM> pixels by <NUM> pixels, from <NUM> by <NUM> pixels to <NUM> by <NUM> pixels or different combinations of the upper and lower limits described above or combinations of any integer in the ranges listed above. A technical effect of having the tile size in the above ranges is that it enables a shorter processing time for analysis of the image data, and accordingly enable a display to visualize at least one cosmetic skin attribute in a shorter amount of time.

Referring to <FIG>, the method <NUM> comprises receiving the digital image <NUM> in step <NUM> and in step <NUM>, a single degree of indicium <NUM> is assigned uniquely to each tile <NUM> of the defined plurality of tiles based on the analyzed at least one cosmetic skin attribute. At least some of the plurality of tiles, each having uniquely assigned single degree of indicium are displayed in step <NUM> to visualize an entropy value of at least one cosmetic skin attribute as shown in <FIG>.

To explain the way the system <NUM> and the methods <NUM>, <NUM>, <NUM> work to determine and visualize at least one cosmetic skin attribute according to the present invention, it is helpful to understand how a digital image of a face of the subject is obtained in step <NUM>, how the color channel image is extracted from the obtained digital image in step <NUM>, how the extracted at least one color channel image is filtered in step <NUM>, how a single degree of indicium is assigned uniquely to each tile in step <NUM> and how the tiles are displayed in step <NUM>. Accordingly, the steps <NUM>, <NUM>, <NUM>, <NUM> of the method <NUM> according to the present invention and the steps <NUM>, <NUM> and <NUM> of the method <NUM> are described hereinafter as individual processes for performing each step. Each process may also be described as a sub-routine, i.e. a sequence of program instructions that performs a corresponding step according to the methods <NUM>, <NUM> according to the present invention.

The step <NUM> of obtaining digital image according to the method <NUM> according to the present invention is described with reference to <FIG> which is a series of process flow diagrams illustrating how digital image data is obtained from the digital image, and <FIG> is a flow chart of a process <NUM> of obtaining digital image data corresponding to the step <NUM>.

An input image 50a of the face <NUM> is illustrated in <FIG>. The input image 50a may be captured by a user, for example, using the camera <NUM> in a step <NUM> of the process <NUM> as shown in <FIG> illustrates a step <NUM> of cropping the input image 50a to obtain an edited image data 50b which comprises at least a portion of the face. The input image 50a may be cropped by identifying an anchor feature 1a of the face, including but not limited to facial features such as eyes, nose, nostrils, corners of the mouth or the like, and cropping accordingly. While the eye is depicted as the anchor feature 1a as shown in <FIG>, it will be appreciated that this is merely an example and any prominent or detectable facial feature(s) may be an anchor feature. The edited image data 50b may be a first digital image <NUM> that is obtained in step <NUM>. Alternatively, as shown in <FIG>, the edited image data 50b may be further processed by cropping to remove one or more unwanted portions of the input image 50a thereby obtaining the first digital image data <NUM> which includes the at least a portion of the face <NUM> defined by a boundary line <NUM> in step <NUM>. The obtained first digital image <NUM> may comprise at least one region of interest (ROI) <NUM> of the at least a portion of the face <NUM> that is defined by the boundary line <NUM>. The ROI <NUM> may be the entire portion of the face <NUM>, preferably at least a portion of the face, more preferably, one or more skin regions that defines the at least portion of the face <NUM>. Details of how the skin regions are defined are described hereinafter with reference to <FIG>, and the flowchart of <FIG>.

Optionally, the process <NUM> may comprise step <NUM> in which the ROI <NUM> may be selected from the group consisting of: a skin region around the eye ("eye region 2a"), a skin region around the cheek ("cheek region 2b"), a skin region around the mouth ("mouth region 2c"), and combinations thereof, preferably the ROI <NUM> is a part of the at least a portion of the face <NUM> of the subject, more preferably the obtained first digital image data define a left or right side of the face <NUM>. The ROI <NUM> may comprise an area of at least <NUM>%, from <NUM>% to <NUM>%, from <NUM>% to <NUM>% of the obtained first digital image.

<FIG> is a picture illustrating a plurality of tiles <NUM> on the first digital image data <NUM>. <FIG> is a flow chart illustrating a process <NUM> of defining the plurality of tiles <NUM> on the first digital image data <NUM>. Referring to <FIG>, the first digital image <NUM> includes the at least a portion of the face <NUM> defined by a boundary line <NUM> as described hereinbefore with reference to <FIG>. Referring to <FIG>, the process <NUM> comprises defining an outer periphery <NUM> enveloping the boundary line <NUM> surrounding the obtained first digital image (step <NUM>). The obtained first digital image <NUM> is formed by a total number of pixels, for example, the obtained first digital image <NUM> may have a number of pixels which is determined at step <NUM> or step <NUM> depending an image size after cropping of the input image 50a. Accordingly, an overall image size based on the obtained first digital image <NUM> may be defined in step <NUM>. For example, if the tile size is set at <NUM> by <NUM> pixels to <NUM> by <NUM> pixels, accordingly, the number of tiles <NUM> that form the plurality of the tiles <NUM> across the obtained first digital image <NUM> in step <NUM> will be obtained by dividing the overall image size by the specified tile size.

The methods according to the present invention may further comprise a step of generating an image description corresponding to the generated Skin Attribute Index described hereinbefore for visualizing a cosmetic skin condition. The image description may comprise a heat map (such as shown in <FIG>, <FIG>), an aggregate score (such as skin age shown in the fourth area <NUM> in <FIG>, feature <NUM> in <FIG>), and combinations thereof. The aggregate score may be computed based on the generated Skin Attribute Index described hereinbefore.

<FIG> are process flow diagrams illustrating details of a process of displaying a plurality of tiles according to step <NUM> of the method <NUM> of the present invention. <FIG> is a flow chart illustrating a process <NUM> of displaying the plurality of tiles. <FIG> is a picture illustrating a second digital image <NUM> interposed on the first digital image data <NUM>. The second digital image <NUM> includes at least a portion of the face of the subject with displayed plurality of tiles <NUM> each having uniquely assigned single degree of indicium <NUM>. <FIG> illustrates three zones, a first zone <NUM>, a second zone <NUM>, a third zone <NUM> displayed on the obtained first digital image based on the plurality of tiles <NUM> each having uniquely assigned single degree of indicium. Each zone <NUM>, <NUM>, <NUM> identifies a respective region of interest (ROI) <NUM> on the face <NUM> of the subject described hereinbefore with reference to FIGS. 9A to 9C and <FIG>. <FIG> differs from <FIG> in that a boundary line <NUM> and an outer periphery <NUM> is displayed in the second digital image data <NUM> of <FIG> but are not displayed in the second digital image <NUM> of <FIG>. The first zone <NUM> may comprise a first zone line having a first zone colour 110a, the second zone <NUM> may comprise a second zone line having a second zone color 120a and the third zone <NUM> may comprise a third zone line having a third zone color 130a. Based on the analysed image data of the tiles <NUM> in each zone, a color of each zone lines may be different to better visually distinguish the tiles that visualize cosmetic skin attributes which may be in a normal, beautiful, or vulnerable condition relative to the other zones of the subject, such as for example as illustrated in an exemplary user interface of <FIG>.

<FIG> is a flow chart illustrating a process <NUM> of displaying the plurality of tiles in step <NUM> of the method <NUM> according to the present invention. The process <NUM> may begin in step <NUM> in which the processor reads analyzed image data of each tile <NUM> and assigns a single degree of indicum uniquely to each tile <NUM> of the plurality of tiles based on the analyzed at least one visually cosmetic skin attribute of the tile <NUM> (step <NUM>). When the single degree of indicium is illumination, the analyzed image data of each of the tiles may be converted to reflect a corresponding degree of brightness of the illumination at each tile in step <NUM>. In an exemplary example, the zone <NUM> may have a lower degree of illumination at each of the tiles within the zone <NUM> relative to a degree of illumination at each of the tiles within the zone <NUM>. Further, in step <NUM>, the zones may be defined such that the first zone <NUM> may correspond to an eye zone, the second zone <NUM> may correspond to a cheek zone and the third zone <NUM> corresponds to a mouth zone. An average index of the tiles of each zone may be calculated to generate a diagnosis of a skin condition correlating to a displayed cosmetic skin attribute according to the respective zone so as to assign a product recommendation item to the zone for treating the displayed cosmetic skin attribute in the zone. Specifically, the method <NUM> may further comprise displaying at least one product recommendation item to treat the displayed cosmetic skin attribute.

<FIG> are process flow diagrams illustrating a method of visualizing at least one cosmetic skin attribute according to the present invention. <FIG> is a flow chart illustrating a method <NUM> of visualizing at least one cosmetic skin attribute according to the present invention. <FIG> is a color picture illustrating a first digital image of at least a portion of a face of a subject that is displayed in step <NUM> of the method <NUM> of <FIG> is a color picture illustrating a second digital image of at least a portion of a face of a subject and a plurality of tiles each having uniquely assigned single degree of indicium, wherein the second digital image is interposed on the first digital image in step <NUM>. Optionally, the first digital image may be converted into grey scale as shown in <FIG> to provide better contrast between the plurality of tiles each having uniquely assigned single degree of indicium and the first digital image. In step <NUM>, three zones are displayed on the second digital image based on the plurality of tiles each having uniquely assigned single degree of indicium.

<FIG> is a flow chart illustrating a variation of the method <NUM> of visualizing at least one cosmetic skin attribute as illustrated in <FIG>. At least one product recommendation item is displayed in step <NUM> following step <NUM> of the method <NUM> of <FIG>. In step <NUM>, the user is prompted to select to end the method <NUM> and the method <NUM> terminates in step <NUM> if the user selects YES. If the user selects NO, steps of the method <NUM> of <FIG> is performed and the method <NUM> returns to step <NUM>.

The present invention also relates to a human machine user interface (hereinafter "user interface") for providing a product recommendation to treat at least one cosmetic skin attribute. The user interface may be a graphical user interface on a portable electronic apparatus including a touch screen display/display with an input device and an image obtaining device. The user interface may comprise a first area of the touch screen display displaying a first digital image of at least a portion of a face of the subject obtained from the image obtaining device and a second digital image interposed on the first digital image, the second digital image having the at least a portion of a face of the subject and said displayed plurality of tiles each having uniquely assigned single degree of indicium. The user interface may further comprise a second area of the touch screen display different from the first area, the second area displaying a selectable icon for receiving a user input, wherein an image of at least one product recommendation item to treat the displayed cosmetic skin attribute is displayed on the touch screen display if the user activates the selectable icon.

<FIG> are screen shots, each illustrating an exemplary user interface cooperating with each other for visualizing a cosmetic skin attribute according to the present invention. Although <FIG> are described as a series of user interfaces which are provided in a sequential manner in response to a preceding user interface, it will be appreciated that the user interfaces of <FIG> may be programmed in multiple ways to define an overall user interface for visualizing at least one cosmetic skin attribute according to methods according to the present invention as described hereinbefore. Preferably, all the user interfaces of <FIG> define an exemplary user interface for visualizing a cosmetic skin attribute according to the present invention.

<FIG> depicts a user interface <NUM> for receiving a first user input, preferably the first user input is the age of the user. The user interface <NUM> may comprise a first area <NUM> for receiving the first user input. The first area <NUM> may include one or more user input features <NUM> for receiving the first user input. The user input feature <NUM> may be such as for example, a selectable input icon corresponding to a predetermined user feature such as for example a user's age as shown in <FIG>. The user interface <NUM> may further comprise a second area <NUM> including corresponding instructions to the user for providing the first user input. The second area <NUM> may be disposed above the first area <NUM> so as to be provide a more user-friendly interface. The user interface <NUM> may be part of a start option for beginning a method <NUM> according to the present invention.

<FIG> depicts a user interface <NUM> for receiving a second user input, preferably the second user input is a cosmetic skin attribute that is causing concern to the user. The cosmetic skin attribute may be described as a skin concern of the user. The user interface <NUM> may be provided in response to the selection of a first user input from the user input feature <NUM> of <FIG>. The user interface <NUM> may comprise a first area <NUM> for receiving the second user input. The first area <NUM> may include one or more user input features <NUM> for receiving the second user input. The user input feature <NUM> may be such as for example, a selectable input icon corresponding to a predetermined skin concern. The first area <NUM> may further comprise an explanatory area <NUM> corresponding to the one or more input features <NUM> in which the explanatory area <NUM> includes a brief description of a cosmetic skin attribute or the skin concern. The user interface <NUM> may further comprise a second area <NUM> including corresponding instructions to the user for providing the user input. The second area <NUM> may be disposed above the first area <NUM> so as to be provide a more user-friendly interface.

<FIG> depicts a user interface <NUM> for obtaining an input image of a user. The user interface <NUM> may comprise a first area <NUM> with instructions for aligning an anchor feature (such as eyes) so as to obtain the first digital image data according to the process <NUM> as described in <FIG>. The user interface <NUM> may be provided in response to the selection of the second user input through the one or more user input features <NUM> of <FIG>.

<FIG> depicts a user interface <NUM> for displaying at least one cosmetic skin attribute. The user interface <NUM> may be provided after the input image of the user is obtained in the user interface <NUM> of <FIG>. As shown in <FIG>, the at least one portion of skin of the person is facial skin; wherein the facial skin comprises at least one region of interest (ROI), which is preferably selected from the group consisting of cheek region/zone, eye region/zone, forehead region/zone, nose region/zone, and combinations thereof; and wherein the image description visualizes a need for improvement in said at least one ROI or a difference in the cosmetic skin attribute between a first ROI and a second ROI.

The user interface <NUM> may comprise a first area <NUM> displaying the plurality of tiles each having uniquely assigned single degree of indicium to visualize at least one cosmetic skin attribute according to methods of the present invention. The first area <NUM> may display similar features as shown in FIG. 18D but differs only in that lines defining the plurality of tiles may be turned off and/or set as an invisible layer. The first area <NUM> may comprise a first zone <NUM> corresponding to an eye zone of the at least a portion of the face of the user, a second zone <NUM> corresponding to a cheek zone of the at least a portion of the face of the user, and a third zone <NUM> corresponding to a mouth zone of the at least a portion of the face of the user. As shown in <FIG>, a zone result may be displayed in a third area <NUM> whereby the zone result comprises an index which may be generated for each zone based on a relative comparison of the indexes of the zones within the at least a portion of the face of the user. In an exemplary embodiment, depending on the zone results, the first zone <NUM> may be described as a normal/beautiful/vulnerable zone, the second zone <NUM> may be described as a normal/beautiful/vulnerable zone and the third zone <NUM> may be described as a normal/beautiful/vulnerable zone. Preferably, each zone may have different descriptions based on the relative differences in the zone results. The user interface <NUM> also includes a second area <NUM> for receiving a third user input. The second area <NUM> may include one or more user input features <NUM> for receiving the third user input. The user input feature <NUM> may be such as for example, a selectable input icon for proceeding with a next step of the method according to the present invention. Optionally, the user interface <NUM> may comprise a fourth area <NUM> for displaying a skin age of the user based on the analyzed at least one cosmetic skin attribute of each tile of the plurality of tiles based on the obtained first digital image data of the at least a portion of the face of the user.

<FIG> depicts a user interface <NUM> comprising a first area <NUM> for displaying a product recommendation item <NUM>. The user interface <NUM> may be provided in response to selection of the user input feature <NUM> from the user interface <NUM> of <FIG>. Optionally, the user interface <NUM> may comprise a second area <NUM> for providing details of the product recommendation item <NUM>. Preferably, the user interface <NUM> may comprise a third area <NUM> for receiving a fourth user input such as for example request for assistance from a product consultant for enquiry and/or purchase of the product recommendation item <NUM>. The third area <NUM> may include one or more user input features <NUM> for receiving the fourth user input. The user input feature <NUM> may be such as for example, a selectable input icon for proceeding with a next step of the method according to the present invention.

<FIG> depicts a partial view of an exemplary user interface <NUM> comprising an image description <NUM> overlaid on a digital image <NUM> for visualizing at least one cosmetic skin attribute according to the present invention. The image description <NUM> comprises a heat map generated based on the entropy values output from the method <NUM> described hereinbefore. The heat map comprises a first heat map section <NUM> based on low entropy values which correspond to a better cosmetic skin attribute condition. The heat map <NUM> further comprises a second heat map section <NUM> based on high entropy values correspond to a poorer cosmetic skin attribute condition. The first heat map section <NUM> is formed of a first plurality of tiles which is visually different from a second plurality of tiles in the second heat map section <NUM>. For example, the first plurality of tiles is converted to display a different color from the color of the second plurality of tiles. Heat map sections <NUM> which are not displayed (hereinafter "non-displayed heat map sections <NUM>") correspond to entropy values between the high and low entropy values. The heat map sections may be configured as follows to display entropy information related to the cosmetic skin attribute condition and the Skin Attribute Index as outlined in Table <NUM> below.

<FIG> depicts an alternate variation of an image description <NUM> for visualizing at least one cosmetic skin attribute in the user interface <NUM> of <FIG>. The image description <NUM> differs from the image description <NUM> of <FIG> in that the image description <NUM> comprises a displayed region of interest (ROI) <NUM> wherein the displayed ROI <NUM> is converted to display a color to indicate poorer cosmetic skin attribute condition relative to other non-displayed regions of interest (ROI) <NUM> which correspond to better cosmetic skin attribute condition. An advantage of only displaying a single heat map section (see <FIG>) or ROI is that the consumer viewing the user interface is not overloaded with too much visual information.

<FIG> is a screen shot illustrating an exemplary user interface <NUM> for visualizing at least one cosmetic skin attribute according to the present invention, wherein the at least one cosmetic skin attribute is skin purity. The user interface <NUM> differs from the user interface <NUM> of <FIG> in that the user interface <NUM> comprises alternate text <NUM> describing the cosmetic skin attribute and an aggregate score <NUM> based on the generated Skin Attribute Index. The user interface <NUM> may further comprise a meter <NUM> and a meter marker <NUM> for representing the aggregate score on a scale of <NUM> to <NUM> along the meter <NUM>. The meter <NUM> is a different way of visualizing the aggregate score <NUM>, and may be optional. A color of the meter <NUM> may be configured to show a gradient of colors representative of the first heat map section <NUM> and the second heat map section <NUM>.

The methods for determining a cosmetic skin condition according the present invention described hereinbefore may further comprise a step of tracking the cosmetic skin attribute over a predetermined period of time. For example, the user interface <NUM> as shown in <FIG> may comprise a first selectable icon <NUM> which upon selection, causes instructions to be received by and steps performed by the processor to generate a calendar or schedule to create a cosmetic skin attribute diary to track improvement of cosmetic skin attributes. For example, when the consumer uses it on Day <NUM>, the date and facial analysis is recorded and saved in the memory. Subsequently, whenever the consumer uses the method according to the present invention in future (after a predetermined period, <NUM> week, <NUM> month, <NUM> months), the facial skin of the consumer is analyzed again and the consumer can compare how his/her facial skin looks at the time after the predetermined period relative to Day <NUM>. The methods according to the present invention may be configured to be a downloadable software application that is stored as a native application on a portable electronic device or a web application that can be accessed through a login account specific to a consumer, so that the consumer can perform a self-skin analysis based on the methods according to the present invention and view and/or monitor the improvement (reduction in the ROIs with poorer cosmetic skin attribute condition) over a period of time.

Claim 1:
A method of determining a cosmetic skin attribute of a person, the method comprising the steps of:
a) obtaining at least one color channel image (60a; 60b; 60c) comprising at least one portion of skin of the person;
b) analyzing the at least one color channel image using entropy statistics to obtain an entropy value; and
c) determining the cosmetic skin attribute of the at least one portion of skin of the person based on the entropy value;
wherein a Skin Attribute Index is generated as a probability value indicative of a condition of the cosmetic skin attribute of the at least one portion of skin of the person relative to a defined population of people, the Skin Attribute Index is generated as a function of the entropy value defined by F(Entropy Value), wherein said function is determined by a model established upon a training dataset wherein the training dataset comprises: (i) a plurality of color channel images of a the defined population of people, wherein each of the plurality of color channel images comprises facial skin of a person in the defined population of people, wherein the facial skin comprises the cosmetic skin attribute; (ii) an associated class definition based on the cosmetic skin attribute; and
wherein the at least one color channel image (60a; 60b; 60c) are images selected from the group consisting of a L color channel image, an a-channel image, a b-channel image from the L*a*b* color system and a blue-channel image from the RGB color system;
wherein the entropy values are selected from the group consisting of a L-entropy value, an a-entropy value, and a b-entropy value, from the L*a*b* channel images, and a c-entropy value from the blue-channel image; and
wherein the function has the following formula: <MAT> wherein A, B, C, D, and E are constants generated by the model based on the training dataset;
wherein at least one of B, C, D, and E is not <NUM>.