Source: http://www.google.com/patents/US7324668?dq=7,634,557
Timestamp: 2017-09-22 12:48:38
Document Index: 136096921

Matched Legal Cases: ['arts 204', 'art 204', 'art 100', 'art 700', 'Application No. 60', 'Application No. 60']

Patent US7324668 - Feature extraction in beauty analysis - Google Patents
A method of performing a beauty analysis is disclosed. The method comprises receiving information of at least one portion of a subject's external body condition, identifying in the information at least one condition, extracting from the information at least one feature of the at least one condition,...http://www.google.com/patents/US7324668?utm_source=gb-gplus-sharePatent US7324668 - Feature extraction in beauty analysis
Publication number US7324668 B2
Application number US 10/024,495
Also published as EP1297782A1, US20030063801
Publication number 024495, 10024495, US 7324668 B2, US 7324668B2, US-B2-7324668, US7324668 B2, US7324668B2
Inventors Gilles Rubinstenn, Francis Pruche
Patent Citations (49), Non-Patent Citations (25), Referenced by (27), Classifications (40), Legal Events (4)
Feature extraction in beauty analysis
US 7324668 B2
A method of performing a beauty analysis is disclosed. The method comprises receiving information of at least one portion of a subject's external body condition, identifying in the information at least one condition, extracting from the information at least one feature of the at least one condition, and storing extracted information reflective of the at least one feature.
1. A method of performing a skin analysis and maintaining a subject's privacy, the method comprising:
receiving at least one image of at least one portion of a subject's facial skin, wherein the at least one image includes facial features enabling substantial identification of the subject's identity;
identifying in the at least one image at least one skin condition, wherein during identifying, the at least one image is processed to identify substantially all visible occurrences of the at least one skin condition in at least one part of the at least one image;
extracting from the at least one image at least one representation of the at least one skin condition, wherein the extracted representation includes a skin condition image devoid of substantially all facial features other than the at least one skin condition;
storing information reflective of the at least one representation; and
displaying the skin condition image such that the subject is substantially unidentifiable.
2. The method of claim 1, wherein the stored information includes an image of the at least one skin condition.
3. The method of claim 1, wherein the stored information includes a quantification of the at least one representation.
4. The method of claim 3, wherein the quantification indicates at least one of an extent, intensity, frequency, type, and severity of the at least one skin condition.
5. The method of claim 1, wherein the at least one skin condition includes at least one wrinkle.
6. A method of performing a skin analysis and maintaining a subject's privacy, the method comprising:
identifying at least one skin condition in the at least one image of the at least one portion of the subject's facial skin, the at least one skin condition including at least one wrinkle,
wherein during identifying, the at least one image of the at least one portion of the subject's facial skin is processed to identify substantially all visible wrinkles in at least one part of the at least one image of the at least one portion of the subject's facial skin;
extracting at least one representation of the at least one skin condition from the at least one image of the at least one portion of the subject's facial skin, wherein the at least one extracted representation includes a skin condition image devoid of substantially all facial features other than the visible wrinkles; and
7. The method of claim 6, wherein the visible wrinkles are represented in the extracted representation by marks mirroring contours and locations of the visible wrinkles.
8. The method of claim 7, wherein wrinkle depth is reflected in the extracted representation by at least one of mark intensity, color, and visual cue.
9. The method of claim 1, wherein during receiving, the at least one image is obtained in digital form.
10. The method of claim 1, wherein during identifying, a computer processor is used to perform an image processing function.
11. The method of claim 1, wherein the at least one skin condition includes at least one of skin pore size, texture, elasticity, dryness, cellulitis, sweating, aging, wrinkles, melanoma, exfoliation, desquamation, homogeneity of color, micro-circulation, shininess, softness, smoothness, hydration, sebum production, cleanliness, irritation, redness, vasomotion, vasodilation, vasoconstriction, pigmentation and freckles.
12. The method of claim 1, wherein storing includes saving the at least one representation at a geographical address separate from a geographical address of the at least one image.
13. The method of claim 1, further comprising instructing the subject on how to record the at least one image.
14. The method of claim 13, wherein instructing includes advising the subject on how to capture the at least one image with an image capture device.
15. The method of claim 14, wherein the image capture device is a digital camera.
16. The method of claim 13, wherein instructing includes advising the subject on how to capture the at least one image using a scanner.
17. The method of claim 1, further comprising associating personal information about the subject with the information reflective of the at least one representation.
18. The method of claim 17, wherein the personal information includes at least one of physical characteristics, lifestyle information, family history information, vocational information, environmental information, genetic information, and information correlated to the at least one skin condition.
19. The method of claim 18, performed on a plurality of subjects, the method further comprising maintaining a searchable database for correlating personal information of the plurality of subjects with skin conditions of the plurality of subjects.
20. The method of claim 3, wherein the quantification is tracked over time.
21. A method of performing a skin analysis and maintaining a subject's privacy, the method comprising:
receiving at least one image of at least one portion of a subject's facial skin, wherein the at least one image includes facial features enabling substantial identification of the subiect's identity;
identifying at least one skin condition in the at least one image of the at least one portion of the subject's facial skin;
extracting at least one representation of the at least one skin condition from the at least one image of the at least one portion of the subject's facial skin,
wherein extracting occurs to an extent that the subject is anonymous when the representation is viewed; and
displaying the representation such that the subject is anonymous.
22. The method of claim 1, wherein during extracting at least one portion of the at least one image is magnified to facilitate identifying the at least one skin condition.
23. A method of performing a skin analysis, the method comprising:
identifying in the at least one image at least one skin condition;
extracting from the at least one image at least one representation of the at least one skin condition, wherein the extracted representation includes a skin condition image devoid of substantially all facial features other than the at least one skin condition; and
storing information reflective of the at least one representation,
wherein skin in the received image is covered with powder to facilitate extracting the at least one representation.
24. A method of performing a skin analysis, the method comprising:
wherein skin in the received image is illuminated with a Woods lamp to facilitate extracting the at least one representation.
25. The method of claim 1 conducted, at least in part, in a network environment, wherein receiving at least one image occurs via a network and in at least one location remote from a location of the subject.
26. A method of performing a skin analysis and maintaining a subject's privacy, the method comprising:
receiving an image of a portion of a subject's skin, wherein the image includes facial features enabling substantial identification of the subject's identity;
identifying in the image at least one skin condition, wherein during identifying, the at least one image is processed to identify substantially all visible occurrences of the at least one skin condition in at least one part of the at least one image;
extracting from the image at least one representation of the at least one skin condition, wherein the extracted representation includes a skin condition image devoid of substantially all facial features other than the at least one skin condition;
27. The method of claim 26, wherein during extracting at least a portion of the at least one image is magnified to facilitate identifying the at least one skin condition.
28. A method of performing a skin analysis, the method comprising:
receiving an image of a portion of a subject's skin, wherein the subject is substantially identifiable in the at least one image;
identifying in the image at least one skin condition;
extracting from the image at least one representation of the at least one skin condition, wherein the extracted representation includes a skin condition image devoid of substantially all features that identify the subject; and
29. A method of performing a skin analysis, the method comprising:
extracting from the image at least one representation of the at least one skin condition, wherein the extracted representation includes a skin condition image devoid of substantially all features that identify the subiect; and
30. The method of claim 26 conducted, at least in part, in a network environment, wherein receiving an image occurs via a network and in at least one location remote from a location of the subject.
31. A system for performing a skin analysis and maintaining a subject's privacy, the system comprising:
first memory for storing an image of at least a portion of a subject's facial skin, wherein the image includes facial features enabling substantial identification of the subiect's identity;
processor configured to identify in the image at least one skin condition and for extracting from the image at least one representation of the at least one skin condition to thereby protect the subject's identity; and
second memory for storing information reflective of the at least one representation.
32. A method of protecting an identity of an individual providing a body image, the method comprising:
instructing the subject to capture at least one image of at least one portion of the subject, the image containing information for use in a skin analysis and information unrelated to a skin analysis, including facial features enabling substantial identification of the subject's identity;
providing software for modifying the at least one image to remove at least some of the information unrelated to the skin analysis, thereby protecting the subject's identity during transmission;
receiving the modified image over a network; and
performing a skin analysis on the modified image.
33. A method of performing a hair analysis, the method comprising:
receiving at least one image of at least one portion of a subject's hair;
identifying in the at least one image at least one hair condition;
extracting from the at least one image at least one representation of the at least one hair condition; and
storing information reflective of the at least one representation.
34. The method of claim 33 conducted, at least in part, in a network environment, wherein receiving at least one image occurs via a network and in at least one location remote from a location of the subject.
35. A method of performing a nail analysis, the method comprising:
receiving at least one image of at least one portion of a subject's nails;
identifying in the at least one image at least one nail condition;
extracting from the at least one image at least one representation of the at least one nail condition; and
36. The method of claim 35 conducted, at least in part, in a network environment, wherein receiving at least one image occurs via a network and in at least one location remote from a location of the subject.
The present invention relates to methods, combinations, apparatus, systems, and articles of manufacture involving feature extraction in beauty analysis. The invention may be particularly beneficial for extracting from images and isolating for analysis skin, hair, and nail conditions such as wrinkles, freckles, split-ends, nail discoloration and other conditions.
Beauty treatments, and particularly treatments of the facial skin, are often aimed at improving a particular skin condition. For example, a subject with a condition such as wrinkles may seek a treatment focused on wrinkle reduction while a subject with a condition such as freckles may seek a treatment specifically tailored to reducing the frequency and intensity of freckles. In both instances, it may be beneficial to quantify the extent of the adverse conditions at the beginning of the treatment and at various stages during the treatment in order to gauge treatment effectiveness and/or to help the subject better appreciate the extent of the adverse condition. Further, quantification of conditions is often helpful in determining an appropriate treatment regimen.
Methods, combinations, apparatus, systems, and articles of manufacture consistent with the features and principles of the present invention may perform feature extraction in beauty analysis.
One exemplary aspect of the present invention may include a method of performing a skin, hair, or nail analysis. The method may include receiving at least one image of at least one portion of a subject's facial skin, identifying in the at least one image at least one skin, hair, or nail condition, extracting from the at least one image at least one representation of the at least one skin, hair, or nail condition, and storing information reflective of the at least one representation.
A second exemplary aspect may further include quantifying the at least one representation. The quantification may indicate at least one of an extent, intensity, frequency, type, and severity of the at least one skin, hair, or nail condition.
In a third exemplary aspect, a facial image may be processed to substantially identify all visible occurrences of the at least one skin, hair, or nail condition in at least one part of the at least one portion of the subject. This process may result in at least one representation of the skin, hair, or nail condition substantially devoid of all subject-identifying features other than the condition.
A fourth exemplary aspect of the present invention may include receiving an image of a portion of a subject's skin, identifying in the image at least one skin condition, extracting from the image at least one representation of the at least one skin condition, and storing information reflective of the at least one representation.
A fifth exemplary aspect of the present invention may include a system for performing a skin, hair, or nail analysis. The system may include first memory for storing an image of at least a portion of a subject, a processor(s) configured to identify in the image at least one skin, hair, or nail condition and for extracting from the image at least one representation of the at least one skin, hair, or nail condition, and second memory for storing information reflective of the at least one representation. Of course, the first and second memories might exist within the same physical structure.
Additional aspects of the invention are set forth in the description which follow and, in part, are obvious from the description, or may be learned by practice of methods, combinations, devices, systems, and articles of manufacturer consistent with features of the present invention. The aspects of the invention may be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is understood that both the foregoing description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate several aspects of the invention and, together with the description, serve to explain exemplary principles of the invention. In the drawings,
FIG. 1 illustrates an exemplary flow chart for performing skin analysis consistent with features and principles of the present invention;
FIG. 2 illustrates an exemplary partitioned image consistent with features and principles of the present invention;
FIG. 3A illustrates an exemplary initial facial image consistent with features and principles of the present invention;
FIG. 3B illustrates an exemplary processed image consistent with features and principles of the present invention;
FIG. 3C illustrates an exemplary image with some facial features removed consistent with features and principles of the present invention;
FIG. 4A illustrates an exemplary quantification consistent with features and principles of the present invention;
FIG. 4B illustrates an exemplary graphical representation of quantified data consistent with features and principles of the present invention;
FIG. 4C illustrates an exemplary graph conveying changes in condition consistent with features and principles of the present invention;
FIG. 5 illustrates an exemplary environment consistent with features and principles of the present invention;
FIG. 6 illustrates an exemplary system consistent with features and principles of the present invention;
FIG. 7 illustrates an exemplary second flow chart for performing skin analysis consistent with features and principles of the present invention;
FIG. 8A illustrates an exemplary image consistent with features and principles of the present invention;
FIG. 8B illustrates an exemplary ultra-sonic topographical plot consistent with features and principles of the present invention;
FIG. 9 illustrates an exemplary algorithm for extracting shininess features consistent with features and principles of the present invention;
FIG. 10 illustrates an exemplary algorithm for extracting wrinkle features consistent with features and principles of the present invention;
FIG. 11 illustrates an exemplary representation of reflectivity indices consistent with features and principles of the present invention;
FIG. 12 illustrates an exemplary representation of substantial wrinkle depths consistent with features and principles of the present invention;
FIG. 13 illustrates an exemplary composite image consistent with features and principles of the present invention;
FIG. 14 illustrates an exemplary representation of features stored to a database consistent with features and principles of the present invention; and
FIG. 15 illustrates an exemplary reflectivity distribution consistent with features and principles of the present invention.
Reference is now made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or like parts. While the invention has particular benefit with respect to skin, hair, and nail analysis, the foregoing description uses skin analysis for exemplary purposes.
One embodiment of the invention may include a method for performing a skin analysis. Consistent with the invention, the skin analysis may include identifying and/or quantifying a skin condition. Examples of skin conditions may include skin texture, elasticity, dryness, cellulitis, sweating, aging, wrinkles, melanoma, exfoliation, desquamation, homogeneity of color, micro-circulation, shininess, softness, smoothness, hydration, sebum production, cleanliness, irritation, redness, vasomotion, vasodilation, vasoconstriction, pigmentation, freckles, or any other visible condition affecting the skin.
An embodiment of the invention may also include receiving an image of at lease one portion of a subject's facial skin. Consistent with the invention, the image may include an image of the entire face of the subject or a portion of the subject's face. Images may contain detailed pictures of the subject's facial skin or images may contain topological plots mapping the contours of the subject's facial skin. As illustrated in a flow chart of FIG. 1, a facial skin image may be received at block 50 through one of many mechanisms. Although mechanisms for capturing the facial image are not necessarily a part of the invention in its broadest sense, the image may be captured by a web camera, film camera, analog camera, digital camera, scanner, ultra-sound imaging device or any other mechanism for acquiring a representation of the subject's countenance. The image may be received electronically or physically. Examples of electronic means for receiving a facial image include reception over a network, reception on a storage medium, facsimile reception or reception in physical form.
Examples of networks that may be used to receive a facial image include public networks such as the Internet, telephony networks, courier networks (e.g. postal service, United Parcel Service, Federal Express, etc.), private networks, virtual private networks, local area networks, metropolitan area networks, wide area networks, ad hoc networks, or any other mechanism for permitting communication between remote sites, regardless of whether the connection is wired or wireless. In a broader sense, images may be received physically such as in hard copy form, mailed or otherwise couriered to the receiver.
Also consistent with the invention, a method may include identifying in the image at least one skin condition. An exemplary implementation of this step is graphically depicted at block 52 in FIG. 1. The skin condition may be one or more of the conditions previously discussed and may be identified through an image processing technique. Image processing techniques may include a software program, computer, application specific integrated circuit, electronic device and/or a processor designed to identify in an image one or more occurrences of a skin condition. Various image processing algorithms known to persons of ordinary skill in the art of image processing may be employed to identify one or more occurrences of the skin condition in the facial image. These techniques may, for example, use software that processes the facial image to create a partitioned image 200, as is exemplified in FIG. 2. In the partitioned image 200, dotted lines 202 are used to depict how the facial image may be segmented into component parts 204. Image recognition techniques known in the art may analyze each component part 204 to identify conditions such as wrinkles 206 and 208.
A visual example of how the image processing may work with respect to wrinkle identification is illustrated in FIGS. 3A and 3B. FIG. 3A illustrates an initial facial image 300 of a subject 302. As illustrated, the image reflects wrinkles in the subject's right and left cheek regions 306 and 308 and in regions of the subject's right and left eyes 307 and 309. In FIG. 3B, the image 300 has been processed and the wrinkles 306-309 identified with lines, the shapes of which may represent the contours of the identified wrinkles, and the intensity of which may represent the depth of the wrinkles. While the identification is graphically depicted in FIG. 3B, a graphical depiction is not necessarily a requirement of the invention in its broadest sense. Rather, the identification may occur within a processor. Examples of such processors may include computers, application specific integrated circuits, electronic devices, and any device that may perform identification operations according to prescribed instructions.
Consistent with the invention a method may further include extracting from the image at least one representation of the skin condition. A corresponding step is illustrated at block 54 in FIG. 1. Extraction of representations may occur in one of many ways. For example, as illustrated in FIG. 3C, extraction may occur using image processing to extract from the facial image 310 a skin condition such as wrinkles 306-309. Vice versa, extraction may also occur using image processing to extract from the facial image 310 everything except the skin condition 306-309. Extraction may occur to an extent such that representations may be maintained or transmitted in a compact form. Extraction may also occur to an extent such that the subject is anonymous when the extracted representation is viewed. This may be used to ensure privacy of a subject undergoing a skin analysis. This may result in an image 312 of the skin condition 306-309 with some or all of the facial features removed as depicted in FIG. 3C. The image 312 may be super-imposed on a model to provide a simulation of the skin condition 306-309 without subject-identifiable body portions or invading the subject's privacy.
Examples of techniques relating to processing of images for use in simulating beauty products are disclosed in PCT Publication No. WO 01/77976, published Oct. 18, 2001, the disclosure of which is incorporated herein by reference. Software for such processing is also available from EZ-Face™ of Israel.
Techniques for locating features in an image are known in the art. For example, the image may be binarized to aid in locating features such as wrinkles. Binarization essentially increases the contrast of the image and facilitates feature detection. Fourier transforms, fast Fourier transforms (FFTs), and/or discrete cosine transforms may be performed on all or part of the image, resulting in coefficients. Based on the coefficients, features may be located, as known in the art. Neural networks may also be used to identify features. It is know to persons skilled in the art how to train a neural network to accomplish these functions. Alternatively, one or more digital filters may be passed through the image for locating specific features. These examples are provided for illustrative purposes with the understanding that any image processing technique may be used within the scope and spirit of the invention.
Furthermore, extraction may involve magnifying portions of the image to facilitate identification of skin conditions. Magnification may be performed digitally on a computer or using analog methods such as zooming with an optical lens. Extraction may also involve applying powder to portions of the subject's skin for easier identification of the skin condition. For example, dusting of colored powder may be brushed on a skin condition such as wrinkles to highlight the skin condition. The colored powder may adhere to or fall into wrinkles on the subject's skin, thereby accentuating the wrinkles for identification. Extraction may additionally involve illuminating a portion of the subject's skin with an ultraviolet lamp, such as a Woods lamp. The ultraviolet lamp may help identify an amount of acne-causing bacteria on the portion of the subject's skin by making visible on the subject's skin residues, such as porphyrine, excreted by the bacteria. An image of the illuminated residue may then be captured for image processing.
Alternatively, the information may be extracted in non-image form, such as through graphical or statistical representation. This concept is exemplified in FIGS. 4A to 4C. In FIG. 4A, the representation of the skin condition occurs numerically with quantifiers characterizing the frequency and severity of a skin condition. As illustrated, an overall analysis may be provided as well as analysis divided by facial region. FIG. 4B exemplifies a graphical representation of the data presented in FIG. 4A. Assuming a subject repeats the analysis process periodically, FIG. 4C is an example of how extracted representations in numeric form may be presented graphically in order to convey to the subject changes in the subject's condition over time. The invention may further permit the subject to record any beauty treatment regimen followed by the subject and to associate the treatment regimen with points on the graph. Such an alternative embodiment may enable the subject to correlate specific treatment regimens and/or products with progress being made in order to gauge effectiveness.
An embodiment consistent with the invention may also include storing information reflective of extracted information. This step is exemplified by block 56 in the flow chart 100 of FIG. 1. In its broadest sense storing may involve maintaining information in memory for a time period sufficient to enable the information to be displayed to the subject. In a narrower respect, storing may include maintaining the information in a memory device for a predetermined or indefinite period of time. Although not part of the invention in its broadest sense, images may be stored in active memory such as RAM, may be stored on a storage medium, or may be stored in any other form. Examples of storage medium may include magnetic storage devices such as floppy disks and hard drives, optical storage devices, such as compact discs and digital video discs, organic storage devices, random access memory, printed media or any other medium for storing information.
As is described hereafter in connection with FIGS. 5 and 6, the information may be stored on a client side of a network, on a server or processor side of a network, or at any location connected to a network. Examples of networks may include the ones previously discussed herein. Alternatively, the information may be stored within a non-networked system. In a broader sense, the information stored may be an image or representation of the extracted skin condition, such as illustrated in FIG. 3C. Alternatively, the stored information may be information derived from the image processing, such as the data reflected in FIGS. 4A to 4C.
FIG. 5 illustrates an exemplary environment 500 in which the invention may be implemented. A subject 502 may self-capture a facial image using a camera such as web camera 504 connected to a central processing unit 506. An interconnected display device 508 may permit the subject to view a captured image. This “subject side” or “client side” structure may be embodied within a home computing system, may be located in a kiosk, or may be part of a processing system run by professionals in a salon, place of business, or retail establishment. The system capturing the image may be linked to an image processor 510 via a network 512. Networks include the examples previously described above. All of the image processing functions may be accomplished in the image processor 510, or may be partially accomplished in the central processing unit 506. Alternatively, and as depicted in FIG. 6, the invention may be implemented in a non-networked system 600.
System 600 may include image capture device 602 (such as web cam, digital camera, etc.), computer 604, host server 606, searchable database 608, and three communication links 610-612. The communication links may be hard wired, wireless, or may include at least one network. Image capture device 602 may be operated by the subject (or at the subject's direction) to obtain image information. Instructions displayed via computer 604 may facilitate the image capture process. The image information may then be relayed to the computer 604 using the first communication link 610. This relay may occur in digital or analog form. The subject may then indicate the skin condition for the computer to analyze. Alternatively, the computer may automatically identify conditions that are beyond a predetermined or given severity. The computer 604 may then process the image to extract and quantify specific skin conditions. Results of extraction, processing, and quantification may thereafter be displayed to the subject in one form or another. Displayed results may include representations of the features to the subject such as the exemplary images 1100, 1200, and 1300 illustrated in FIGS. 11 to 13 and/or statistical and graphical representations such as illustrated in FIGS. 4A to 4C. Results may also include demographic statistics calculated from beauty analyses of other people, including the subject.
Via the computer 604 personal information may be gathered from the subject. The computer 604 may then send some or all of the personal information, image, and features to the host server 606 via the second communications link 612. The host server 606 may receive the sent personal information in the database 608 via the third communications link 614. Unique information that identifies the subject associated with the portions may be retained at computer 604, or if transmitted therefrom, excluded from storage into the database 608 for privacy reasons. Alternatively, unique information may be stored and encrypted in a second database (not shown) located at an address different from an address of a location of the first database 608.
Another embodiment of the invention may include a method for performing a skin analysis illustrated by a flow chart 700 in FIG. 7. In step 702 of FIG. 7, sensor information is received. Sensor information may be any information that identifies characteristics (e.g. physical, physiological, biological, and aesthetic) of a subject. As previously discussed, sensor information may be a traditional image, but the invention may use sensor information from other sources. For example, FIGS. 8A and 8B contrast an exemplary image 800 with an ultra-sonic topographical plot 802, respectively, that may be received as sensor information at step 702. The image 800 contains information on the facial skin of the subject and portions of the facial skin may have been scanned with an ultrasonic imaging device. The dotted box 802 in FIG. 8A delineates one of the portions that may be scanned. The topographical plot 802 in FIG. 8B may be a detailed surface map of the facial skin in the portion delineated by the dotted box 802.
After the sensor information is received at step 702 in FIG. 7, the subject may be requested to identify desirable and undesirable conditions in the external body condition for beauty analysis at step 704. Desirable and undesirable conditions available for beauty analysis may include skin conditions. As previously discussed, different algorithms known by persons of ordinary skill in the art and compatible with features and principles of the present invention may be used to extract features reflective of the conditions. FIGS. 9 and 10 illustrate two exemplary algorithms for extracting shininess and wrinkle features, respectively. Detailed descriptions of the exemplary algorithms are provided later herein.
Once features are extracted at step 706 in FIG. 7, the features may be processed at step 708. Processing may include creating representations of the features and overlaying the representations of the features onto the image 800. For example, FIGS. 11 and 12 illustrate a first and a second exemplary representation of features consistent with features and principles of the present invention, respectively. In FIG. 11, a processed image 1100 contains shaded regions 1102 that mark portions of the subject's facial skin with high reflectivity indices as determined during feature extraction at step 706. Reflectivity indices are features representing the skin condition of shininess. High reflectivity indices indicate excessive shininess. In FIG. 11, a second processed image 1200 contains lines 1202 that mark portions of the subject's facial skin with substantial wrinkle depths as determined during feature extraction at step 706. Wrinkle depths are features representing the skin condition of wrinkles. Substantial wrinkle depths indicate excessive visible wrinkles. Shaded regions 1102 and lines 1202 are used above as exemplary representations of features, but any mark or visual cue, including variations of any mark or visual cue, may be used instead. Examples of variations include color, intensity, frequency, and shape of mark or visible indicator.
FIG. 13 illustrates an exemplary composite 1300 of representations of features that may be generated during features processing at step 708, consistent with features and principles of the present invention. Both representations of the high reflectivity indices and substantial wrinkle depths 1102 and 1202 are overlaid onto the image 800.
After feature processing at step 708 in FIG. 7, the feature may be quantified at step 710. Quantification of features may involve generation of metrics for desirable and undesirable conditions in the subject's external body condition. Examples of metrics for wrinkles may include average density, extent, intensity, frequency, type and severity (e.g., calculated from wrinkle depths and percentage area). Examples of metrics for shininess may include extent, intensity, frequency, type, and severity of shininess (e.g., calculated from reflectivity indices).
Further, quantification at step 710 may include tracking changes in metrics for desirable and undesirable conditions over time. For example, sensor information may be received at step 702 at various times for feature extraction at step 706, processing at step 708, and quantification at step 710. At the various times, metrics generated during quantification at step 710 may be compared and analyzed against metrics generated from sensor information received at step 702 from prior times. Quantification at step 710 may then include, for example, calculating change in metrics, average metrics, and standard deviation of metrics over time. Quantification at step 710 may also include comparing the subject's metrics against a database of other subject's metrics.
Personal information from the subject may be collected at step 712. Although depicted as following step 710, the order of steps is not material to the invention in its broadest sense. Personal information may include any data regarding the subject that may correlate with desirable and undesirable conditions. For example, it may be known that there is a correlation between smoking and wrinkles in the facial skin. Therefore smoking habits and patterns (e.g., frequency, quantity, and products used) may be collected. Or it may be known that certain diets affect the shininess of facial skin. Therefore, frequency, quantity, content, and nutritional quality of food consumed by the subject may be collected. Additional exemplary personal information collected may include characteristic, lifestyle, familial, vocational, environmental, and genetic information of the subject. Portions of the personal information, sensor information, features, and results from various steps in the method (steps 702-710) may be stored as subject information in the database at step 714.
The database may contain similar subject information from other subjects. Subject information may be used to create demographical statistics. Unique information that identifies the subject (e.g., the subject name or likeness) may be excluded from the personal information or stored separately and encrypted for the purposes of privacy. Such unique information may be stored at an address location different from an address location of the database. For example, FIG. 14 illustrates an exemplary representation of features 1400 stored to a database in the method consistent with principles of the present invention. The representation of features 1400 does not include unique information identifying the subject such as the image 800 of the subject. Should the invention be used in connection with analysis of portions of the subject's body deemed by the subject to be “private”, the representation may only contain information characterizing a condition of the subject, without revealing an identifiable body image.
FIG. 9 illustrates an exemplary features extraction algorithm 900 consistent with principles of the present invention. The algorithm 900 extracts reflectivity indices from the image 120. At step 902, skin conditions are identified in the image 800 using techniques known in the art. As persons of ordinary skill in the art will appreciate, an average reflectivity index is measured at step 904 for each component part also using methods know in the art.
An exemplary method for measuring the average reflectivity index at step 904 may include determining brightest and darkest component parts in a partitioned image. The brightest and darkest component parts may be assigned reflectivity indices of one and zero, respectively. Remaining component parts may be assigned reflectivity indices between one and zero based on the brightness of the remaining component parts relative to the brightest and darkest component parts. The reflectivity indices may be sorted to create a reflectivity distribution at step 906.
FIG. 15 illustrates an exemplary reflectivity distribution 1500 consistent with features and principles of the present invention. FIG. 15 indicates percentage of component parts of an image that fall within prescribed index ranges. An abscissa axis 1502 indicates the ranges of reflectivity indices corresponding to vertical bars 1506. An ordinate axis 1504 indicates the percentage of component parts with reflectivity indices in the ranges of reflectivity indices corresponding to the vertical bars 1506. For example, a first vertical bar 1508 indicates that six percent of the component parts of the image have reflectivity indices in a range of zero to one-tenth. A second vertical bar 1510 indicates that six percent of component parts have reflectivity indices in a range of one-tenth to two-tenths.
Statistics for the reflectivity index distribution 1500 may be calculated at step 908. For example, a total average reflectivity index may be calculated to represent an average shininess of the subject's facial skin. A reflectivity standard deviation may be calculated to represent variation in shininess of the subject's facial skin. Areas in the partitioned image with excessive shininess may be determined by comparing the reflectivity indices against thresholds to cull out component parts with high reflectivity indices at step 910. For example, component parts with reflectivity indices greater than eight-tenths may be labeled. Labeling may include shading of component parts to indicate regions of excessive shininess as illustrated in FIG. 11.
FIG. 10 illustrates a second exemplary features extraction algorithm 1000 consistent with principles of the present invention. The algorithm 1000 may extract wrinkle depths from the topographical plot 802 in FIG. 8B. As a person of ordinary skill in the art of image processing will appreciate, the three-dimensional topographical plot may be transformed into a two-dimensional contour plot with an overhead perspective at step 1002 in FIG. 10. The contour plot may undergo a differential transformation that calculates slopes, referred to as derivative indices, of contours in the contour plot at step 1004. The contour plot together with the differentiated contour plot may be used to determine wrinkle depths in the subject's facial skin. By way of example, a condition may be identified in the image using the differentiated contour plot (e.g. partitioned at step 1006 into a partitioned contour plot with component parts in a manner similar to step 902 in the algorithm 900 of FIG. 9 described above). An average wrinkle depth may be measured for each component part in the partitioned contour plot at step 1008. Average wrinkle depths may be sorted to create a wrinkle depth distribution at step 1010.
Statistics for the wrinkle depth distribution may be calculated at step 1012. For example, a total average wrinkle depth may be calculated to represent an average severity of wrinkles in the subject's facial skin. A wrinkle depth standard deviation may be calculated to represent variation of wrinkles in the subject's facial skin. Areas in the partitioned contour with excessive wrinkles may be determined by comparing the wrinkle depths against thresholds to cull out component parts with substantial wrinkle depths at step 1014. Culled out component parts may be labeled. Labeling may include marking component parts to indicate regions of excessive wrinkles as illustrated in FIG. 12.
After skin conditions are identified, the invention may involve the proscription of remedies to the extent an identified condition is undesirable. For example, if the beauty analysis indicates excessive shininess or wrinkles, beauty treatments may be recommended to alleviate the excessive shininess or wrinkles. Beauty treatments for a variety of undesirable conditions may include a treatment for wrinkle reduction, anti-aging, elasticity improvement, enhance coloration, improved clarity, skin blemish removal, and freckle reduction.
Conversely, exemplary features for desirable conditions may be extracted during beauty analysis. The extraction, processing, and quantification of features for desirable conditions may be used simply as a diagnostic means without the inclusion of any beauty treatments.
This application claims priority on and incorporates by reference the following U.S. Provisional applications: Artificial Intelligence For Use In Cosmetic And Non-Cosmetic Environments, Application No. 60/325,561 (provisional filed Oct. 01, 2001); and Methods And Systems For Cosmetic And Non-Cosmetic Product Selection, Application No. 60/325,559 (provisional filed Oct. 1, 2001).
The following concurrently filed U.S. patent applications are also incorporated herein by reference: Body Image Enhancement, U.S. patent application Ser. No. 10/024,480; Methods And Systems For Predicting And/Or Tracking Changes In External Body Conditions, U.S. patent application Ser. No. 10/024,354; Methods And Systems For Generating A Prognosis, U.S. patent application Ser. No. 10/024,333; Historical Beauty Record, U.S. patent application Ser. No. 10/024,622; Identification And Presentation Of Analogous Beauty Case Histories, U.S. patent application Ser. No. 10/024,332; Interactive Beauty Analysis, U.S. patent application Ser. No. 10/024,481; Simulation Of An Aesthetic Feature On A Facial Image, U.S. patent application Ser. No. 10/024,353; Beauty Advisory System And Method, U.S. patent application Ser. No. 10/024,496; Virtual Beauty Consultant, U.S. patent application Ser. No. 10/024,620; Calibrating Image Capturing, U.S. patent application Ser. No. 10/024,334; Use Of Artificial Intelligence In Providing Beauty Advice, U.S. patent application Ser. No. 10/024,616; Shop-In-Shop Website Construction, U.S. patent application Ser. No. 10/024,352; Early Detection Of Beauty Treatment Progress, U.S. patent application Ser. No. 10/024,619; Cosmetic Affinity Indexing, U.S. patent application Ser. No. 10/024,356; Systems And Methods For Providing Beauty Guidance, U.S. patent application Ser. No. 10/024,621; Methods And Systems Involving Simulated Application Of Beauty Products, U.S. patent application Ser. No. 10/024,355; Customized Beauty Tracking Kit, U.S. patent application Ser. No. 10/024,351; Analysis Using Three-Dimensional Facial Image U.S. patent application Ser. No. 10/024,615; Body Image Templates With Pre-Applied Beauty Products, U.S. patent application Ser. No. 10/024,482; and Image Capture Method, U.S. patent application Ser. No. 10/024,651.
The term “network interface” or similar terms, refer to any mechanism for aiding communications between various nodes or locations in a network. A network interface may include, for example a bus, a modem, or any other input/output structure. A network interface may permit a connection to any network capable of being connected to an input and/or output module located within at least one or more of the following exemplary networks: an Ethernet network, an Internet Protocol network, a telephone network, a radio network, a cellular network, or any mechanism for permitting communication between two or more modes or remote locations. In some invention embodiments, a network interface might also included a user interface.
Examples of services forms of beauty products include hair styling, hair cutting, hair coloring, hair removal, skin treatment, make-up application, and any other offering for aesthetic enhancement. Examples of other actions performed include massages, facial rubs, deep cleansings, applications of beauty product, exercise, therapy, or any other action effecting the external body condition whether performed by a professional, the subject, or an acquaintance of the subject.
The following is exemplary and non-exhaustive listing of a few beauty products-scrubs, rinses, washes, moisturizers, wrinkle removers, exfoliates, toners, cleansers, conditioners, shampoos, cuticle creams, oils, and anti-fungal substances, anti-aging products, anti-wrinkle products, anti-freckle products, skin conditioners, skin toners, skin coloring agents, tanners, bronzers, skin lighteners, hair coloring, hair cleansing, hair styling, elasticity enhancing products, agents, blushes, mascaras, eyeliners, lip liners, lipsticks, lip glosses, eyebrow liners, eye shadows, nail polishes, foundations, concealers, dental whitening products, cellulite reduction products, hair straighteners and curlers, and weight reduction products. A beauty care treatment regimen may involve the administration of one or more products, as defined above.
“Personal information”, “subject specific information”, “user specific information”, “user profile”, “personal characteristics”, “personal attributes”, “profile information”, and like terms (collectively referred to in this section as “personal information”) may broadly encompass any information about the subject or user. Such information may, for example, fall within categories such as physical characteristics, fashion preferences, demographics, nutritional information, cosmetic usage information, medical history information, environmental information, beauty product usage information, lifestyle, and may include information such as name; age; birth date; height; weight; ethnicity; eating habits; vacation patterns; geographic location of the individual's residence, location, or work; work habits; sleep habits; toiletries used; exercise habits; relaxation habits; beauty care habits; smoking and drinking habits; sun exposure habits; use of sunscreen; propensity to tan; number of sunburns and serious sunburns; dietary restrictions; dietary supplements or vitamins used; diagnosed conditions affecting the external body, such as melanoma; an image, such as a picture or a multimedia file of the subject; facial feature characteristics; family history information such as physical characteristics information about relatives of the subject (e.g., premature balding, graying, wrinkles, etc.); external body condition (as defined previously); color preferences, clothing style preferences, travel habits; entertainment preferences; fitness information; adverse reactions to products, compounds, or elements (e.g., sun exposure); body chemistry, use of prior beauty care products and their effectiveness; purchasing, shopping, and browsing habits; hobbies; marital status; whether the subject is a parent; country of residence; region of residence; birth country and region; religious affiliation; political affiliation; whether the subject is an urban dweller suburban dweller or rural area dweller; size of urban area in which the subject lives; whether the subject is retired; annual income, sexual preference, or any other information reflecting habits, preferences, or affiliations of the subject.
US3030967 * Oct 6, 1959 Apr 24, 1962 Peyron Antoine Francois Process for applying cosmetic material to the skin
US5308609 * Apr 8, 1993 May 3, 1994 Etheredge Iii Robert W Prophylaxis for keratinous materials
US5363854 * Aug 14, 1991 Nov 15, 1994 U.S. Philips Corporation Method of detecting anomalies of the skin, more particularly melanomae, and apparatus for carrying out the method
US5751829 Aug 18, 1994 May 12, 1998 Autodesk, Inc. Spectrally coordinated pattern search-imaging system and method
US6091836 Sep 4, 1997 Jul 18, 2000 Shiseido Company, Ltd. Method for classifying features and a map representing the features
US6571003 * Jun 14, 1999 May 27, 2003 The Procter & Gamble Company Skin imaging and analysis systems and methods
US20010011818 Mar 7, 1997 Aug 9, 2001 Heritage Publishing, Inc. System and method for promoting stores and products
US20020024528 * Aug 27, 2001 Feb 28, 2002 Kirsten Lambertsen Virtual makeover system and method
US20020054714 May 4, 2001 May 9, 2002 Unilever Home & Personal Care Usa, Division Of Conopco, Inc. Method of evaluating cosmetic products on a consumer with future predictive transformation
EP0226959A2 Dec 11, 1986 Jul 1, 1987 Tsukasa Horikita Make-up simulator
EP1030267A1 Mar 6, 1998 Aug 23, 2000 DRDC limited Method of correcting face image, makeup simulation method, makeup method, makeup supporting device and foundation transfer film
EP1134701A2 Mar 15, 2001 Sep 19, 2001 Infiniteface Inc. Client-server system for three-dimensional face make-up simulation
EP1169964A2 Jun 26, 2001 Jan 9, 2002 DRDC limited Diagnosis system, diagnosis data producing method, information processing device, terminal device and recording medium used in the diagnosis data producing method
EP1177766A1 Jul 19, 2001 Feb 6, 2002 L'oreal Method for the acquisition of the image of a non-dermatoglyphic area of the skin or an area of hairs with an acquisition device comprising a non-optical sensor
JP2001000419A Title not available
JP2001314376A Title not available
JP2001344345A Title not available
JPH0793549A Title not available
JPH0951525A Title not available
JPH05263411A Title not available
JPH06105826A Title not available
JPH06189942A Title not available
JPH07231883A Title not available
WO1998020458A1 Nov 7, 1997 May 14, 1998 Mirror Software Corporation Aesthetic imaging system
WO1999023609A1 Oct 29, 1998 May 14, 1999 Headscanning Patent B.V. A method and a device for displaying at least part of the human body with a modified appearance thereof
WO2000033271A2 Dec 2, 1999 Jun 8, 2000 Gary Shkedy Method and apparatus for facilitating buyer-driven purchase orders on a commercial network system
WO2001004838A1 Jun 9, 2000 Jan 18, 2001 Unilever Plc A system for colour cosmetic selection
WO2001004840A1 Jun 13, 2000 Jan 18, 2001 Unilever Plc Colour cosmetic selection system
WO2001018674A2 Aug 31, 2000 Mar 15, 2001 The Procter & Gamble Company Methods and apparatuses for providing a customized product combination to a consumer
WO2001020517A2 Sep 12, 2000 Mar 22, 2001 The Procter & Gamble Company Method for obtaining consumer information
WO2001035827A1 Nov 9, 2000 May 25, 2001 Polartechnics Limited System and method for examining, recording and analysing dermatological conditions
WO2001057771A1 Feb 5, 2001 Aug 9, 2001 Omnichoice.Com System and method for assisting customers in choosing among a set of commodities using customer preferences
WO2001077976A2 Mar 27, 2001 Oct 18, 2001 Eyeweb, Inc. Image segmenting to enable electronic shopping for wearable goods and cosmetic services
WO2001080122A2 Apr 9, 2001 Oct 25, 2001 The Procter & Gamble Company An interactive system for conducting business and method for the interactive distribution of information relating to products and services
WO2001087245A2 May 10, 2001 Nov 22, 2001 The Procter & Gamble Company Method for analyzing hair and predicting achievable hair dyeing ending colors
WO2001091600A2 May 25, 2001 Dec 6, 2001 The Procter & Gamble Company Methods and system for providing personalized preparations
WO2001091601A2 May 25, 2001 Dec 6, 2001 The Procter & Gamble Company Method and apparatus for providing personalized cosmetics
WO2002003232A2 Jun 28, 2001 Jan 10, 2002 The Procter & Gamble Company Method and system for creating and improving products and services using electronic collection of information
WO2002005249A2 Jun 27, 2001 Jan 17, 2002 Rami Orpaz Make-up and fashion accessory display and marketing system and method
WO2002037421A1 Jun 13, 2001 May 10, 2002 Unilever Plc Method of evaluating cosmetic products on a consumer
1 Catherine Pelachaud, et al., "Final Report to NSF of the Standards for Facial Animation Workshop", The Institute For Research In Cognitive Science, University of Pennsylvania, IRCS Report 94-21, Nov. 1994, pp. 1-62.
2 Co-pending U. S. Appl. No. 10/024,334; Title: Calibrating image Capturing Inventor(s): Gilles Rubinstenn, filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
3 Co-pending U. S. Appl. No. 10/024,496; Title: Beauty Advisory System and Method, Inventor(s): Gilles Rubinstenn et al., filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
4 Co-pending U. S. Appl. No. 10/024,620; Title: Virtual Beauty Consultant, Inventor(s): Daniela Giacchetti et al., filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
5 Co-pending U.S. Appl. No. 10/024,034; Title: Devices and Methods for Enabling Evaluation of Typological Characteristics of External Body Portions, and Related Devices, Inventor(s): Roland Bazin, filed Dec. 21, 2001.
6 Co-pending U.S. Appl. No. 10/024,332; Title Identification and Presentation of Analogous Beauty Case Histories, Inventor(s): Gilles Rubinestenn, Filed: Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
7 Co-pending U.S. Appl. No. 10/024,333; Title: Methods and Systems for Generating a Prognosis, Inventor(s): Gilles Rubinstenn et al., Filed: Dec. 21, 2001, Preliminary Amendment Filed: April 22, 2002.
8 Co-pending U.S. Appl. No. 10/024,351; Title: Customized Beauty Tracking Kit, Inventor(s): Gilles Rubinstenn et al., filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
9 Co-pending U.S. Appl. No. 10/024,352; Title: Shop-in-Shop Website Construction, Inventor(s): Jerome Peyrelevade et al., filed Dec. 21, 2001.
10 Co-pending U.S. Appl. No. 10/024,353; Title: Simulation of an Aesthetic Feature on a Facial Image, Inventor(s): Daniela Giacchetti et al., filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
11 Co-pending U.S. Appl. No. 10/024,354; Title: Methods and Systems for Predicting and/or Tracking Changes in External Body Conditions, Inventor(s): Gilles Rubinstenn et al., filed: Dec. 21, 2001, Preliminary Amendment Filed Apr. 22, 2002.
12 Co-pending U.S. Appl. No. 10/024,355; Title: Methods and Systems Involving Simulated Application of Beauty Product, Inventor(s): Jerome Peyrelevade et al., filed: Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
13 Co-pending U.S. Appl. No. 10/024,356 ; Title: Cosmetic Affinity Indexing, Inventor(s): Daniela Giacchetti et al., filed: Dec. 21, 2001.
14 Co-pending U.S. Appl. No. 10/024,480; Title: Body Image Enhancement, Inventor(s): Gilles Rubinstenn et al., filed Dec. 21, 2001, Preliminary Amendment filed: Apr. 22, 2002.
15 Co-pending U.S. Appl. No. 10/024,481; Title: Interactive Beauty Analysis, Inventor(s): Gilles Runinstenn et al., filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
16 Co-pending U.S. Appl. No. 10/024,482; Title: Body Image Templates With Pre-Applied Beauty Products, Inventor(s): Daniela Giacchetti, filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
17 Co-pending U.S. Appl. No. 10/024,615; Title: Analysis Using a Three-Dimensional Facial Image, Inventor(s): Gilles Rubinstenn et al., filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
18 Co-pending U.S. Appl. No. 10/024,616; Title: Use of Artifical Intelligence in Providing Beauty Advice, Inventor(s): Jerome Peyrelevade, filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
19 Co-pending U.S. Appl. No. 10/024,619; Title: Early Detection of Beauty Treatment Progress, inventor(s): Francis Pruche et al., filed: Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
20 Co-pending U.S. Appl. No. 10/024,621; Title: Systems and Methods for Providing Beauty Guidance, Inventor(s): Daniela Giacchetti et al., filed: Dec. 21, 2001,Preliminary Amendment Filed: Apr. 22, 2002.
21 Co-pending U.S. Appl. No. 10/024,622; Title: Historical Beauty Record, Inventor(s): Daniela Giacchetti et al., Filed: Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
22 Co-pending U.S. Appl. No. 10/024,651; Title: Image Capture Method, Inventor(s): Gilles Rubinstenn, filed Dec. 21, 2001, Preliminary Amendment Filed: Apr. 22, 2002.
23 * Environmental Health Criteria 160 (EHC 160), 1994, 2nd edition, "Ultraviolet radiation". (pp. 1-4, 45-47).
24 * Lievin et al., "Lip features Automatic Extraction", Oct. 1998, IEEEICIP 98, vol. 3, pp. 168-172.
25 Yin Wu, et al., "A Plastic-Visco-Elastic Model for Wrinkles in Facial Animation and Skin Aging", MIRALab, 1998, 10 pages.
US7437344 * Dec 21, 2001 Oct 14, 2008 L'oreal S.A. Use of artificial intelligence in providing beauty advice
US7574058 * Aug 11, 2005 Aug 11, 2009 Fujifilm Corporation Image processing apparatus, method and program on a computer-readable medium that increases compression rate
US7587075 * Apr 11, 2005 Sep 8, 2009 Novaptus Systems, Incorporated Virtual cosmetic and reconstructive surgery systems, methods, and apparatuses
US7707130 * Feb 26, 2007 Apr 27, 2010 Health Care Information Services Llc Real-time predictive computer program, model, and method
US8358348 May 18, 2010 Jan 22, 2013 Elc Management Llc Method and system for automatic or manual evaluation to provide targeted and individualized delivery of cosmetic actives in a mask or patch form
US8425477 Jul 31, 2009 Apr 23, 2013 Elc Management Llc Method and system for providing targeted and individualized delivery of cosmetic actives
US8433116 Nov 1, 2010 Apr 30, 2013 Mela Sciences, Inc. Showing skin lesion information
US8452063 May 3, 2011 May 28, 2013 Mela Sciences, Inc. Showing skin lesion information
US8491926 Dec 8, 2010 Jul 23, 2013 Elc Management Llc Method and system for automatic or manual evaluation to provide targeted and individualized delivery of cosmetic actives in a mask or patch form
US8597667 Mar 24, 2009 Dec 3, 2013 Elc Management Llc Targeted and individualized cosmetic delivery
US8861866 * Jun 20, 2012 Oct 14, 2014 Hewlett-Packard Development Company, L.P. Identifying a style of clothing based on an ascertained feature
US9058765 * Mar 17, 2009 Jun 16, 2015 Taaz, Inc. System and method for creating and sharing personalized virtual makeovers
US9363507 Apr 23, 2013 Jun 7, 2016 Mela Sciences, Inc. Showing skin lesion information
US20030065636 * Dec 21, 2001 Apr 3, 2003 L'oreal Use of artificial intelligence in providing beauty advice
US20060034524 * Aug 11, 2005 Feb 16, 2006 Fuji Photo Film Co., Ltd. Image processing apparatus, method, and program
US20080097943 * Feb 26, 2007 Apr 24, 2008 Health Care Information Services Llc Real-time predictive computer program, model, and method
US20080312952 * Jun 12, 2007 Dec 18, 2008 Gulfo Joseph V Regulating Use Of A Device To Perform A Procedure On A Subject
US20090280150 * Mar 24, 2009 Nov 12, 2009 Tamar Lara Kamen Targeted And Individualized Cosmetic Delivery
US20100068247 * Jul 31, 2009 Mar 18, 2010 Tsung-Wei Robert Mou Method And System For Providing Targeted And Individualized Delivery Of Cosmetic Actives
US20100198682 * Feb 4, 2009 Aug 5, 2010 Miranda Aref Farage Sensitive skin product marketing articles
US20110103660 * Nov 1, 2010 May 5, 2011 Christiano Butler Showing skin lesion information
US20110123703 * May 18, 2010 May 26, 2011 Fatemeh Mohammadi Method and System For Automatic or Manual Evaluation to Provide Targeted and Individualized Delivery of Cosmetic Actives in a Mask or Patch Form
US20110210984 * May 3, 2011 Sep 1, 2011 Maciej Wojton Showing Skin Lesion Information
US20130343615 * Jun 20, 2012 Dec 26, 2013 Tong Zhang Identifying a style of clothing based on an ascertained feature
US20150186518 * Feb 15, 2013 Jul 2, 2015 Hitachi Maxell, Ltd. Management system for skin condition measurement analysis information and management method for skin condition measurement analysis information
U.S. Classification 382/118, 382/276, 382/190
International Classification G06F19/00, G06T11/00, G06K9/36, A45D44/00, G06K9/46, G06K9/66, G06K9/00, G06T7/60, A61B5/103
Cooperative Classification A61B5/7267, A61B5/446, A61B5/444, A61B5/7475, G06F19/3418, A61B5/442, A61B5/1034, G06T11/00, A61B5/0077, G06F19/3487, A61B5/411, G06F19/321, H04N5/23206, G06F19/3437, A45D44/005, A61B5/445
European Classification A61B5/44B6, A61B5/44B4, A61B5/44B8, A61B5/44B2, A61B5/00P9, A61B5/103A2, A61B5/41B, H04N5/232C1, G06F19/32A, A61B5/74M, G06T11/00, A45D44/00S
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RUBINSTENN, GILLES;PRUCHE, FRANCIS;REEL/FRAME:012882/0928;SIGNING DATES FROM 20020408 TO 20020424