Patent Description:
Hair is a feature that contributes to people's looks and is most of the time exposed and visible. Hair care is an important part of a person's everyday personal care, with the use of products applied onto hair such as shampoo, mechanical handling of hair with brushes and treatments changing the general appearance of hair such as hair cuts or coloration treatments. One's age, lifestyle, diet or the use of medication can also influence the properties of hair.

A large variety of products is available to take appropriate care of a person's hair. Products intend to target specific hair types, based on color, damage state, greyness levels for example. In order to optimize hair care, knowledge of the current state of a person's hair is needed to select the right hair treatment.

The subjective assessment of a person's hair by a hair stylist or any other person may lead to incorrect assessment of the true state of a person's hair.

To add objectivity to this assessment, quantitative photometric determination of the current hair color of a user can be done. Separate assessment of the oxidative damage of hair or its water content can be done using further optical tools, in particular near infrared spectroscopy. However, even though photometry provides a more accurate picture of the state of hair, it fails to distinguish between identical or substantially identical colors that are obtained using different combinations of pigments.

Indeed, the perceived color of hair results from light absorbed, scattered and reflected by hair fibers. The chemical composition of these hair fibers may comprise a large variety of chemicals in different concentrations, and different mixtures of hair pigments can lead to identical perceived colors. A distinction can be made between natural dyes (for example melanin) and dyes that have been added to the fibers via coloration treatments (artificial dyes).

Artificial dyes are present in hair fibers in concentrations and ratios that are very difficult to predict from the mere knowledge of past coloration treatments.

All this uncertainty leads to random assessment of the pigment composition of hair fibers using conventional color determination techniques.

Furthermore, it is to be noted that different pigments can lead to similar or virtually identical perceived hair colors but the pigments themselves react differently to further hair treatments or further application of hair dyes. This effect is particularly true when hair is subjected to oxidative coloration treatments. For example, a natural medium brown hair color dyed with a lightening shade, e.g. light blonde with <NUM>% hydrogen peroxide will be significantly brighter after the dyeing process than a chemically dyed medium brown hair color. This can be explained by the fact that brown dyes (from previous oxidative coloration treatments) are inherently more stable towards further oxidative treatments than natural dyes receiving a first oxidative hair coloration treatment.

Document <CIT> describes a method and system for determining hair and skin properties using one or many conventional hyperspectral cameras. Document <CIT> describes a device to measure hair properties using light emitted by a combing device reflected from hair and then detected by the combing device.

This illustrates the need to provide a more reliable way of determining the pigment composition of hair.

In order to overcome the above drawbacks, the invention provides a method according to independent claim <NUM> for determining a composition of pigments in a hair fiber, the method comprising:
exposing a region of the hair fiber sequentially to electromagnetic radiation of different wavelengths, wherein the electromagnetic radiation comprises wavelengths in a visible range between <NUM> and <NUM>, as well as wavelengths in an infrared range between <NUM> and <NUM>, wherein the electromagnetic radiation comprises at least three wavelengths in the visible range, at least one wavelength in a first near infra-red range from <NUM> to <NUM> and at least one wavelength in a second near-infrared range from <NUM> to <NUM>; - recording, using a camera of a mobile phone, signals corresponding to electromagnetic radiation that has interacted with the hair fiber during exposure of the region of the hair fiber, wherein the recorded signals from electromagnetic radiation that has interacted with the hair fiber during exposure of the region of the hair fiber form a plurality of images;.

The invention adds an element of objectivity to the assessment of the chemical composition of hair fibers, in particular by making it possible to detect complex pigment compositions comprising not just one type of pigment, but virtually any combination of pigments. Reference spectra of hair having known pigment compositions can include both reference spectra of hair fibers having only one type of pigment, or different mixtures of pigments, in different concentrations. Typically, a comparison can be made using a correlation between a measured spectrum and a reference spectrum. More elaborate comparison techniques involving machine learning algorithms and the use of classification models can further improve the identification of pigment compositions. Such techniques can in particular render more accurate a quantification of the amount of pigment per pigment type, even if the determined spectrum does not match an available reference spectrum.

The invention further improves identification of pigment compositions in hair fibers by gathering for example reflected and scattered light within a wavelength range comprising visible and infrared light. Signals comprising more than one wavelength are recorded, and in particular a plurality of wavelengths that can be processed as Hyperfrequency signals. "Hyperfrequency" signals are signals that comprise a spectrally rich information for contiguous spectral bands across a wide wavelength range. It can be a reconstructed signal based on measurements performed using several narrow-band sources or one source or plurality of sources capable of emitting light having a broad spectrum. The spectrum obtained from such signals provides a better identification opportunity of specific spectral features of pigments in the visible as well as in the infrared range.

According to the invention, the electromagnetic radiation may comprise at least three wavelengths in the visible range, at least one wavelength in a first near infra-red range from <NUM> to <NUM> and at least one wavelength in a second near-infrared range from <NUM> to <NUM>.

In order to obtain accurate Hyperfrequency information from light reflected, absorbed and scattered by the hair fiber, a sampling of the visible spectrum with at least three wavelengths is preferred, as well as at least one wavelength in the first near-infrared range (in which the spectrum of natural melanin can be easily distinguished from that of artificial brown dyes due to recognizable absorption features). Gathering reflected light within the second near infrared range between <NUM> and <NUM> is advantageous in order to identify vibrational overtones of pigments, which can be easily recognized due to their high intensities in this range. This allows both quantitative and qualitative assessment of the pigment composition of a hair fiber. Accuracy of the prediction can be enhanced if reflected light is measured with devices having an acute sensitivity to wavelengths spaced <NUM> apart within the ranges described above. In particular, <NUM> wavelengths can be measured with increased spectral intensity in the visible range typically from <NUM> to <NUM>. Generally, sensors have a sensitivity that peaks at a specific wavelength but can still detect signals within a certain range around that peak. In order to obtain a better hyperspectral image of the hair fiber, it is possible to use a plurality of sensors having peak sensitivities every <NUM> in the visible range. Similar arrangements can be used to measure signals in the first and second near infrared ranges.

According to an embodiment the reference spectra may comprise spectra corresponding to electromagnetic radiation in the visible range and the infrared range that has interacted with hair samples having a pigment composition including more than one pigment.

It is in particular possible to use previously recorded spectra for which a pigment composition was already identified as a reference spectrum for future implementations of the method on new hair fibers.

According to an embodiment the reference spectra may be obtained from a database comprising spectral features of hair pigments.

Such a database can be for example accessed online, in scientific literature or via information stored from previously recorded spectra from which a pigment composition of a hair fiber was identified.

According to an embodiment, the method may further comprise:.

Machine learning algorithms make it possible to interpret spectra of complex pigment compositions with more accuracy. The classification models that are generated by analyzing spectral features of reference spectra make it possible to estimate the presence of a pigment, even if it is present in small amounts in the hair fiber, and also to quantify that pigment. A mixture of pigments leads to spectra that do not correlate so closely with reference spectra of hair comprising only one type of pigment. Machine learning trained on a variety of reference spectra overcomes this challenge.

According to an embodiment the machine learning algorithm may use at least one method from a group of methods, wherein the group of methods includes:.

Typically, the type of pigments that can be identified could be found among melanins, such as eumelanin or phaeomelanin, oxidative coupling products with two nuclei such as indamines, indoanilines, indophenols, more complex coupling products comprising three or more nuclei and direct dyes such as nitro dyes, azo dyes or anthraquinones for example.

A quantitative assessment of the pigment composition in the hair fiber can for example be achieved by comparing the relative intensities of spectral features within the recorded signals with the reference spectra. Accuracy of this detection is enhanced by improving the spectral resolution of the detectors used to record the electromagnetic radiation reflected, absorbed and scattered by the hair fiber. Furthermore, in addition to the spectral resolution, pixel-based sensors having a suitable spatial resolution can provide a spatially resolved information, allowing a distinction in the composition of hair fibers in the tips, lengths or roots of a hair fiber, or in different areas of a strand of hair for example.

According to the invention, the method may further comprise:.

Such a method consisting in processing information from a plurality of images can be easily implemented using a portable device such as a smartphone or a simple portable apparatus. First, substantially monochromatic light is cast on the hair fiber or hair fibers. This light can also be non monochromatic and comprise a wider range of wavelengths. Each exposure is configured to cast a different type of wavelength on the hair fiber. The reflected, absorbed and/or scattered light is captured by sensors and a processing of the plurality of images thus recorded is implemented to reconstruct a hyperspectral image of the hair fiber. This method is implemented using a mobile phone.

Further determining the color of the hair fiber using traditional colorimetry, that is to say spectroscopic tools involving for example the processing of a picture of the hair fiber, can help corroborate the information provided by the spectrum analysis described above. The color that is determined can be parameterized in a color space such as the Lab color space, CIELab or RGB for example.

In case of an incompatibility between the color determined using colorimetry and the properties of the pigment composition that is identified, further processing and comparison of the spectrum with reference spectra can be implemented to correct the identified pigment composition.

Knowing more precisely the pigment composition of the hair fiber, it is then possible to recommend hair treatment products (for example shampoos, hair coloration compositions) that are compatible with the current state of the hair fiber. This will reduce the risk of damaging hair or obtaining an undesired hair color.

According to an embodiment electromagnetic radiation that has interacted with the hair fiber during exposure of the region of the hair fiber may comprise electromagnetic radiation reflected by the region of the hair fiber and electromagnetic radiation scattered by the region of the hair fiber.

When interacting with the hair fiber or hair fibers, electromagnetic radiation can be either reflected at the surface of the hair, pass through the hair, be refracted and absorbed, or be scattered by the hair fiber or hair fibers. Absorption signals can be detected, for example by arranging a source and detector at different sides of the hair fiber. The method described above can advantageously easily be implemented by detecting signals reflected by the hair fiber or hair fibers. In such a case, sources of electromagnetic radiation and detectors are advantageously located close to one another, facing the hair fiber or hair fibers.

The disclosure also pertains to a system for determining the composition of pigments in a hair fiber, the system comprising:.

It is further possible to have more than one source and more than one detector. The number of detectors can be based on the breadth of the spectrum that is to be investigated and also on the spectral resolution that is sought. The finer the resolution and the larger the spectrum, the more accurate can the determination of the pigment composition be.

According to an example, the at least one source and the at least one detector may be arranged on a mobile portable device.

The disclosure also further pertains to a non-transitory computer readable storage medium having stored thereon a computer program comprising instructions for execution of a method for determining a composition of pigments in a hair fiber as described above.

In other words, the disclosure also describes a computer program product comprising instructions for execution of a method for determining a composition of pigments in a hair fiber as described above.

The present disclosure will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and:.

For the sake of clarity, dimensions of features represented on these figures may not necessarily correspond to the real-size proportion of the corresponding elements.

The following detailed description is merely exemplary in nature and is not intended to limit the disclosure or the application and uses of the subject-matter as described herein. Furthermore, there is no intention to be bound by any theory presented in the preceding background or the following detailed description.

The invention provides a method to determine the pigment composition of a hair fiber using a hyperspectral imagery technique. The invention analyzes the spectra of light reflected by hair fibers over a broad spectral range including both reflected spectra in the visible range between <NUM> and <NUM> and the infrared range, between <NUM> and <NUM>. The infrared range can be restricted to the most relevant portion of the near infrared between <NUM> and <NUM>.

Spectral features in the recorded signals can be correlated to expected spectral signatures observed in pigmented hair. The use of a broad spectral range with hyperspectral quality makes it possible to assert not only the presence or absence of a pigment of known spectral response in the visible and near infrared range, but also to identify a plurality of pigments, whose spectral signatures are mixed. Machine learning algorithms can improve this determination of overlapping spectral features that would render a direct comparison with the spectral signatures of individual pigments less reliable.

<FIG> provides a flowchart summarizing four possible steps of a method <NUM> to determine a pigment composition of a hair fiber using hyperspectral imagery.

A first step may consist in exposing <NUM> a region of the hair fiber to electromagnetic radiation. The electromagnetic radiation can be cast either all at once using a source advantageously capable of generating a broad spectrum with a substantially homogeneous distribution of intensity peaks, or from several sources generating light within narrower spectral ranges. The exposure should advantageously include at least <NUM> wavelengths in the visible range between <NUM> and <NUM>, and wavelengths in the infrared range between <NUM> and <NUM>.

More specifically, it has been observed that pigments in hair fibers have strong optical responses noticeable in recorded light reflected by hair in the near infrared range between <NUM> and <NUM>, as well as in the range between <NUM> and <NUM>.

A second step of the method may consist in recording <NUM> signals corresponding to electromagnetic radiation that has interacted with the hair fiber during exposure of the region of the hair fiber.

This electromagnetic radiation is typically light reflected and scattered by the hair fiber. However, it is also conceivable to record the electromagnetic radiation that is absorbed by the hair fiber in a transmission configuration instead of a reflection configuration.

The detection can be done using one detector sensitive to light both in the visible and in the infrared range. However, a plurality of detectors can also be used to increase sensitivity across the wavelengths that are monitored. The detector is, according to the invention, a camera of a mobile phone. In examples not falling under the scope of the invention the detector can be any type of photodetector, a CCD (charge coupled device) camera, a QWIP (quantum well infrared photodetector), a spectrometer or an array of such devices or a combination of such devices.

The signal that is detected can typically be recorded as a spectrum, as an image or as a waveform.

It is to be noted that detectors can have a high spatial resolution, and thereby provide a spatially resolved information on the composition of a region of a hair fiber. That way, it is possible to distinguish the pigment composition of roots, lengths or tips of hair fibers, and detect differences in hair pigments in different parts of a strand of hair.

A third step consists in comparing <NUM> a spectrum of the recorded signals to reference spectra of hair having known pigment compositions.

These reference spectra can be absorption features known to be found in known pigments based on available laboratory tests (that could for example be published in scientific publications or databases) or recorded spectra available for random hair samples whose pigment composition is known. It is also possible to use as a reference spectrum the spectrum of a previously analyzed hair fiber for which the method helped identify the pigment composition accurately. Reference spectra are advantageously also obtained via reflection measurements using Hyperspectral imagery techniques.

Advantageously, reference spectra were obtained in the same wavelength ranges as those used to illuminate the region of the hair fiber under investigation. The higher the number of reference spectra available the more accurate can the qualitative as well as quantitative estimation of the pigment composition in the hair fiber be. It is also possible to include reference spectra for pigmented hair comprising only one type of pigment and/or reference spectra for pigmented hair comprising more than one type of hair pigment.

Finally the method continues by identifying <NUM> a pigment composition in the region of the hair fiber based on the comparison.

A machine learning algorithm can be trained to identify relevant spectral features from such reference spectra, in order to distinguish not only the mere presence or absence of a pigment in the region of a hair fiber, but also estimate the amount of pigment in the hair fiber. Spectral intensity information, combined with the wavelength information can be used to achieve such a quantitative assessment of the presence of pigments and the amount in which they are present. The result of the identification step can be outputted in the form of a qualitative information, indicating the presence of pigments by naming them and/or by mentioning what pigments are not present in the region of hair fiber investigated among a list of known pigments. It is also possible to output a more quantitative information, by indicating a range of concentrations for each identified and/or known pigment type. For example, it is possible to define low, medium and high concentration values. If the spectral features identifying the presence of a pigment hint towards a high low or medium concentration, this information can be provided in an output showed for example to a user.

Regression approaches and machine learning algorithms can provide an even more precise identification of the concentration of each pigment type in the hair fiber. The output can then provide an absolute value for a concentration of each identified pigment, or else relative percentages for each pigment in the hair fiber. The percentages can for example be expressed as parts per weight.

In order to implement the method described above in connection with <FIG>, a system <NUM> as that illustrated on <FIG> can be used.

<FIG> shows hair <NUM> of a user. A hair strand comprising hair fiber <NUM> is illuminated with a source <NUM> of electromagnetic radiation <NUM>. Hair region <NUM> of hair fiber <NUM> reflects and scatters this electromagnetic radiation which is then detected in its modified form by detector <NUM>. In the system <NUM> represented on <FIG>, detector <NUM> communicates wirelessly with a non-transitory data processing unit <NUM>, which can for example be a computer <NUM> or a portable mobile device <NUM>. The source <NUM> can also have communication capabilities with a data processing unit and be programmed to emit electromagnetic radiation according to a sequence. As an alternative to wireless communication, wired communication can also be used. All sorts of communication protocols can be used to receive and/or send information to/from the source <NUM>, detector <NUM> and non-transitory data processing unit <NUM>.

Although <FIG> only represents one source <NUM> and one detector <NUM>, a plurality of sources and detectors can be used, in order to cast light of different wavelengths on the region <NUM> of hair fiber <NUM>.

The electromagnetic radiation can be cast all at once, from a source <NUM> or plurality of sources capable of generating a broad spectrum covering the visible range with wavelengths between <NUM> and <NUM> as well as the infrared range with wavelengths from <NUM> to <NUM> and more particularly the near-infrared range with wavelengths from <NUM> to <NUM>.

The electromagnetic radiation can also be cast and/or recorded in sequence. For example, a first round of measurements can comprise illumination using monochromatic or narrow-spectrum sources on the hair fiber <NUM> in the visible range. Then narrow-spectrum sources in the near infrared are used. Detectors adapted for each type of electromagnetic radiation to be detected can then be used. A reconstructed spectrum can be built using the different measurements that were made.

Another alternative may consist in using the Hawkspecs algorithm developed by Fraunhofer Institute. To do so, a mobile device <NUM> such as a smartphone can be used to cast light generated by one group of light emitting sources (diodes, LED) from the screen of the mobile device on the region <NUM> of the hair fiber <NUM>. The camera of the mobile device <NUM> is used to capture images in each illumination condition. These images are then processed using an algorithm to reconstruct a Hyperspectral image of the hair fiber <NUM>, based on a limited number of wavelengths. Further use of near-infrared sources can be associated in combination with such an approach to provide more accurate results concerning spectral features modified during interaction with the hair fiber at infrared wavelengths.

The non-transitory data processing unit <NUM> typically comprises components capable of storing information, in particular the signals recorded and sent by the detector <NUM>. It may further comprise at least one processor to convert, if necessary, waveform information provided by the detector <NUM> into a spectrum, and compare that spectrum to features extracted from reference spectra of hair having known pigment compositions. The non-transitory data processing unit <NUM> can further possess an interface capable of receiving inputs by users and to display information, such as outputting the qualitative and or quantitative assessment of the pigment composition of the hair fiber <NUM>. The interface may be capable of interacting with the user based on vocal command, using a keyboard or via a menu in which the user selects the type of pigments he wishes to use or the hair properties he would like to have taken into account when determining a suitable hair treatment product. The non-transitory data processing unit <NUM> may for example comprise a program which queries the type of information the user is willing to obtain about the hair fiber <NUM>, or which type of hair coloration treatment he would like to undergo.

Based on the determined pigment composition of the hair fiber, the non-transitory data processing unit <NUM> may determine what coloration products or hair treatment products are compatible with the current state of the hair fiber <NUM>, to avoid further damage or modification of the hair color from a desired hair color, A user may provide his desired hair color or hair state, to receive recommendations on the type of pigments or hair coloration products that he may use based on the determined pigment composition.

In order to further corroborate the results determined by the method implemented with system <NUM>, a colorimetric measurement may be performed on the region <NUM> of the hair fiber <NUM>, to determine a color of the hair fiber <NUM>. The thus determined hair color can be compared to the color expected for the pigment composition that has been identified. In case of a disagreement, a recommendation to run the method one more time may be provided.

In order to further illustrate the Hyperspectral imagery method of the invention, <FIG> provide a schematic view of spectra of light that can be cast on the hair fiber <NUM> and detected after interaction with the hair fiber.

<FIG> shows spectral intensity on vertical axis <NUM> versus wavelengths on a horizontal axis <NUM>. In the schematic example of <FIG>, the visible range <NUM> between <NUM> and <NUM> comprises three wavelengths with a particularly strong spectral intensity. Since most sources, even when they emit substantially monochromatic light, have a certain spectral width, it is possible to cover enough portions of the visible spectrum with few light sources. In most cases, only portions of the visible spectrum are covered in the light that is cast on the hair fiber. According to a preferred embodiment, the light source or light sources is/are capable of providing enough spectrum intensity across the entire visible range so that a detection of reflected light can be achieved with a <NUM> resolution, that is to say with recorded signals having a particularly strong spectral intensity for reflected light every <NUM> between <NUM> and <NUM>, amounting to <NUM> input variables in the visible range.

<FIG> further shows a gaussian spectrum for electromagnetic radiation generated in a first near infrared range <NUM> between <NUM> and <NUM> and two gaussian spectra for electromagnetic radiation generated in a second near infrared range <NUM> corresponding to wavelengths between <NUM> or <NUM> and <NUM>. Similarly to what has been described in relation with the visible spectrum <NUM>, more light sources can be used and a higher number of wavelengths with high spectral intensity in the near infrared range can be generated and detected.

The second near-infrared range <NUM> can provide particularly strong absorption spectra in the light reflected and scattered by the hair fiber <NUM>.

<FIG> schematically illustrates a spectrum that can be determined for recorded signals corresponding to electromagnetic radiation that has interacted with the hair fiber <NUM>. <FIG> therefore shows how the spectrum of <FIG> is modified after interaction (in particular reflection and scattering) in the hair fiber <NUM>.

<FIG> shows spectral intensity along a vertical axis <NUM> versus wavelengths along a horizontal axis <NUM>. Strong modification of the intensity of the spectrum in the second near infrared range can be seen with absorption feature <NUM>. Another particularly noticeable feature in the visible spectrum is seen with absorption dip <NUM>, and reduction of intensity <NUM>. These spectral features are then compared to reference spectra, which can for example be spectra obtained in similar conditions on hair samples that have a known pigment composition.

Reference spectra may also merely be general information on the absorption properties of individual pigments or combinations thereof, performed via traditional spectroscopic methods and available in scientific literature or in any other form of database.

Based on this comparison, if a high correlation exists between the spectral feature identified in the spectrum that is obtained from the signals recorded by the detector <NUM> and the reference spectra, a pigment and its amount in the hair fiber <NUM> can be identified.

An advantage of the invention is that pigments and their amount in the hair fiber <NUM> can be identified even if the hair fiber comprises a complex mix of natural and or artificial pigments.

For example, among known pigments, the following chemicals might be investigated and identified in a hair fiber:.

The steps of the examples and embodiments described above can be implemented by a processor such as a computer. A computer program product comprising steps of the above-described method can be used to implement the method on a computer.

Different types of non-transitory computer readable storage mediums on which a computer program comprising instructions to implement the method of the invention can be used. These could for example comprise a processor or chip, an electronic circuit comprising several processors or chips, a hard drive, a flash or SD card, a USB stick, a CD-ROM or DVD-ROM or Blue-Ray disc, or a diskette or floppy disk.

Claim 1:
A method (<NUM>) for determining a composition of pigments in a hair fiber (<NUM>), the method comprising:
- exposing (<NUM>) a region (<NUM>) of the hair fiber (<NUM>) sequentially to electromagnetic radiation of different wavelengths, wherein the electromagnetic radiation (<NUM>) comprises wavelengths in a visible range (<NUM>) between <NUM> and <NUM>, as well as wavelengths in an infrared range between <NUM> and <NUM>, wherein the electromagnetic radiation comprises at least three wavelengths in the visible range, at least one wavelength in a first near infra-red range (<NUM>) from <NUM> to <NUM> and at least one wavelength in a second near-infrared range (<NUM>) from <NUM> to <NUM>;
- recording (<NUM>), using a camera of a mobile phone, signals corresponding to electromagnetic radiation that has interacted with the hair fiber during exposure of the region of the hair fiber, wherein the recorded signals from electromagnetic radiation that has interacted with the hair fiber during exposure of the region of the hair fiber form a plurality of images;
- comparing (<NUM>) a spectrum of the recorded signals to reference spectra of hair having known pigment compositions, wherein spectral characteristic of the region of the hair fiber is determined by processing the plurality of images so as to reconstruct a hyperspectral image of the hair fiber;
- identifying (<NUM>) a pigment composition in the region of the hair fiber based on the comparison.