Patent Description:
There are many different types of personal care operations in which images of hair and skin can be evaluated to determine properties of the skin, hair or both, with those properties being taken into account when performing the personal care operation, or when providing guidance or recommendations to a user of a personal care device that is to perform a personal care operation. Exemplary personal care operations include shaving, hair cutting, hair removal, hair regrowth, photoepilation, skin massage, skin light treatment, etc. In a hair cutting or shaving device, it can be useful, for example, to determine a thickness or density of hairs to be cut or shaved, as this can be used to adjust the cutting or shaving parameters of the personal care device. In a photoepilation or skin light treatment device, it can be useful, for example, to determine a thickness or colour of hairs, or a skin tone, in order to use an appropriate power and/or wavelength of light, and also useful to determine a hair count per area during the course of treatment to allow for the efficacy of the photoepilation treatment to be monitored.

While it is straightforward to obtain images of hair and skin, for example using a camera on a smartphone, tablet or smart mirror, etc., it is not always straightforward to analyse the images to distinguish between the hair and skin in the image or to determine properties of the hair and skin in the image. It is known that skin and hair properties vary from person to person, and so a common approach to define skin types and hair types and to derive suitable parameters from those general types to "optimise" hair recognition on skin. However, given the variation of skin types and hair types, and the combinations thereof, such optimisation is not in fact optimal.

<FIG> illustrates different skin type and hair colour combinations. Six skin types are defined, labelled I-VI, from lightest (type I) to darkest (type VI), and six hair colours, including grey, light blond, dark blond, light brown, dark brown and black. The grid <NUM> shows the possible combinations of skin type and hair colour, with six of those combinations (the ones marked with hatching) not being considered possible. The example images <NUM>, <NUM>, <NUM>, <NUM> were obtained by a device using common settings of different skin type/hair colour combinations. Image <NUM> is for a subject with a dark skin type and black hair, image <NUM> is for a subject with a light skin type and black hair, image <NUM> is for a subject with a light skin type and brown hair, and image <NUM> is for a subject with a light skin type and grey/blond hair. In images <NUM>, <NUM> and <NUM> the hairs are readily distinguishable, whereas in image <NUM> the hairs are difficult to see due to a poor optical hair-skin contrast.

It is noted that <CIT> discloses a method which might detect a skin region by having two LEDs emitting light at different wavelengths, a camera receiving reflected light from an object at different timings creating first and second up images which include at least a skin detection region used for detecting the skin region.

It is further noted that in the paper titled "<NPL>, it is discussed that a drivers face region can be detected by a camera during nighttime driving by using unique reflecting characteristics of materials.

In the case of shaving, simulations and user test results show that taking into account user characteristics and variation (e.g. hair, skin, user handling) can be more important for the end shaving performance results than further general improvements that could be made to the mechanical design of the shaver. Objective and subjective test results support this, showing a much larger spread between users than between types of shavers.

Thus, shaving performance can be improved by taking into account individual differences in hair and/or skin type, and similar benefits are expected for other types of personal care operations too. A user's hair and/or skin type, and hair and skin properties relevant for the personal care operation, can be determined using a sensor or a questionnaire. The properties of hairs which can be relevant for personalisation of a personal care operation, can include colour, thickness, shape, density and/or orientation. The properties of skin which can be relevant for personalisation of a personal care operation, can include colour, tone, the presence of scars, moles, freckles, spots, etc..

The optical properties of skin and hair are similar and therefore the contrast between the two is limited. This contrast is dependent not only on the colour of the skin and hair but also on other properties of the skin and hair. For instance, an optical method that provides a high contrast with respect to the colour of skin and hair, can mean that light and thin hairs (e.g. non-medullated blond hairs) on light skin (i.e. skin type <NUM>-<NUM>) - such as in image <NUM> - would be hard to detect. This can lead to poor efficacy for hair detection and thus may deteriorate the possibilities for personalisation.

Therefore, there is a need for improvements in the analysis of images of hair and skin on a body of a subject, and in particular to a technique for selecting spectral bands for a subject that enables or improves the analysis of an image of the subject's skin and hair.

According to a first specific aspect, there is provided a computer-implemented method configured for analysing images of hair and skin on a body of a subject. The method comprises (i) receiving one or more images of a body part of the subject, the one or more images comprising a skin region corresponding to skin on the body part and a hair region corresponding to hair on the body part; (ii) processing the one or more images to determine diffuse reflectance of the skin region at different wavelengths of light; (iii) processing the one or more images to determine diffuse reflectance of the hair region at different wavelengths of light; (iv) determining a first contrast measure for a first pair of values of first and second wavelengths, wherein the first contrast measure is determined from the diffuse reflectance intensities for the skin region and the hair region in first and second spectral bands of light, wherein the first and second spectral bands are respectively centred on the value of the first wavelength and the value of the second wavelength in the first pair of values; (v) repeating step (iv) to determine one or more further contrast measures for respective further pairs of values of the first and second wavelengths; and (vi) selecting first and second spectral bands corresponding to the pair of values of the first and second wavelengths that provides a contrast measure that meets a criterion; wherein each value of the first wavelength is in the range between <NUM> and <NUM>, and each value of the second wavelength is in the range between <NUM> and <NUM>, wherein in a pair of values, the value of the first wavelength is different to the value of the second wavelength. Thus, the first aspect provides a technique for selecting spectral bands for a subject that enables or improves the analysis of an image of the subject's skin and hair.

Step (iv) comprises determining the first contrast measure from (a) a difference between the diffuse reflectance intensity for the skin region in the first spectral band and the diffuse reflectance intensity for the skin region in the second spectral band, and (b) a difference between the diffuse reflectance intensity for the hair region in the first spectral band and the diffuse reflectance intensity for the hair region in the second spectral band. In these embodiments, step (iv) can comprise determining the first contrast measure as a ratio of the differences.

In some embodiments, one of: the criterion is met if the magnitude of the contrast measure is above a threshold; the criterion is met if the magnitude of the contrast measure is below a threshold; the criterion is met if the contrast measure is the highest of the determined contrast measures; the criterion is met if the contrast measure is the lowest of the determined contrast measures; and the criterion is met if the contrast measure is an optimal value.

In some embodiments, the method further comprises controlling one or more light sources to concurrently or separately illuminate the subject with light including wavelengths corresponding to the selected first and second spectral bands; and receiving one or more further images of the subject while the subject is illuminated with the light including wavelengths corresponding to the selected first and second spectral bands. In these embodiments, the method can further comprise analysing the received one or more further images to determine one or more properties of the skin and/or hair of the subject.

In alternative embodiments, the method further comprises analysing the received one or more images in the selected first and second spectral bands to determine one or more properties of the skin and/or hair of the subject.

In some embodiments, the method further comprises receiving or determining an indication of the skin tone of the subject and/or the hair colour of the subject in the received one or more images. In these embodiments, the method can further comprise repeating the method on images of hair and skin for a plurality of different subjects having different skin tones and/or different hair colours. In these embodiments, the method can further comprise: storing, in a look-up table or database, an indication of the selected first and second spectral bands, and/or an indication of the pair of values of the first and second wavelengths corresponding to the selected first and second spectral bands, and the corresponding indication of the tone of the skin and/or colour of the hair. In these embodiments, the method can further comprise: receiving an indication of a skin tone and/or a hair colour of a further subject to be imaged; and using the look-up table or database to determine first and second spectral bands to use for imaging the further subject according to the skin tone and/or hair colour in the received indication. In these embodiments, the method can further comprise: controlling one or more light sources to illuminate the further subject with light including wavelengths corresponding to the determined first and second spectral bands; and obtaining an image of the further subject while the subject is illuminated with the light including wavelengths corresponding to the determined first and second spectral bands. In these embodiments, the method can further comprise analysing the obtained image of the further subject in the determined first and second spectral bands to determine one or more properties of the skin and/or hair of the further subject.

According to a second aspect, there is provided a computer program product comprising a computer readable medium having computer readable code embodied therein, the computer readable code being configured such that, on execution by a suitable computer or processor, the computer or processor is caused to perform the method according to the first aspect or any embodiment thereof.

According to a third aspect, there is provided an apparatus configured for analysing images of hair and skin on a body of a subject. The apparatus is configured to: (i) receive one or more images of a body part of the subject, the image comprising a skin region corresponding to skin on the body part and a hair region corresponding to hair on the body part; (ii) process the one or more images to determine diffuse reflectance of the skin region at different wavelengths of light; (iii) process the one or more images to determine diffuse reflectance of the hair region at different wavelengths of light; (iv) determine a first contrast measure for a first pair of values of first and second wavelengths, wherein the first contrast measure is determined from the diffuse reflectance intensities for the skin region and the hair region in first and second spectral bands of light, wherein the first and second spectral bands are respectively centred on the value of the first wavelength and the value of the second wavelength in the first pair of values; (v) repeat operation (iv) to determine one or more further contrast measures for respective further pairs of values of the first and second wavelengths; and (vi) select first and second spectral bands corresponding to the pair of values of the first and second wavelengths that provides a contrast measure that meets a criterion; wherein each value of the first wavelength is in the range between <NUM> and <NUM>, and each value of the second wavelength is in the range between <NUM> and <NUM>, wherein in a pair of values, the value of the first wavelength is different to the value of the second wavelength.

In some embodiments, the apparatus is configured to receive the one or more images from an image acquisition unit or a memory unit. In some embodiments, the image acquisition unit comprises an illumination unit for generating light to illuminate the subject when an image is to be acquired. In some embodiments, the illumination unit is configured to selectively generate light in specific spectral bands.

In some embodiments, the apparatus further comprises the image acquisition unit. In other embodiments, the apparatus is part of a system that comprises the image acquisition unit. Further embodiments of the third aspect are also provided in which the apparatus is further configured to perform the method according to any of the various embodiments of the first aspect.

As noted above, it can be useful to be able to analyse images of skin and hair of a subject, for example to enable parameters of a personal care operation to be adapted to the subject. As outlined below, it has been found that using particular wavelengths of light to obtain images from a subject can improve the contrast between the hair and skin in the image, enabling properties of the hair and/or skin to be more easily derived. Due to the different optical properties of different skin types and hair colours, there is no universal set of wavelengths that are applicable to all subjects, and so the techniques described herein provide a technique for selecting spectral bands centred on specific wavelengths for a subject that enables or improves the analysis of an image of the subject's skin and hair, in particular, facial hair.

Before describing the technique and apparatus for implementing the technique in more detail, a discussion of the principles underlying the technique is provided.

In the following, the preliminary results obtained using a hyperspectral imaging system are discussed. An aim of this pilot experiment was to identify a spectral band which shows a maximum hair-skin contrast for all hair-skin types (i.e. all combinations of hair colour and skin type). Hyperspectral imaging of the full face of several subjects was performed using a hyperspectral imaging set-up that utilises polarised white light illumination and cross-polarised detection of the light reflected from the skin in a bandwidth of <NUM> nanometres (nm)-<NUM> in steps of <NUM>. Experiments were performed on eight test subjects with different skin types, and the results are shown in <FIG>. It should be noted that the hyperspectral imaging set-up is not required for implementing the techniques described herein, and thus further details are not provided.

<FIG> shows a graph for each subject, showing the ratio of light intensity detected from the skin for different wavelengths (shown by line <NUM>) and the ratio of light intensity from hairs for different wavelengths (shown by line <NUM>). The ratio of light intensity across the range of wavelengths detected from the skin is referred to herein as a "skin diffuse reflectance spectrum" and the ratio of light intensity across the range of wavelengths detected from the hair is referred to herein as a "hair diffuse reflectance spectrum". The eight subjects have different combinations of skin type and hair colour. From left to right in the top row of graphs, the subjects have skin type II and light blond hair, skin type II and dark blond hair, skin type II and light brown hair, and skin type III and dark blond hair. From left to right in the bottom row of graphs, the subjects have skin type III and light brown hair, skin type III and dark brown hair, skin type IV and dark brown hair, and skin type V and black hair.

It can also be seen from <FIG> that the hair-skin contrast is a maximum around in a spectral band between <NUM> and <NUM>, but the optimal range and position of the band depends on the specific hair-skin type for the subject.

In view of these results, a difference imaging technique is proposed in which light in two or more particular spectral bands reflected from the skin and hair is evaluated in order to enhance the contrast between the skin and hair. The centre wavelength of each spectral band will depend on the subject (and in particular their skin type and/or hair colour), and in some embodiments the width of the spectral band also depends on the subject (and in particular their skin type and/or hair colour). In the following, the techniques are described with reference to the use of light in two spectral bands, but it will be appreciated that the techniques can use light in three or more spectral bands. Table <NUM> below sets out the broad wavelength bands within which the centre wavelengths of two particular spectral bands for any subject will reside. The spectral bands are defined by respective centre wavelengths, denoted λ<NUM> and λ<NUM> respectively. Table <NUM> shows that, regardless of the skin type and hair colour, the first spectral band has its centre wavelength λ<NUM> in the range between <NUM> and <NUM>, and the second spectral band has its centre wavelength λ<NUM> in the range between <NUM> and <NUM>.

Tables <NUM>-<NUM> below show the contrast obtained for different pairs of spectral band centre wavelengths, with the contrast being derived from the diffuse reflectance spectra shown in <FIG>. Thus, Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type II and light blond hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type II and dark blond hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type II and light brown hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type III and dark blond hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type III and light brown hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type III and dark brown hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type IV and dark brown hair.

Table <NUM> shows the contrast obtained for different combinations of first and second spectral bands for a subject with skin type V and black hair.

<FIG> shows dual spectral band differential matrices for a particular subject with skin type II and light blond hair. The graph in <FIG> shows the spectral integrated intensity difference calculated between different pairs of spectral bands for skin, the graph shown in <FIG> shows the spectral integrated intensity difference calculated between different pairs of spectral bands for hair, and the graph in <FIG> shows the relative contrast in the form of a contour plot of the skin-to-hair dual spectral band differential contrast ratio. <FIG> allows for a visual determination of optimal wavelength pairs that result in high contrast between hair and skin. The relative contrast in <FIG> is derived as the ratio of the graph in <FIG> to the graph in <FIG>.

<FIG> shows graphs of the contrast ratio - derived as shown in <FIG> - for the eight subjects from <FIG>. <FIG> shows that, for different skin and hair colour combinations, different optimal wavelength pairs result in maximum contrast values, and thus there is no wavelength pair that is applicable to all skin and hair colour combinations. Therefore, as provided by the techniques described herein, the wavelengths in the wavelength pair is 'tuned' for improved or maximum contrast for a specific hair-skin combination.

The graph in <FIG> illustrates the improvement in contrast between hair and skin in images obtained using the described techniques with suitable dual spectral bands for the eight subjects in <FIG> and <FIG> compared to images obtained using white light.

The block diagram in <FIG> illustrates an embodiment of an apparatus <NUM> for analysing images of hair and skin on a body of a subject according to the techniques described herein. In this illustration, the apparatus <NUM> is shown as part of a system <NUM> that also includes a separate image acquisition unit <NUM> for obtaining one or more images of a subject. In alternative embodiments, the apparatus <NUM> can include the image acquisition unit <NUM>, or otherwise include functionality for performing the functions of the image acquisition unit <NUM>. In other embodiments the apparatus <NUM> can be implemented independently of any device or unit that obtains the images of the subject.

The apparatus <NUM> can be any type of electronic device or computing device. For example, the apparatus <NUM> can be, or be part of, a smartphone, a tablet, a smart watch, a smart mirror, a laptop, a computer or a server, for example a server in a data centre (also referred to as being `in the cloud'). In some embodiments, the apparatus <NUM> can be, or be part of, a personal care device, for example a shaver, epilator, or skin treatment device. Where present, the image acquisition unit <NUM> may be in the form of, or be part of, a smartphone, a tablet, a smart watch, a smart mirror, a laptop, or other device capable of obtaining an image of a subject. In some embodiments, the image acquisition unit <NUM> may be in the form of, or be part of, a personal care device, for example a shaver, epilator, or skin treatment device.

The apparatus <NUM> includes a processing unit <NUM> that controls the operation of the apparatus <NUM> and that can be configured to execute or perform the methods described herein. The processing unit <NUM> can be implemented in numerous ways, with software and/or hardware, to perform the various functions described herein. The processing unit <NUM> may comprise one or more microprocessors or digital signal processors (DSPs) that may be programmed using software or computer program code to perform the required functions and/or to control components of the processing unit <NUM> to effect the required functions. The processing unit <NUM> may be implemented as a combination of dedicated hardware to perform some functions (e.g. amplifiers, pre-amplifiers, analog-to-digital convertors (ADCs) and/or digital-to-analog convertors (DACs)) and a processor (e.g., one or more programmed microprocessors, controllers, DSPs and associated circuitry) to perform other functions. Examples of components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, DSPs, application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), hardware for implementing a neural network and/or so-called artificial intelligence (AI) hardware accelerators (i.e. a processor(s) or other hardware specifically designed for AI applications that can be used alongside a main processor).

The processing unit <NUM> is connected to a memory unit <NUM> that can store data, information and/or signals for use by the processing unit <NUM> in controlling the operation of the apparatus <NUM> and/or in executing or performing the methods described herein. In some implementations the memory unit <NUM> stores computer-readable code that can be executed by the processing unit <NUM> so that the processing unit <NUM> performs one or more functions, including the methods described herein. The memory unit <NUM> can comprise any type of non-transitory machine-readable medium, such as cache or system memory including volatile and non-volatile computer memory such as random access memory (RAM), static RAM (SRAM), dynamic RAM (DRAM), read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM) and electrically erasable PROM (EEPROM), and the memory unit <NUM> can be implemented in the form of a memory chip, an optical disk (such as a compact disc (CD), a digital versatile disc (DVD) or a Blu-Ray disc), a hard disk, a tape storage solution, or a solid state device, including a memory stick, a solid state drive (SSD), a memory card, etc..

In some embodiments, the apparatus <NUM> can also comprise interface circuitry <NUM> for enabling a data connection to and/or data exchange with other devices, including, for example, image acquisition unit <NUM>, and optionally any other devices such as servers, databases, user devices, etc. The connection may be direct or indirect (e.g. via the Internet), and thus the interface circuitry <NUM> can enable a connection between the apparatus <NUM> and image acquisition unit <NUM> via a network (such as the Internet), or directly between the apparatus <NUM> and image acquisition unit <NUM>, via any desirable wired or wireless communication protocol. For example, the interface circuitry <NUM> can operate using WiFi, Bluetooth, Zigbee, or any cellular communication protocol. In the case of a wireless connection, the interface circuitry <NUM> (and thus apparatus <NUM>) may include one or more suitable antennas for transmitting/receiving over a transmission medium (e.g. the air). Alternatively, in the case of a wireless connection, the interface circuitry <NUM> may include means (e.g. a connector or plug) to enable the interface circuitry <NUM> to be connected to one or more suitable antennas external to the apparatus <NUM> for transmitting/receiving over a transmission medium (e.g. the air). The interface circuitry <NUM> is connected to the processing unit <NUM> to enable information or data received by the interface circuitry <NUM> to be provided to the processing unit <NUM>, and/or information or data from the processing unit <NUM> to be transmitted by the interface circuitry <NUM>.

In some embodiments, the apparatus <NUM> comprises a user interface <NUM> that includes one or more components that enables a user of apparatus <NUM> (e.g. the subject) to input information, data and/or commands into the apparatus <NUM>, and/or enables the apparatus <NUM> to output information or data to the user of the apparatus <NUM>. For example the user interface <NUM> can include a display screen for displaying one or more images of the subject, and/or the results of analysis of images of the skin and hair of the subject. The user interface <NUM> can comprise any suitable input component(s), including but not limited to a keyboard, keypad, one or more buttons, switches or dials, a mouse, a track pad, a touchscreen, a stylus, a camera, a microphone, etc., and/or the user interface <NUM> can comprise any suitable output component(s), including but not limited to a display screen, one or more lights or light elements, one or more loudspeakers, a vibrating element, etc..

It will be appreciated that a practical implementation of apparatus <NUM> may include additional components to those shown in <FIG>. For example, the apparatus <NUM> may also include a power supply, such as a battery, or components for enabling the apparatus <NUM> to be connected to a mains power supply.

The image acquisition unit <NUM> is provided to obtain one or more images of the skin and hair of the subject. These images are to be analysed by the apparatus <NUM> according to the techniques described herein. thus, the image acquisition unit <NUM> comprises an imaging unit <NUM> for obtaining images. The imaging unit <NUM> may include any suitable components for capturing one or more images or a video sequence comprising multiple images, for example a charge-coupled device (CCD) and one or more lenses and/or mirrors. In some embodiments, the imaging unit <NUM> is a camera, such as a digital camera. In some embodiments, the imaging unit <NUM> can be configured, or be configurable to, obtain images in one or more specific spectral bands, for example in at least two spectral bands with respective centre wavelengths in the range from <NUM> to <NUM>. For example, the imaging unit <NUM> may comprise one or more filters to enable light in the desired spectral band to be used to form the image. Alternatively, the sensor in the imaging unit <NUM> may be configured to only sense light in one or more specific spectral bands. In other embodiments the imaging unit <NUM> can be sensitive to light across the range from <NUM> to <NUM>, and subsequent processing of the image data can extract or select image data corresponding to a required spectral band.

In some embodiments, the image acquisition unit <NUM> can comprise interface circuitry <NUM> for enabling a data connection to and/or data exchange with other devices, including, for example, apparatus <NUM> (via interface circuitry <NUM>), and optionally any other devices such as servers, databases, user devices, etc. The interface circuitry <NUM> can be implemented in a similar way to the interface circuitry <NUM> described above.

In some embodiments, the imaging unit <NUM> obtains images of the subject using the ambient light in the environment of the subject. However, in other embodiments the image acquisition unit <NUM> comprises an illumination unit <NUM> for generating light to illuminate the subject when an image is to be acquired by the imaging unit <NUM>. The illumination unit <NUM> may be configured to generate white light or otherwise light across a broad spectrum of wavelengths, e.g. at least from <NUM> to <NUM>. In other embodiments the illumination unit <NUM> may be configured to selectively generate light in specific spectral bands, for example in at least two spectral bands with respective centre wavelengths in the range from <NUM> to <NUM>. The illumination unit <NUM> may be configured to generate the light in the specific spectral bands at the same time, or at different times (i.e. the illumination unit <NUM> can generate light in the first spectral band for a first time period and light in the second spectral band for a second time period). In some embodiments the illumination unit <NUM> is controllable to generate light in a required spectral band. In particular, the illumination unit <NUM> can be controlled to generate light in the two spectral bands identified according to the techniques described herein that are particularly suitable for the subject being imaged. In embodiments where the illumination unit <NUM> is to generate light in multiple spectral bands, the illumination unit <NUM> can be provided with a suitable arrangement of light sources, filters, etc. to enable light of the required wavelengths to be generated.

The flow chart in <FIG> illustrates a method of analysing images of hair and skin on a body of a subject. The method can be implemented by the apparatus <NUM>, for example by the processing unit <NUM> executing suitable computer code stored in the memory unit <NUM>. The method is also described with reference to <FIG>, which shows an exemplary image <NUM> and several graphs/plots <NUM>-<NUM> illustrating steps of the method.

Thus, in step <NUM>, one or more images of a body part of the subject are received by the apparatus <NUM>. The image(s) may have been obtained by an image acquisition unit <NUM>. The image(s) may be received directly from the image acquisition unit <NUM>, for example in real-time as the image(s) are acquired, or the image(s) may be received by retrieving the image(s) from a memory, such as memory unit <NUM>. An exemplary image <NUM> is shown in <FIG>. The body part of the subject in the image <NUM> includes one or more 'skin regions' <NUM> which are regions of skin on the body part, and one or more 'hair regions' <NUM> which are regions of hair on the body part. It should be noted that hair regions <NUM> correspond to the hairs themselves, and the skin region(s) <NUM> include areas of skin between individual hairs.

In some embodiments, a plurality of images are received in step <NUM>, with each image <NUM> being obtained for light of a respective wavelength or narrow band of wavelengths. Each image <NUM> may have been obtained by an image acquisition unit <NUM> while the body part is sequentially or consecutively illuminated with light of different wavelengths or different narrow bands of wavelengths. Alternatively, the plurality of images can be obtained by an image acquisition unit <NUM> while the body part is illuminated with white light, and an imaging unit <NUM> can use a filter or other means to capture a set of images from respective wavelengths of light or from respective different narrow bands of wavelengths.

In step <NUM>, the image(s) <NUM> are processed to determine the intensity of diffuse reflectance from the skin region(s) <NUM> at different wavelengths of light. <FIG> shows an exemplary graph <NUM> of the intensity of diffuse reflectance from the skin region(s) <NUM> for different wavelengths, which is denoted Rskin(λ). The diffuse reflectance of the skin region(s) <NUM> for different wavelengths is also referred to as a `skin region diffuse reflectance spectrum'. Those skilled in the art will appreciate that a diffuse reflectance spectrum is a measurement of the diffuse reflection of light from the sample in the image <NUM>, and excludes the specular reflectance of light from the sample.

In step <NUM>, the image(s) <NUM> are processed to determine the intensity of diffuse reflectance from the hair region(s) <NUM> at different wavelengths of light. Step <NUM> can be performed before, after, or at the same time as, step <NUM>. <FIG> shows an exemplary graph <NUM> of the intensity of diffuse reflectance from the hair region(s) <NUM> for different wavelengths, which is denoted Rhair(λ). The diffuse reflectance of the hair region(s) <NUM> for different wavelengths is also referred to as a 'hair region diffuse reflectance spectrum'.

Step <NUM> and/or <NUM> can be performed in a number of different ways. In each case, the intensity of diffuse reflectance at a series of different wavelengths or series of narrow bands of wavelengths reflected from the skin region(s) <NUM> and reflected from the hair region(s) <NUM> are determined. In embodiments where each image <NUM> relates to a specific wavelength or specific narrow band of wavelengths, each image <NUM> can be analysed to determine the intensity of diffuse reflectance from the skin region(s) <NUM> and the hair region(s) <NUM> in the images <NUM>. For an image <NUM> at a particular wavelength (or narrow band of wavelengths), the intensity of diffuse reflectance from the skin can be determined by averaging the intensity of a number of pixels in the image <NUM> corresponding to skin region(s) <NUM>. This is repeated for the images <NUM> at different wavelengths to form the skin region diffuse reflectance spectrum. In some embodiments, only a subset of the pixels corresponding to skin region(s) <NUM> may be used to determine the intensity of the diffuse reflectance, for example a subset of pixels in a part of the image <NUM> that does not include and/or is not close to, hair region(s) <NUM> (e.g. to avoid errors or artefacts due to shadows cast by the hairs, etc.). The hair region diffuse reflectance spectrum can be determined from the images <NUM> in a similar way.

It will be appreciated that for some of the above embodiments of steps <NUM> and/or <NUM>, prior to determining the intensity of diffuse reflectance, the received image(s) <NUM> can be processed in order to identify a part or parts of the image(s) <NUM> that correspond to skin and a part or parts that correspond to hair. Techniques for identifying skin and/or hair in an image are known in the art, and are not described further herein.

In step <NUM>, a first contrast measure is determined for a first pair of values of first and second wavelengths. In particular the first contrast measure is determined from the diffuse reflectance intensities for the skin region <NUM> and the hair region <NUM> in first and second spectral bands of light, with the first and second spectral bands being respectively centred on the value of the first wavelength (λ<NUM>) and the value of the second wavelength (λ<NUM>). The first wavelength is a value between <NUM> and <NUM>, and the second wavelength is a value between <NUM> and <NUM>. The spectral bands are also referred to herein as 'detection bands'. Plot <NUM> in <FIG> shows an exemplary first spectral band that is centred on λ<NUM>, and plot <NUM> in <FIG> shows an exemplary second spectral band that is centred on λ<NUM>. The first wavelength and the second wavelength have different values. The first spectral band is defined as a function F<NUM> of wavelength λ with a peak at λ<NUM>, and represents a sensitivity curve or filter that is to be applied to the diffuse reflectance spectra determined in steps <NUM> and <NUM>. Likewise, the second spectral band is defined as a function F<NUM> of wavelength λ with a peak at λ<NUM>, and represents a sensitivity curve or filter that is to be applied to the diffuse reflectance spectra determined in steps <NUM> and <NUM>.

In some embodiments, a detectable skin diffuse reflectance intensity in the first spectral band, Sskin<NUM>(λ<NUM>). can be determined as: <MAT> i.e. a sum of the product of the first spectral band and the skin region diffuse reflectance spectrum across all wavelengths (or more specifically across <NUM> to <NUM>). The detectable skin diffuse reflectance intensity Sskin<NUM>(λ<NUM>) is shown in plot <NUM> of <FIG>.

In these embodiments, a detectable skin diffuse reflectance intensity in the second spectral band, Sskin<NUM>(λ<NUM>), can also be determined as: <MAT> i.e. a sum of the product of the second spectral band and the skin region diffuse reflectance spectrum across all wavelengths (or more specifically across <NUM> to <NUM>). The detectable skin diffuse reflectance intensity Sskin<NUM>(λ<NUM>) is shown in plot <NUM> of <FIG>.

In these embodiments, a detectable hair diffuse reflectance intensity in the first spectral band, Shair<NUM>(λ<NUM>), can also be determined as: <MAT> i.e. a sum of the product of the first spectral band and the hair region diffuse reflectance spectrum across all wavelengths (or more specifically across <NUM> to <NUM>). The detectable hair diffuse reflectance intensity Shαir<NUM>(λ<NUM>) is shown in plot <NUM> of <FIG>.

Finally, in these embodiments, a detectable hair diffuse reflectance intensity in the second spectral band, Shair<NUM>(λ<NUM>), can also be determined as: <MAT> i.e. a sum of the product of the second spectral band and the hair region diffuse reflectance spectrum across all wavelengths (or more specifically across <NUM> to <NUM>). The detectable hair diffuse reflectance intensity Shair<NUM>(λ<NUM>) is shown in plot <NUM> of <FIG>.

In some embodiments, the contrast measure can be determined from a difference between the detected diffuse reflectance intensity for the skin region in the first spectral band (e.g. plot <NUM>) and the detected diffuse reflectance intensity for the skin region in the second spectral band (plot <NUM>), and a difference between the detected diffuse reflectance for the hair region in the first spectral band (plot <NUM>) and the detected diffuse reflectance for the hair region in the second spectral band (plot <NUM>). In some embodiments, the contrast measure is determined from a ratio of these differences. In particular, the contrast measure for the first pair of values of the first and second wavelengths can be determined as: <MAT>.

Thus, equation (<NUM>) gives the contrast of the skin regions relative to the hair regions. It will be appreciated that (although less preferred) the contrast measure could instead relate to the contrast of the hair regions relative to the skin regions by inverting the ratio in equation (<NUM>).

In a computationally more efficient approach than the approach outlined above with regard to equations (<NUM>)-(<NUM>), having determined the skin region diffuse reflectance spectrum and the hair region diffuse reflectance spectrum in steps <NUM> and <NUM>, the first contrast measure can be calculated for the first pair of values of the first and second wavelengths directly as: <MAT>.

As with equation (<NUM>), the contrast measure in equation (<NUM>) gives the contrast of the skin regions relative to the hair regions.

Next, in step <NUM>, step <NUM> is repeated for respective further pairs of values of the first and second wavelengths to determine one or more further contrast measures. That is, one or both of the values of the first and second wavelength are changed, and a further contrast measure determined as described above. Step <NUM> can be repeated any number of times, but preferably contrast measures are determined for a range of values of the first wavelength between <NUM> and <NUM>, and a range of values of the second wavelength between <NUM> and <NUM>.

In some embodiments, a skin spectral difference map can be determined for different values of the first and second wavelengths, and a hair spectral difference map can be determined for different values of the first and second wavelengths. The skin spectral difference map can be given by: <MAT> and the hair spectral difference map can be given by: <MAT>.

Finally, in step <NUM>, the plurality of contrast measures are evaluated to select a particular pair of first and second spectral bands. In particular, a pair of first and second spectral bands are selected for which the corresponding pair of values of the first and second wavelengths provide a contrast measure that meets a criterion. For example, the criterion can be the highest contrast measure, and therefore the first and second spectral bands (and the corresponding first and second wavelengths) are selected that provided the highest contrast measure. Mathematically, step <NUM> can be expressed as: <MAT> where Δλ<NUM>, Δλ<NUM> represent the width of the first spectral band and the second spectral band respectively. In some embodiments, the values of Δλ<NUM>, Δλ<NUM> are fixed, whereas in other embodiments, the width of one or both of the first spectral band and the second spectral band can be varied in repetitions of step <NUM> to determine different contrast measures. In embodiments where the widths of the first and second spectral bands are not varied, the width of the spectral bands can be set to any value in the range <NUM> to <NUM>.

The criterion evaluated in step <NUM> can take any suitable form. For example, the criterion could be or include a threshold, and the criterion can be met by a contrast measure that exceeds the threshold. Alternatively, the criterion could be or include a threshold, and the criterion can be met by a contrast measure that is below the threshold. Alternatively, the criterion can be met by the highest of the determined contrast measures. Alternatively, the criterion can be met by the lowest of the determined contrast measures. In another alternative, the criterion is met if the contrast measure is an optimal value. An optimal value is the maximum value, or the minimum value.

In some embodiments, once the first and second spectral bands have been selected in step <NUM>, one or more light sources (e.g. in illumination unit <NUM>) can be used to concurrently or separately illuminate the subject with light including wavelengths corresponding to the selected first and second spectral bands. An imaging unit <NUM> can be used to obtain one or more further images of the subject while illuminated with this light, and these images received by the processing unit <NUM>. These further images can be analysed to determine one or more properties of the skin and/or hair of the subject.

Alternatively, once the first and second spectral bands have been selected in step <NUM>, the image(s) received in step <NUM> can be analysed to determine one or more properties of the skin and/or hair of the subject. In particular, where a plurality of images are received in step <NUM>, with each image <NUM> being obtained for light of a respective wavelength or narrow band of wavelengths, the analysis to determine one or more properties of the skin and/or hair can be performed on the images <NUM> corresponding to the selected first and second spectral bands.

In either of the above embodiments, the property or properties of hair can include, for example, colour, thickness, shape, density and/or orientation. The property or properties of skin can include, for example, colour, tone, the presence of scars, moles, freckles, spots, etc. Techniques for deriving these properties from images are known in the art, and are not described further herein.

In some embodiments, the results of the analysis can be used in a personal care operation, such as shaving, to improve the performance of the personal care operation and/or to provide feedback to the subject about the personal care operation. For example, the analysis can determine that there are (still) hairs to be shaved on the body part, and therefore the subject needs to shave that part of the body (again) for a cleaner shave, or to achieve a certain facial hair style. On the other hand, the analysis can determine that all hairs have been sufficiently shaved, and the subject can be notified that they don't need to shave that part of the body again, thereby reducing irritation of the skin due to unnecessary shaving strokes. In the case of a personal care operation involving the application of light to the body part, e.g. photoepilation, the results of the analysis of the skin and/or hair can be used to select an appropriate power level for the light output by the photoepilator, and/or an appropriate wavelength of light output by the photoepilator. Any feedback for the subject determined from the analysis of the skin and/or hair can be provided to the subject via the user interface <NUM>. It will be appreciated from the above that to provide guidance and/or feedback on a personal care operation, the image(s) can be obtained, and the analysis of the image(s) performed, during the performance of a personal care operation, e.g. during shaving, or during a photoepilation treatment.

In some embodiments, the method can further comprise receiving or determining an indication of the skin tone of the subject and/or the hair colour of the subject in the image(s) received in step <NUM>. Such an indication can be input by the subject themselves, for example via user interface <NUM>, or the skin tone and/or hair colour can be determined from an analysis of the image(s) themselves as outlined above. The indication of the skin tone and/or hair colour can be stored in a look-up table or database, along with the pair of values of the first and second wavelengths corresponding to the first and second spectral bands selected in step <NUM>.

To expand the look-up table or database, the method in <FIG> can be repeated for a number of different subjects with different skin types and/or hair colours, and these skin types and/or hair colours can be stored in the table or database along with an indication of the pair of values of the first and second wavelengths corresponding to the first and second spectral bands selected for the respective subjects.

Thus, when another subject is to be imaged, they can input their skin tone and/or hair colour into the apparatus <NUM> (e.g. using user interface <NUM>), and the look-up table or database can be consulted to determine the appropriate first and second wavelengths to use for that skin tone and/or hair colour. The illumination unit <NUM> can be controlled to illuminate the subject with light in the appropriate spectral bands and one or more images of the subject obtained, for analysis to determine other properties of the skin and/or hairs. Alternatively, the subject can be illuminated with white light (e.g. by the illumination unit <NUM>) and appropriate filters can be used by the imaging unit <NUM> to obtain images from light in the appropriate spectral bands. Again, these images can be analysed to determine other properties of the skin and/or hairs.

Claim 1:
A computer-implemented method configured for analysing images of hair and skin on a body of a subject, the method comprising:
(i) receiving (<NUM>) one or more images of a body part of the subject, the one or more images comprising a skin region corresponding to skin on the body part and a hair region corresponding to hair on the body part;
(ii) processing (<NUM>) the one or more images to determine diffuse reflectance of the skin region at different wavelengths of light;
(iii) processing (<NUM>) the one or more images to determine diffuse reflectance of the hair region at different wavelengths of light;
(iv) determining (<NUM>) a first contrast measure for a first pair of values of first and second wavelengths, wherein the first contrast measure is determined from (a) a difference between the diffuse reflectance intensity for the skin region in the first spectral band and the diffuse reflectance intensity for the skin region in the second spectral band, and (b) a difference between the diffuse reflectance intensity for the hair region in the first spectral band and the diffuse reflectance intensity for the hair region in the second spectral band, wherein the first and second spectral bands are respectively centred on the value of the first wavelength and the value of the second wavelength in the first pair of values;
(v) repeating (<NUM>) step (iv) to determine one or more further contrast measures for respective further pairs of values of the first and second wavelengths; and
(vi) selecting (<NUM>) first and second spectral bands corresponding to the pair of values of the first and second wavelengths that provides a contrast measure that meets a criterion;
wherein each value of the first wavelength is in the range between <NUM> and <NUM>, and each value of the second wavelength is in the range between <NUM> and <NUM>, wherein in a pair of values, the value of the first wavelength is different to the value of the second wavelength.