Patent Description:
When performing a personal care activity, such as shaving or trimming hair, it is often desirable to perform the particular activity accurately in order to achieve the desired result. For example, when trimming a beard, a user may intend that the beard is trimmed similarly on both sides of the face, and may intend for the beard to appear symmetrical.

To aid the user, the user may perform the personal care activity in front of a mirror, so that they can view their reflection, or in front of a device capable of displaying a live image of the user while the activity is performed. Even then, it may be difficult to know what the result will be of performing the personal care activity.

An example of prior art is given by the patent documentation <CIT>.

In contrast to existing systems, embodiments of this disclosure provide a mechanism by which a user can see a visual prediction of an outcome of a personal care activity before the activity has been performed. The inventors have recognised that, by using various pieces of data, it is possible to generate an image illustrating an effect of using a personal care device, such that a user can see the effect of the device before it is used. For example, a user of a shaving device may be able to view a representation of their face which includes a modification to illustrate how the user's face might look if the shaving device is applied to a particular portion of their face. In this way, the user is able to make a decision regarding whether or not to proceed with the treatment (e.g. shaving procedure) before any irreversible changes have been made. Moreover, by displaying the predicted modification on a representation of the user's face at a position based on the position of the personal care device, the user may be able to position the device more accurately in an intended position, thereby making easier for the user to perform personal care activity as intended.

According to a first specific aspect, there is provided an apparatus comprising a processor configured to receive image data in respect of a user of a personal care device, wherein the personal care device is to be used to treat a portion of the user; receive device operating data relating to the personal care device; determine position information of at least a treatment element of the personal care device relative to the user; generate, based on the received image data, the received device operating data and the determined position information, an image representative of a predicted appearance of the portion of the user following treatment using the personal care device; and provide the generated image for display on a representation of the user.

According to some embodiments, the processor may be further configured to determine, based on the received image data, a degree of deformation of a surface of the user by the personal care device. The processor may be further configured to generate the image representative of the predicted appearance of the portion of the user further based on the determined degree of deformation of the surface of the user.

The processor may, in some embodiments, be configured to generate the image representative of the predicted appearance of the portion of the user further based on an output of a sensor of the personal care device.

In some examples, the device operating data may comprise a size of the treatment element of the personal care device. The processor may be configured to generate the image representative of the predicted appearance of the portion of the user having a size based on the size of the treatment element.

The device operating data may comprise data indicative of an orientation and/or a motion of the personal care device. The processor may be configured to generate the image representative of the predicted appearance of the portion of the user having a size based on the orientation/motion data.

In some examples, the processor may be further configured to determine, based on the received image data, an indication of the body part of the user that is to be treated using the personal care device. The processor may be further configured to generate the image representative of the predicted appearance of the portion of the user having a size based further on the indication of the body part.

In some embodiments, the apparatus may comprise an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone or a wearable device.

According to a second aspect, there is provided a computer-implemented method comprising receiving image data in respect of a user of a personal care device, wherein the personal care device is to be used to treat a portion of the user; receiving device operating data relating to the personal care device; determining position information of at least a treatment element of the personal care device relative to the user; generating, based on the received image data, the received device operating data and the determined position information, an image representative of a predicted appearance of the portion of the user following treatment using the personal care device; and displaying the generated image on a representation of the user.

The computer-implemented method may further comprise displaying the representation of the user and the generated image on the representation of the user in an alternating manner.

In some embodiments, the computer-implemented method may further comprise determining, based on the received image data, an amount of deformation of a surface of the user by the personal care device. Generating the image representative of the predicted appearance of the portion of the user may be further based on the determined amount of deformation of the surface of the user.

According to a third aspect, there is provided a personal care system comprising a personal care device having a treatment element to be used to treat a portion of a user; an image capture device configured to capture image data in respect of the user of the personal care device; a display unit; and processing apparatus configured to operate the image capture device to capture image data in respect of the user of the personal care device; receive device operating data relating to the personal care device; determine position information of at least the treatment element of the personal care device relative to the user; generate, based on the captured image data, the received device operating data and the determined position information, an image representative of a predicted appearance of the portion of the user following treatment using the personal care device; and provide the generated image for display on a representation of the user on the display unit.

In some examples, the personal care device may comprise a first sensor configured to measure a force or pressure applied to the user by the personal care device. The processing apparatus may be configured to generate the image representative of the predicted appearance of the portion of the user further based on an output of the first sensor.

The personal care device may, in some in bottoms, comprise a second sensor configured to measure orientation data and/or motion data in respect of the personal care device. The processing apparatus may be configured to generate the image representative of the predicted appearance of the portion of the user further based on an output of the second sensor.

In some examples, the personal care device may comprise a device selected from a group comprising: a hair trimming device, a shaving device, a hair treatment device, a photoepilation device, a skin treatment device, a skin rejuvenation device and a product application device.

According to various embodiments of the invention, methods, apparatuses and systems are provided that enable a user of a personal care device to view a visual indication of the effect of performing the personal care activity before the activity has been performed. Various embodiments are described in the context of personal care activities performed using personal care devices, such as haircare devices and skin care devices. However, it will be appreciated that the disclosed embodiments may be implemented using any type of personal care device.

Referring to the drawings, <FIG> is an illustration of a user <NUM> of a personal care device <NUM>. In this example, the personal care device <NUM> comprises a shaving device of the type used to shave hair, for example from the face of the user <NUM>. In some cases, particularly when the user <NUM> cannot directly view the portion of their body being treated, the user may perform personal care activities (e.g. shaving) in front of a mirror so that they can position the personal care device <NUM> more accurately, to make it easier to achieve the desired outcome. In the example shown in <FIG>, the user <NUM> is performing the personal care activity in front of a display device <NUM> capable of displaying a representation of at least part of the user, for example a reflection of the user or a representation of the user that has been captured using a camera.

In some examples, the display device <NUM> may comprise an interactive mirror. An interactive mirror, sometimes referred to as a smart mirror, is a unit which, in addition to functioning as a mirror to show a user his or her reflection, is also capable of displaying information to the user. Information, such as text, images and videos, may be displayed on a display portion of the interactive mirror which may, for example, be positioned behind a mirrored (or partially mirrored) panel or a mirrored (or partially mirrored) surface. In this way, the display screen, or portions thereof, may be visible through the mirror portion, so that a user is able to simultaneously view their reflection and information presented on the display screen. The interactive mirror <NUM> may include one or more sensors, such as an imaging device <NUM> (e.g. a camera) capable of capturing an image (e.g. of the user <NUM>) which can be displayed on the screen of the interactive mirror or used for determining data (e.g. device position data) as explained below. The interactive mirror <NUM> may be connected (wirelessly or via a wired connection) to one or more other devices, such as the personal care device <NUM>. The processing circuitry within the interactive mirror <NUM> may receive data from the personal care device <NUM> (and/or from other connected devices) and may display information to the user relating to the connected device.

In other examples, an alternative display device <NUM> may be used by the user <NUM> instead of an interactive mirror. For example, the user <NUM> may perform the personal care activity in front of a smart phone, a tablet computer, a laptop computer, or some other display device capable of displaying a representation of the user along with other information. For example, the camera <NUM> may form part of the display device or may be a separate device that is connected to the display device <NUM>.

The personal care device <NUM> may comprise a body <NUM> and a treatment element <NUM> for performing the intended treatment of the personal care device. For example, in a shaving device, the treatment element <NUM> may comprise a shaving head having blades that cut hair during use. The body <NUM> of the personal care device <NUM> may house various components. In some examples, the personal care device <NUM> may include one or more sensors, such as a first sensor <NUM> and/or a second sensor <NUM> for measuring data relating to the personal care device and/or its use.

Various steps of the methods disclosed herein may be performed using one or more processors, such as a processor <NUM>, which may form part of a computing device or cloud computing environment connected to the display device <NUM>. In examples where the display device <NUM> comprises part of a computing device (e.g. a smartphone or tablet computer), the processor <NUM> may also form part of the computing device. In the example shown in <FIG>, the processor <NUM> forms part of the interactive mirror <NUM>. According to embodiments of the invention, during use of the personal care device <NUM>, the processor <NUM> may use various data (e.g. image data acquired using the camera <NUM> and/or data acquired using the sensors <NUM>, <NUM>) to generate an image <NUM> that represents the predicted appearance of part of the user <NUM> following treatment using the personal care device <NUM>. The generated image <NUM> may comprise a patch that can be displayed on the display device <NUM> with the representation (e.g. the reflection or the generated representation) of the user <NUM>. For example, the generated image <NUM> may be presented as an overlay or a superimposed region on the display device <NUM>. In this way, the user <NUM> is able to view themselves (i.e. the representation of them) and, at the same time, see a prediction of what they will look like if they continue to use the personal care device <NUM> in a particular region.

In some embodiments, the generated image <NUM> may be displayed on the display device <NUM> as the personal care device <NUM> approaches the user <NUM> (e.g. when the personal care device is within a defined threshold distance of the user) but before the treatment element <NUM> of the personal care device treats the user. Moreover, the position of the generated image <NUM> relative to the representation of the user <NUM> on the display device <NUM> may be based on the position of the personal care device <NUM> or the position of the treatment element <NUM> that the personal care device, such that movement of the treatment element <NUM> results in movement of the image <NUM> on the display device. Thus, prior to performing the personal care activity, which may result in irreversible changes being made, the user <NUM> may view the predicted outcome shown by the generated image <NUM> and decide whether or not to proceed with the personal care activity.

According to a first aspect, the present invention provides an apparatus. <FIG> is a schematic illustration of an example of an apparatus <NUM> may be used in the implementation of embodiments of the invention. The apparatus <NUM> comprises a processor <NUM> The processor <NUM> may comprise or be functionally similar to the processor <NUM>. The apparatus <NUM> may comprise or form part of a computing device such as a smartphone or a tablet computer, or may comprise or form part of an interactive mirror. The processor <NUM> is configured to receive image data in respect of a user <NUM> of a personal care device <NUM>, wherein the personal care device is to be used to treat a portion of the user. The image data may, for example, be acquired from an image capture device or camera <NUM> forming part of a computing device or interactive mirror, or from an image capture device or camera that is separate from, but capable of delivering image data to, the apparatus <NUM>. The image data, which may be captured using known image capture techniques, in any known image format, may include part of the user <NUM> and, in some examples, may also include some or all of the personal care device <NUM>. In examples where an image of at least part of the personal care device <NUM> is captured in addition to an image of at least part of the user <NUM>, it may be possible to determine information from the image data, such as data indicative of relative position, orientation and/or movement of the personal care device <NUM> and the user <NUM>.

The camera <NUM> may comprise a 2D or 3D camera (e.g. a stereo camera) and may be capable of using techniques such as time of flight measurement. Data acquired using the camera <NUM> may be used to create a 2D and/or 3D model of at least part of the user <NUM>. Determination of the location and/orientation of the personal care device <NUM> relative to the user <NUM> (sometimes referred to as device tracking) may be achieved by monitoring the position of the user in the captured image. When the user's face is captured in the image data, the face position and orientation may be detected using facial landmarks (e.g. points of the eyes, nose mouth, and so on). The positions of the landmarks are then incorporated onto a pre-recorded 3D facial model of the user <NUM>. The position and/or orientation of the personal care device <NUM> may be obtained by detecting landmarks on the personal care device (e.g. reference points or corners of the device), sometimes referred to as device landmarks. These device landmarks may be inherent of the device aspect or may be specifically integrated into the personal care device to improve the tracking ability (e.g. green dots at specific positions on the device). The device landmarks may be analysed with respect to the facial landmarks of the user <NUM> to provide data indicative of the position and/or orientation of the personal care device relative to the portion of the user <NUM> (e.g. the face).

The processor <NUM> is also configured to receive device operating data relating to the personal care device <NUM>. Device operating data may comprise data indicative of the type or nature of the personal care device <NUM> being used, and/or details of the treatment element <NUM> being used on the personal care device. For example, device identification data may indicate the type of personal care device being used, and/or parameter information may indicate settings (e.g. cutting length). In some embodiments, device operating data may include data acquired using one or more sensors associated with the personal care device <NUM>. For example, device operating data may be acquired from a sensor or sensors located within the personal care device <NUM> or from a sensor or sensors external to but associated with the personal care device. In other examples, device operating data may include data relating to a position, orientation and/or movement of the device relative to a reference, such as the apparatus <NUM> or the user <NUM>. Thus, the device operating data may be data that has been stored in respect of the personal care device <NUM> prior to the use of the device or data that is acquired in real-time during the use of the personal care device.

The device operating data may be received from the personal care device <NUM> itself or from a storage (e.g. a memory) associated with the processor <NUM>, in which such data is stored. For example, the memory may store a database containing device operating data in respect of several personal care devices <NUM>.

The processor <NUM> is further configured to determine position information of at least a treatment element <NUM> of the personal care device <NUM> relative to the user <NUM>. Position information may include a location or position of at least the treatment element <NUM> relative to a reference point or object, such as a portion of the user <NUM> or the apparatus <NUM>, an orientation of at least the treatment element relative to the reference point or object, a distance from at least part of the treatment element to the reference point or object and/or an indication of a direction of motion of at least the treatment element relative to the reference point or object. The position information may be determined from the image data received in respect of user of the personal care device <NUM> and/or from one or more other sources, such as the device operating data and sensors within the personal care device.

The processor <NUM> is further configured to generate, based on the received image data, the received device operating data and the determined position information, an image <NUM> representative of a predicted appearance of the portion of the user <NUM> following treatment using the personal care device <NUM>. The processor <NUM> is further configured to provide the generated image for display on a representation of the user <NUM>. For example, the image <NUM> and the representation of the user may be presented on the display <NUM>. In examples where the display <NUM> forms part of a computing device, such as a smartphone or tablet computer, the representation of the user <NUM> may be an image or live video footage of the user (i.e. image data) acquired using the image capture device <NUM>. In examples where the display <NUM> forms part of an interactive mirror, then the representation of the user <NUM> may be a reflection of the user in the mirror.

The image <NUM> representing the predicted appearance of the portion of the user <NUM> may generally be smaller than the display <NUM> on which the representation of the user <NUM> is presented, and may be sized so that it is smaller than the representation of the user. The image <NUM> may be considered to be a patch or mask (e.g. square or rectangular in shape) that is intended to cover or replace a portion of the representation of the user. For example, if the user <NUM> is performing a shaving activity to shave one of their sideburns, then the image <NUM> generated by the processor <NUM> may comprise a patch (e.g. rectangular) representing the appearance of a portion of the side of the user's face that is intended to be shaved using the personal care device <NUM> (e.g. a shaver). The image <NUM> may comprise a representation of the user's skin with no hair or shorter hair, and this may be presented to the user <NUM> as a mask, overlay or otherwise superimposed on the representation of the user on the display <NUM>.

To generate the image representative of the predicted appearance of the portion of the user <NUM> following treatment, the processor <NUM> may, in some embodiments, use prestored data (e.g. data stored in a memory) indicating or describing how a particular portion of the user might appear if the personal care activity is carried out. For instance, in the shaving examples, the generated image <NUM> may comprise a stored image of clean-shaven skin, so that the user <NUM> can see what a particular portion of their body might look like clean-shaven. A more accurate prediction of the appearance of the portion of the user may be made using additional data available to the processor <NUM>. For example, data indicative of the user's skin color, tone, complexion and the like may be determined from the received image data, and the image <NUM> of the predicted appearance of the portion of the user <NUM> may be generated using such data, so that the generated image is more realistic.

In some examples, device operating data relating to the personal care device (e.g. the shaver) <NUM> may be used to improve the prediction. <FIG> is an illustration of three different examples of images <NUM> generated using device operating data relating to the shaver. In each example, a sideburn of a user <NUM> is shown with part of the user's hair. In <FIG>, device operating data of the shaver may indicate that the treatment element <NUM> of the shaver is set to perform a clean-shaven (e.g. with no shaving guide in place). In this example, therefore, the image <NUM> may show a clean-shaven portion of the user's skin to replace the sideburn. In <FIG>, device operating data of the shaver may indicate that the treatment element <NUM> of the shaver is set to cut the user's hair very short and, therefore, the image <NUM> may show a portion of the user's skin with stubble replacing the sideburn. In <FIG>, device operating data of the shaver may indicate that the treatment element <NUM> of the shaver is set merely to trim the user's hair and, therefore, the image <NUM> may show a portion of the user's skin with hair that is slightly shorter than the users current hair length in the sideburn region. In some examples, the device operating data indicating the nature of the treatment element <NUM> may be acquired automatically from the personal care device <NUM> while, in other examples, a user may provide (e.g. via user interface, not shown) details of the treatment element, such as an intended length of cut.

An appearance (e.g. a size, shape and/or orientation) of the image <NUM> generated by the processor <NUM> may be based on data available to the processor <NUM> including, for example, the received image data, the received device operating data and/or the determined position information. <FIG> is an illustration of two different examples of the appearance of the image <NUM>. In a first example, labelled <NUM>, the generated image <NUM> is relatively small, covering a small proportion of the representation of the user <NUM>. In a second example, labelled <NUM>, the generated image <NUM> is relatively larger, covering a larger proportion of the representation of the user <NUM>.

The processor <NUM> may determine from image data (e.g. from the camera <NUM>) that the personal care device <NUM> is to be used to shave a sideburn of the user <NUM> in example <NUM> and used to shave a cheek of the user in example <NUM>. In some examples, if a relatively smaller portion of the user is to be treated using the personal care device <NUM>, then the generated image <NUM> may be relatively smaller (example <NUM>) while if a relatively larger portion of the user is to be treated, then the generated image may be relatively larger (example <NUM>). Device operating data relating to the personal care device <NUM> may indicate an orientation in which the personal care device <NUM> is being held relative to the head of the user <NUM>. The orientation of the image <NUM> generated by the processor <NUM> may, in some examples, correspond to the orientation of at least part of the personal care device <NUM>, such as the treatment element <NUM>. Device operating data and/or position information of the treatment element <NUM> and/or the personal care device <NUM> may provide an indication of a speed of movement of the personal care device relative to the user <NUM>. For example, when shaving a relatively smaller region such as a sideburn, the user <NUM> may move the personal care device <NUM> slower than when shaving a larger portion such as a cheek or a neck. In other examples, the received image data may be used to determine which part of the user <NUM> is to be treated using the personal care device <NUM>, and this may be used to determine the size of the image <NUM>. For example, the processor <NUM> may be configured to determine, based on the received image data, an indication of the body part of the user <NUM> that is to be treated using the personal care device <NUM>. The processor <NUM> may be configured to generate the image <NUM> representative of the predicted appearance of the portion of the user <NUM> having a size based further on the indication of the body part.

When the personal care device <NUM> is determined to be moving relatively quickly, the generated image <NUM> may be relatively larger than when the personal care device is determined to be moving relatively slowly. Thus, the device operating data may comprise data indicative of an orientation and/or a motion of the personal care device <NUM>. The processor <NUM> may be configured to generate the image <NUM> representative of the predicted appearance of the portion of the user <NUM> having a size based on the orientation/motion data. Various limits and thresholds may be defined and used by the processor <NUM> when determining the appearance of the image <NUM>.

In some embodiments, the size of the image <NUM> may correspond to, or be based on details of the treatment element <NUM> of the personal care device <NUM>. For example, the device operating data may comprise a size of the treatment element <NUM> of the personal care device <NUM>. The processor <NUM> may be configured to generate the image <NUM> representative of the predicted appearance of the portion of the user <NUM> having a size based on the size of the treatment element <NUM>.

The processor <NUM> may, in some embodiments, be configured to determine, based on the received image data, a degree of deformation of a surface of the user <NUM> by the personal care device <NUM>. For example, some personal care devices may be used by touching a treatment element <NUM> of the personal care device <NUM> against the skin of the user <NUM> or pushing the treatment element against the skin of the user. Contact between the treatment element <NUM> (or any other part of personal care device <NUM>) and a surface (e.g. the skin) of the user <NUM> may cause the surface to be deformed. Using the received image data (e.g. image data acquired using the camera <NUM>), an amount or degree of deformation may be measured or determined, and this may be taken into account when generating the image <NUM>. The image data may be used, for example, to determine a depth of the personal care device <NUM> in the 3D model of the user <NUM>. In some embodiments, parameter information relating to the surface of the user may be used to improve the determination of the amount of deformation. For example, skin elasticity values at different positions on the user's body may be used. Known values of skin elasticity may be stored in a memory accessible to the processor <NUM>, for example. In some examples, data indicating an ethnicity and/or an age of the user may be used to determine an amount of deformation of the skin. Thus, the processor <NUM> may be further configured to generate the image representative of the predicted appearance of the portion of the user <NUM> further based on the determined degree of deformation of the surface of the user. For example, if the received image data indicates that the skin of the user <NUM> has been deformed by the personal care device <NUM>, then the image <NUM> generated by the processor <NUM> may show such deformation.

In other examples, deformation of the skin of the user <NUM> resulting from the personal care device <NUM> may be determined or measured in another way. For example, the first sensor <NUM> and/or the second sensor <NUM> may comprise a force sensor or a pressure sensor to measure an amount of force or pressure applied by the personal care device <NUM> onto a surface of the user <NUM>. The data acquired using the sensor's <NUM>, <NUM> may be used when generating the image <NUM>. For example, an indication of an amount of force applied onto the skin of the user <NUM> may be used to predict an amount of deformation of the skin, and this deformation may be displayed in the image <NUM>. Thus, the processor <NUM> may be configured to generate the image <NUM> representative of the predicted appearance of the portion of the user <NUM> further based on an output of a sensor <NUM>, <NUM> of the personal care device <NUM>.

In some examples, the image <NUM> may be displayed on the representation of the user (e.g. on the display <NUM>) only when certain conditions are met. For example, the image <NUM> may be displayed only if the personal care device <NUM> is determined to be within a defined threshold distance of the user <NUM>. <FIG> is an illustration of two examples of representations of the user <NUM> and the personal care device <NUM> according to embodiments of the invention. In <FIG>, data available to the processor <NUM> (e.g. received image data, received device operating data and/or determined position information) may indicate that the personal care device <NUM> is beyond a threshold distance from the user <NUM>. In this example, the image <NUM> may not be displayed on the representation of the user <NUM>. In <FIG>, however, the data available to the processor <NUM> may indicate that the personal care device <NUM> is within a threshold distance from the user <NUM>. In this example, the image <NUM> is displayed on the representation of the user <NUM>. By displaying the image <NUM> only when the personal care device <NUM> is within a defined threshold distance of the user <NUM>, the processor <NUM> may be able to determine an intended treatment location of the user to higher confidence level. Moreover, the user <NUM> may have some control over when the image <NUM> is to be displayed on the display <NUM>. For example, if the user <NUM> wishes to view the representation without the image <NUM> overlay, then they may simply move the personal care device <NUM> away from their face.

As noted briefly above, the apparatus <NUM> may comprise or form part of a computing device. In some examples, the apparatus <NUM> may comprise an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone or a wearable device (e.g. a smart watch).

According to a second aspect, the present invention provides a method. <FIG> is a flowchart of an example of a method <NUM>. The method <NUM>, which may comprise a computer-implemented method, may be considered to be a method for predicting an appearance of the user following treatment using a personal care device. The method <NUM> comprises, at step <NUM>, receiving image data in respect of a user <NUM> of a personal care device <NUM>, wherein the personal care device is to be used to treat a portion of the user. At step <NUM>, the method <NUM> comprises receiving device operating data relating to the personal care device <NUM>. The method comprises, at step <NUM>, determining position information of at least a treatment element <NUM> of the personal care device <NUM> relative to the user <NUM>. At step <NUM>, the method comprises generating, based on the received image data, the received device operating data and the determined position information, an image <NUM> representative of a predicted appearance of the portion of the user <NUM> following treatment using the personal care device <NUM>. The method <NUM> comprises, at step <NUM>, displaying the generated image <NUM> on a representation of the user <NUM>. For example, the image <NUM> may be displayed on the display <NUM>.

<FIG> is a flowchart of a further example of a method <NUM>. The method <NUM> may comprise a computer implemented method and may include one more steps of the method <NUM>. The method <NUM> may comprise, at step <NUM>, displaying the representation of the user <NUM> and the generated image <NUM> on the representation of the user in an alternating manner. Thus, the image <NUM> may be periodically displayed over the representation of the user <NUM> and removed, such that the image <NUM> repeatedly appears for a short period of time (e.g. <NUM> seconds or <NUM> second). In this way, the user <NUM> is able to compare how they currently look with how they might look if they proceed with the treatment using the personal care device <NUM>.

In other embodiments, the display and/or removal from display of the image <NUM> may be controlled by the user <NUM>. For example, the user <NUM> may perform a defined movement or gesture (e.g. using a finger, a hand, their head, a facial expression, or a defined movement of the personal care device) which may be captured using the camera <NUM> and interpreted as an indication that the user wishes to display or remove from display the image <NUM>. In another example, a pause in movement of the personal care device <NUM> by the user <NUM> may be detected and recognised as a signal to display the image <NUM>. In this way, a user may stop moving the personal care device <NUM> when a would like to understand what effect further movement of the device might have. In other embodiments, the display and/or removal from display of the image <NUM> may be effected via a user interaction with a user interface of the personal care device <NUM> or the computing device (e.g. the interactive mirror or tablet computer) housing the display <NUM>. For example, the user <NUM> may press a button to switch between cases where the image <NUM> is displayed and not displayed.

At step <NUM>, the method <NUM> may comprise determining, based on the received image data, an amount of deformation of a surface of the user <NUM> by the personal care device <NUM>. For example, contact between the personal care device <NUM> and skin the user <NUM> may cause deformation of the skin, and the amount and nature of the deformation may be determined. Generating (step <NUM>) the image <NUM> representative of the predicted appearance of the portion of the user <NUM> may be further based on the determined amount of deformation of the surface of the user. Thus, the image <NUM> generated at step <NUM> may include deformation of the surface.

One or more steps of the methods <NUM>, <NUM> may be performed using the processor <NUM> of the apparatus <NUM>.

According to another aspect, a computer program product is provided. <FIG> is a schematic illustration of an example of a processor <NUM> in communication with a computer-readable medium <NUM>. According to various bodies, a computer program product may comprise a non-transitory computer-readable medium <NUM>, the computer-readable medium having computer-readable code embodied therein, the computer-readable code being configured such that, on execution by a suitable computer or processor <NUM>, the computer or processor is caused to perform steps of the methods and <NUM>, <NUM> disclosed herein. The processor <NUM> may comprise or be similar to the processors <NUM>, <NUM> discussed above.

According to a fourth aspect, the present invention provides a personal care system. <FIG> is a schematic illustration of an example of a personal care system <NUM>. The personal care system <NUM> comprises a personal care device <NUM> having a treatment element <NUM> to be used to treat a portion of a user <NUM>. The personal care system <NUM> also comprises an image capture device <NUM> configured to capture image data in respect of the user of the personal care device <NUM>. The image capture device <NUM> may, for example, comprise a 2D or 3D camera. The personal care system <NUM> also comprises a display unit <NUM> (e.g. the display of an interactive mirror or of a computing device). The personal care system <NUM> also comprises processing apparatus <NUM>, <NUM>. The processing apparatus <NUM>, <NUM>, <NUM>, the display unit <NUM> and/or the image capture device <NUM> may form part of a single unit or component, such as a computing device or an interactive mirror. The personal care device <NUM>, the display unit <NUM> and the image capture device <NUM> may all be in communication with the processing apparatus <NUM>, <NUM>, <NUM>, for example via a wired or wireless connection.

The processing apparatus <NUM>, <NUM>, <NUM> is configured to operate the image capture device <NUM> to capture image data in respect of the user <NUM> of the personal care device <NUM>, receive device operating data relating to the personal care device, determine position information of at least the treatment element <NUM> of the personal care device relative to the user, generate, based on the captured image data, the received device operating data and the determined position information, an image representative of a predicted appearance of the portion of the user following treatment using the personal care device, and provide the generated image for display on a representation of the user on the display unit.

In some embodiments, the personal care device <NUM> may comprise a first sensor <NUM> configured to measure a force or pressure applied to the user <NUM> by the personal care device <NUM>. For example, the personal care device <NUM> may comprise a resistance sensor, a capacitance sensor and/or a piezoelectric sensor to measure a force applied to skin of the user <NUM> by the treatment element <NUM> of the personal care device during use. The processing apparatus <NUM>, <NUM>, <NUM> may be configured to generate the image <NUM> representative of the predicted appearance of the portion of the user <NUM> further based on an output of the first sensor <NUM>.

In some embodiments, the personal care device <NUM> may comprise a second sensor <NUM> configured to measure orientation data and/or motion data in respect of the personal care device. For example, the personal care device <NUM> may comprise one or more of an accelerometer, and magnetometer, a gyroscope and an inertial measurement unit (IMU), configured to measure an orientation of the personal care device (e.g. relative to Earth) and/or data relating to any movement of the personal care device during use. The processing apparatus <NUM>, <NUM>, <NUM> may be configured to generate the image <NUM> representative of the predicted appearance of the portion of the user <NUM> further based on an output of the second sensor <NUM>.

As noted above, the invention a be used in the field of personal care, or any field where a treatment is to be performed in respect of the user. In some embodiments, the personal care device <NUM> may comprise a device selected from a group comprising: a hair trimming device, a shaving device, a hair treatment device, a photoepilation device, a skin treatment device, a skin rejuvenation device and a product application device (e.g. a device for applying product such as cream, lotion, make up and the like) to a user.

Embodiments of the invention disclosed herein provide a mechanism by which a user may view and anticipate the likely effect of performing a personal care activity before the activity is actually performed. This is achieved by predicting an appearance of part of the user if the personal care activity were performed, and displaying an image depicting the predicted appearance to the user prior to the performance of the activity. In this way, a user may make an informed decision regarding whether or not to proceed with the personal care activity. Moreover, with foresight of the likely outcome of performing a personal care activity, the user may perform the personal care activity more accurately and quicker, reducing the power used by a personal care device, and reducing wear of components of the personal care device (e.g. the treatment element).

The processor <NUM>, <NUM>, <NUM> can comprise one or more processors, processing units, multi-core processors or modules that are configured or programmed to control the apparatus <NUM> in the manner described herein. In particular implementations, the processor <NUM>, <NUM>, <NUM> can comprise a plurality of software and/or hardware modules that are each configured to perform, or are for performing, individual or multiple steps of the method described herein.

The term "module", as used herein is intended to include a hardware component, such as a processor or a component of a processor configured to perform a particular function, or a software component, such as a set of instruction data that has a particular function when executed by a processor.

It will be appreciated that the embodiments of the invention also apply to computer programs, particularly computer programs on or in a carrier, adapted to put the invention into practice. The program may be in the form of a source code, an object code, a code intermediate source and an object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to embodiments of the invention. For example, a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines. An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing stage of at least one of the methods set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically. Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.

Claim 1:
An apparatus (<NUM>) comprising:
a processor (<NUM>) configured to:
receive image data in respect of a user (<NUM>) of a personal care device (<NUM>), wherein the personal care device is to be used to treat a portion of the user;
receive device operating data relating to the personal care device;
determine position information of at least a treatment element (<NUM>) of the personal care device relative to the user;
generate, based on the received image data, the received device operating data and the determined position information, an image (<NUM>) representative of a predicted appearance of the portion of the user following treatment using the personal care device; and
provide the generated image for display on a representation of the user.