Patent Description:
Skin treatment devices with imaging units are known. Skin treatment devices which involve phototherapy or photo-epilation are also known. In some cases, the treated skin area is recorded by imaging to avoid cases that a subsequent treatment step is not carried out on the same skin area. This may also be implemented by displacement sensors, which detect a current position relative to the position of the treated area. Repetitive treatment of a skin area, either by overlapping of treated areas or by unintentional repeated application of treatment on a previously treated skin area could cause injury to the skin. The recording of treated areas is even more desirable when the treatment is carried out using light, e.g., in applications such as intense pulsed light (IPL). In other cases, the skin to be treated is recorded before treatment, and analyzed for presence of blemishes or tattoos, in order to selectively treat such areas using the correct light intensity without treating the surrounding skin. The below details relate to devices which use light, amongst other forms of energy, for non-therapeutic skin treatment.

<CIT> discloses a device for treating a skin surface, wherein a controller controls the application of the treatment in accordance with a displacement of the device relative to the skin surface sensed by a displacement sensor. Displacement information provided by the displacement sensor is used to determine whether or not a particular skin area has already been treated previously, or to adjust the treatment to a determined rate of displacement of the device.

<CIT> discloses a hand-held device for performing a personal care operation on the body of a subject. The device comprises an imaging unit and a displacement sensor to enable the position and/or the orientation of the device with respect to the body of the subject to be determined. The images of the body captured by the imaging unit are used to determine the position and/or the orientation of the device when the device is not in contact with the body. The displacement sensor is used to measure displacement of the device along the body when the device is in contact with the body. The device further has a controller configured to control the personal care operation in dependence on the position and/or the orientation of the device relative to the body determined by the imaging unit and the displacement sensor.

<CIT> discloses a system for ultrasound treatment, comprising an ultrasound probe having a position or motion sensor which is used to determine a speed of movement of the ultrasound probe along a skin surface and to determine whether the speed of movement is accurate for the treatment. In an embodiment, the position sensor comprises a camera or video capture device to geotag particular features present on the skin surface, such as scars, moles and tattoos, which may be useful for setting treatment parameters, determining treatment progress or success, or positioning of the treatment probe. The position sensor may track the position of the treatment probe, and the tracked position may be compared with a predefined treatment plan.

<CIT> discloses an apparatus for dermatologic laser treatment of the skin of a subject. The apparatus comprises a positioning device configured to move, under control of a control system, a working head to follow a predefined path to scan a pulsed laser beam over the whole of a skin area of the subject to be treated. The apparatus may further comprise one or more movement detectors, such as a camera arranged on the working head, to detect movement of the subject during the treatment. The control system may be configured to correct the path followed by the working head to compensate for the detected movement of the subject or to stop the treatment when the detected movement is too large or too fast.

While using cosmetic skin treatment devices, especially photo-epilation devices, it is an object to obtain information of skin to be treated, before performing the treatment. In an IPL device, e.g., it is generally recommended to avoid treating skin area with blemishes or tattoos for safe use of the device.

Such information can be obtained by means of imaging elements incorporated in the device. However, imaging units like camera involve a certain latency while capturing and processing image data. In other words, period T, starting a time instant when an image frame is captured and an instant the captured image frame is processed (including data readout and data transfer), is greater than zero. Further, the higher the image resolution, the higher the latency. It is desirable to goal to decrease this latency or delay, however, for reasons involving added cost of the device and ease of manufacturing, this is not always achieved.

A problem exists that once an image of a skin area is captured by the imaging unit, the user may intentionally or non-intentionally move the skin treatment device from the skin area. In this case, the processed image will no longer reflect the features of the skin under that device at that particular moment. This is not desirable, as the treatment would be executed on a non-analyzed part of the skin.

An object of the present invention to provide a method and a device thereof, which takes into account the delay in processing images to perform effective skin treatment.

According to an aspect of the invention, a device for skin treatment is provided. The device comprises a treatment source for performing skin treatment, an image capturing unit which is configured to capture an image frame of a skin area to be treated, a motion or position sensor configured to sense a displacement of the device on the skin area, and a control means configured to process the captured image frame during a processing period, receive, from the motion or position sensor, displacement information about displacement of the device on the skin area occurring during the processing period of processing the captured image frame, and determine whether to perform treatment based on the received displacement information, wherein the control means is further configured to enable the treatment source when the displacement information indicates that the displacement of the device on the skin area during the processing period is zero and/or disable the treatment source when the displacement information indicates that the displacement of the device on the skin area during the processing period is non-zero.

A method for determining whether to perform skin treatment by a device is further provided. The method is computer-implemented. The method comprises the steps of receiving from an image capturing unit a captured image frame of a skin area to be treated, processing the captured image frame during a processing period, receiving from a motion or position sensor displacement information about displacement of the device on the skin area occurring during the processing period of processing the captured image frame, determining whether to perform the skin treatment based on the received displacement information, and enabling the skin treatment when the received displacement information indicates that the displacement of the device on the skin area during the processing period is zero, and/or disabling the skin treatment when the received displacement information indicates that the displacement of the device on the skin area during the processing period is non-zero.

According to another aspect of the invention, the control means is further configured to enable the treatment source upon determining that the imaged treatment area is suitable for skin treatment. The corresponding method comprises the step of enabling the treatment source upon determining that the imaged treatment area is suitable for skin treatment.

According to yet another aspect of the invention, the device further comprises a user interface unit. The control means is configured to control the image capturing unit to capture the image frame, upon detecting a user input to the user interface unit. The corresponding method includes controlling the image capturing unit to capture the image frame, upon detecting a user input to the user interface unit.

According to yet another aspect of the invention, the motion or position sensor is further configured to detect an initial position of the device with respect to the skin area, and the control means is configured to control the image capturing unit to capture the image frame based on the detection. The corresponding method comprises the step of detecting an initial position of the device with respect to the skin area by the motion or position sensor, and controlling the image capturing unit to capture the image frame based on this detection.

According to yet another aspect of the invention, the motion or position sensor comprises a skin contact sensor. In other words, the initial position is detected via contact with the skin area. Once contact is registered, the image capturing unit is enabled.

According to yet another aspect of the invention, the control means determines whether to perform treatment based on whether contact remains established with the imaged skin area during the processing period. The corresponding method comprises determining whether to perform treatment based on whether contact remains established with the imaged skin area during the processing period.

According to yet another aspect of the invention, the control means is further configured to control the image capturing unit to capture a new image frame during the processing period based on the received displacement. The method includes controlling the image capturing unit to capture a new image frame during the processing period based on the received displacement.

According to yet another aspect of the invention, the processing period is <NUM>-<NUM> milliseconds, preferably <NUM>-<NUM> milliseconds, more preferably <NUM>-<NUM> milliseconds.

According to yet another aspect of the invention, the treatment source is a light-based source, such as a light emitting diode, a laser or a halogen lamp.

According to yet another aspect of the invention, a computer program product is provided, which comprises a computer readable medium having computer readable code embodied therein, the computer readable code being configured such that, on execution by a suitable computer or processing unit, the computer or processing unit (control means) is caused to perform the method described above, and the details listed in the below sections.

These and other aspects, and further advantages, will be apparent from and elucidated with reference to the embodiment(s) described herein.

The matters exemplified in this description are provided to assist in a comprehensive understanding of various exemplary embodiments of the present invention disclosed with reference to the accompanying figures.

Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the exemplary figures/embodiments described herein can be made without departing from the scope of the claimed invention.

Further, the functionality associated with any particular means may be centralized or distributed, whether locally or remotely. It may be advantageous to set forth that the terms "include" and "comprise," as well as derivatives thereof, mean inclusion without limitation. In addition, reference to an element by the indefinite article "a" or "an" does not exclude the possibility that more than one of the element is present, unless the context clearly requires that there be one and only one of the elements. The indefinite article "a" or "an" thus usually means "at least one".

The expression "at least one of A, B and C" means "A, B, and/or C", and that it suffices if e.g. only B is present.

Terms such as, for example, "processing," "computing," "calculating," "determining," "establishing", "analyzing", "checking", or the like, used herein, may refer to, in a non-limiting manner, operation(s) and/or process(es) of a computer, a computing platform, a computing system, or other electronic computing device, that manipulates and/or transforms data represented as physical (e.g., electronic) quantities within the computer's registers and/or memories into other data similarly represented as physical quantities within the computer's registers and/or memories or other information non-transitory storage medium (e.g., a memory) that may store instructions to perform operations and/or processes. The terms "plurality" and "a plurality" as used herein may include, for example, "multiple" or "two or more". The terms "plurality" or "a plurality" may be used throughout the specification to describe two or more components, devices, elements, units, parameters, or the like. Unless explicitly stated, the method embodiments described herein are not constrained to a particular order or sequence. Additionally, unless otherwise specified, some of the described method embodiments or elements thereof can occur or be performed simultaneously, at the same point in time, or concurrently.

<FIG> shows a block diagram of a device <NUM> for skin treatment according to an embodiment of the invention. Device <NUM> is configured to determine whether to perform skin treatment as described below. Device <NUM> is suitable for skin treatment, as will be clear from below. In this embodiment, it is not considered necessary for device <NUM> to be able to perform treatment. It makes the decision to perform treatment.

<FIG> shows another block diagram where device <NUM> is shown coupled with a skin treatment device <NUM>. The system can then be used to perform skin treatment.

In <FIG>, the device <NUM>, or the components comprised therein, are part of the skin treatment device <NUM>. Skin treatment device <NUM> may be an IPL device.

Skin treatment device <NUM> includes a treatment head <NUM>. Treatment head <NUM> is configured to be placed on a skin surface when treatment is being applied to that skin surface (skin area). In an embodiment, treatment head <NUM> may be detachable and re-attachable to a remaining portion of skin treatment device <NUM>.

In <FIG> embodiment, device <NUM> includes at least an image capturing unit <NUM>, a control means <NUM> and a motion/position sensor <NUM>.

In an embodiment as shown in <FIG>, the device <NUM> is incorporated in a light-based skin treatment device <NUM>. An example of implementing the image capturing unit <NUM> in skin treatment device <NUM> is disclosed in <FIG>, Euro-PCT publication <CIT> or <FIG>, <CIT>. As mentioned below, the invention is not limited to light-based treatment.

In another embodiment such as in <FIG> or <FIG>, the image capturing unit <NUM> may be a camera of a mobile user device <NUM> which may be removably attached to the skin treatment device <NUM> at a suitable location on its housing (e.g., via a mechanical receptacle - as disclosed in <FIG>, <CIT> or <CIT>). In this case, it is known to the skilled person how to structurally modify the skin treatment device and/or device <NUM> for device <NUM> to be able to control the application of skin treatment. Device <NUM> and skin treatment device <NUM> may be connected to each other via a wireless communication system, as shown in <FIG>.

In a non-limiting manner, in the skin treatment device <NUM>, the at least one image capturing unit <NUM> may be comprised in a head portion of device <NUM>. This is shown in <FIG>.

The image capturing unit <NUM> is configured to capture an image frame of a skin area to be treated. In an embodiment, the image capturing unit <NUM> captures an image frame upon user-initiation i.e., upon registering user input via operation of user interface unit <NUM> of device <NUM> or <NUM>. In another embodiment, the image capturing unit <NUM> captures an image frame based on skin contact measurements. Details of how this is implemented are given in the below parts of the description. The skin area thus captured by the image frame is termed the imaged skin area herein. As mentioned, such image capture is targeted to study or analyze the skin area before the treatment is carried out. If there exists an area with a mole or other skin lesion on the skin, it is desirable to not carry out treatment on such area.

The control means <NUM> receives the captured image frame from the image capturing unit <NUM> and processes the captured image frame.

The control means <NUM> may be internal to the skin treatment device <NUM> or located in an external device, in which case, the skin treatment device <NUM> receives the processed information from the external control means. This can be implemented via e.g., wireless communication technology such as Bluetooth, NFC, WiFi etc., the options being known to the skilled person. <FIG> shows an example of a system comprising device <NUM> and skin treatment device <NUM> coupled to each other via a wireless communication system.

In an embodiment, the image capturing unit <NUM> may process the captured image. In yet another embodiment, the image may be jointly processed by the image capturing unit <NUM> and the control means <NUM>.

Depending on the resolution of the image (the image capturing unit <NUM>) and the processing power of the control means <NUM>, there is a certain processing period required to process the captured image. This period includes time required to transfer/receive the captured image data, process the data and/or output the processed data.

The image processing period may be of the order of a few milliseconds, e.g., <NUM> milliseconds, to hundreds of milliseconds.

In an embodiment, as shown in <FIG> or <FIG>, the motion sensor <NUM> is external to the skin treatment device <NUM> and comprised in device <NUM>. Motion sensor <NUM> then senses displacement of device <NUM> on the skin area. Since device <NUM> is coupled to skin treatment device <NUM>, the motion sensor <NUM> can further process the displacement of device <NUM> to correlate to displacement of skin treatment device <NUM> on the skin area. This is especially the case when device <NUM> is physically attached to device <NUM>. In an embodiment, the image capturing unit <NUM>, the motion sensor <NUM> and control means <NUM> may be controlled via a software application stored in a memory of device <NUM>. Device <NUM> and the method thereof may then be controlled, amongst others, via user input through the software application.

In another embodiment, as shown in <FIG>, the motion sensor <NUM> is internal to the skin treatment device <NUM>. Motion sensor <NUM> then senses displacement of skin treatment device <NUM> on the skin area.

Device <NUM> or skin treatment device <NUM> may include additional circuitry <NUM>, such as additional sensors or components such as transceivers, for enabling communication in a wired or wireless manner.

The motion sensor <NUM> in device <NUM> is communicatively coupled with control means <NUM>. As mentioned, control means <NUM> can be located in device <NUM> or skin treatment device <NUM>. It is not necessary that the image capturing unit <NUM>, control means <NUM> and motion sensor <NUM> be located in one device.

In the embodiment of <FIG>, motion sensor <NUM> includes one or more displacement sensing devices that are configured to sense a displacement of treatment head <NUM> on a skin surface. It is also possible for the motion sensor <NUM> to use another reference instead or in addition to the treatment head <NUM> in the skin treatment device <NUM> to measure displacement.

In an embodiment, the motion sensor <NUM> is a mechanical displacement sensor.

In another embodiment, the motion sensor <NUM> is an optical sensor, e.g., a camera, using sequential images.

In an embodiment, the image capturing unit <NUM> may also function as the optical motion sensor <NUM>.

In an embodiment of <FIG>, motion sensor <NUM> may be implemented using an external camera, such as that in a mobile user device (e.g., a smartphone). The method may utilize a motion sensor <NUM> of a mobile device which functions as the image capturing unit <NUM>. The control means <NUM> analyses the images to detect whether a skin feature at one reference position in a first image frame has moved from the position to another in second image frame.

The control means is configured to receive from motion sensor <NUM> information on a displacement of device <NUM> and/or skin treatment device <NUM>.

It is an object of the present invention to ensure that the imaged skin area corresponds to the skin area which is treated in a subsequent step. For sake of conciseness, the below discussion focuses on the embodiment where the image capturing unit <NUM>, the control means <NUM> and motion sensor <NUM> are part of the skin treatment device <NUM>, as shown in the embodiment of <FIG>.

The motion sensor <NUM> senses displacement of the treatment head <NUM> during the image processing period of the captured image frame. The image processing period can be a predetermined/pre-stored value (corresponding to the device parameters) or be variable (depending on different image resolutions, programming instructions), and defines the time the device <NUM>(or <NUM>) takes to process a certain image frame.

In an embodiment the motion sensor <NUM> senses displacement of the treatment head <NUM> relative to the imaged skin area during the image processing period. The control means <NUM> is configured to extract position information of the imaged skin area from the captured image frame and/or a skin feature therein and obtain displacement of the imaged skin area and/or skin feature by analyzing a subsequent image frame captured by the image capturing unit <NUM> or the optical motion sensor <NUM> or by obtaining position coordinates from a mechanical motion sensor.

Based on the sensed displacement, the control means <NUM> controls a function of a treatment source <NUM> of the skin treatment device <NUM>.

As mentioned, in a practical implementation, the device <NUM> comprising the image capturing unit <NUM>, the control means <NUM> and the motion sensor <NUM> may be part of a mobile user device or smartphone, which is suitable for controlling the application of skin treatment by communicating with a treatment device (and thereby controlling the treatment device).

The treatment source <NUM> may be located in the treatment head <NUM> of the skin treatment device <NUM>. For example, treatment source <NUM> may include a radiation source (e.g., of visible, ultraviolet, infrared, or radiofrequency radiation), an electromagnetic device, a heat source, a mechanical device (e.g., vibrator, mechanical massager, shaver, or other mechanical device), or another skin treatment device. The example shown in <FIG> relates to a skin treatment device <NUM> in which the treatment source <NUM> is a radiation source. The treatment source <NUM> is not limited to being situated in the treatment head <NUM> but can be disposed elsewhere in the skin treatment device <NUM>, as long as there are other means to transmit the emitted energy (light, heat, sound, vibration, rotation etc.) to the skin to carry out the treatment. Operation of treatment source <NUM> is controlled by control means <NUM>. The control means <NUM> may control operation of treatment source <NUM>, in other words, the application of skin treatment, in accordance with at least one of user input via operation of user interface unit <NUM>, sensed information from motion sensor <NUM>, characteristics of the captured image frame by the image capturing unit <NUM>, and programmed instructions.

The control means <NUM> is configured to receive information on displacement of the skin treatment device <NUM> and/or treatment head <NUM> (or device <NUM>, as mentioned above) during the processing period of the captured image frame, or while processing the image frame. The displacement may be measured relative to a position of the last imaged skin area.

The control means <NUM> determines whether to perform the treatment based on the sensed displacement. For example, it could enable or disable the treatment source <NUM> based on the measured displacement.

If the displacement during the image processing period is zero, the treatment source <NUM> is enabled. The treatment source <NUM> can be enabled by sending a trigger signal to a user interface unit <NUM>, to indicate to the user to push a button on the skin treatment device <NUM> or be automatically enabled by the control means <NUM>. It is determined that the skin treatment device <NUM> has not moved from the last imaged skin area, or since an instant when a previous image was captured [T0, P0→T1, P0]. Here, P0 is the set of position coordinates of the imaged skin area, registered at time T0 when the image of the skin area was captured by the image capturing unit <NUM>. At time T1, when the image has been processed by the control means <NUM>, the sensed position is still P0, meaning the device has been stationary during the image processing period T1-T0.

If the displacement during the image processing period is non-zero, the treatment source <NUM> is disabled. It is determined that the skin treatment device <NUM> has moved from the last imaged skin area, or since an instant when a previous image was captured [T0, P0→T1, P1]. Here, P0 is the set of position coordinates of the imaged skin area, registered at time T0 when the image of the skin area was captured by the image capturing unit <NUM>. At time T1 when the image has been processed by the control means <NUM>, the sensed position coordinates correspond to P1. P1 no longer reflects the position of the skin area imaged or captured at time T0 by the image capturing unit <NUM>.

The control means <NUM> may determine displacement instantaneously during the processing period, i.e. while processing the image frame, or after an estimated processing period T1-T0, the value of which may be pre-stored in the memory of the device. The value may be defined based on factors like image resolution, processing power of control circuitry etc..

In an embodiment, if the control means <NUM> detects that the displacement is non-zero when the image has been processed at time T1 or after the pre-defined processing period, it transmits a trigger signal to the image capturing unit <NUM> to capture a further (a second e.g.) image frame, the image frame being that of the skin area at the new position P1.

In an embodiment, if the control means <NUM> detects that the displacement is non-zero at an intermediate instant Tint during the image processing period T1-T0, it already transmits a trigger signal to the image capturing unit <NUM> to capture the further image frame, the image frame being that of the skin area at the new position at Tint, without adding a delay otherwise needed to process the previously captured image frame. The previously captured image frame may be deleted from a memory of the device or stored therein for future use.

As a result of the check during the processing period, it is possible for device <NUM> to determine whether there has been a displacement of the device since the last captured skin image and effect the treatment only if the imaged skin is the same as the treated skin (or the skin which would be treated).

In an embodiment, the control means <NUM> is configured to send a trigger signal to the image capturing unit <NUM> when a user inputs a command via operation of user interface unit <NUM>.

In an embodiment, the control means <NUM> is configured to detect whether the displacement is intentionally triggered by the user using user interface unit <NUM>, e.g., by checking whether the displacement exceeds a predetermined threshold. The control means <NUM> may check whether the sensed displacement after image processing, at time T1, or at any time instant Tint during the image processing period.

It is another object of the invention to not perform treatment on areas which are unsuitable for treatment, such that those having skin irregularities including moles and tattoos.

In this regard, the control means <NUM> is configured to check whether the imaged skin area is suitable for treatment. It checks for the presence of skin characteristics which indicate unsuitability of the targeted skin area.

The control means <NUM> enables the treatment source (treatment pulse) upon determining that the imaged area is suitable for treatment. When the skin treatment device <NUM> is an IPL device, the treatment pulse is a light pulse.

The control means <NUM> transmits a signal to the user interface unit <NUM> to indicate to the user a change of treatment area, upon determining that the imaged skin area is unsuitable for skin treatment.

<FIG> shows a general method carried out by device <NUM> or <NUM>, according to an exemplary embodiment of the invention.

Step <NUM> comprises obtaining an image frame of the skin area to be treated. The image is obtained either via manual trigger or automatically by detecting a mode of initiation such as contact or proximity detection. The start position is registered by the device.

Step <NUM> comprises sensing a displacement of the device during a processing period of the captured image frame. Displacement is calculated relative to the start position.

Step <NUM> comprises determining whether to perform the skin treatment based on the sensed displacement.

Details of this method are listed above, as steps performed by device <NUM> or <NUM>.

As with the device functionalities, any of the above-mentioned steps carried out by the device may be combined in the method.

<FIG> relates to a method for detecting displacement of device <NUM> or skin treatment device <NUM> while processing the image frame and performing a control action based thereupon. In this specific embodiment, the motion sensor <NUM> is a skin contact sensor <NUM>, i.e., device <NUM> further includes a skin contact sensor. It is well-known to the skilled person that any motion detection means may be implemented in the present invention.

The contact sensor may be optical or image-based (e.g., using a camera, and obtaining a difference in images in a contact vs no-contact mode) or a capacitance sensor which measures a change in capacitance upon registering contact of e.g. the treatment head <NUM> with skin. The skin contact sensor can alternately be ultrasound or a proximity sensor.

It is understood that the motion sensor is faster than the latency of the image capturing unit <NUM> (the time required to process the image). Depending on the image resolution that is acquired for processing, the latency might be in the range of tens of milliseconds or even longer. Therefore, it is preferred that the motion sensor offers a response time below a millisecond, ideally even faster.

In step <NUM>, a step of detecting initial skin contact of a treatment head is performed by the skin contact sensor. The control means processes information obtained by the skin contact sensor <NUM> to determine contact with the skin area. The skin area where contact is registered is a start/initial position/area, relative to which motion is detected. In other words, the method utilizes information from a motion sensor (here, skin contact sensor) to initiate the treatment control.

In step <NUM>, a step of capturing an image frame is performed by the image capturing unit <NUM>.

In step <NUM>, a step of processing the image frame is initiated by the control means <NUM>. During this step, the control means continues to detect contact with skin via information obtained from the skin contact sensor <NUM> during the processing period.

In step <NUM>, a step of controlling an application of skin treatment, or determining whether to perform the treatment, is performed by control means <NUM>. For example, if contact with the skin is determined to be lost during the processing period (at any time instant while processing the image frame), the control means <NUM> determines that device <NUM> has displaced while processing the image frame, and that the skin area to be treated no longer corresponds to the imaged area. It sends a trigger signal to a treatment source <NUM> to disable it. As mentioned above, treatment source <NUM> can be located external to device <NUM>. In addition, it may transmit a trigger signal to the image capturing unit <NUM> to obtain a second image frame at the new position where the device has registered contact and goes back to step <NUM>. The second frame may be captured even during processing period T (Tint<T1), to avoid delay in device operation. This is especially useful when a predetermined processing period T1-T0 based on factors like image resolution, processing parameters etc. is pre-stored in the device, and the time instant when the displacement is detected is less than the predetermined value T1-T0. The method may further check whether the movement was user-initiated, and if not, display a warning to the user via the user interface unit <NUM> for motion control.

If at T1, it is determined that the skin contact sensor <NUM> registered contact throughout period T1-T0, then control means <NUM> sends a trigger signal to a treatment source <NUM> to enable it at the imaged skin area.

The above embodiments can be combined or be separately implemented in the present invention.

<FIG> shows a method of performing skin treatment using device <NUM> or skin treatment device <NUM> in an embodiment which combines at least some of the above specific steps.

In step <NUM>, a method of initiating skin treatment is performed by control means <NUM>. As mentioned above, the method can be initiated by the user via the user interface unit <NUM> and/or automatically by device <NUM> by registering contact with a certain skin area by the skin contact sensor <NUM> (which is an indication of a start position, as acquired by the motion sensor, as sufficiently clear from <FIG> embodiment).

In step <NUM>, the method captures an image frame of the skin area to be treated.

In step <NUM>, the image frame is processed. Simultaneous to processing the image, the method checks for a displacement of device <NUM> and/or <NUM>. Based on this check, the method controls application of treatment to the imaged skin area. The control can be performed by sending a trigger signal to a treatment source to enable/disable it.

If there is zero displacement, i.e. if the device has not moved from the imaged skin area, in step <NUM>, to ensure safety while performing skin treatment, it is determined whether the skin area is suited to treatment, e.g. by identifying certain skin characteristics in the image frame. If it is determined that the skin area is suited to treatment, the method enables the treatment source in step <NUM>. Otherwise, if the skin area is not suited, the treatment source is disabled in step <NUM>. In step <NUM>, the user may be prompted to locate device <NUM> or <NUM> at a new skin area by a feedback signal transmitted by control means <NUM> via the user interface unit <NUM>. The method captures a new image at the new skin area in step <NUM>, and repeats the method at step <NUM>.

If a non-zero displacement is determined, the treatment source (and hence the treatment) is disabled in step <NUM>. The method may further calculate an extent of the displacement to check whether the displacement was intentional. If not, a message may be displayed to the user. In step <NUM>, in an embodiment where capturing an image frame is initiated by registering contact with the skin contact sensor in step <NUM>, the method may automatically capture a new image frame at the new skin area (after displacement), and the method is repeated from step <NUM>. When the method is initiated by the user in step <NUM>, a feedback may be signaled to the user via the user interface unit <NUM> to capture the new image frame. Method step <NUM> may be resumed for a next treatment session.

It is thus understood that a device according to the present invention can function according to any or a combination of the mentioned methods.

The present invention thus not only provides a position-triggered image capture but also a manner of treatment determination compensating for processing constraints of the image unit which captures the position of the device.

The control means <NUM> can be implemented in numerous ways, with software and/or hardware, to perform the various functions described herein. The control means <NUM> may comprise one or more microprocessors or digital signal processors (DSPs) that may be programmed using software or computer program code to perform the required functions and/or to control components of the control means <NUM> to effect the required functions. The control means <NUM> may be implemented as a combination of dedicated hardware to perform some functions (e.g. amplifiers, pre-amplifiers, analog-to-digital convertors (ADCs) and/or digital-to-analog convertors (DACs)) and a processor (e.g., one or more programmed microprocessors, controllers, DSPs and associated circuitry) to perform other functions. Examples of components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, DSPs, application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), hardware for implementing a neural network and/or so-called artificial intelligence (AI) hardware accelerators (i.e. a processor(s) or other hardware specifically designed for AI applications that can be used alongside a main processor).

The control means <NUM> can comprise or be associated with a memory. The memory can store data, information and/or signals (including image(s)) for use by the control means <NUM> in controlling the operation of the device <NUM> or <NUM> and/or in executing or performing the methods described herein. In some implementations the memory stores computer-readable code that can be executed by the control means <NUM> so that the control means <NUM> performs one or more functions, including the methods described herein. In particular embodiments, the program code can be in the form of an application for a smart phone, tablet, laptop, computer or server. The memory can comprise any type of non-transitory machine-readable medium, such as cache or system memory including volatile and non-volatile computer memory such as random access memory (RAM), static RAM (SRAM), dynamic RAM (DRAM), read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM) and electrically erasable PROM (EEPROM), and the memory unit can be implemented in the form of a memory chip, an optical disk (such as a compact disc (CD), a digital versatile disc (DVD) or a Blu-Ray disc), a hard disk, a tape storage solution, or a solid state device, including a memory stick, a solid state drive (SSD), a memory card, etc..

The user interface unit <NUM> may comprise transceivers which enable a data connection to and/or data exchange with other devices, including any one or more of servers, databases, user devices, and sensors. It can operate using WiFi, Bluetooth, Zigbee, or any cellular communication protocol (including but not limited to Global System for Mobile Communications (GSM), Universal Mobile Telecommunications System (UMTS), Long Term Evolution (LTE), LTE-Advanced, etc.). It may further comprise ciruitry to control any suitable input component(s), including but not limited to a keyboard, keypad, one or more buttons, switches or dials, a mouse, a track pad, a touchscreen, a stylus, a camera, a microphone, etc., and the user interface can comprise any suitable output component(s), including but not limited to a display unit or display screen, one or more lights or light elements, one or more loudspeakers, a vibrating element, etc..

It will be appreciated that a practical implementation of device <NUM> or <NUM> may include additional components to those shown in the figures.

Instead, unless otherwise specified, each such dimension is intended to mean both the recited value and a functionally equivalent approximation surrounding that value. Also, unless otherwise specified, the dimensions mentioned herein are measured using common laboratory measurement techniques known to the skilled person.

Claim 1:
A device (<NUM>, <NUM>) for skin treatment comprising:
a treatment source (<NUM>) for performing skin treatment;
an image capturing unit (<NUM>) configured to capture an image frame of a skin area to be treated;
a motion or position sensor (<NUM>) configured to sense a displacement of the device on the skin area, and
a control means (<NUM>) configured to:
process the captured image frame during a processing period;
wherein the control means (<NUM>) is further configured to:
receive, from the motion or position sensor (<NUM>), displacement information about displacement of the device (<NUM>, <NUM>) on the skin area occurring during the processing period of processing the captured image frame; and
determine whether to perform treatment based on the received displacement information,
characterised in that
the control means (<NUM>) is further configured to enable the treatment source (<NUM>) when the displacement information indicates that the displacement of the device on the skin area during the processing period is zero and/or disable the treatment source when the displacement information indicates that the displacement of the device on the skin area during the processing period is non-zero.