Patent Description:
A variety of diseases exist that require regular treatment by injection of a medicament. Such injections can be performed by using injection devices, which are applied either by medical personnel or by patients themselves. As an example, type-<NUM> and type-<NUM> diabetes can be treated by patients themselves by injection of insulin doses, for example once or several times per day. For instance, a pre-filled disposable insulin pen can be used as an injection device. Alternatively, a re-usable pen may be used. A re-usable pen allows replacement of an empty medicament cartridge by a new one. Either pen may come with a set of one-way needles that are replaced before each use. The insulin dose to be injected can then for instance be manually selected at the insulin pen by turning a dosage dial and observing the actual dose from a dosage window of the insulin pen. The dose is then injected by inserting the needle into a suited skin portion and pressing an injection button of the insulin pen. To be able to monitor insulin injection, for instance to prevent false handling of the insulin pen or to keep track of the doses already applied or remaining, it is desirable to measure information related to a condition and/or use of the injection device , such as for instance information on the injected insulin type and dose.

For a good treatment of insulin it is necessary to keep a diary to document the day, time and amount of insulin dose. Some patients forget to write the information down or cannot remember when and how much insulin they have injected. Therefore, there is a strong need for further support or automation of this process to make it easier for the patient to keep track of his/her diary.

<CIT> discloses a supplemental device for attachment to an injection device, including an optical sensor that is capable of capturing images of a dosage window of the injection device.

According to the present invention, there is provided a supplemental device according to claim <NUM>, a system according to claim <NUM>, and a method according to claim <NUM>.

A first aspect of the invention provides a supplemental device configured for removable attachment to a medicament injection device, the supplemental device comprising a display, a processor arrangement, at least one memory and an image capturing component, wherein the processor arrangement is configured to cause the supplemental device to:.

This can provide a display of dialled dose that is not subject to correct OCR operation but without requiring a highly reliable or fast-operating optical character recognition capabilities. This can be achieved whilst allowing the supplemental device to identify and record delivered doses without requiring any external device or processing.

The device may be configured to update the display with captured images at substantially the same rate as images are captured. This can allow relatively rapid updating of displayed dose images but without requiring more frequent capturing of images.

The device may be configured to perform optical character recognition on captured images less frequently than performing updating the display with captured images. This can provide a display of dialled dose that is not subject to correct OCR operation but without requiring optical character recognition to be performed frequently.

The device may be configured to respond to a user input to make a record of a dose dialled in to the injection device before dose delivery.

The device may be configured to respond to a detection that a dose dialled in to the injection device has remained constant for a threshold time to make a record of a dose dialled in to the injection device before dose delivery.

The device may be configured to detect that the administration of a medicament dosage is completed when a zero dose is identified by the performed optical character recognition.

The device may be configured to capture images of a medicament dosage indicated by the medicament dispensing device and display the images of the medicament dosage periodically or continually.

The device may be configured to capture images of a medicament dosage indicated by the medicament dispensing device and display the image of the medicament dosage plural times a second.

The device may be configured to cause a first display after a first user input on the device and to cause a second display after a second input on the device.

The non-transient record of dosage information may include a time and/or date information taken from a clock of the device.

A second aspect of the invention provides a system comprising a device as above removably attached to a medicament administration device.

A third aspect of the invention provides a method of operating a supplemental device configured for removable attachment to a medicament injection device, the supplemental device comprising a display, a processor arrangement, at least one memory and an image capturing component, the method comprising the supplemental device:.

Embodiments of the invention relate to a reusable supplementary device that can be used in conjunction with an existing disposable or non-disposable medicament injection pen. The key features of the supplementary device are to aid a user keep a track record of the medicament dosage expelled from the disposable or non-disposable medicament injection pen and to display the current dosage to the user. The supplementary device comprises of an imaging device and an optical character recognition OCR device to capture the dosage displayed on the disposable or non-disposable injection pen. While the captured image is displayed to the user on the supplementary device, the dosage reading obtained from the OCR process is used to determine the expelled dosage and permanently recorded in the memory of the supplementary device along with other relevant information such as time and date of administration. This may then form a logbook record of medicament intake by the user.

The automatic capturing and permanent recording of information on the medicament dosage expelled from an injection pen by the user negates the need for the user to manually perform this task, eliminating the risk of human error. A record of information of each medicament dosage expelled is also electronically stored and easily retrievable for future reference.

The supplementary device comprises an display that is used to display various information to the user. The supplementary device captures information behind the display window of the injection pen and displays this information on the display. The supplementary device also acknowledges commands received from the user through button press on the device by displaying other information on the display.

An advantage of the supplementary device is that it is reusable such that once the medicament in the injection pen is fully expelled, the supplementary device can be reattached to a new injection pen and continue its function. If the injection pen is non-disposable, the user can refill the pen with new medicament and continue using the injection pen with the supplementary device.

Advantageously, the supplementary device also comprises a wireless unit configured to transmit and/or receive information to/from another device in a wireless fashion. This feature allows the information of each medicament dosage permanently recorded in the supplementary device to be conveniently transferred to the other device for safe keeping and future reference.

The supplementary device is notified by the user by a button press when the required medicament dosage is dialled in. Upon receiving this notification, the supplementary device records the dosage dialled into the injection pen by storing the results from the last (or last valid) OCR into the main memory.

In alternative embodiments, the notification press causes image capture to be made and OCR to be performed and for the determined dose to be stored in main memory. The feature of notification triggering image capture and OCR ensures that the information displayed behind the display window of the injection pen is stationary while the image that is subjected to OCR is being captured. This reduces image distortion due to at least motion blur and improves image quality, thus improving the reliability of the OCR and potentially reducing the processing needed to determine the dialled dose through OCR.

In further embodiments, the OCR step is triggered upon the processor determining that two (at least) consecutive or near consecutive images are substantially the same (e.g. because the images are highly correlated). In any case the triggered image capture and OCR step ensure that a picture is taken from a still object and not from a moving object. This reduces image distortion due to at least motion blur and improves image quality thus improving the reliability of the OCR.

In the following, embodiments of the present invention will be described with reference to an insulin injection device. The present invention is however not limited to such application and may equally well be deployed with injection devices that eject other medicaments, or with other types of medicament administration devices.

<FIG> is an exploded view of an injection device <NUM>, which may for instance represent Sanofi's Solostar (TM) insulin injection pen.

The injection device <NUM> of <FIG> is a pre-filled, disposable injection pen that comprises a housing <NUM> and contains an insulin container <NUM>, to which a needle <NUM> can be affixed. The needle is protected by an inner needle cap <NUM> and an outer needle cap <NUM>, which in turn can be covered by a cap <NUM>. An insulin dose to be ejected from injection device <NUM> can be selected by turning the dosage dial <NUM>, and the selected dose is then displayed via dosage window <NUM>, for instance in multiples of so-called International Units (IU), wherein one IU is the biological equivalent of about <NUM> micrograms of pure crystalline insulin (<NUM>/<NUM>). An example of a selected dose displayed in dosage window <NUM> may for instance be <NUM> IUs, as shown in <FIG>. It should be noted that the selected dose may equally well be displayed differently. A label (not shown) is provided on the housing <NUM>. The label includes information about the medicament included within the injection device <NUM>, including information identifying the medicament.

Turning the dosage dial <NUM> causes a mechanical clicker to provide haptic and acoustic feedback to a user. The numbers displayed in dosage window <NUM> are present on a sleeve by printing and the sleeve is contained in housing <NUM> and mechanically interacts with a piston in insulin container <NUM>. When needle <NUM> is stuck into a skin portion of a patient, and then injection button <NUM> is pushed, the insulin dose displayed in display window <NUM> will be ejected from injection device <NUM>. When the needle <NUM> of injection device <NUM> remains for a certain time in the skin portion after the injection button <NUM> is pushed, a high percentage of the dose is actually injected into the patient's body. Ejection of the insulin dose also causes a mechanical click sound, which is however different from the sounds produced when using dosage dial <NUM>.

Injection device <NUM> may be used for several injection processes until either insulin container <NUM> is empty or the expiration date of injection device <NUM> (e.g. <NUM> days after the first use) is reached.

Furthermore, before using injection device <NUM> for the first time, it may be necessary to perform a so-called "prime shot" to remove air from insulin container <NUM> and needle <NUM>, for instance by selecting two units of insulin and pressing injection button <NUM> while holding injection device <NUM> with the needle <NUM> upwards.

For simplicity of presentation, in the following, it will be exemplarily assumed that the ejected doses substantially correspond to the injected doses, so that, for instance when making a proposal for a dose to be injected next, this dose equals the dose that has to ejected by the injection device <NUM>. Nevertheless, differences (e.g. losses) between the ejected doses and the injected doses may of course be taken into account.

<FIG> is a close-up of the end of the injection device <NUM>. This Figure shows a locating rib <NUM> that is located between the dosage window <NUM> and the dosage dial <NUM>.

<FIG> shows an embodiment of a supplementary device <NUM> to be releasably attached to injection device <NUM> of <FIG>. Supplementary device <NUM> comprises a housing <NUM> with a mating unit configured to embrace the housing <NUM> of injection device <NUM> of <FIG>, so that supplementary device <NUM> sits tightly on housing <NUM> of injection device <NUM>, but is nevertheless removable from injection device <NUM>, for instance when injection device <NUM> is empty and needs to be replaced. <FIG> is schematic, and details of the physical arrangement are described below with reference to <FIG>.

Supplementary device <NUM> contains optical sensors for gathering information from injection device <NUM>. As described below, a selected dose (also known as a dialled dose) is displayed via LCD display <NUM> of supplementary device <NUM>. The dosage window <NUM> of injection device <NUM> is obstructed by supplementary device <NUM> when attached to injection device <NUM>.

Supplementary device <NUM> further comprises at least one user input transducer or switch <NUM>, illustrated schematically as a button type switch. These input transducers <NUM> allow a user to turn on/off supplementary device <NUM>, to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, and/or to trigger transmission of information from supplementary device <NUM> to another device), or to confirm something.

<FIG> is a schematic illustration of a second embodiment of a supplementary device <NUM> to be releasably attached to injection device <NUM> of <FIG>. Supplementary device <NUM> comprises a housing <NUM> with a mating unit configured to embrace the housing <NUM> of injection device <NUM> of <FIG>, so that supplementary device <NUM> sits tightly on housing <NUM> of injection device <NUM>, but is nevertheless removable from injection device <NUM>.

Information is displayed via LCD display <NUM> of supplementary device <NUM>. The dosage window <NUM> of injection device <NUM> is obstructed by supplementary device <NUM> when attached to injection device <NUM>.

Supplementary device <NUM> further comprises three user input transducers, buttons or switches. A first button <NUM> is a power on/off button, via which the supplementary device <NUM> may for instance be turned on and off. A second button <NUM> is a communications button. A third button <NUM> is a confirm or OK button. The buttons <NUM>, <NUM>, <NUM> may take any suitable form. These input buttons <NUM>, <NUM>, <NUM> allow a user to turn on/off supplementary device <NUM>, to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, to trigger transmission of information from supplementary device <NUM> to another device), to confirm something, and/or to display information on the LCD display <NUM>.

<FIG> is a schematic illustration of a third embodiment of a supplementary device <NUM> to be releasably attached to injection device <NUM> of <FIG>. Supplementary device <NUM> comprises a housing <NUM> with a mating unit configured to embrace the housing <NUM> of injection device <NUM> of <FIG>, so that supplementary device <NUM> sits tightly on housing <NUM> of injection device <NUM>, but is nevertheless removable from injection device <NUM>.

Information is displayed via LCD display <NUM> of the supplementary device <NUM>. The dosage window <NUM> of injection device <NUM> is obstructed by supplementary device <NUM> when attached to injection device <NUM>.

Supplementary device <NUM> further comprises a touch-sensitive input transducer <NUM>. It also comprises a single user input button or switch <NUM>. The button <NUM> is a power on/off button, via which the supplementary device <NUM> may for instance be turned on and off. The touch sensitive input transducer <NUM> can be used to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, and/or to trigger transmission of image data information from supplementary device <NUM> to the mobile device <NUM>. This multi-function touch-sensitive input transducer <NUM> removes the need for the communications button <NUM> or a confirm button <NUM> and simplifies the configuration of the supplementary device <NUM>. Such a multi-function transducer <NUM> may be mechanical instead of being touch-sensitive.

<FIG> shows a schematic view of the supplementary device <NUM> of <FIG> in a state where it is attached to injection device <NUM> of <FIG>.

With the housing <NUM> of supplementary device <NUM>, a plurality of components is contained. These are controlled by a processor <NUM>, which may for instance be a microprocessor, a Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or the like. Processor <NUM> executes program code (e.g. software or firmware) stored in a program memory <NUM>, and uses a main memory <NUM>, for instance to store intermediate results. Program memory <NUM> may for instance be a Read-Only Memory (ROM) or Flash memory, and main memory may for instance be a Random Access Memory (RAM).

In embodiments such as those shown in <FIG>, processor <NUM> interacts with the first button <NUM>, via which supplementary device <NUM> may for instance be turned on and off. The second button <NUM> may be used to trigger establishment of a connection to another device, or to trigger a transmission of information to another device. The third button <NUM> can be used to acknowledge information presented to a user of supplementary device <NUM>.

In embodiments such as those shown in <FIG>, two of the buttons <NUM>, <NUM> may be omitted. Instead, one or more capacitive sensors or other touch sensors are provided.

Processor <NUM> controls a display <NUM>, which is presently embodied as a Liquid Crystal Display (LCD). LCD display <NUM> is used to display information to a user of supplementary device <NUM>, for instance on present settings of injection device <NUM>, or on a next injection to be given. LCD display <NUM> may also be embodied as a touch-screen display, for instance to receive user input.

Processor <NUM> also controls an image capture device <NUM> that is configured to capture images of the dosage window <NUM>, in which a currently selected (dialled) dose is displayed (by way of numbers, characters, symbols or glyphs present on the sleeve <NUM> contained in injection device <NUM>, which numbers are visible through the dosage window <NUM>). The image capture device <NUM> may be a camera of any suitable type. The camera image taken is stored in the memory <NUM> of the supplementary device <NUM> together with a time stamp and information about the drug type.

Processor <NUM> also controls one or more light-sources such as light emitting diodes (LEDs) <NUM> to illuminate the scene that is visible through the dosage window <NUM>, in which a currently selected dose is displayed. A diffuser may be used in front of the light-sources, for instance a diffuser made from a piece of acrylic glass or polycarbonate. Furthermore, the optical sensor may comprise a lens system, for instance including two aspheric lenses. The magnification ratio (image size to object size ratio) may be smaller than <NUM>. The magnification ratio may be in the range of <NUM> to <NUM>.

Processor <NUM> controls a wireless unit <NUM>, which is configured to transmit and/or receive information to/from another device in a wireless fashion. Such transmission may for instance be based on radio transmission or optical transmission. In some embodiments, the wireless unit <NUM> is a Bluetooth or Bluetooth Low Energy transceiver. Alternatively, wireless unit <NUM> may be substituted or complemented by a wired unit configured to transmit and/or receive information to/from another device in a wire-bound fashion, for instance via a cable or fibre connection.

The supplementary device <NUM> of <FIG> is thus capable of capturing information related to a condition and/or use of injection device <NUM>. This information is displayed on the display <NUM> for use by the user of the device and some of the information is transmitted wirelessly to another device. For instance, the information may be transmitted to a mobile phone, as is described in more detail below.

In use, the supplementary device <NUM> picks up a camera image of the display window <NUM> of the injection device <NUM> and displays that image on the display <NUM> so that the user is able to see what dose is currently dialled on the injection device <NUM>. By that, the user is enabled to use the injection device <NUM> with attached supplementary device <NUM> in the same fashion as the user would use the injection device alone. As the camera image is directly shown on the display, the system reliability in terms of showing the exact amount of dialled drug dose is improved. Further, the time lag between actual dose selection and displaying that dose on the display <NUM> is better controllable because less computing power is required to generate the display image for the user.

<FIG> is a flow chart illustrating operation of the supplementary device <NUM>. The flow chart illustrates how the supplementary device <NUM> operates when the injection device <NUM> is being utilised. The steps of <FIG> are performed by the processor <NUM> of the supplementary device <NUM> under control of the software <NUM> stored in the program memory <NUM>.

In <FIG>, the operation <NUM> starts for instance when the supplementary device <NUM> is turned on or is otherwise activated at <NUM>. In a step <NUM>, the processor <NUM> starts the "Capture Image" routine. In this routine, the processor <NUM> controls the camera <NUM> to periodically (at e.g. <NUM> intervals) capture an image of the current dosage displayed on the number sleeve of the injection device <NUM>, as is visible through the dosage window <NUM> of the injection device <NUM>.

In a step <NUM>, the processor <NUM> starts the "Display Image" routine. In this routine, the image is then caused to be periodically (e.g. at <NUM> intervals) displayed on the LCD display <NUM> of the supplementary device <NUM>.

The image may be processed to some degree before display. In particular, the image may be resized so as to fit the LCD display <NUM>. In the case of the camera having more pixels than the LCD display <NUM>, resizing involves downscaling the image. Downscaling may comprise for instance selecting only some pixels of the captured image for display (and not displaying others), or averaging groups of pixels.

The image advantageously is displayed in greyscale. This avoids the need for the supplementary device <NUM> to perform processing of the image to detect boundaries of characters etc. It also reduces the possibility that the displayed image is significantly different from the scene in front of the camera <NUM>. Alternatively, the image may be displayed in black and white (without greyscale), or in colour.

Once the "Capture Image" routine and the "Display Image" routines are started by the processor <NUM> in steps <NUM> and <NUM>, an image is captured and displayed every e.g. <NUM> by the supplementary device <NUM>. The interval is selected such that, as the dosage is being dialled in by the user on the injection pen <NUM>, the delay between dosage reading displayed behind the window on the injection pen <NUM> and the image displayed on the supplementary device <NUM> is not noticeable or is barely noticeable to the user.

In this condition, the supplementary device <NUM> is in a dialing mode of operation.

In a step <NUM>, the processor <NUM> starts a "Perform OCR" routine. In this routine, the processor <NUM> performs optical character recognition processing on the image captured by the "Image Capture" routine. This can be performed in any suitable way. The optical character recognition (OCR) involves processing the image of the number sleeve that is in the scene in front of the camera <NUM> of the supplementary device <NUM> to identify the dose that is dialled into the supplementary device <NUM>. The result is a number that represents the dialled dose, for instance in IU (International Units). The number may be provided by the optical character recognition process as an integer. It may be between integer numbers if the optical character recognition process is suitably configured. Once the "Perform OCR" routine is started by the processor <NUM> in step <NUM>, optical character recognition is performed on an image every e.g. <NUM>. It should be noted here that the "Image Capture" routine captures an image every <NUM> while the "Perform OCR" routine performs optical recognition on an image every <NUM>. Put another way, the "Image Capture" interval is significantly smaller than the "Perform OCR" interval. In this example, the optical character recognition process is performed by the processor on every fifth image taken by the camera. In this condition, the supplementary device <NUM> still is in the dialing mode of operation. Once the user has arrived at the desired dosage, the dialing mode of operation seizes. At this point, the dosage reading behind the window on the injection pen is stationary. The OCR continues to be performed on a non-moving target which will achieve a result that is not error-prone.

In a step <NUM>, the processor <NUM> checks whether a user input, indicating that a required dosage has been set, has been provided, for instance by a button press on the supplementary device <NUM>.

If no button press is detected, the operation proceeds to step <NUM>, where it is determined if the power button <NUM> has been pressed. On a negative determination, the operation proceeds to step <NUM>, where it is determined if there is a time out condition. The time out condition occurs when a timer that is reset and started when the supplementary device <NUM> powers on or when it is detected that the power button <NUM> has been pressed has expired. A suitable value for the timer may be <NUM> or <NUM> seconds, for example. On a negative determination from step <NUM>, the operation returns to step <NUM>.

On a positive determination from step <NUM> or <NUM>, indicating that the time out condition has occurred or the user has pressed the power button <NUM>, the supplementary device <NUM> powers off and the operation ends at step <NUM>. This helps to minimise power consumption of the supplementary device but without impinging on operation when the user is interacting with the supplementary device <NUM> or the injection device <NUM>.

During the sequence from step <NUM> to step <NUM> to step <NUM> then to step <NUM>, the supplementary device <NUM> remains capturing images, displaying them and performing optical character recognition on them until either the power button <NUM> is pressed or the time out condition occurs or until it is determined at step <NUM> that the confirm or OK button <NUM> has been pressed. This loop allows the user to set the required dosage by turning the dosage dial <NUM> on the injection device <NUM> and reading the image containing the current dosage information displayed on the LCD display <NUM>.

When the processor <NUM> detects in step <NUM> that a confirm or OK button <NUM> press by the user to confirm that a required dosage has been set, at step <NUM> a "Dose Set" condition is indicated on the display <NUM>. In a step <NUM>, the processor <NUM> records the dosage dialled into the injection device <NUM> by the user by storing the results from the last (or last valid) optical character recognition into main memory <NUM> at a step <NUM>.

In other embodiments, the dose set condition triggers an image capture and OCR step to store the dialed dose in the log. In further embodiments, the OCR step is triggered upon the processor determining that two (at least) consecutive or near consecutive images are substantially the same (e.g. because the images are highly correlated). In any case the triggered image capture and OCR step ensure that a picture is taken from a still object and not from a moving object. This reduces image distortion due to at least motion blur and improves image quality thus improving the ability of the OCR process to determine the dialled dose reliably and correctly.

Steps <NUM> and step <NUM> may be performed in the other order, or they may be performed in parallel with one another. In this condition, the supplementary device <NUM> is in a dose set mode of operation.

In a step <NUM>, the processor <NUM> controls the LCD display <NUM> to display "Administering". At this stage, the user may be administering (delivering) the dose dialled into the injection device <NUM> before the confirm or OK button <NUM> to set dose was detected to be pressed at step <NUM>. It should be noted that during this time, the image in front of the camera is displayed on the display <NUM> at <NUM> intervals. Also, optical character recognition is performed at <NUM> intervals. The operation may progress from step <NUM> to <NUM> after a fixed time period. Alternatively, it may progress in response to a detection that the dialed dose is changing. The dialled dose can be detected to be changing either from comparing two subsequent OCR readings (if they are different, the dialled dose is changing) of by detecting if there is significant change between two successively captured images (but without performing OCR to identify the dialled dose). In this condition, the supplementary device <NUM> is in a dose administering mode of operation.

As the dose is being administered, the number that represents the current dosage, provided as an integer or between integers by the optical character recognition process, decreases. At a step <NUM>, the processor <NUM> checks if the administration of medicament is complete by determining if zero dose remains. This is done by comparing the current dosage determined by the optical character recognition process against a fixed value, zero, stored in program memory <NUM>. If there is a zero dose dialed into the injection device <NUM>, it is inferred by the processor that the administration of medicament is complete (i.e. the dialled dose in step <NUM> is completely expelled from the injection pen <NUM>). In a step <NUM>, the processor <NUM> records the dialled dosage at step <NUM> as the delivered dosage. Since a zero dose was detected at the previous step <NUM>, it is assumed that the dialled dosage has been fully administered by the user and a record is kept in step <NUM>. In a step <NUM>, the processor <NUM> controls the LCD display <NUM> to display "Complete".

Next it is determined at step <NUM> whether or not the power button <NUM> has been pressed. If it is detected that the power button <NUM> has been pressed, the processor <NUM> turns the supplementary device <NUM> off at step <NUM>. If not, it proceeds to step <NUM>, where the processor <NUM> checks to see if a timeout condition is met. The sequence step <NUM> and <NUM> repeats until either the time out condition is met or the power button <NUM> is pressed and the processor <NUM> turns the supplementary device <NUM> off at step <NUM>.

On a negative determination at step <NUM>, indicating that the current dosage on display has not reached zero, the processor <NUM> checks if the power button <NUM> has been pressed at a step <NUM>. This condition may arise if the user changes his mind after dialling in the medicament dosage at step <NUM> and decides to terminate the injection process before the full dialled dosage is expelled. The user can indicate this by operating the power button <NUM> without delivering all of the dialled dose. On a positive determination at step <NUM>, the processor <NUM> takes the latest dosage reading determined by the optical character recognition process, indicating the current dosage level remaining in the injection device <NUM>, and subtracts it from the dialled dosage recorded at step <NUM>. The difference in dose (balance dosage) represents how much medicament has been injected by the user. In a step <NUM>, the balance dosage is recorded in program memory <NUM> by the processor <NUM>. Once complete, the processor <NUM> then proceeds to step <NUM> and turns the supplementary device <NUM> off.

On a negative determination at step <NUM>, the operation advances to a step <NUM>. At step <NUM>, the processor <NUM> determines whether or not the administering of the medicament is still in progress. The processor <NUM> performs a less than or equal to (S:) comparison periodically between the latest dosage reading determined by the optical recognition process and the dosage reading from the previous cycle over a period of "X" seconds. The processor <NUM> here has obtained the dosage reading from the previous cycle having performed the optical character recognition process on a dosage image previously captured by the camera. If the processor <NUM> determines that the latest dosage reading is less than the dosage reading from the previous cycle after X seconds using the above mentioned comparison approach, the operation returns to a step <NUM>. The processor <NUM> infers here that the medicament administration process is still ongoing. If the OCR fails to produce a dialled dose, the operation also returns to step <NUM>. Failure of the OCR to produce a dose reading can occur because of blurring when the number sleeve is moving relative to the camera. Detecting whether a change has occurred in X seconds can involve resetting and starting a timer whenever a change is detected and determining whether the timer has expired when a valid OCR reading is made.

If the processor <NUM> determines that there is no change between the latest dosage reading and the previous dosage reading after X seconds in step <NUM>, the operation advances to step <NUM>. Here, the processor <NUM> infers that the user has finished dispensing and is not going to dispense the remaining dialled dose. As discussed above, at step <NUM> the processor <NUM> takes the latest dosage reading determined by the optical character recognition process, indicating the current dosage level remaining in the injection device <NUM>, and subtracts it from the dialled dosage recorded at step <NUM>. The balance dosage represents how much medicament has been injected by the user. In a step <NUM>, the balance dosage is recorded in program memory <NUM> by the processor <NUM>. Once complete, the processor <NUM> then proceeds to step <NUM> and turns the supplementary device <NUM> off.

The storage of the dose information at step <NUM> and <NUM> constitute a record of the medicament administration. The record includes the time or time and date of administration, taken from the internal clock of the supplementary device <NUM> and the dose delivered. This allows a complete record of the medicament intake of the user to be recorded by the supplementary device <NUM> without requiring the user to enter the dialled, post-delivered or delivered dose. This information can be transferred from the supplementary device <NUM> to another device at a later time by the user using the wireless feature provided by the supplementary device <NUM>.

Operation of the system will now be described from the users perspective.

The user begins by turning on the supplementary device <NUM> (which requires one press of the power button <NUM>). When turned on, the current dosage on the injection device <NUM> is displayed to the user on the supplementary device <NUM> LCD display <NUM>. The user can now set the required medicament dosage by turning the dosage dial <NUM> on the injection device <NUM> while reading the current dosage reading on the LCD display <NUM>.

When the required medicament dosage is set, the user presses the confirm or OK button <NUM> on the supplementary device <NUM>. At this time, the supplementary device <NUM> is displaying the medicament dose on the LCD display <NUM>. After a short time, the display of the LCD display <NUM> on the supplementary device <NUM> then changes to indicate that the dose has been set. Before or after this change in display, the user can start to inject the medicament. As the medicament is administered, the dosage reading on the LCD display <NUM> changes as the dose indicated on the part of the number sleeve of the injection device <NUM> in front of the camera changes. When the injection process is complete, the user may press the confirm or OK button <NUM> again or may allow the timer to timeout. The supplementary device <NUM> LCD display <NUM> then changes to display "Complete". The supplementary device <NUM> at this time displays the remaining dosage in the injection device <NUM> on the LCD display <NUM>. The remaining dose typically is zero but it may be higher if the user did not complete the injection.

<FIG> shows the supplementary device and injection device <NUM> being used in conjunction with a mobile device <NUM> such as a smartphone. The mobile device <NUM> is programmed in a suitable way, for instance by being provided with a suitable software application <NUM>.

In brief, the system of the supplementary device <NUM> functions to display medicament dialled into the injection device <NUM> as it is used, and record delivered doses. The mobile device <NUM> functions to keep a record of delivered doses, using dose information provided by the supplementary device <NUM>. The supplementary device <NUM> communicates with the mobile device <NUM> using a communication interface <NUM> e.g. Bluetooth. The user interacts primarily with the supplementary device <NUM>. The mobile device <NUM> serves primarily to provide information to the user and to record the user's injection history through the use of a medicament administration monitoring application <NUM>. A more detailed explanation of how the system is configured and functions is described below.

<FIG> is a schematic view of the mobile terminal of <FIG> showing internal components of the mobile terminal <NUM>. The mobile device <NUM> comprises a memory <NUM>, i.e. a working or volatile memory, such as Random Access Memory (RAM), and a non-volatile memory. The non-volatile memory stores an operating system and a medicament administration monitoring application <NUM>, which advantageously is a distinct application, as well as storing data files and associated metadata. The medicament administration monitoring application <NUM> may be provided in the mobile device <NUM> on manufacture or it may be downloaded into the mobile device <NUM>, for instance from an application market place or application store, or it may be side loaded into the mobile device <NUM>.

The mobile device <NUM> comprises a display <NUM>, for instance an LCD, TFT (thin film transistor), OLEO (organic light emitting diode) or ePaper display. The display may be a touch sensitive display having a display part <NUM> and a tactile interface part <NUM>. The mobile device <NUM> also includes a communications interface <NUM>, such as a Bluetooth interface <NUM>. The mobile device <NUM> also houses a battery <NUM> to power the mobile device <NUM> by a power supply <NUM>.

The processor <NUM> is configured to send and receive signals to and from the other components in order to control operation of the other components. For example, the processor <NUM> controls the display of content on display <NUM> and receives signals as a result of user inputs from tactile interface <NUM>. The display <NUM> may be a resistive touch screen or capacitive touch screen of any kind. The display may alternatively not be a touch screen. For instance it may be a liquid crystal display (LCD).

The mobile device <NUM> may combine in the application <NUM> the determined medicament dosage, the label content, the time and date information and/or the position information combined with other important data like blood glucose value, physical stress and alimentation in order to provide a detailed analysis of the disease for the patient and/or their therapy. The combined data may further provide information about the as well as the progress in therapy and/or compliance of the patient.

The scope of the invention is not limited to the above-described embodiments and various alternatives will be envisaged by the skilled person. Further alternatives will now be described.

Triggering of transition from dialing mode to dose set mode at step <NUM> may be made other than in response to a user input. In some embodiments, the processor <NUM> is configured to detect that the dialled dose remained at an non-zero amount for greater than a threshold time, for instance <NUM>,<NUM><NUM>, or <NUM> seconds, and to respond to such a detection by transitioning from dialing mode to dose set mode. In this case, the dialled dose at this time is used as the dose dialled prior to dose delivery.

In other embodiments, the dose set mode is omitted and the supplementary device <NUM> instead can transition directly from dose dialing mode to administering mode. This can occur in response to a user input on the button <NUM>. It may alternatively occur in response to detecting that the dialled dose remained at an non-zero amount for greater than a threshold time. Alternatively, the transition may be triggered by analysis of the OCR readings over time and determining therefrom when dose is being delivered. The supplementary device may distinguish between dose that is being dialled down and dose that is being delivered in any suitable way. Here, the transition may be detected retrospectively, i.e. after the event. Also, the supplementary device <NUM> is configured to determine the dose that was dialled at the time of the transition and to use this as the dose dialled prior to dose delivery.

In <FIG>, the communications button <NUM> can be omitted from the supplementary device. When the power button <NUM> is pressed, the supplementary device <NUM> can turn on and automatically establish connection with the mobile device <NUM>. This simplifies the function of the supplementary device <NUM> and allows it to have fewer hardware buttons.

Instead of transmitting dose data only in response to a user input on the supplementary device <NUM>, operation may differ. For instance, image data may be transmitted continually or frequently to the mobile device <NUM>, and the mobile device may then display the dialled dose as dialling occurs and/or as injecting occurs. In this case, the user input indicating that the dose has been set may be made on the mobile device <NUM> instead of on the supplementary device <NUM>. In this case, the user can check the dialled dose indicated on the mobile device <NUM> (which has been subjected to optical character recognition) against the image displayed on the LCD display <NUM> of the supplementary device <NUM>. Similarly, the user indicating that the injection has completed may be made on the mobile device <NUM> instead of the supplemental device <NUM>. Alternatively, both the supplemental device <NUM> and the mobile device <NUM> may be configured to receive the dose set user input and/or the injection complete user input, thereby allowing the user more choices for using the system.

The supplemental device <NUM> may include a means for detecting the medicament included in the injection device <NUM>. This may take the form of a colour sensor that is configured to detect the colour of a label on the injection pen, the label colour indicating the type of medicament contained.

Claim 1:
A supplemental device (<NUM>) configured for removable attachment to a medicament injection device (<NUM>), the supplemental device comprising a display (<NUM>), a processor arrangement (<NUM>), at least one memory (<NUM>) and an image capturing component (<NUM>), wherein the processor arrangement is configured to cause the supplemental device to:
use the image capturing component to capture successive images of a medicament dosage indicated by a medicament dispensing device; and
successively display the captured images on the display,
wherein the processor arrangement is configured to cause the supplemental device to capture and display the images plural times a second,
wherein the processor arrangement is further configured to:
cause optical character recognition to be performed on at least one of the captured images thereby to identify a medicament dosage indicated by the medicament dispensing device when the images were captured, the optical character recognition caused to be performed less frequently than performing updating the display with captured images; and
cause a non-transient record of delivered dosage information to be made based at least in part on the identified medicament dosage.