Patent Description:
There are many procedures associated with the intra oral cavity in which a precise three-dimensional virtual representation of the intra oral cavity can be useful to the dental practitioner.

Such virtual representations (also referred to interchangeably herein as "virtual models", "computer models", "3D numerical entities", and so on) enable the practitioner to study the intra oral cavity of individual patients via a computer system, in a similar manner to the study of the traditional physical plaster model. Furthermore, three-dimensional numerical entities of the intra oral cavity also allow the practitioner to study methods or approaches when dealing with particular dental problems of any given patient, and for the design of physical entities, for example prostheses, dental brackets, aligners and so on, in relation therewith. For example, in prosthodontics, a computer model of a patient's teeth may be manipulated to provide machining data to manufacture a physical model of the intra oral cavity, and/or to design and manufacture a coping and/or a prosthesis, while in orthodontics a computer model of a patient's teeth may be manipulated to enable a dental appliance, including for example orthodontic brackets and/or aligners, to be designed and manufactured, and/or for designing a treatment.

A parameter used in the design and manufacture of a dental prosthesis, such as a crown or bridge, is the finish line, or transition boundary between the prosthesis and the dental preparation, and this needs to be precisely defined in three-dimensions. Obtaining finish line coordinates from a computer virtual model is more efficient and often more accurate than from a plaster cast, and moreover facilitates the production of such a prosthesis, for example via CNC machining, rapid prototyping, or other computerised technologies, if desired.

However, it is often the case that when scanning the intra oral cavity to obtain 3D data of the preparation and finish line, on which the virtual model is based, part of the finish line, and possibly also the shoulder and other parts of the preparation, may be obscured by soft tissues such as the gum that, no longer being supported by the dental surfaces that have been removed, deform to cover at least a part of the finish line on the prepared dental site.

Additionally or alternatively, part or all of the finish line may be obscured by other agents or materials, including, for example, accumulation of one or more of saliva, blood, lubricant used with a dental drill, debris resulting from working the dental site, and so on.

Similar issues may arise when scanning the intra oral cavity to obtain 3D data of the position and orientation of a dental implant in relation to the surrounding portions of the intra-oral cavity, and in addition the corresponding impression abutment (also referred to herein as a scanning body) may partially obscure part of the intra-oral cavity.

Similarly, there are other situations in which a virtual model of a physical item, obtained from scanning the physical item, is partially obscured or incomplete, or in which part of the physical item needs to be subsequently modified after obtaining the virtual model. Such situations would conventionally require a rescanning of the entire physical item, and this may involve significant additional time, inconvenience and, where the physical item is a part of the body of a patient (such as for example the intra oral cavity), this may also involve significant patient discomfort. <CIT> discloses a 3D virtual model of an intra oral cavity in which at least a part of a finish line of a preparation is obscured is manipulated in virtual space by means of a computer or the like to create, recreate or reconstruct finish line data and other geometrical corresponding to the obscured part. Trimmed virtual models, and trimmed physical models, can then be created utilizing data thus created. The virtual models and/or the physical models may be used in the design and manufacture of copings or of prostheses.

Herein "intra oral cavity" (also referred to interchangeably herein as dental cavity) is taken to include, but not be limited to, one or more real teeth and/or one or more prosthetic teeth and/or part of one or more real teeth, of one jaw or of both jaws of <NUM> a patient, and/or can also include all the real teeth and/or prosthetic teeth in one or both jaws, and/or adjacent gingiva and other adjacent objects of the patient.

Herein, "dental material" refers to any material associated with dental structures of the intra oral cavity, including but not limited to natural dental materials such as for example enamel, dentine, pulp, dental roots, and also including non-natural dental materials from which items such as for example metallic and non-metallic fillings, restorations, crowns, bridges, copings, preparations, and so on, are made from.

Herein, "dental clinic" refers to the interface between a dental practitioner and a patent, and thus includes any physical entity, in particular a clinic, in which there is interaction between a dental patient and a dental practitioner. While "dental practitioner" typically refers to a dentist, doctor or dental technician, it also includes herein all other caregivers, including for example dental surgeons, orthodontists, prosthodontists, dental assistants or any other caregiver or professional that may interact with a dental patient during the course of a dental treatment, or that may be involved in determining, preparing or providing dental treatment to a patient, particularly prosthodontic treatment and/or orthodontic treatment. While "dental patient" (also referred to interchangeably herein as "patient") typically refers to a person requiring the dental services of a dental practitioner, it also includes herein any person regarding whom it is desired to create a 3D numerical model of the intra oral cavity thereof, for example for the purpose of practicing the same or for carrying out research.

The term "prosthesis" is herein taken to include any restoration and any onlays, such as crowns and bridges, for example, and inlays, such as caps, for example, or veneering, or any other artificial partial or complete denture.

The term "virtual", applied herein with respect to models, manipulation of models, and so on, in particular 3D virtual models, for example, refers to being created, simulated, manipulated, carried out, and so on by means of a CAD/CAM system, a computer, a computer network, or the like, i.e., in a computer environment, particularly with reference to digital dentistry.

While the term "preparation" typically refers to the stump and including the finish line and shoulder that is left of the tooth that is to be replaced by the prosthesis - typically a crown - and on which the crown or other prosthesis is to be mounted or seated, the term "preparation" herein also includes artificial stumps, pivots, cores and posts, or other devices that may be implanted in the intraoral cavity in such a position or in a position that is optimal for implanting the crown or other prosthesis.

The term "prosthodontic procedure" refers, inter alia, to any procedure involving the intraoral cavity and directed to the design, manufacture or installation of a dental prosthesis at a dental site within the intraoral cavity, or a real or virtual model thereof, or directed to the design and preparation of the dental site to receive such a prosthesis.

The term "3D virtual model" is used herein synonymously with digital model, virtual model, 3D virtual model, 3D model, three dimensional model, 3D numerical entity, numerical entity, computer model, 3D computer model, dimensional data, 3D digitized data, 3D representation, and other such terms, and relates to a virtual representation in a computer environment of a real object, such as for example a dentition or at least a part of the intraoral cavity, or of a real (physical) model thereof, for example of a plaster model or a stone model of the dentition or any dental structure. In particular a virtual dental model is one example of such a 3D virtual model of a dental structure.

The term "physical part" is used herein, synonymously with "real part" to refer to a physical object, in particular a physical dental object having a real (physical) surface and included but not limited to part or all of the dentition of the intraoral cavity including dies, a coping, a prosthesis, and so on, or to a physical dental model of part or all of the dentition of the intraoral cavity including dies, a coping, a prosthesis, and so on.

The term "scanning" and its analogues refer to any procedure directed at obtaining 3D topographic data of a surface, particularly of a dental surface, wherein to provide a 3D virtual model, and thus includes mechanical-based or other contact systems and methods, typically based on 3D probes for example, and/or any other noncontact systems and methods included but not limited to optical-based systems and methods and/or radiation-based systems and methods, including for example confocal-based systems and methods, for example as disclosed in <CIT>,
x-ray systems and methods including CT systems and methods, laser scanners, ultrasound scanners, and/or indeed any other suitable system and method for providing 3D virtual model.

The terms "tool" and "machining tool" are taken herein interchangeably to include any tool that is adapted for material removal, and may include inter alia mechanical tools such as drills for example, laser tools such as for example laser drills or cutters, ultrasonic tools such as for example ultrasonic cutters, and so on. Preferably, the machining paths and material removal characteristics of such tools can be finely controlled, typically by computer systems or other automated means.

According to a first aspect of the invention there is provided a computer based a computer based method for updating a 3D virtual model of an intraoral cavity of a patient the method, as defined in independent claim <NUM>.

According to a second and a third aspect of the invention, there are also provided a computer program product as defined in independent claim <NUM>, and a computer system as defined in independent claim <NUM>.

In order to understand the invention and to see how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:.

A computer-based method, particularly useful for creating, manipulating and refining a virtual dental model, according to a first embodiment of the invention and designated with reference numeral <NUM> is illustrated in <FIG>.

In step <NUM> carried out by the method <NUM>, an accurate 3D representation, i.e., a first 3D virtual model of a physical structure, in this example the intraoral cavity, is obtained. This first 3D virtual model is generally designated with the numeral VM1 in the accompanying figures. As used herein, and as already discussed, the intra oral cavity can include one or more real teeth and/or one or more prosthetic teeth and/or part of one or more real teeth of one jaw or of both jaws of a patient, and/or can also include all the real teeth and/or prosthetic teeth in one or both jaws, and/or adjacent gingiva and other adjacent objects of the patient, and/or can include a physical model or other physical representation of one or more or all the real teeth, and/or one or more or all of the prosthetic teeth, and/or part of one or more or all the real teeth, of one jaw or of both jaws, and/or of adjacent gingiva and/or other adjacent objects, of the patient.

Referring also to <FIG>, the first 3D virtual model VM1 is thus representative of a physical part RM1 of the intra-oral cavity (typically of a patient, in vivo, but alternatively the first 3D virtual model VM1 may be of a physical dental model, as will become clearer below) including a tooth or teeth of interest.

The first 3D virtual model VM1, i.e. the 3D digitized data of the intraoral cavity, including the dentition and associated anatomical structures of a patient, may be provided using any suitable scanning equipment for scanning a patient's teeth, for example by scanning the intra oral cavity of the patient in vivo, or via scanning of a physical model or an impression thereof. Referring to <FIG>, this may be done for example at a dental clinic <NUM> by the dentist or another dental practitioner. The dental clinic <NUM> is typically linked to one or more dental labs <NUM>, and possibly also to a dental service center <NUM> via a communication means or network such as for example the Internet or other suitable communications medium such as an intranet, local access network, public switched telephone network, cable network, satellite communication system, and the like, indicated by the cloud at <NUM>. The dental lab <NUM> is particularly adapted for defining the finish line, as well as for other tasks such as designing prostheses, designing and manufacturing physical models of the dentition, and possibly also for manufacturing at least an external profile of the prostheses. The dental service center <NUM> is particularly adapted for manufacturing dental hardware that requires a very high degree of precision, for example inner surfaces of prostheses that are required to match external surfaces of copings, and possibly also the copings themselves.

Such scanning equipment may include any suitable scanner, for example, an optical hand-held scanner <NUM> (or any other suitable optical scanner, mechanical scanner, ultrasound scanner, radiation-based scanner, including for example x-ray scanner, or other laser scanner, or any other suitable scanner) that is used by the practitioner to acquire the 3D data for example by directly scanning the patient's oral cavity. For example, a hand held apparatus including a probe for determining three dimensional structure by confocal focusing of an array of light beams can be used, for example as manufactured under the name of CB-CAD or as disclosed in <CIT>,
and in which in at least one embodiment, the apparatus is configured for determining surface topology of a portion of a three-dimensional structure, such as the intra oral cavity for example, the apparatus comprising:.

The 3D data obtained by the scanner <NUM> may then be stored in a suitable storage medium, for example a memory in a computer workstation or system <NUM>, which includes a display <NUM>, such as for example a computer screen, operatively connected thereto. Typically, the 3D data can be sent over a suitable communication network <NUM> to the dental lab <NUM>, for further processing. Optionally, the 3D data may be sent via communication network <NUM> to the dental service center <NUM>, for the further processing.

The computer system <NUM> is configured for enabling the user to interact with images displayed in the display <NUM>, and comprises an input device <NUM> configured for enabling the user to point to displayed objects on the display, and/or to interact with the display <NUM> to at least enable deletion and/or replacement of images thereon, as will become clearer below. The input device <NUM> may comprise, for example, a wand <NUM> (for example a light sensitive wand, or light pen) and/or a mouse <NUM>, and/or the display <NUM> may incorporate the input device, being configured as a touch sensitive screen configured for at least enabling deletion and/or replacement of images thereon wherever a displayed image on the screen is touched or stroked by the user.

Optionally, color data of the intraoral cavity may also provided together with the 3D data, and thus the virtual model comprises coordinates and corresponding color information of the dental surfaces scanned. Examples of such scanners are disclosed in co-pending application entitled "METHOD AND APPARATUS FOR COLOUR IMAGING A THREE-DIMENSIONAL STRUCTURE", published under <CIT>, and which is assigned to the present Assignee.

At least one embodiment of such a scanner comprises a device configured for determining the surface topology and associated color of at least a portion of a three dimensional structure, such as the intra oral cavity for example, comprising:.

Such scanning means (a) may comprise the at least one embodiment of the apparatus disclosed in disclosed in <CIT> and for example as defined above in connection therewith.

Alternatively or additionally, the clinic <NUM> may include equipment for obtaining a negative casting of a patient's teeth. In this case, the negative cast or impression can be taken of the patient's teeth, in a manner known in the art, and this physical negative model is dispatched to one of the dental labs <NUM> that is equipped to prepare from the negative model a physical positive cast suitable for scanning. The positive cast may be scanned at the dental lab <NUM> by any method known in the art, including for example x-ray scanning, laser scanning or using the aforesaid probe manufactured under the name of CB-CAD or as disclosed in <CIT> and referred to above. The 3D data is then transmitted over the network <NUM> to the service center <NUM>. Alternatively, the positive cast may be dispatched to the service center <NUM> by the dental clinic <NUM> and scanned at the service center <NUM> to obtain the 3D data. Alternatively, the service center <NUM> produces a positive model from the negative model and is scanned thereat, or sent to the dental clinic <NUM> to be scanned thereat. Alternatively, the negative model is scanned, either at the dental lab <NUM> or at the service center <NUM>.

Alternatively, the negative model provided by the clinic <NUM> is sent to the service center <NUM>, either directly by the clinic <NUM>, or indirectly via the dental lab <NUM>, and a composite physical positive-negative model may be manufactured from the original negative model. Thereafter, the positive-negative model may be processed to obtain 3D digitized data, for example as disclosed in <CIT>, assigned to the present Assignee.

Alternatively, the 3D first virtual model VM1 may be obtained in any other suitable manner, including other suitable intra oral scanning techniques, based on optical methods, direct contact or any other means, applied directly to the patient's dentition. Alternatively, X-ray based, CT based, MRI based, or any other type of scanning of the patient or of a positive and/or negative model of the intra-oral cavity may be used. As is clear from the aforegoing, the dimensional data of the respective virtual model may be associated with a complete dentition, or of a partial dentition, for example such as a preparation only of the intra oral cavity.

Once the 3D digitized data is obtained, the virtual model VM1 is input to suitable computer system <NUM>, and the next steps <NUM> to <NUM>, are performed with the aid of computer system <NUM>. In alternative variations of this embodiment, the scanner <NUM> provides raw data to the computer system <NUM> which then generates the first virtual model VM1 therein from this raw data.

In step <NUM>, the first virtual model VM1 is displayed (and optionally magnified and/or manipulated) in display <NUM> as a first display image DI1 corresponding to the first virtual model VM1.

For example, the display <NUM> can be a 2D display such as conventional 2D display screen, and thus the images are 2D images. Alternatively, the display can be a 3D display and the images are also 3D images. Alternatively, the display can be a 2D stereoscopic display and the images are also 2D stereoscopic images.

The first virtual model VM1 can then be checked visually by the user via the image DI1 on the display <NUM>. This image DI1 can be virtually manipulated on the display <NUM> with respect to up to six degrees of freedom (i.e., translated and/or rotated with respect to one or more of three mutually orthogonal axes) by suitably manipulating the first virtual model VM1 within the computer environment of system <NUM>, using suitable user controls (hardware and/or virtual) to enable viewing the first virtual model VM1 from any desired direction on the screen <NUM> via the corresponding display image DI1 on the display <NUM>, enabling the first virtual model VM1 to be visually checked by the user.

According to this embodiment, steps <NUM> to <NUM> are implemented when part of the first virtual model VM1, desi gnated DVM1, is considered to be unsuitable or undesired, while concurrently it is desired to retain another part of the first virtual model VM1.

For example, this part DVM1 of the first virtual model VM1 may be considered by the user as not acceptable or desirable and needing to be better defined for a particular dental procedure of interest. The part DVM1 can correspond, for example, to a part of a real dental surface DRM1 of the real (physical) part RM1 of the intra-oral cavity that was not sufficiently clearly defined in the first virtual model VM1. For example, during the initial 3D data collection step, for example via scanning, that resulted in the first virtual model VM1 being generated, the corresponding part DRM1 of the physical dental surface was covered with foreign material, such as for example saliva, blood, debris, or was otherwise obscured by another element such as for example part of the gums, cheek, tongue, dental instruments, artifacts, etc. Alternatively, for example, during the initial 3D data collection step, for example via scanning, that resulted in the first virtual model VM1 being generated, the virtual part DVM1 may be distorted or otherwise defective and does not properly correspond to real part DRM1, for example due to some defect in the actual scanning process, while the real part DRM1 itself is acceptable.

In step <NUM> this part DVM1 of the first virtual model VM1 is marked on the first image of the first virtual model VM1 on the display <NUM>. By "marked" it is meant that this zone or area of the first image DI1 is at least identified by the user, and may optionally include interacting with the display <NUM> so that a visual mark is included in the image to show and demarcate this area on the image DI1 that is on the display <NUM>. For example, wand <NUM>, operatively connected to the computer system <NUM> can be used for interacting with the display <NUM>, wherein a visual mark is displayed wherever the tip <NUM> of the wand <NUM> touches the image DI1 on the display <NUM>.

In step <NUM>, and referring also to <FIG>, part DVM1 of the first virtual model VM1 is then "deleted" or otherwise removed or replaced interactively on the display <NUM> by the user, resulting in the first virtual model VM1 being modified to become a modified first virtual model VM1', by passing the tip of the wand <NUM> over the marked area of the image DI1. The deletion, removal or replacement of part DVM1 is responsive to the application of a special corresponding computer-implemented function (i.e. a corresponding deletion function, removal function or replacement function) via the computer system <NUM>. The special computer-implemented function is, for ease of reference referred to herein as the "delete" function (and includes at least one of a remove function, remove command, delete command, replace command, or replace function) of the computer system <NUM>, and operates to modify for example the first virtual model VM1 by at least one of deleting, removing or replacing a part thereof when "delete" function is activated, i.e., when the "delete" function is applied to the marked area of the image DI1.

According to this special "delete" function, the computer system <NUM> is configured for causing at least the deletion and/or removal and/or replacement of data corresponding to part DVM1 of the first virtual model VM1, when a corresponding part of the display image DI1 on the display <NUM> is correspondingly deleted or removed or replaced on the display <NUM>, which in turn is accomplished by interaction by the user, such as touching the desired parts of the image DI1 on the display <NUM> with the wand <NUM> when the "delete" function is activated.

Although in at least one embodiment the display image DI1 is a two dimensional image, each element or pixel of such a 2D display image DI1 corresponds to a unique part of the three-dimensional data of the first virtual model VM1, as viewed in a viewing direction corresponding to image DI1, and thus the computer system is configured for deleting or removing or replacing such parts of the three-dimensional data from the first virtual model VM1 when the corresponding elements or pixels in the image DI1 are "touched" on the display <NUM> and the computer system <NUM> has the special "delete" function activated.

Particularly where the first virtual model VM1 represents a three dimensional surface of the physical part RM1, it is readily understood that the deleted or removed or replaced portions of the first virtual model VM1 are also three dimensional surfaces.

The above interaction for deletion or removal with respect to image DI1 can alternatively be accomplished without recourse to touching the display <NUM>. For example, the computer system may be additionally or alternatively configured for enabling parts of the image DI1 to be deleted or removed by interaction therewith via mouse <NUM> or any other suitable input device <NUM>.

The first virtual model VM1 is thus modified by the loss of the three dimensional data corresponding to part DVM1, effectively generating a modified first 3D virtual model VM1'.

For example, the dental procedure of interest may be providing a dental prosthesis, and the deleted or removed part DVM1 may be part of the finish line <NUM> of a preparation <NUM> that exists in real dental surface DRM1, but failed to be represented at all, or to be clearly represented, in the first virtual model VM1, for example due to obfuscation thereof by foreign material, distortion of the scanned data, etc, as discussed above, for example.

The dental surface DRM1 is thus considered the "first physical portion" of step <NUM>.

In step <NUM>, and referring also to <FIG>, a second virtual model VM2 is created, representing a second part RM2 of the physical dental structure. The second virtual model VM2 comprises a virtual part DVM2 that represents the part DRM1 of the physical dental surface, plus additional identifying surface data ID that represents a part P2 of the real dental surface in proximity to part DRM1, and thus second part RM2 at least partially overlaps with the physical part RM1. Before doing so, the part DRM1 of the physical dental surface is cleaned up and/or unobstructed, and for example rescanned to obtain second virtual model VM2. The scanning procedure thus also includes scanning the additional part P2 the real dental surface surrounding the part DRM1 to obtain additional identifying 3D surface data ID.

It is to be noted that in a variation of step <NUM>, for example the virtual part DVM1 may be distorted or otherwise defective and does not properly correspond to real part DRM1, for example due to some defect in the actual scanning process thereof, while the real part DRM1 itself is acceptable. In such a case, second virtual model VM2 is created, representing a second part RM2 of the physical dental structure, and likewise the second virtual model VM2 comprises a virtual part DVM2 that represents the same part DRM1 of the physical dental surface, plus additional identifying surface data ID that represents a part P2 of the real dental surface in proximity to part DRM1, and thus second part RM2 at least partially overlaps with the physical part RM1. While scanning to provide the second virtual model VM2, it is now ensured that second virtual model VM2 is free from distortions or imperfections that originate from the scanning procedure itself.

In step <NUM>, and referring also to <FIG>, the second 3D virtual model VM2 is spatially registered with respect to the modified first 3D virtual model VM1' to provide a composite third 3D virtual model VM3, wherein the part DVM1 that was previously deleted/removed is at least partially replaced with a corresponding part the second 3D virtual model VM2. In particular, the second virtual model VM2 is manipulated in the computer system <NUM> to register the second virtual model VM2 onto the modified first virtual model VM1'. In this connection, the identifying surface data ID of second virtual model VM2 may be useful as it may be aligned with corresponding parts of the modified first virtual model VM1', since the surface data for part P2 of the real physical dental surface should be nominally identical in both scans. In this aligned position, part DVM2 of the second virtual model VM2 fits in and corresponds to at least a portion of the deleted portion DVM1, and part DVM2 is then stitched to modified first virtual model VM1' in a virtual manner to create a further modified first virtual model, i.e., composite third 3D virtual model VM3. The remainder of the second virtual model VM2, including the identifying surface data ID may then be discarded.

Alternatively, it may not be necessary that second part RM2 at least partially overlaps with the physical part RM1, and instead the 3D data defining each respective virtual model can be referred to the same global coordinate system in a different manner, for example via an optical marker whose 3D coordinates are known with respect to a global coordinate system, and which is scanned together with each one of second part RM2 and physical part RM1.

Thus, the composite third 3D virtual model VM3 replaces the undesired part DVM1 of the original virtual model VM1 with new 3D data provided by part DVM2.

It is readily evident that by carrying out steps <NUM> to <NUM>, the user only needs to "correct" or modify parts of the original virtual model VM1 of the dental surface i.e. of physical part RM1, and does not need to obtain a new virtual model of the whole of physical part RM1 from scratch, should even a small part of the virtual model VM1 not be acceptable.

In alternative variations of this embodiment, steps <NUM> to <NUM> may be implemented in a different manner. For example, and referring to <FIG>, steps <NUM> to <NUM> may be replaced with steps <NUM>' to <NUM>' of modified method <NUM>', which can include steps <NUM>', <NUM>' and <NUM>' which are respectively identical to steps <NUM>, <NUM>, <NUM> of method <NUM> as disclosed herein, mutatis mutandis.

Step <NUM>' comprises all the elements and features of step <NUM> as disclosed herein, mutatis mutandis, with the main difference that step <NUM>' is implemented immediately following step <NUM>'. In other words, and having carried out steps <NUM>' and <NUM>', the second virtual model VM2 is created, representing a second part RM2 of the physical dental structure. Again, the second virtual model VM2 comprises a virtual part DVM2 that represents the part DRM1 of the physical dental surface, plus additional identifying surface data ID that represents a part P2 of the real dental surface in proximity to part DRM1, and thus second part RM2 at least partially overlaps with the physical part RM1. Before doing so, the part DRM1 of the physical dental surface is cleaned up and/or unobstructed, and for example rescanned to obtain second virtual model VM2. The scanning procedure thus also includes scanning the additional part P2 the real dental surface surrounding the part DRM1 to obtain additional identifying 3D surface data ID.

Then, in step <NUM>', second virtual model VM2 is virtually registered with the first virtual model VM1. In particular, the second virtual model VM2 is manipulated in the computer system <NUM> to register the second virtual model VM2 onto the first virtual model VM1. In this connection, the identifying surface data ID of second virtual model VM2 may be useful as it may be aligned with corresponding parts of the first virtual model VM1, since the surface data for part P2 of the real physical dental surface should be nominally identical in both scans. In this aligned position, part DVM2 of the second virtual model VM2, corresponds to, in particular spatially corresponds to, and is different from, in particular is topographically different from, at least a portion of the portion DVM1 of the first virtual model VM1 (as is the case also in steps <NUM> to <NUM> of method <NUM>, mutatis mutandis). At this point, portion DVM1 has not yet been deleted, removed or identified.

In step <NUM>', the second virtual model VM2 is also displayed (and optionally magnified and/or manipulated) in display <NUM> as a second display image DI2 corresponding to the second virtual model VM2, wherein display image DI2 is similar to first display image DI1 as disclosed herein, mutatis mutandis, but corresponds to the second virtual model VM2 rather than the first virtual model VM1. For example when using a 2D display, the second display image DI2 is also a two-dimensional image, but in 3D displays the second display image DI2 can be a 3D image as well, or in 2D stereoscopic displays the second display image DI2 can be a 2D stereoscopic image as well for example.

Both the second virtual model VM2 and the first virtual model VM1 are viewable on the display <NUM> via their respective images DI2 and DI1, either together in registry, or may be selectively viewed separately, in different display windows on the same display <NUM>, for example, or alternately on the same display, or in different displays, and so on. To facilitate viewing the images in 3D registry, the images DI2 and DI1 may be visually encoded, each in a different manner. For example, the images DI2 and DI1 may be encoded each in a different color or shade of gray. Alternatively, at least parts of the images DI2 and DI1 which do not exactly correspond to one another may be color encoded in this manner to highlight the corresponding topographical differences between the real first part RM1 and the real second part RM2 of the physical dental structure.

In step <NUM>', part DVM1 of the first virtual model VM1 is marked by the user on the first image of the first virtual model VM1 on the display <NUM>, this part DVM1 having first been visually identified by the user from the images DI1 and DI2 displayed in step <NUM>'. Thus, step <NUM>' is similar to step <NUM> as disclosed herein, mutatis mutandis, and thus by "marked" it is meant that the user may optionally interact with this area of the first image DI1 in the display <NUM> so that a visual mark is included in the image to show and demarcate this area on the image DI1 that is on the display <NUM>. For example, wand <NUM>, operatively connected to the computer system <NUM> can be used for interacting with the display <NUM>, wherein a visual mark is displayed wherever the tip <NUM> of the wand <NUM> touches the image DI1 on the display <NUM>.

Step <NUM>' is similar to step <NUM> as disclosed herein, mutatis mutandis, and thus part DVM1 of the first virtual model VM1 is then "deleted" or otherwise removed or replaced interactively on the display <NUM> by the user, resulting in the first virtual model VM1 being modified to become a modified first virtual model VM1', for example by passing the tip of the wand <NUM> over the marked area of the image DI1, when a special "delete" function (also referred to interchangeably herein as a remove function, remove command, or deleted command, or replace function, or replace command) of the computer system <NUM> is activated, i.e., when a corresponding function (delete function or remove function or replace function) is applied to the marked area of the image DI1. Step <NUM>' in addition comprises part of step <NUM> as disclosed herein, mutatis mutandis, and, with the second 3D virtual model VM2 already registered with respect to the modified first 3D virtual model VM1 (step <NUM>'), the part DVM1 that was previously deleted/removed is at least partially replaced with a corresponding part of the second 3D virtual model VM2. Alternatively, this function operates as a unified replacement function in which DVM1 is replaced in one operation with part DVM2.

In the aligned position of the registered modified first virtual model VM1' with second virtual model VM2, part DVM2 of the second virtual model VM2 virtually fits in and corresponds to at least a portion of the deleted portion DVM1, and part DVM2 is then stitched to modified first virtual model VM1' in a virtual manner to create a further modified first virtual model, i.e., composite third 3D virtual model VM3. The remainder of the second virtual model VM2, including the identifying surface data ID may then be discarded.

Thus, in step <NUM>', a composite third 3D virtual model VM3 (comprising modified first virtual model VM1' part DVM2) effectively replaces the undesired part DVM1 of the original virtual model VM1 with new 3D data provided by part DVM2.

It is to be noted that at least in some alternative variations of the method <NUM>', step <NUM>' and/or step <NUM>' can be omitted. For example, the user can scan the first physical part of the structure in step <NUM>' and then without displaying the respective first 3D virtual model, proceed with scanning the second part of the physical structure in step <NUM>' to provide the second 3D virtual model, also without displaying the respective second 3D virtual model. Thus, so long as the first 3D virtual model and the second 3D virtual model can be spatially registered (and thus the first physical part corresponds to (in particular spatially corresponds to) but may be different from (in particular topographically different from) the second physical part), step <NUM>' can be implemented automatically and the first 3D virtual model replaces parts thereof with the second 3D virtual model, without the need to have these parts or the first 3D virtual model or the second 3D virtual model displayed, identified or marked. Such a situation may arise, for example, where the user suspects or knows (for example during or after scanning to provide the first 3D virtual model) that some portions of the scanned first part of the physical structure were for example obscured, ill-defined, badly scanned, and so on and need to be rescanned. The user can then go back to these portions of the physical structure and rescan those portions to provide the second 3D virtual model which then automatically replaces corresponding parts of the first 3D virtual model.

In a similar manner, mutatis mutandis, in at least in some alternative variations of the method <NUM>, step <NUM> can be omitted, and steps <NUM> and <NUM> can be modified so that the interaction with the display is omitted, and the first 3D virtual model replaces parts thereof with the second 3D virtual model automatically via registration therewith, rather than implementing a delete function first, and a stitching function later.

Referring to <FIG>, a second embodiment of the invention has all the elements, features and steps of the first embodiment including steps <NUM> to <NUM> or alternative variations thereof, for example steps <NUM>' to <NUM>', mutatis mutandis, the main difference being that in the second embodiment the physical part RM1 of the intra-oral cavity includes a removable physical artifact which may be temporarily obscuring part of the dental surfaces.

For example, the artifact may be a scanning body or impression abutment <NUM> (or any other structure) that is mounted onto a dental implant and projects into the intra oral cavity so that the spatial orientation and/or other characteristics of the implant <NUM> (which is already anchored in the jaw <NUM> and thus cannot be seen) with respect to the dental surfaces may be derived from the position/orientation of the artifact <NUM>.

The first virtual model VM1 for this embodiment thus also includes a virtual representation of the artifact <NUM>, as well as all the other dental areas of interest of the physical part RM1, but the presence of the artifact <NUM> may render it difficult or impossible to obtain at the same time a full scan of the physical part RM1, as the artifact <NUM> may be too close in parts to the dental surfaces (e.g. adjacent teeth <NUM>, <NUM>) and thus obscures or blocks the ability of a scanner to scan such areas.

In this embodiment, and in applying method <NUM> to this embodiment, in steps <NUM> and <NUM>, each part of the virtual model corresponding to an obscured area (and possibly also corresponding to the artifact <NUM>) is deleted interactively in a similar manner that disclosed above for the first embodiment, mutatis mutandis, to provide the corresponding modified first virtual model VM1'.

Then, and prior to step <NUM>, the artifact <NUM>, which is considered the "first physical portion" in step <NUM>, is physically removed from the intraoral cavity and an area of the physical part RM1 including the previously obscured areas that were not fully defined previously in the first virtual model VM1 is scanned, in the absence of the artifact, enabling full definition of this area to be achieved in the corresponding second virtual model VM2 thereby generated.

Thereafter, in step <NUM>, second virtual model VM2 is registered with the modified first virtual model VM1', in a manner similar to that disclosed above for the first embodiment, mutatis mutandis, to provide the corresponding the corresponding composite third virtual model VM3.

If necessary or desired, the artifact <NUM> itself (or part thereof) may also be scanned separately to obtain a virtual model thereof. This may be used to further modify the composite third virtual model, if for example part of the artifact was deleted in step <NUM>.

Method <NUM>' may be applied in a corresponding manner to the second embodiment, mutatis mutandis.

It is readily evident that by carrying out this embodiment of the invention, it allows obtaining a virtual model of the intra oral cavity including such an artifact, wherein even the parts of the dental surfaces obscured by the artifact can be fully defined with respect thereto, even when originally obscured by the artifact.

Referring to <FIG>, a third embodiment of the invention has all the elements, features and steps of the first embodiment including steps <NUM> to <NUM> or alternative variations thereof, for example steps <NUM>' to <NUM>', mutatis mutandis, the main difference being that the physical part RM1 in the third embodiment is considered to be well defined in the first virtual model VM1, i.e., faithfully represents the surfaces of interest of the physical part RM1; however, a first physical portion of the physical part RM1 is not considered suitable for a dental procedure.

For example, the physical part RM1 may be a dental preparation <NUM> for a dental prosthesis (e.g. a crown), and analysis of the first dental model with respect to a virtual model of the opposing dentition of the opposite jaw reveals that the form of the preparation would result in an inadequate structure for the prosthesis. For example, the dental preparation is too long and/or too thick, and would result in the thickness of the crown at the cusp being too thin, and thus mechanically weak.

In this connection, the distances between the preparation <NUM> and the opposed dental surfaces may be determined, for example, in a manner as disclosed in <CIT>, which in turn can provide a measure of the corresponding thickness of the respective dental prosthesis. In at least one embodiment disclosed in <CIT>, there is provided a method for obtaining a dental occlusion map of a three-dimensional virtual computer model of teeth of upper and lower jaws of a mouth, said occlusion map indicative of distances between opposite regions on facing surfaces of opposite teeth of the upper and lower jaws of the mouth, said method comprising the steps of:.

The part of the first 3D virtual model that corresponds to the unsuitable portion of the dental preparation <NUM> is then deleted or removed or replaced in steps <NUM> and <NUM> in applying method <NUM> to this embodiment, in a manner similar to that disclosed above for the first embodiment, mutatis mutandis.

The real dental preparation <NUM> is also physically modified by the dental practitioner in the areas found to be unsuitable for the prosthesis, for example via a material removal operation such as by using dental drills or dental lasers, for example, to provide a modified physical preparation <NUM>'.

Thereafter, in step <NUM>, a second virtual model VM2 corresponding to the modified preparation <NUM>' is obtained, for example by scanning the newly worked area of the modified preparation <NUM>', but also including additional part <NUM> of the preparation that was not altered in the material removal; process.

In step <NUM>, second virtual model VM2 is registered with the modified first virtual model VM1', in a manner similar to that disclosed above for the first embodiment, mutatis mutandis, to provide the corresponding the corresponding composite third virtual model VM3.

A new cycle of checking and modifying the preparation can be initiated if desired or necessary, wherein the third virtual model previously generated can be considered to be a "first virtual model" for the new cycle, and checked as in step <NUM>, mutatis mutandis, and if necessary, steps <NUM> to <NUM> repeated as often as required, each time providing a new third virtual model than can be considered, if desired as a new first virtual model, until the newly modified third virtual model has a geometry for the dental preparation (corresponding to the geometry of the real dental preparation) that is adequate for receiving a prosthesis, according to criteria.

It is also readily evident that rather than modifying the whole preparation, only part of the preparation, for example a part of the finish line, can be modified instead, and the method applied to this part only, saving considerable time by not having to scan the remainder of the preparation (that is considered acceptable) or surrounding areas, i.e., the whole physical part RM1 again each time.

Method <NUM>' may be applied in a corresponding manner to the third embodiment, mutatis mutandis.

It is also readily evident that by carrying out this embodiment of the invention, it allows the dental practitioner to modify a dental structure such as dental preparation in a quick and easy manner with a minimum of scanning after the initial virtual scan. i.e., without the need to rescan the whole physical part RM1 again each time.

It also readily evident that parts or all of the method steps according to each of the first, second and third embodiments and/or alternative variations thereof may be applied to one or more of the other embodiments as well.

It is also readily evident that the method (and corresponding system) according to each of the first, second and third embodiments and/or alternative variations thereof may further comprise a manufacturing step, in which a dental object may be manufactured based on the respective composite third 3D virtual model VM3 under computer aided manufacture (CAM). Such a dental object may be manufactured, for example, based on a material removal operation that is performed by a computer aided removal operation machine having a suitable machining tool, using any suitable CAM (Computer Aided Manufacturing) technology, typically a CNC milling machine, on a blank of material. This material is typically plaster or any other type of material commonly used for dental models, however any other suitable material may be used. Alternatively, other CAM-based techniques may be used, for example rapid prototyping or any other suitable 3D printing technique, for creating the dental object. Accordingly, a dental object corresponding to composite third 3D virtual model VM3 or associated with the composite third 3D virtual model VM3 can be manufactured.

For example, the dental object may comprise a physical model of the intraoral cavity, and thus composite third 3D virtual model VM3 can be used directly to provide the necessary data for the CAM process.

In another example, and where the composite third 3D virtual model VM3 is based on one or more teeth requiring a prosthesis, and thus comprise a suitable preparation. A dental object in the form of the respective prosthesis may be prepared based on information from the composite third 3D virtual model VM3. The dentist or a technician may generate a 3D virtual prosthesis model of a crown to be fitted on a tooth stump (or of a bridge to be fitted on the tooth surface, or of any other prosthesis to be fitted to the tooth/teeth including any restoration and/or any onlays, and/or any inlays, such as caps, for example, or veneering, or any other artificial partial or complete denture), to generate a digital file. Alternatively, the outer surface of the prosthesis may be designed manually if desired. The prosthesis may then be manufactured using any suitable CAM techniques, for example as disclosed above, mutatis mutandis, and in a further step, the prosthesis may be installed in the oral cavity of the patient. Optionally, the virtual prosthesis model may also include a virtual model of a coping plus a virtual model of a cap that is to be mounted onto the coping. The coping may be manufactured using any suitable method, for example as disclosed in <CIT>, also assigned to the present Assignee.

The cap or full prosthesis may be manufactured using any suitable method, for example as disclosed in <CIT> or in <CIT>, also assigned to the present Assignee.

In another example, and where the composite third 3D virtual model VM3 is based on one or more teeth requiring an orthodontic treatment, a set of aligners may be manufactured based on the composite third 3D virtual model VM3. For example, the teeth shown in the 3D virtual model, which normally would be of a patient's teeth in their initial positions, can be segmented (i.e. digitally cut into separate objects). The resultant digital data can then be used for orthodontic treatment planning. The individual teeth can be moved by a computer program and/or by an operator into a desired final setup. Then a number of digital intermediate tooth arrangements can be generated. These digital intermediate and final tooth arrangements of the treatment plan can be used to fabricate positive molds of intermediate arrangements (such as by using rapid prototyping equipment or milling machines) which are used to form aligners for moving teeth or they can be used to directly form aligners.

Alternatively, where the composite third 3D virtual model VM3 is based on one or more teeth requiring an orthodontic treatment, dental objects in the form of a set of orthodontic appliances, for example brackets, may be virtually designed and/or manufactured (for example using suitable CAM-based techniques) based on the composite third 3D virtual model VM3.

Furthermore, where the composite third 3D virtual model VM3 is based on one or more teeth requiring an orthodontic treatment, such an orthodontic treatment may be designed using a computer system based on third 3D virtual model VM3. For example such an orthodontic treatment may be provided by implementing a method for virtual orthodontic treatment, for example as disclosed in <CIT>, also assigned to the present Assignee, and at least one embodiment of such a method for virtual orthodontic treatment comprises:.

It is also readily evident that the method (and corresponding system) according to at least one embodiment of the present invention may be applied to obtaining a 3D virtual model of any physical structure, including non-dental structures, and in which it may be desired or necessary to re-scan a part of the structure, without the need to rescan the whole structure again to obtain an updated 3D virtual model of the physical structure. Such method (and corresponding system) may optionally be further used for manufacturing a physical object based on or associated with the updated 3D virtual model of the physical structure.

For example, the method (and corresponding system) according to at least one embodiment of the invention may be applied to scanning a complex circuit board comprising a plurality of chips mounted thereon, replacing one such ship and scanning the new chip in situ, and modifying the original 3D virtual model to replace the part thereof corresponding to the old chip with the 3D data corresponding to the new chip.

In another example, the method (and corresponding system) according to at least one embodiment of the invention may be applied to scanning a complex geometrical physical structure comprising a plurality of geometrical entities mounted or formed thereon, adding or removing a geometrical physical entity with respect to the structure, and scanning the modified physical structure in the area that includes the new geometrical entity or that includes the modification of the physical structure arising from the removal of the geometrical entity, respectively, and modifying the original 3D virtual model to replace a corresponding part thereof with the 3D data corresponding to the aforesaid scanned area.

In the method claims that follow, alphanumeric characters and Roman numerals used to designate claim steps are provided for convenience only and do not imply any particular order of performing the steps.

Finally, it should be noted that the word "comprising" as used throughout the appended claims is to be interpreted to mean "including but not limited to".

Claim 1:
A computer based method for updating a 3D virtual model of an intraoral cavity of a patient, the method comprising:
obtaining (<NUM>) first 3D scan data of the intraoral cavity including the dentition and associated anatomical structures of a patient, said first 3D scan data having been acquired by a hand-held intraoral scanner;
displaying (<NUM>) an image of a first virtual model on a display operatively connected to a computer system to enable a user to interact with the displayed image, wherein the first virtual model is based on said first 3D scan data of the intraoral cavity;
identifying (<NUM>), based on the user's interaction with the displayed image, a part of the first virtual model which it is desired to retain; and the method being characterised by
updating (<NUM>, <NUM>, <NUM>) another part of the first 3D virtual model by modifying the 3D virtual model with second 3D scan data obtained from a corresponding physical part of the intraoral cavity while concurrently retaining the part of the first virtual model which it is desired to retain thereby providing an updated 3D virtual model of the intraoral cavity.