Source: https://patents.google.com/patent/CN101686853B/en
Timestamp: 2020-05-28 13:24:48
Document Index: 727197273

Matched Legal Cases: ['Application No.60', 'application No.11', 'application No.11', 'arts 604', 'art 604', 'art 604']

CN101686853B - Video-assisted margin marking for dental models - Google Patents
Video-assisted margin marking for dental models Download PDF
CN101686853B
CN101686853B CN2008800225972A CN200880022597A CN101686853B CN 101686853 B CN101686853 B CN 101686853B CN 2008800225972 A CN2008800225972 A CN 2008800225972A CN 200880022597 A CN200880022597 A CN 200880022597A CN 101686853 B CN101686853 B CN 101686853B
CN2008800225972A
CN101686853A (en
罗伯特·N·那扎尔
爱德华·K·塔克安
伊利亚·A·克里夫斯阔
埃里克·B·帕里
2007-06-29 Priority to US94701207P priority Critical
2007-06-29 Priority to US60/947,012 priority
2008-06-27 Application filed by 3M创新有限公司 filed Critical 3M创新有限公司
2008-06-27 Priority to PCT/US2008/068584 priority patent/WO2009006303A2/en
2010-03-31 Publication of CN101686853A publication Critical patent/CN101686853A/en
2013-05-08 Publication of CN101686853B publication Critical patent/CN101686853B/en
238000003786 synthesis Methods 0 claims description 56
238000002372 labelling Methods 0 claims description 39
238000005516 engineering processes Methods 0 description 68
The video-assisted margin marking that is used for dental models
The application requires in the priority of the U.S. Provisional Patent Application No.60/947012 of submission on June 29th, 2007.
The present invention relates to stomatology, more particularly, relate to the tools and techniques for marker edge on the three-dimensional digital model of denture.
2. the explanation of association area
The latest developments of dentistry have made the digital dental impression that captures pin-point accuracy become possibility.Existing scanning technique conceptually provides enough resolution, with directly for the preparation of multiple dental prosthetic part (such as bridge, corona, etc.) and the physical model of dental appliance, dental prosthesis etc.Yet aspect acquisition important area (for example edge of the tooth surface of preparation) three-dimensional data accurately on every side, there are many physical barriers in a mouthful interscan.This comprise periodontal tissue wall flexible of preparation and can gather and the blood at fuzzy a part of edge, saliva, etc.In this case, only according to the threedimensional model of gained, can not identify easily or differentiate the fuzzy part in the gained 3-D scanning.
Need improved technology to process digital dental models.For example, need improved edge labelling instrument to come auxiliary figure to prepare the dental prosthetic part.
Replenish the view of threedimensional model by the rest image with the object of modeling, improved the digital preparation technology who is used for the dental prosthetic part.The video data that gathers during model scanning provides the source of rest image, this rest image can show along the threedimensional model of drawing, and can two views (model and rest image) are synchronous, thereby obtain the common perspective view of simulated target thing.The method provides available visual information, to be used for eliminating the ambiguity of surface character during the treatment step at for example labelling edge of the dental surface of preparation used for repair member.Can similarly strengthen the Interactive Modeling instrument.For example, the instrument that is used for edge labelling can make the demonstration of the edge line between rest image and model synchronize, thus the user can with visual representation in any one or interaction between them.
In one aspect, graphical user interface disclosed herein comprises: Video Controller, and it receives the user with a selection as the work sheet picture in a plurality of video images; The working region, it shows the work sheet picture, and receives the user to the manipulation of one or more points, these one or more points are used for marker edge on denture; And 3-D view, its three-dimensional perspective that shows the mathematical model of denture is drawn.
Video Controller can comprise window slide, and window slide shows a plurality of thumbnail images of denture and receives the user to the selection of in a plurality of thumbnail images.Window slide can show each the three-dimensional view in a plurality of thumbnail images.Can select a plurality of thumbnail images according to dependency.Each in a plurality of thumbnail images can comprise the orientation identification to one in a plurality of thumbnail images.Video Controller can comprise the video time axis controller.The video time axis controller can show the thumbnail of current video image.Video Controller can comprise the two-dimensional array of thumbnail image.The working region can show the three-dimensional view of work sheet picture.Graphical user interface can comprise the cursor of the volume rendering in three-dimensional view.Can select the degree of depth of the cursor in three-dimensional view, make cursor be retained on the three-dimensional surface of working region.Graphical user interface can comprise for the one or more instrument that user comment is provided to work sheet picture and mathematical model.The working region can comprise the note of the orientation of identification work sheet picture.Graphical user interface can comprise customer controller, and it is used for choice decision, and selects responsively and show basically from orientation to provide a plurality of video images of view one as the work sheet picture.The work sheet picture that the figure image intensifying can be applied to show in the working region.The figure image intensifying can comprise that the local auto-adaptive contrast strengthens and the self adaptation block diagram equilibrium of contrast-limited in one or more.
3-D view can the display digit model three-dimensional view.3-D view can also be included in the cursor of the volume rendering in digital view.Graphical user interface can also comprise cutaway view, and it shows the section of denture and comprises of nearest selection in one or more points.Can corresponding to the each time manipulation of user to the one or more points in the working region, show the three-dimensional point of one or more correspondences in 3-D view.3-D view can be suitable for receiving the user to the manipulation of one or more points, and in order its response to be upgraded in the working region one or more points of marker edge on denture.User's manipulation can comprise one or more in interpolation point, selected element, cancellation selected element, deletion point and transfer point.Graphical user interface can also comprise customer controller, and it is used for handling the viewpoint of mathematical model, wherein selects new work sheet to look like to come the viewpoint of corresponding mathematical model more closely.By by the combination of one or more available video images and mathematical model with the generating virtual video image, user interface can be in response to the selection of the denture perspective view that does not manifest in any one in a plurality of video images.Graphical user interface can also comprise wherein adjusts the viewpoint of mathematical model be used to the customer controller of selecting new work sheet picture, so that its viewpoint of corresponding new work sheet picture more closely.Mathematical model can be the model of texture mapping.Can strengthen the work sheet picture by the one or more overlapping video image in a plurality of video images, thereby the image that has higher pixel resolution than each video image in a plurality of video images is provided.
On the other hand, method disclosed herein comprises: the rest image that shows the video that derives from object in first window; The 2 d fluoroscopy of the threedimensional model of display-object thing is drawn in Second Window; And customer controller is provided, with the lip-deep point of the object in any window that is used for manipulation first window or Second Window, wherein, draw corresponding point in another window in first window and Second Window.
Method can comprise that reception is with a selection as rest image in a plurality of video images.Receive and select to comprise that the reception user is from the input of video time axis controller.Receive and select to comprise that the reception user is to the selection of in a plurality of video thumbnails.Reception derives from the selection of a new video in a plurality of videos of new perspective view of object, and shows threedimensional model from new perspective view.Method can comprise provides customer controller, with the perspective view for the object of handling Second Window; From the selection of customer controller reception to new perspective view; Select more closely new rest image corresponding to new perspective view from the video of object; And show new perspective view in first window.The customer controller that is used for handling lip-deep point can comprise for one or more the controller that adds point, deletion point, selected element, cancellation selected element and transfer point.Lip-deep point can be the point on the continuous lines that is formed by lip-deep a plurality of points.Continuous lines can form closed loop.
A kind of system disclosed herein comprises: first window, and it is suitable for showing the rest image of the video that derives from object; Second Window, its 2 d fluoroscopy that is suitable for the threedimensional model of display-object thing is drawn; And customer controller, to handle the lip-deep point of the object in any window in first window or Second Window, wherein draw corresponding point in another window in first window and Second Window.
System can comprise for the controller that receives the selection of the rest image that derives from a plurality of video images.Controller can comprise the video time axis controller.Controller can comprise a plurality of video thumbnails.Can from the perspective view of the rest image selected, by show threedimensional model Second Window, system responses be selected.System can comprise customer controller, it is used for reception to the selection of the new perspective view of the object of Second Window, new rest image corresponding to new perspective view is selected more closely from the video of object in system responsiveness ground, and shows new rest image in first window.Customer controller can comprise for one or more the controller that adds point, deletion point, selected element, cancellation selected element and transfer point.Lip-deep point can be the point on the continuous lines that is formed by lip-deep a plurality of points.Continuous lines can form closed loop.
On the other hand, a kind of system disclosed herein comprises: the first display device, and it is used for showing at first window the rest image of the video that derives from object; The second display device, it is used for drawing at the 2 d fluoroscopy of the threedimensional model of Second Window display-object thing; And customer controller, it wherein draws corresponding point in another window in first window and Second Window for the lip-deep point of the object in any window of handling first window or Second Window.
System can also comprise receiving system, and it is used for receiving a selection as rest image with a plurality of video images.Receive and select to comprise that the reception user is from the input of video time axis controller.Receive and select to comprise that the reception user is to the selection of in a plurality of video thumbnails.Show threedimensional model by the perspective view from the rest image selected the second display device, receiving system can respond selection.System can also comprise second control device, and it is used for: receive the selection of the new perspective view of the second display device; Select more closely new rest image corresponding to new perspective view from the video of object; And show new rest image in the first display device.User control can comprise for one or more the controller that adds point, deletion point, selected element, cancellation selected element and transfer point.Lip-deep point can be the point on the continuous lines that is formed by lip-deep a plurality of points.Continuous lines can form closed loop.
On the other hand, the computer program that embodies on computer-readable medium disclosed herein comprises computer-executable code, when computer-executable code is carried out, carry out following steps on one or more accountants: the rest image that shows the video that derives from object in first window; The 2 d fluoroscopy of the threedimensional model of display-object thing is drawn in Second Window; And customer controller is provided, customer controller is wherein drawn corresponding point in another window in first window and Second Window for the lip-deep point of the object in any window of handling first window or Second Window.
Computer-executable code can comprise the code of carrying out following steps: receive a selection as rest image in a plurality of video images.Receive and select to comprise that the reception user is from the input of video time axis controller.Receive and select to comprise that the reception user is to the selection of in a plurality of video thumbnails.Computer-executable code can comprise the code of carrying out following steps: receive the selection of a new video in a plurality of videos of the new perspective view derive from object, and show threedimensional model from new perspective view.Computer-executable code can comprise the code of carrying out following steps: customer controller is provided, and customer controller is used for the perspective view of the object of manipulation Second Window; From the selection of customer controller reception to new perspective view; Select more closely new rest image corresponding to new perspective view from the video of object; And show new rest image in first window.The customer controller that is used for handling lip-deep point can comprise for one or more the controller that adds point, deletion point, selected element, cancellation selected element and transfer point.Lip-deep point can be the point on the continuous lines that is formed by lip-deep a plurality of points.Continuous lines forms closed loop.
On the other hand, method disclosed herein comprises: the rest image that shows the video that derives from dental surface in first window; The 2 d fluoroscopy that shows the threedimensional model of dental surface in Second Window is drawn; And customer controller is provided, customer controller is used for generating the lip-deep edge line of any window Tooth of first window or Second Window, wherein draws corresponding edge line in another window in first window and Second Window.
The customer controller that is used for the generation edge line can connect the point of a plurality of users' selections to form the full curve section.Method can comprise that the initial edge line is automatically generated by the dentist being prepared before dental surface and the threedimensional model of afterwards dental surface compares.Method can comprise by relatively coming to determine the initial edge line with carrying out Boolean (Boolean logic) with preparation tooth volume afterwards before the preparation of dental surface.Method can comprise the manual adjustment that receives the initial edge line.
The computer program that embodies on computer-readable medium disclosed herein comprises computer-executable code, when computer-executable code is carried out, carry out following steps on one or more accountants: the rest image that shows the video that derives from dental surface in first window; The 2 d fluoroscopy that shows the threedimensional model of dental surface in Second Window is drawn; And customer controller is provided, customer controller is used for generating the lip-deep edge line of any window Tooth of first window or Second Window, wherein draws corresponding edge line in another window in first window and Second Window.
The customer controller that is used for the generation edge line can connect the point of a plurality of users' selections to form the full curve section.Computer program can comprise the code of carrying out following steps: by the dentist being prepared before dental surface and the threedimensional model of afterwards dental surface compares, the initial edge line is automatically generated.Computer program can comprise the code of carrying out following steps: by determining the initial edge line with carrying out Boolean comparison with preparation tooth volume afterwards before the preparation of dental surface.Computer program can comprise the code of carrying out following steps: receive the manual adjustment to the initial edge line.
A kind of system disclosed herein comprises: first window, and it is suitable for showing the rest image of the video that derives from dental surface; Second Window, its 2 d fluoroscopy that is suitable for showing the threedimensional model of dental surface is drawn; And customer controller, it is used for generating the lip-deep edge line of any window Tooth of first window or Second Window, wherein draws corresponding edge line in another window in first window and Second Window.
The customer controller that is used for the generation edge line can connect the point of a plurality of users' selections to form the full curve section.Can be by the dentist being prepared before dental surface and the threedimensional model of afterwards dental surface compares, the initial edge line is automatically generated.Can be by determining the initial edge line with carrying out Boolean comparison with preparation tooth volume afterwards before the preparation of dental surface.Customer controller can be accepted the manual adjustment to the initial edge line.
On the other hand, a kind of system disclosed herein comprises: the first display device, and it is used for showing at first window the rest image of the video that derives from dental surface; The second display device, it is used for showing at Second Window the 2 d fluoroscopy drafting of the threedimensional model of dental surface; And user control, user control is used for generating the lip-deep edge line of any window Tooth of first window or Second Window, wherein draws corresponding edge line in another window in first window and Second Window.
User control can connect the point of a plurality of users' selections to form the full curve section.System can comprise generating apparatus, and generating apparatus is by preparing the dentist before dental surface and the threedimensional model of afterwards dental surface compares and automatically generates the initial edge line.Can be by determining the initial edge line with carrying out Boolean comparison with preparation tooth volume afterwards before the preparation of dental surface.System can comprise receiving system, and it is used for receiving the manual adjustment to the initial edge line.
On the other hand, method disclosed herein comprises: select digital dental models from workflow queue; Use the one or more moulds in the first digital dental models of instrument cutting in graphical user interface; Be appointed as with one in mould the tooth that operates; Use the second instrument marker edge on the tooth that operates in graphical user interface, thereby the digital teeth that is cut, is labeled model is provided; And the digital dental models that will be cut, be labeled is transferred to remote data base.
Method can be included in before the digital dental models that will be cut, be labeled is transferred to remote data base, forms groove on the tooth that operates.Method can be included in after the digital dental models that will be cut, be labeled is transferred to remote data base, forms groove on the tooth that operates.Method can comprise the based on network interface accessing workflow queue by safety.The numeral dental models can be included in the repair member preparation before and the model of the dental surface after preparation.Marker edge can comprise according to before repair member preparation and the dental surface after preparation relatively come to determine initial edge.Relatively can comprise and to carry out Boolean comparison with the Alignment model for preparing dental surface afterwards before the repair member preparation.The edge can be transferred to remote data base, the edge line that limits in the coordinate system as digital dental models.Cut one or more cutting planes that one or more moulds can comprise that restriction is relevant to digital dental models.Cut one or more moulds and can comprise digital dental models is divided into a plurality of models, it comprises at least one model for each of one or more moulds.
On the other hand, computer program disclosed herein is included in the computer-executable code that embodies in computer-readable medium, when computer-executable code is carried out, carry out following steps on one or more accountants: select digital dental models from workflow queue; Use the one or more moulds in the first digital dental models of instrument cutting in graphical user interface; Be appointed as with one in mould the tooth that operates; Use the second instrument marker edge on the tooth that operates in graphical user interface, thereby the digital teeth that is cut, is labeled model is provided; And the digital dental models that will be cut, be labeled is transferred to remote data base.
Computer program can comprise the computer-executable code of carrying out following steps: before the digital dental models that will be cut, be labeled is transferred to remote data base, form groove on the tooth that operates.Computer program can comprise the computer-executable code of carrying out following steps: after the digital dental models that will be cut, be labeled is transferred to remote data base, form groove on the tooth that operates.Computer program can comprise the computer-executable code of carrying out following steps: by the based on network interface accessing workflow queue of safety.The numeral dental models can be included in the repair member preparation before and the model of the dental surface after preparation.Marker edge can comprise according to before repair member preparation and the dental surface after preparation relatively come to determine initial edge.Relatively can comprise and to carry out Boolean comparison with the Alignment model for preparing dental surface afterwards before the repair member preparation.The edge can be transferred to remote data base, the edge line that limits in the coordinate system as digital dental models.
On the other hand, method disclosed herein comprises: from adopting mouthful a plurality of images of the dental object that the interscan device collects to obtaining the three-dimensional digital model of dental object; The zone of the concern in the identification three-dimensional digital model; Select a plurality of images right set relevant to the zone of paying close attention to; And the set that a plurality of images are right is transferred to remote location.
Method can comprise three-dimensional digital model is transferred to the position.Remote location can be dental laboratory.Select the right set of a plurality of images can comprise according to the covering of view data and the one or more groups of selecting in orientation.
By with reference to following accompanying drawing, be appreciated that the specific embodiment of the present invention and following some embodiment.
Fig. 1 shows the dental image trapping system.
Fig. 2 is the block diagram that is used for the vague generalization preparation technology of dental object.
Fig. 3 is the high level flow chart of dental object manufacturing process.
Fig. 4 shows the vague generalization technique of using instrument as herein described to be used for digital dental models.
Fig. 5 shows figure mould cutting operation.
Fig. 6 shows figure mould cutting operation.
Fig. 7 shows the pattern edge marking operation.
Fig. 8 shows figure and forms the groove operation.
Fig. 9 shows the automatic edge labelling technique.
Figure 10 shows the user interface of vision assisted margin marking.
As herein described is to solve the system and method for identification, refine and other manipulation at the edge that is used for the dental prosthetic part according to the three-dimensional digital data that traps from the mouth interscan.Although some technology that focuses on some scanning technique and be exclusively used in marker edge on the digital dental impression that is obtained by these scanning techniques is described, but be to be understood that, for the person of ordinary skill of the art, the other variations of following methods and system, adaptive change and combination (for example there is no the manufacturing of specifically described dental prosthetic part or the use of the technology outside following dental field) will be apparent.For example, the techniques described herein can be used for the refine three-dimensional animation model, and it gets self-scanning physical object or machine vision background, the object that is scanned with labelling or evaluation.All these variations, adaptive change and combination are intended to be within the scope of the present invention.Should be appreciated that in addition method and system described in the invention can be used for examining of model and verify and any other application, wherein can carry out useful comparison between the threedimensional model of video image and correspondence.
In the following description, term " image " typically refers to the two-dimensional pixel set that forms the two dimension view of object in the plane of delineation.Term " image set " typically refers to the set of the relevant two dimensional image that can resolve into three-dimensional data.Term " some cloud " typically refers to the set of the three-dimensional point of the 3-D view that forms the object that is rebuild by a plurality of two dimension views.In the 3-D view trapping system, a plurality of such some clouds can be aligned and be combined into the accumulation point cloud of the image configuration that is trapped by mobile camera in addition.Therefore, and unless should be appreciated that another implication is illustrated or be clearly from context, pixel typically refers to 2-D data, and point typically refers to three-dimensional data.
Unless different implications is clearly by clear or from context, otherwise as used herein term " three-dimensional surface represents ", " digital surface represents ", " three-dimensional surface mapping ", etc. be intended to refer to all or part of any other data on any three-dimensional surface mapping of object (for example the some cloud of surface data, the set of planar polygons) or indicated object surface, as obtaining by capturing and/or process 3 d scan data.
Unless different implications is clearly by clear or from context, otherwise " three dimensional representation " can comprise the surface expression of above-mentioned Arbitrary 3 D and volume represents and other expression.
Usually, term " drafting " for example refers to be used for the two-dimentional visualization of the three dimensional object that shows on monitor.Yet, should be appreciated that the 3 D rendering technology that exists, and it can be used to system and method disclosed herein effectively.For example, system and method as herein described can effectively adopt holographic show, automatic stereo shows, the demonstration watched with anaglyph viewer, wear-type stereo display or any other two dimension show and/or three dimensional display.Thus, " drafting " as herein described should explain in the mode of broad sense, unless clearly provide than the implication of narrow sense or be otherwise clearly from context.
As used herein, term " dental object " is intended to broadly refer to be exclusively used in the object of dentistry.This can comprise a mouthful structure therein, denture for example, the more generally mankind's denture, for example single tooth tooth, quadrant, full bow, paired bow (can be independent or closed polytype), soft tissue, etc., and bone and any other supporting structure or around structure.As used herein, natural structure body in term " mouthful structure therein " refers to as mentioned above mouthful and mouthful in man-made structures (for example following dental object) the arbitrarily dental object that may exist can comprise " repair member ", the temporary transient repair member that it usually can be understood to include the assembly (such as corona, bridge, veneer, inlay, onlay, amalgam, composite) of the structure of repairing existing denture or function and various structures body (such as top cover etc.) and use when making permanent repair member.Dental object can comprise that also " prosthese " dental object that substitutes denture with removable structure or permanent structure (for example whole secondary artificial tooth, part artificial tooth, implant, maintenance artificial tooth, etc.) also can comprise for " utensil " of proofreading and correct, aim at or otherwise temporarily or for good and all adjust denture, for example removable just abnormal utensil, surgical stent, the utensil of grinding one's teeth in sleep, device for preventing snoring, indirectly the Stent Implantation utensil, etc.Dental object also can comprise " hardware " that is fixed to for a long time denture, for example implantation body's localizer, implant abutment, just abnormal carriage and other orthodontic component.Dental object also can comprise " the interim assembly " in the dentistry manufacturing, for example dentistry mould (all and/or part), wax shape, investment mould, etc., and other assembly of adopting in making such as pallet, pedestal, mould and repair member, artificial tooth.Dental object can be classified as natural dental object in addition, for example tooth, bone and above-mentioned other mouthful structure therein or artificial dental object, for example interim assembly in repair member, artificial tooth, utensil, hardware and the manufacturing of above-mentioned dentistry.
For example " digital dental models ", " digital dental impression ", etc. term be intended to refer to be used in collection, analysis, prescription and the three dimensional representation of the dental object of the multiple aspect made, unless different implications is by clear otherwise or be clearly from context.For example the term of " dentistry mould " or " dental impression " is intended to refer to physical mask, for example foundry goods, printing or the Physical Examples of dental object of processing otherwise.Unless designated, term " model " can refer to any one or both in physical model and mathematical model when using separately.
It should also be understood that, for example the term of " instrument " or " control " is intended to refer to when being used for the aspect of description user interface usually: can adopt multiple technologies to receive user's input in graphical user interface or other user interface, this user's input stimulus or control to process includes, but is not limited to drop-down list, radio button, cursor and/or mouse action (click, regional choosing, drag-and-drop operation, etc.), check box, order line, text entry field, message and alarm, progress bar etc.Therefore, in the following description, unless implication is by clear otherwise or be clearly from context more specifically, otherwise term " instrument ", " control " etc. should be broadly construed.
Fig. 1 shows the image trapping system.Usually, system 100 can comprise scanner 102, and its surface 106 from object 104 (for example dental patient) captures image, and image conveyer is arrived computer 108, it can comprise display 110 and one or more user input apparatus, for example mouse 112 or keyboard 114.Scanner 102 also can comprise and input or output device 116, for example control inputs spare (as, button, touch dish, thumb wheel etc.) or display (as, LCD or light-emitting diode display), so that status information to be provided.
Scanner 102 can comprise any video camera or the camera chain that is applicable to capture image, and three-dimensional point cloud can recover from image.For example, scanner 102 can adopt porous disclosed in this invention system, for example at U.S. Patent application No.11/530, and disclosed porous system in 413 (authorizing the people such as Roh á ly), its full content is incorporated herein by reference.Although Roh á ly discloses a kind of porous system, should be appreciated that and similarly to adopt any porous system that is applicable to be rebuild by a plurality of two dimensional images three-dimensional point cloud.In a porous embodiment, scanner 102 can comprise a plurality of holes (comprising the centre bore that arranges along the central optic axis of lens), and it is provided for the central passage of scanner 102 together to any relevant imaging hardware.In this class embodiment, central passage can provide the conventional video image of the object that is scanned.In other embodiments, independent video camera and/or passage can be set, realize identical result to be used for preferably from identical perspective view or to have fixedly the perspective view of known relation from the perspective view with scanner 102, namely with the scanning of the object video of corresponding object in time.Scanner 102 also can (or alternatively) comprise solid, 3D vision or other multiple-camera or other structure, in these structures, a plurality of video cameras or light path are in fixed relation to each other, to obtain the two dimensional image of object from a plurality of slightly different perspective views.Scanner 102 can comprise suitable processing, to be used for maybe each two dimensional image set can being sent to ppu, the processor that for example comprises in following computer 108 from an image collection or the derivative three-dimensional point cloud of a plurality of image collection.In other embodiments, scanner 102 can adopt structurized light source, laser scanning, directly range finding or be applicable to any other technology of the 2-D data that gathers three-dimensional data, maybe can resolve into three-dimensional data.Although following technology can adopt the video data that gathers by the 3 D scanning system based on video effectively, but should be appreciated that to capture occurs with the three dimensional data collection same time or otherwise synchronizes the video acquisition system of suitable video data of appearance replenishing any other 3 D scanning system.
In one embodiment, scanner 102 is hand-held freely positionable detectors, it has at least one user input apparatus 116, for example button, control stick, dial, thumb wheel, switch, etc., (for example) begins scanning and stops scanning as trapping system 100 for user's control figure to be used for.In an embodiment, scanner 102 can be shaped and arrange size, to be used for dentistry scanning.More particularly, scanner can be shaped and arrange size, thus by in the mouth that inserts imaging object and with suitable distance through the top of mouthful inner surface 106 to gather the surface data of tooth, gingiva etc., capture to be used for mouthful interscan and data.By continuous like this gatherer process, scanner 102 can be directly or by multiple intermediate process steps, capture the some cloud of surface data, this cloud for preparation example such as prosthese, hardware, utensil, etc. dental object have enough spatial resolution and degree of accuracy.In other embodiments, can collect surface data from the dental models of for example dental prosthesis, carry out correct coupling to guarantee to use corresponding before this denture (dental surface that for example prepares as dental prosthesis) scanning.
Although do not illustrate in Fig. 1, should be appreciated that and effectively to adopt a plurality of additional illumination system during image acquisition.For example, can strengthen ambient lighting with one or more spotlights of illumination target thing 104, to accelerate image acquisition and to improve the depth of field (or degree of depth of spatial resolution).Scanner 102 also can (or alternatively) comprise stroboscope, flash lamp or other light source, to replenish the illumination to object 104 during image acquisition.
Object 104 can be the set of any object, object, a part or other object of object.More particularly, about dentistry discussed in this article, object 104 can comprise mankind's denture of collecting in the mouth of dental patient mouth.Scanning can capture according to the specific purpose of scanning part or all the three dimensional representation in denture.Therefore, scanning can capture the quadrant of tooth, tooth or comprise the full tooth of two relative bows and the mathematical model of soft tissue or any other phase critical point structure therein.Scanning can capture a plurality of expressions, for example before the preparation repair member or the dental surface of preparation after repair member.As will be described below, can adopt these data to be used for modeling subsequently, for example design the edge line of repair member or definite repair member.In scan period, the central passage of scanner 102 or independent video system can capture the denture video from the observation station of scanner.In other embodiment (for example, the manufacturing part of completing for surface preparation and by test set-up in fact to together), scanning can comprise dental prosthesis, such as inlay, corona or any other dental prosthesis, dentistry hardware, dental instrument etc.Object 104 also can comprise (or alternatively) plaster cast, wax shape, die or the negative die of dental models, for example tooth, soft tissue or these some combinations.
Computer 108 can be (for example) personal computer or other blood processor.In one embodiment, computer 108 can comprise two 2.8GHz Opteron central processing units, 2GB random access memory, TYAN Thunder K8WE mainboard and 250GB, 10,000rpm hard disk drive.In a current embodiment, system can operate, and to use the techniques described herein, each image is captured more than 5,000 in real time, and stores the meeting point cloud of several white ten thousand points.Certainly, can also (for example) pass through to extract cloud data or produce corresponding surface data grid, this some cloud being further processed, so that it adapts to date processing subsequently.As used herein, term " in real time " mean usually process and show between there is no the waiting time that can perceive.In the scanning system based on video, more particularly refer in real time the processing in the time between video data frame, and this according to per second approximately 15 frames and per second approximately the particular video frequency technology between 30 frames difference is arranged.More generally say, the disposal ability of computer 108 can have difference according to the spatial resolution of the speed of the size of object 104, image acquisition and required three-dimensional point.Computer 108 also can comprise ancillary equipment, and for example keyboard 114, display 110 and mouse 112, carry out interaction for user and camera chain 100.Display 110 can be touch-screen display, and it can receive by the direct physical interaction with display 110 user's input.On the other hand, display can comprise the automatic stereoscopic display device that can show stereo-picture.
Communicating by letter between computer 108 and scanner 102 can be used any suitable communication link, comprise (for example) wired connection or according to wireless connections (being called in addition wireless ethernet), bluetooth or any other suitable use of (for example) IEEE 802.11 (as) wireless standard of radio frequency, infrared or other wireless communication medium.In medical imaging or other sensitive application, can guarantee from scanner 102 to computer 108 wireless image transmission.Computer 108 can produce control signal for scanner 102, and this control signal can also comprise conventional camera control except comprising the image acquisition instruction, for example focuses on or convergent-divergent.
In the general operation example of 3-D view trapping system 100, scanner 102 through the surface of objects above the time, scanner 102 can gather the two dimensional image set under certain video rate.The two dimensional image set can be forwarded to computer 108, to be used for derivative three-dimensional point cloud.Use a plurality of different technology, the three-dimensional data of the two dimensional image set of each new collection can derive and coordinate or " stitching " to existing three-dimensional data.This system has adopted camera motion estimation, thereby does not need independent tracking the to scanner 102 positions.The U.S. Patent application No.11/270 that owns together that an available example of this technology was submitted on November 9th, 2005 describes in 135 to some extent, and its full content is incorporated herein by reference.Yet, should be appreciated that this example is not restrictive, and principle as herein described can be applied to the vast scope of 3-D view trapping system.
Display 110 can comprise and is applicable to the video drawn with the level of detail corresponding with the data that collect or any display of other speed.Suitable display comprises cathode ray tube display, liquid crystal display, light emitting diode indicator etc.In certain embodiments, display can comprise touch screen interface, its use (for example) condenser type, resistance-type or surface acoustic wave type (being called in addition the dispersion signal formula) touch screen technology or be used for sensing and any other suitable technology of the physical interaction of display 110.
Fig. 2 is the conceptual schema for the participant of the vague generalization manufacturing process of dental object.System 200 can from the patient 202 who is scanned instrument 204 scannings (for example above-mentioned scanner 102 and image trapping system 100), represent 206 with the digital surface that obtains one or more mouthfuls of structure thereins.This can be included in prepared the surface receive dental prosthetic part or other dental object before and/or scan afterwards.Therefore, (for example) pre-prepared scanning can be used for being captured in shape and any interlock information that generates the available initial anatomy of repair member, and the surface scan of preparation can be used as the basis that generates repair member, and it is surperficial to be used in particular for that repair member is configured as preparation.The articulator data relevant to the orientation of up-bow and lower bow and/or relative motion can obtain by the bow in interlock being carried out one or more scannings in addition, or obtain by other technology, for example bend rest image or video in multiple orientation, or from bending the measurement of the multiple dimension that directly traps, or the physics bite registration that traps on the thin material sheet material.
Can process digital surface by one or more post-processing steps 208 and represent 206.This can comprise that several data enhancement process, quality control treatments, outward appearance detect, convert to the form that is applicable to rapid prototyping machine manufacturing (or other is made) etc.Long-range post processing center or other computer facility (can be (for example) dental laboratory or quick manufacturing facility) execution post-processing step of post processing can carried out image file.In some cases, can itself carry out this post processing by image trapping system 100.Post processing can relate to the cleaning of any amount, comprises filler opening, removes outlier etc.
Data strengthen can comprise that (for example) is level and smooth, truncate, extrapolation, interpolation, filling (as, S/V) and any other suitable processing, represent 206 quality to improve digital surface, or improve the suitability that it is used for the expection purpose.In addition, can strengthen spatial resolution with multiple post-processing technology.Other enhancing can comprise the modification to data, for example in fact by for each bow provides pedestal, digital surface is represented that 206 form the surface of sealing, or otherwise represents for the preparation of the digital surface of subsequent fabrication steps.
In quality control treatments, can analyze digital surface and represent whether 206 exist zone or the hole of imperfect or inadequate scan-data.In addition can the automatic check digital surface represent whether 206 have in the curvature of not expecting of the bow that is scanned or unsymmetry or the data that collect, whether other obvious defective being arranged.Other quality control treatments can comprise extra data.For example, can will compare same patient's current scanning and scanning before this.And for example, for the suitability of estimating surface preparation be used for admitting any around denture of repair member, can with the selection of dental prosthetic part with analyze together with the dental surface scanning of repair member.More generally say, be used for representing that with respect to digital surface 206 quality, internal consistency or expection make to estimate any processing that digital surface represents 206 data and can be used in the post processing quality control treatments.
For example draw by the perspective view of the surface data grid that a cloud is provided on display or collects, also can display digit surface expression 206, detect for people.For example, the dentist of acquisition scans or other people can select the part of dental models (for example bow or particular tooth) to be used for subsequent processing steps.Manually the part of preference pattern and/or scanning can reduce significantly for the required data volume of particular procedure.In addition, any in manual identification model part or video data then can the automatic fitration data.For example, in case the dentist has selected to be used for the particular tooth of subsequent treatment, just can will get rid of from further processing with the incoherent video data of this tooth or one or more adjacent tooth, and can (for example) not be transferred to downstream, for example following edge labelling system.At this moment or rear scan process At All Other Times, the user can check that digital surface represents 206, is used for the edge of repair member with mark.This concrete details of processing below will be described in more detail.
After any post processing manually or automatically, as shown in arrow 209, the mathematical model of gained can be transferred to quick manufacturing facility 216.In addition, can transmit the articulator data 218 of any suitable form, with subsequent processing steps and for the manufacture of repair member, utensil, hardware, etc. prescription or other description in use.Fast manufacturing facility 216 can or have for made any other facility of the machinery of physical model by mathematical model for the inside dental laboratory of dental laboratory, dentist's office.Manufacturing facility 216 can (for example) comprise milling system 210, stereolithography system 212 or three-dimensional printer 214 or these some combination fast.Milling system 210 can comprise (for example) CNC milling machine.Milling system can be used for drawing materials piece and generating multiple export, comprises full bow model, mould, wax shape, investment chamber or final repair member or utensil.This class piece can comprise ceramic base, particle board, wax, metal or multiple other material.Can use in addition the dentistry milling system of the Procera that for example derives from Nobel Biocare Inc. and the Cerec that derives from Sirona Inc. to generate final dentistry nextport hardware component NextPort.Stereolithography system 212 can comprise (for example) 3D Systems, the Viper System of Inc..Three-dimensional printer 214 can comprise that (for example) derives from the InVision HR printer of 3DSystems.Each in these manufacturing technologies below will be described in more detail.
Manufacturing facility 216 can use articulator data 218 and mathematical model to generate one or more dental objects fast, for example one or more full bow models 220, one or more mould 222, one or more wax shape 224, one and a plurality of investments chamber 226 and/or one or more final repair member or utensil 228.Some assemblies (for example mould 222 and bow 220) can insert in articulator mould 234, for example have the articulator of standard base portion 230 or customization base portion 232.Dental laboratory can adopt multiple these assemblies completing repair member 236, its can turn back to the dentist with in the denture that is placed to dental patient/denture on.
A plurality of suitable quick manufacturing facilities are known in this area, and can effectively be adopted by system and method as herein described.Below by way of example the explanation mode and unrestriced mode is described a plurality of these class technology.
A kind of suitable technology is milling.Technology is normally cut down in milling, and wherein material is cut down rather than added from piece.Therefore, can advantageously adopt the workpiece near the pre-cutting of common Milling Shape, to reduce the quantity of material that must remove at the milling duration of work, can reduce like this material cost and/or save time in Milling Processes.Computerized numerically controlled (CNC) milling is a kind of suitable technology.Another the available milling technology that is used for the dentistry manufacturing process is the profile milling system, and its permission converts three dimensional form to the milling target manually or automatically from physical object.CNC milling technology and other milling technology can be used for making dental models, dental models assembly, wax shape, investment chamber and other dental object.In addition, there is special-purpose dentistry milling device, for example derives from the Cere system of SironaDental.All milling systems that can be suitable in dental applications as herein described are intended to belong in the scope of quick manufacturing facility as herein described.
Another suitable technology is to use the stereolithography technology of stereolithography equipment (SLA).Usually, SLA adopts laser to come the sequentially layer of cure polymer (normally Photocurable liquid resin), so that it has the pattern that limits three dimensional object.The available commercial embodiment of SLA is the SCS-1000HD that can derive from Sony Corporation.Stereolithography is very suitable for the high yield production of dental models and mould, and this is because parts can carry out batch processing to produce fast on machine.When optimised, these parts can be used for substituting Dental gypsum and other dental object.Similar techniques has adopted the plane section of digital light processing (DLP) with the while cure polymer, and can effectively use with system as herein described in addition.
Another kind of suitable technology is three dimensional printing.Usually, three-dimensional printer is successively adopting print head with coating material in additive process, for example curable photopolymer or powder.Three-dimensional printer is very suitable for making fast small parts, for example wax pattern or wax shape and mould little dental object relative to other.A business system that is applicable to three-dimensional dentistry printing application is the InVision HR printer that derives from 3D Systems.
Should be appreciated that other rapid prototyping mechanism manufacturing system is well known in the art.As used herein, term " manufacturing " is interpreted as referring to above-mentioned manufacturing technology and any other rapid prototyping mechanism technology for making or other manufacturing technology, it can be suitable for making the customization dental object, includes, but is not limited to selective laser sintering (SLS), fusion sediment modeling (FDM), laminated solid body manufacturing (LOM) etc.Similarly, any technology (alone or in combination) in above-mentioned technology can be as operating for the manufacture of, printing, preparation or the device that otherwise generates dental object as herein described.Should be appreciated that the above-mentioned manufacturing step of describing with reference to particular technology can be extra step (such as curing, cleaning etc.) afterwards, thereby obtain final products.Above-described manufacturing technology can make up in many ways, thereby obtains the manufacturing process of multi-modal.Therefore, for example, can use the CNC milling machine to generate the mould that is used for tooth, these need to be more than the available details of SLA, and SLA can be used for comprising the dental arch model of mould.The method of this multi-modal can be in the advantage of the different aspect of manufacturing technology allotment multiple technologies, for example use stereolithography be used for fast, precision milling, and three dimensional printing is to be used for the high speed manufacturing of small parts.
Fig. 3 is the high level flow chart of dental object manufacturing process.This technique 300 has adopted directly the three dimensional representation of the denture that gathers from the mouth interscan, and can advantageously walk around a plurality for the treatment of steps that use in conventional stomatology.
Usually, technique 300 can be from data acquisition, as shown in step 302.Data acquisition can comprise other three-dimensional or other expression of the denture of any collection that digital surface represents or applicable dental object manufacturing process.Can use (for example) above-mentioned scanner 102 and image trapping system of describing with reference to Fig. 1 to come the executing data collection.In certain embodiments, can gather a plurality of different scannings, for example be used for create the scanning of the interlock of bow and articulator or before the preparation of surface and the scanning after preparation, these scannings can be united and used with generation prosthese etc.In certain embodiments, scanning can obtain with different resolution, the relatively low resolution scan that for example is used for relative bow with for the preparation of the relative high resolution scan at edge of dental surface.
Be to be understood that, although following explanation relates in general to the operation of carrying out in the outside of dentist's office, for example on mathematical model labelling the center processing position at edge or the operation that the dental laboratory place carries out, in when scanning or before scan-data being transferred to the teleprocessing center, user interface as herein described, instrument and technology can adopt in many ways effectively.
For example, the dentist can adopt video scan tool (watching combination separately or with synchronizeing of mathematical model), to be used for assessing the qualitatively suitability of specific scanning.The volume rendering of video image and/or mathematical model can provide the insight of use, the clinician can use its determine complementary scan or whole new scanning whether suitable.
In other embodiments, before transferring data to dental laboratory or other long-range position, the dentist can carry out part or all in edge labelling.
In other embodiments, use can be transferred to scan-data the information at long-range position, the dentist can be on model surface frame or the point of labelling video data.The instrument of the note that this ability can arrange within being used for graphical user interface (for example following user interface) embodies.These notes can comprise (for example) prescription, marginal information, edge labelling explanation or any out of Memory relevant to edge labelling during the dental prosthetic part is processed or other step.Can be by selecting video image or the lip-deep point of mathematical model and entering any required text, adnexa or other data or information is inputted this information.These notes can visually be shown as flag or other visual terrestrial reference.In one aspect, note can be arranged on video image.On the other hand, note can be arranged on model.On the other hand, note can be arranged in a view, and all shows on two views.
Should be appreciated that out of Memory (for example camera model, distortion model, calibration data, etc.) can be effectively together with prescription data (being used for given patient and/or repair member) or transmit as its part.In addition, for example can transmit the information of inserting heading message in video data frame and so on by scanner.This heading message (its can comprise specific scanner details (as, serial number), be used for the lighting condition of scanner, the denture zone of scanning etc.) can effectively transmit in addition, and can be used for multiple downstream use, for example automatically the determining of video metadata (for example observation of present image inner teeth gear (and as, buccal, lingual surface, far away in, centre, occlusal surface etc.) or identify).And nonrestrictive, this information can be used for the thumbnail that the following airmanship of labelling is used by way of example.In other embodiments, can at remote location place storage camera model (camera parameters, calibration data, distortion data, etc.), wherein identify to select the camera model of specific scanning according to the scanner in video metadata.The method has advantageously reduced the data volume of scan transfer each time, and the threedimensional model at the remote location place that comprehensive information characterizes observation and/or control model and the relation between video data are provided simultaneously.
Except replenishing above-mentioned model information, dentist or other scanning founder can prepare compacter transfer of data by remove unwanted material from video and/or model data.Usually, this selection course has been used General Principle, that is, the required video data of reconstructing three-dimensional model can be different from auxiliary model or the required video data of modelling operability (for example edge labelling) checked of (usually greater than) hdr video.For example, after having identified the concrete tooth that is used for repair member etc., the operator can delete unwanted frame of video or model data, or can be according to the zone of what video data and concern relevantly causes not that the automatic moving of needs data removes.The zone of paying close attention to can comprise the dental surface of preparation, one or more adjacent tooth, one or more relative tooth, the tooth (such as being used for bridge) of a plurality of preparations etc.Video image and/or corresponding model can carry out volume rendering in the user interface at scanner location place, select with the pre-transmission in the auxiliary zone of paying close attention to.User interface can be incorporated part or all with respect to the following characteristics of the user interface that is used for edge labelling into.Usually, can adopt a plurality of standards to be used for selecting the zone of paying close attention to or the correlogram picture frame that is used for dentistry operation (for example edge labelling).For example, can select video data frame to be used for the overlay image data, the zone of for example cover paying close attention to fully or best (as, not overlapping or overlapping predetermined amount) cover the zone of paying close attention to.Similarly, can select frame according to the view data orientation (for example optimal viewing angle) of the precision of the three-dimensional data that is used for vision-based detection or calculates any one (or both).Can also be included according to the selection of orientation the selection that has the multiframe of substantially different perspective views on each surface point or surf zone, to guarantee or to improve the chance of a plurality of unique perspective views on each surface character.Even should be appreciated that in addition in the zone of paying close attention to, the video image capture rate of scanner can be also that the mankind that only need a small amount of video image to be used for having a mind to check.Therefore, for example, data reduce to be processed and can be automatically to be eliminated one, every five frames every a frame and eliminate four, every ten frames and eliminate nine or the selected frame that is used for auxiliary any other quantity of checking of video as herein described to preserve enough video datas.In manual technique, the user can clearly select the video image of being correlated with.In semi-automatic technology, the user can identify point or the zone of paying close attention to from figure, and can processing video data satisfy the video image of one or more choice criteria (for example above-mentioned standard) with selection.In full-automatic operation, the user can identify simply associated teeth or prescription is provided, and computer program can process video image, with the zone determining to pay close attention to and therefore select video data frame.
Therefore, in one aspect, herein disclosed is a kind of technology, it is used for by removing the size that reduces digital dental models with the incoherent frame of video of repair member and/or model data.On the other hand, herein disclosed is a kind of technology, it is used for reducing by removing the unwanted frame of video of marker edge and/or model data the size of digital dental models.Except being used for the detailed video and/or model data in selected zone, the low-qualityer model of extra denture (low quality that for example is used for physics or actual dental articulator is bent model entirely) can also adopt selected zone to transmit.On the other hand, when showing thumbnail view in following user interface, can select the similar subset of video image.Therefore, can select the significant image in dental prosthetic operation (for example edge labelling), show at video navigation user interface (for example following interface) being used for.These images can also be marked with the orientation information for the user of for example observation (buccal, lingual surface, far away, closely medium), this orientation information can show by text, or show by exemplary icon, schematic diagram, three-dimensional compass or any other suitable visualization technique.
In case collect suitable data, just can carry out one or more modelling operabilities, as shown in step 304.This can comprise modeling procedure, for example form groove in the actual mould of digital dental models, specify for the treatment of tooth, filler opening or otherwise correction data, bite registration and/or design any other modeling available under repair member, prosthese, hardware or other dental object and dentistry environment fully or mathematical model is handled.The instrument that uses multiple commercially available computer Automated Design (CAD) or other D modeling tool and incorporate following extra in greater detail feature into can be carried out modeling.
For example, modeling can comprise defines the surface expression to form solid, then generates the set of void space or void space in solid, and these void spaces do not affect important dentistry surface, for example denture or soft tissue on every side.This can advantageously cause having reduced thus the time of material cost and preparation dental models by make a large amount of minimizings of the required material of dental models with the mathematical model in space.Modeling also can comprise the edge on the dental surface that generates or handle preparation.With reference to following concrete manufacture process, a plurality of other modeling procedures are described.Should be appreciated that as used hereinly, term " modeling " can refer to any processing to digital dental models, comprises full-automatic, semi-automatic and/or manual handle (for example in the processing described in whole description).
As shown in step 306, can leave prescription.This specified repair member, prosthese, etc. type, and can comprise the multiple extra information relevant to maker, color, finishing agent, mold interval etc.Should be appreciated that and can carry out recipe step 306 before modeling procedure 304, for example the dentist will be transferred to dental laboratory from the surface expression of patient's initial number together with prescription, and part or all of modeling left in the processing of dental laboratory.
As shown in step 308, can make one or more dental objects.Can use from the data of in above-mentioned modeling, use any technology in above-mentioned manufacturing technology (separately or with multiple combination) to make, these data can be as required by reformatting or revise to be used for specific printing, milling or other manufacturing technology.In addition, will be clear that as some from following instance, manufacturing can comprise the combination of different manufacturing technologies.For example, dental models can be printed with in the mode of three-dimensional the space for mould, and mould can form by different material millings, to be used for procedure of processing subsequently.Therefore, as used herein, unless concrete manufacturing technology is clearly specified or otherwise it seems it is clearly from context, term " manufacturing " is intended to refer to any suitable manufacturing technology.A plurality of concrete manufacturing examples have below been discussed in more detail.
As shown in step 310, prosthese or other dental object can be returned the dentist, to be used for being placed to patient's denture.
Should be appreciated that above-mentioned processing and following method and system can realize by hardware, software or these any combination that is applicable to data acquisition as herein described, modeling and manufacturing technology.This is included in one or more microprocessors, microcontroller, embedded microcontroller, programmable digital signal processor or other programmable device together with the realization in inside and/or external memory storage.This also can comprise (or alternatively) one or more concrete integrated circuits, programmable gate array, programmable logic array assembly, maybe can be configured to process any other device of electronic signal.It should also be understood that, realization can comprise the computer-executable code of using structured programming language (for example C), OO programming language (for example C++) or any other senior or rudimentary programming language (comprising assembler language, hardware description language and database programming language and technology) to produce, and these codes can be stored, compile or translate to move and heterogeneous combination, processor structure or the different hardware of processor and the combination of software in said apparatus.Simultaneously, this processing that can distribute on whole device (for example video camera and/or computer and/or manufacturing equipment and/or dental laboratory) in a plurality of modes, or all functions can be integrated in special-purpose stand-alone device.All these classes are arranged and combination is intended to be within the scope of the present invention.
Should be appreciated that in addition any suitable assembly that can comprise above-mentioned image trapping system 100 with reference to Fig. 1 description for the device of carrying out the step relevant to above-mentioned processing, together with any software and/or the hardware that are applicable to control its operation.Be intended to be within the scope of the present invention for all these class implementations and the device of carrying out processing disclosed herein.
Fig. 4 shows the vague generalization of using instrument as herein described to be used for digital dental models and processes, and more particularly, shows for the preparation of the vague generalization of the model that uses in the manufacturing of dental prosthetic part (for example corona) and process.
User interface, command line interface, etc. in, user's (for example dental technician) can be from the work queue of mathematical model preference pattern, as shown in step 402.This can be that (for example) is stored in the formation on local system or is used for dental laboratory or the formation of remote location place's storage that other DENSPs can access by based on network entrance.Be to be understood that, although formation generally includes for the one or more users that the modeling project are assigned on systematization base (for example file server, Content Management System, etc.), digital dental models and subsidiary data can just be expressed as the file (or file group) that is arranged in the local computer catalogue or the file (or file group) that receives in addition on network.Model can comprise (for example) related scans, for example before the preparation of the patient's who is used for repair member dental surface and the digital dental impression of collection after preparation.Also can effectively comprise out of Memory, for example for consumer-oriented dentistry prescription information with at the video data that gathers for the scan period that obtains digital dental impression.The latter's data can be used as the auxiliary of (for example) edge labelling, as described in more detail below.
After having selected concrete model, the user can be at model internal labeling mould, as shown in step 404.Usually, be separated into mould and make in subsequently physics (and numeral) is processed and more easily to handle the tooth that operates, and each mould will be manufactured to the monolithic that uses in dental laboratory.Cut into mould can comprise to the user present model together with control for the user models show (as, rotation orientation, convergent-divergent, translation etc.) instrument and limit the instrument of one or more moulds for the user in mould.In one embodiment, the mould cutting element can make the user limit and pass separation at the vertical plane of the model of the position of the tooth of bow.Below the example of this operation has been described in Fig. 5 to Fig. 6.
After model is separated into mould, the user can marker edge to be used for repair member, as shown in step 406.The user can be prompted to identify the one or more moulds that need edge labelling.In case specified one or more moulds, user interface will provide the 3 D rendering of of specifying in mould, and can be provided in user interface the graphical tool along expection edge labelling point.Moreover interface can comprise for the instrument of controlling models show (such as rotation orientation, convergent-divergent, translation etc.), thereby the user can navigation expediently around model between mark phase.Edge labelling instrument in interface can make it possible to along the model surface selected element, and can form edge line by any suitable algorithm, to be used on dental surface, point being linked to be continuous closed loop.This instrument can make it possible to add point, deletion point and/or transfer point.This instrument can make it possible in addition select and/or abandon selected element for the group operation, such as being linked to be edge line, deleting, remove etc.A plurality of available interface characteristics that are used for assisted margin marking have below been described in more detail.
In case labelling the edge, just can form groove in mould, as shown in step 408.Usually, this operation is accompanied by removing of mould part below edge line, makes in follow-up maneuvering sequence and can more easily identify edge line.Can automatically carry out groove and form step to remove material below edge line (or transformation only used the surface of model to represent surface) by transaction module.Manually forming groove can support by the user interface tool that makes it possible to remove modeling material in addition.Can adopt the combination of automatic technique and manual technique in addition.
In case the edge that cut mould, labelling and formed groove model, model can be saved for further processing, as shown in step 410.Then, the user can turn back to work queue to select another model, as shown in step 402.More generally say, model and a plurality of parts thereof (as, mould) can store in any stage of processing, thus the user can preserve any current work and turn back to the project of preserving in the time subsequently.Although do not specifically illustrate, but be to be understood that, before completing before this selected model, the user can select New model (step 402) from work queue, thereby the user can according to needs, personal like or any other standard of scheduling, keep the model of any amount in a plurality of stages of completing.
Be assigned with should be appreciated that a plurality of positions that aforesaid operations can relate in digital dental work flow process in the middle of.For example, model can initially use digital scanner (for example any scanner in above-mentioned scanner) to generate by the dentist.The model that is scanned can be transferred to central repositories by data network (together with prescription information and any other data available), its memory scanning data and provide safe interface for downstream user.Can by in the dental technician at dental laboratory or other facility place as mentioned above in the work queue mode from the bank selector model, and dental technician can be cut and markup model as required.Then, the technical staff can use any suitable groove and form operation, or the model after cutting and labelling can be returned to other post processing of central repositories or some position, to be used for automatically forming groove.In case turn back to central repositories, just can provide to quick manufacturing facility (again passing through safe interface) other data, manufacturing facility can prepare corresponding dental object and it is forwarded to dental laboratory for arranging fast.Although this is effectively to come an example of the workflow of allocation process step according to ability and performance, should be appreciated that many other layouts are fine, and can effectively be used in the scope of system and method as herein described.
In one aspect, said method can be for the preparation of the model that is used for Fast Construction etc., cause by be cut, labelling (on the edge) and forms the mathematical model manufacturing physical model of the mould of groove, as above as described in.In one aspect, methods described herein comprise: select digital dental models; Cut at least one mould from digital dental models, thereby mold former is provided; Marker edge on mold former, thus the model of labelling obtained; Form groove on the model that is labeled, thereby the model that forms groove is provided; And by the model manufacturing physical model that forms groove.The method can comprise that the model that will form groove is transferred to remote data base, is transferred to the dentist for checking or be transferred to quick manufacturing facility for generating physical model.
Fig. 5 and Fig. 6 show can be at the figure mould cutting operation that adopts for the user interface of handling digital dental models.As shown in Figure 5, by by required perspective view rendering model 502, can with graphics mode, model 502 be shown in user interface 500, for example the scanning of dental arch.Although should be appreciated that to show Dan Gong, model 502 can comprise multiple bow, comprises relative bow, maybe can comprise the part of bow, one or more teeth of for example paying close attention to.As shown in Figure 6, graphical tool can be so that the user can be at the one or more otch 602 of the interior appointment of model 502, model is divided into one or more parts 604, comprise one or more moulds or each tooth, it also is called the tooth (be used for for example repair member of bridge, mould can comprise a more than tooth) that operates.Then, each part 604 can be located in separately reason as required.Although otch 602 is shown as the line of the model that passes proper orientation, the figure cutting element can adopt a plurality of different technology being used for parted pattern 502, it comprise line (can limit vertical plane), plane, etc.Every plane be used for to limit the part 604 of model 502, and instrument can provide any suitable pictorial representation on plane in user interface, and can be so that the user can add, removes or change the plane.Instrument can make (as required) user can make the plane offset from perpendicular in addition, with the required segmentation of implementation model 502.Should be appreciated that digital dental models is cut into section (for example mould) can be carried out with a plurality of user interface tools, and can use multiple technologies to carry out numeral.For example, model can be separated into a plurality of independent surface model for each section of initial model, or can be relevant to initial model for the cutting plane that limits section, to show its a plurality of parts.Be applicable to cutting apart any technology that is expressed as a plurality of sections (for example mould) with digital form and can use initial model together with system and method as herein described.
Fig. 7 shows can be at the pattern edge marking operation that adopts for the user interface of handling digital dental models.As shown in Figure 7, by drawing mould 702 from required perspective view, can be with graphics mode at the above-mentioned model 702 of (for example mould) in deriving from digital dental models shown in user interface 700.By on model 702 surfaces (every repair member should meet the dental surface of preparation) upward select one or more points 706 and will put 706 edge lines 704 that connect into continuous closed-loop, can be at the interior generation edge line 704 of model 702.User interface 700 can be provided for controlling the instrument for the perspective view of rendering model 702 or viewpoint (for example be used for rotation, translation, convergent-divergent, etc.).In the following description, term (for example perspective view or viewpoint) is used in reference to convertibly and describes by the position of its observed object thing and the data of orientation.In three dimensions, the orientation that this generally includes x coordinate, y coordinate and z coordinate and rotates on three axles.User interface 700 can provide instrument to be used for handling point 706 in addition, for example is used for generation, deletion or transfer point and is used for selecting and/or cancels selected element with for the group operation, for example moves or deletes.Instrument can comprise cancels feature, to be used for cancelling one or more operations before this.Point 706 can automatically or manually connect, or certain combination of these modes, for example by making the institute that not have manually to connect the instrument in the interface 700 that an automatic mutual connects be arranged or connect according to the instrument of any under the extrapolation of existing point or interpolation are advised.Edge line 704 can be expressed as line, line-segment sets, point set or can be (and according to expansion in the coordinate system of model 702, in the coordinate system of the model of Fig. 5 and Fig. 6, or any other mathematical model of the tooth model that is operated by its acquisition) any other suitable data set of limiting.Usually, although at these shown in the drawings of two-dimentional user interface, the user interface 700 of system and method as herein described can adopt any suitable two-dimentional rendering technique or 3 D rendering technology, comprises multiple stereoscopic three-dimensional interface as herein described.
Fig. 8 shows the groove that can adopt at the user interface 800 that is used for the manipulation mathematical model and forms application drawing shape.In case define edge line 802 for mould 804, just can be manually or automatically carry out the mould groove and form operation, thereby obtain tooth base 806 with the convenient physical model of handling the gained that dental laboratory was used, with the generation repair member, and make the edge line of more easily seeing in mathematical model and physical model.Adopt the correct edge line 802 of formulating, the mould groove forms operation can be adapted to very high automaticity.User interface 800 still can provide instrument to be used to specify that multiple groove forms parameter (degree of depth, the material amount of removing etc.) and for detection of the mould of the formation groove of gained.User interface 800 can provide the mould of instrument to be used for manually forming groove and/or automatically forming groove for refine in addition.In the situation that used highly meticulous dental models, for example formation can advantageously be located at numerical data center (for example above-mentioned remote data base) to carry out automatically.
Fig. 9 shows automatization's edge labelling technology.An available techniques of automatization's edge labelling has adopted before the preparation of repair member and the preparation direct comparison of dental surface afterwards.As shown in Figure 9, in cutaway view, can aim at the model of dental surface after preparation repair member 904 at the model of the dental surface of preparation before repair member 902, wherein, pre-prepared model 902 comprises the volume of rear preparation model 904 and extra tooth structure body.Be formed on line 906 (in left hand edge and the right edge of section, only having two points on this line is visible in Fig. 9) on the outward flange of Alignment model define for the preparation of the edge line of dental surface.Can use the boolean XOR of the surface of Alignment model or volume or use any technology in a plurality of other suitable edge discovery techniques to identify line 906 on algorithm.
For example, can use the profile evaluation and come edge on the rear preparation model 904 on identification three-dimensional on algorithm (or relevant pre-prepared model).Similarly, the edge discovery technique can be applied to static video image, and use (for example) the techniques described herein that result is mapped to threedimensional model.In another embodiment, two dimensional technique and 3-D technology can with on average or the result of otherwise being combined be combined with, with derivative single edge line.In the embodiment of semi-automation, can use separately image-based technique and based on the technology of model, and can make the user can select which result to be used for edge line, maybe can make the user can select the part of edge line from each result.
Figure 10 shows the user interface for the vision assisted margin marking.Above-mentioned a plurality of processing is relatively simple and amendable for automatization or computer aided modeling.Yet, because the soft tissue of underscan zone blood, saliva or the replacement on every side that is used for the edge causes the digital surface scanning at denture may have gross error, cause edge labelling to exist special difficult.Following interface replenishes the demonstration of threedimensional model by the video image that obtains with scan period, solved these difficulties.This interface is particularly suitable for the scanning technique based on video, for example comprises the porous video camera for the centre gangway that captures video, as above as described in.
User interface 1000 can comprise (for example) video image window 1010, cutaway view window 1020, model view window 1030 and video control window 1040.One or more in these windows 1010-1040 can be by volume rendering, or otherwise use available data (thereby for example threedimensional model, video image to and/or can packagedly obtain suitable sequence of stereoscopic images) with three dimensional display.Model view window 1030 and cutaway view window 1020 adopt according to the two dimension of threedimensional model to be drawn, so the volume rendering in these windows is relatively simply using of known stereo technology.Every porous or multiple-camera image sequence of providing, the rest image in video image window 1010 in addition can according to stereo-picture to, etc. in the depth information of coding come volume rendering.In one aspect, can according to central passage image (in the situation that available), the 3D model of rebuilding and image is provided and object space between the camera model of mapping synthesize this stereo-picture.In one aspect, the user can be switched between the stereo-picture that gathers pair and synthetic stereo-picture, with qualitatively evaluation and/or the checking of permission to three-dimensional digital model.
Video image window 1010 can show rest image by the video of object.Can gather video during 3-D scanning, for example from the central passage of porous video camera or from respect to scanning means nearby, video camera fixing and known position gathered video.Usually, known multiple hand held scanner has adopted the multiple technologies that are used for obtaining 3-D view, comprises structured lighting or laser technology, transition time technology, single camera video technique, multiple-camera, porous or minute pupil technology etc.Although exceptional case is arranged, these technology rely on the three-dimensional reconstruction algorithm to a great extent, and it needs the video camera path data as input or derivative video camera path data during processing scan data.In other words, for each video image that obtains in scan period, all have corresponding, known, simultaneous camera position basically, it comprises with respect to the camera position that is scanned object and rotation orientation.Therefore, for the rest image that shows in video image window 1010, can determine perspective view or the viewpoint of the scanner on picture material--in this case, object is the dental surface of preparation.As described in more detail below, this Information Availability is in view is synchronizeed with the perspective view window.Every non-video scanning technique that adopted can be come supplementary data with simultaneous two-dimensional video, and this two-dimensional video provides rest image to replenish edge labelling and other operation (as described in as this paper).
Can be in video image window 1010 (or otherwise associated) display orientation information effectively.For example, in order to use the image orientation assisted user in the denture environment, video image window 1010 can show present image viewpoint (as, buccal, lingual surface, far away in, closely medium) and/or distance, and any the position of scanner data that can (as mentioned above) be obtained by scan period in viewpoint and distance are determined.The user can also be set control the direct selection that is used for orientation.For example, the user can select to observe when front teeth or the required orientation of dental surface with text or graphics mode.User interface can responsively select to comprise the image of object orientation (the most closely corresponding to selected orientation), and this image is shown in video image window 1010.In addition, following video is controlled window 1040 and can responsively be upgraded, and for example is chosen in the group that has multiple different perspective view on selected dental surface or have a plurality of predetermined thumbnails that adjoin orientation 1042.
On the other hand, multiple image enhancement technique can be applied to the work sheet picture of demonstration in video image window 1010, to strengthen the visual quality of shown image.For example, demonstration can adopt the local auto-adaptive contrast to strengthen or the self adaptation block diagram of contrast-limited is balanced or any other suitable technology.Display also can (or alternatively) adopts out of Memory, for example with the distance of light source or the information that obtains from corresponding threedimensional model, with control color for improvement of the visual display of static video image, intensity, etc.For example by covering the zone around the edge or emphasizing the zone of high spatial contrast, can advantageously adopt in addition pseudo-painted.Should be appreciated that enhancement techniques as herein described can be used for assisted margin marking or other dental operation, and scan period or after scanning immediately as the supplementary mode of scan operation person's video observation.
As described below, in one aspect, system's operation is with viewpoint or the perspective view of object in synchronization video image window 1010 and model view window 1030.Can adopt multiple technologies with the consistent visual information in the middle of a plurality of windows that keep user interface 1000.For example, video image can be undistorted, and is apparent with the depth information that closer mates in the volume rendering threedimensional model.In one embodiment, threedimensional model accurately reflect physics, three-dimensional counter pair and incorporate into any calibration data, camera parameters, distortion model, etc., so preferred technology should be used for making video image undistorted, therefore be used for making show undistorted.As significant advantage, the simple pin hole projection that the method allows to shine upon between video image control and mathematical model control characterizes, and it can reduce the computation time for the mapping between two expressions significantly.Yet, in some cases, may and can be advantageously be to make the threedimensional model distortion, with spatially corresponding to the video image of volume rendering.In any situation, generally can by mapping be used for by the data of the whole camera model of video data generating three-dimensional models, calibration data, etc. come the implementation space corresponding.This adjustment can comprise the distortion model for camera chain, and it can illustrate in one or more passages of camera chain x dependent variable, y dependent variable and/or the distortion of z dependent variable and the sight parameter at visual angle etc. for example.
Be used for comprising in other technology of multiple display applying image: for example pass through the video data texture mapping to model, or parcel, combination or otherwise process existing image to coming the synthetic perspective view corresponding with model view, the perspective view that the demonstration of rest image is adapted to select in model view.
A plurality of points 1012 (can be the point that arranges of user or the point of computer installation) define some or all ((rather than mode of restriction) shows the part edge line by way of example) in edge line 1014 in video image window 1010.Can be by the user interface tool of for example cursor together with any drop-down menu, list, scroll bar, thump or be applicable to add, delete and other controller of transfer point 1012 comes control point 1012.In addition, point 1012 can be selected or cancel selection, to be used for the group operation, for example the group of the group of the group of junction point (to form some or all in the edge), transfer point, deletion point or, adjust the group of point to generate comparatively level and smooth edge line, or according to curvature analysis, about the data of the dental surface of preparation not or in conjunction with any other available informations of multiple technologies known in the art, on algorithm, point is moved to more possible marginal position.Can provide in addition other more to process intensive function, for example recommend around the some position in the zone of current cursor position, complete the edge line of closed loop or concentrate at the current point that limits edge line and seek possible outlier according to the point of one or more users' selections.Every video image window 1010 can be arranged three-dimensional cursor in addition by volume rendering, navigates with the user in the three dimensions that adapts to drafting.Can similarly adopt this three-dimensional cursor in any in the window 1010,1020,1030,1040 that adopts volume rendering technology or other 3 D rendering technology.
A plurality of available features can be incorporated three-dimensional cursor into.For example, three-dimensional cursor can act on effectively, the surface that just looks like its model (or stereoscopic video images) of being attached to imaging is the same, thereby the user movement (for example adopting the motion of mouse) in two dimensional surface is projected on relevant correspondence image position, three-dimensional coordinate system neutral body drawing image surface.This technology performs well in said system, and wherein video and models show comprise the projection for each screen position (for example pixel etc.) unique surface location.Yet, in certain embodiments, the extra 3 d function that is not attached to projection surface can be set.This can comprise (such as) checking of model and/or stereo-picture, come edit model etc. according to stereoscopic video images.Under this class situation, can adopt for example extra control of mouse roller and so on, thereby obtain the extra degree of freedom for user's input.
Although three-dimensional input can allow cursor to move without restrictions in the three dimensions of volume rendering, the 3rd user input (as, roller) can also be applicable to edge labelling operation as herein described in addition.For example, use interface described herein, instrument and three-dimensional cursor, the mathematical model of user in can direct editing model view window 1030 for example generates better agreement between video image and threedimensional model.For this editor, can there be many reasons.For example, with reference to video, the user can identify the artificial objects in the visual field, such as tendon, saliva, blood etc.And for example, can seem different based on the volume rendering of video with based on the volume rendering of model.This can appear in following situation: for example, the image that three-dimensional video-frequency is directly obtained by scan period is to derivative, and use camera model (as, camera parameters, calibration data, distortion data, etc.) derive model.The lip-deep point of model (or video image) by selecting volume rendering and along 3 D auto ground transfer point, the user can process these variablees.For example, roller can control in screen z axle or along with the movement of the surface point of surperficial orthogonal direction.The user can also follow mobile degree around point by control loop.Can adopt in addition this technology to make the edge become clear, wherein, the edge on model seems by excessive rounding, or the edge shown in the video image temporary transient adjacent image of more clear content viewable (or provide) otherwise is provided.In one aspect, these instruments make it possible to manipulate directly the video image of mathematical model and/or volume rendering.On the other hand, these instruments can compare to verify mathematical model by direct and source image data.In any situation, the model correction that the user arranges can be used for correction model to the mapping of video image, makes the change that keeps all the time the user in any follow-up model manipulation.Another available application is each tooth of segmentation, and wherein model seems on the gap between whole neighbour the tooth that mode connects or bridge joint is adjacent with physics.
Cutaway view window 1020 can be included in user interface 1000, with the profile of assisted user identification dental surface, and is used in particular for more accurately that edge manuallys locate.Cutaway view: this view shows the section of current selected editing area point, to help to identify high curvature areas.Window 1020 can show (for example) one or more sections or mathematical model 1026 perspective views that begin at the section place, plane that comprises current in-edit 1024 or these some combination in the section 1022 of the object that current in-edit 1024 (it can be any point in the point 1012 that shows in video image window 1010) is located.The orientation of passing the plane section of object can have difference, still for the purpose of distinct profile, can suitably select to have the orientation of the most precipitous or maximum differential.Can effectively adopt in addition the plane with the edge line quadrature.Point (for example other point of current in-edit 1024 or edge line and to its change) can be synchronizeed with the point that shows in video image window 1010 and/or model view window 1030, as above as described in.
Model view window 1030 can be included in user interface 1000, thereby obtains the edge labelling environment of the three-dimensional data in the mathematical model 1032 of based target thing more closely.Model view window 1030 can (together with instrument and/or controller) provide the two dimension of mathematical model to draw or 3 D rendering, and is for example above-mentioned for adding, delete or otherwise handling the group of point 1034 and/or point with instrument and/or the controller of labelling edge line 1036 on dental surface.As mentioned above, to put 1034 each change other window 1010,1020,1040 point and/or the demonstration of edge line that can be used for upgrading user interface 1000 together with the change to the edge line 1036 of gained.
Video is controlled window 1040 and can be included in user interface 1000, thereby obtains the rest image that the user selects demonstration in video image window 1010, or more generally says, the navigation in the video flowing that is used for being captured by camera chain.Use video to control window 1040, the user can navigate in video sequence as one sees fit, to generate, to check and the checking edge line.Video sequence can be the video sequence that derives from for obtaining for the camera chain of the three-dimensional data that scans object, or derives from respect to camera chain and/or scan the video sequence that object has the associated camera of basic known relation.
In one embodiment, controller can comprise a plurality of thumbnail images 1042, and it is illustrated in the image that scan period derives from multiple camera position.Other visual cues can have thumbnail image 1042.For example, arrow 1044 or other outstanding marker characteristic can be set, comprise which in surf zone visual in model view window 1030 or thumbnail 1042 and comprise the viewable portion of edge line so which in thumbnail 1042 to be shown.Thumbnail image 1042 also can adopt (or alternatively) orientation information to show.For example, by using each thumbnail to comprise or the note of text, icon or other visual cues of adjacent demonstration, thumbnail image 1042 can provide the orientation details (as, buccal, lingual surface, far away in, near in) or distance.The current video image that shows in video image window 1010 can be identified with outstanding labelling 1046 or other visable indicia in addition.Although the left-hand side at window 1040 shows present image, present image can alternatively be positioned at center or any other suitable position of thumbnail image 1042.Should be appreciated that usually and can select thumbnail image 1042 and/or with its grouping, with assisting users according to dependency.For example, can select thumbnail image 1042, thereby obtain working as the multiple view of front teeth or work as the part of the edge line of pre-editing.Every dentist (or other scanning person) has identified a plurality of teeth, with the thumbnail grouping, makes and only has the technical staff who helps especially the downstream when the image of front teeth.
Although figure 10 illustrates one dimension thumbnail array, should be appreciated that many other technology are known in the art for the video time axle to control, and can suitably use with system as herein described.(rather than restriction mode) by way of example, video are controlled window 1040 can show two-dimensional array (that is, 2 * 5,3 * 5 or any other suitable dimension).Video is controlled window 1040 also can (or alternatively) comprise slider or other controller, is used for the user and navigates along whole video sequence.On the other hand, thumbnail image 1042 can be the frame of temporary transient adjacent video data, or can separate with suitable interval (for example every five frame data, every ten frame data, etc.).Thumbnail image 1042 also can (or alternatively) comprise the composograph that obtains from a plurality of viewpoints that can be used for edge labelling.Control at video as herein described that window 1040 is interior can adopt these modification and other modification effectively.
In one aspect, between video image window 1010 and model view window 1030, perspective view or viewpoint can be by synchronously.For example, the user can operate video and control the interior controller of window 1040, with the video image of selecting to show at video image window 1010.Be the selection of response to the video image of object, model view window 1030 can come render target thing (according to the mathematical model of object) by identical viewpoint or perspective view.For this reason, be used for the data acquisition that the position data (for example x position, y position and z position (in any coordinate system of reference object thing) and rotation are orientated) of scanner/video camera can collect from scan period.Then, can adopt this position data to draw suitably mathematical model.
The user also can (or alternatively) controls the mathematical model perspective view in model view window 1030, as above as described in.In this case, more the new video image window 1010, thereby obtain the video image of user-selected perspective view in corresponding model view window 1030 more closely.Can suitably adopt a plurality of technology to be used for synchronous from model view window 1030 to video image window 1010.For example, the customer controller that be used for to change the perspective view of model view window 1030 can be restricted, thereby the user comes mobile perspective view along the video camera path that is used for obtaining three-dimensional data only.In this example, can provide the limited ability of translation or convergent-divergent to be used for staying the viewpoint variations in the current video image environment.In addition, video image can be wrapped, revise size or otherwise handle, to adapt to the minor change form in rotation orientation etc.And for example, by find the most closely the video image of the viewpoint of selecting corresponding to the user in whole video sequence (or part of whole video sequence), can select the new video image that shows at video image window 1010.This can (for example) according to New Consumers select viewpoint and and video sequence in the position of viewpoint of image correlation and/or any suitable distance or other Quantitative Comparison between the rotation orientation determine.And for example, can synthesize new video data with video data, camera chain distortion model, three-dimensional digital model data and any other data available, this new video data almost or the perspective view of accurately selecting corresponding to the user.This can comprise (for example) with the video texture data map to threedimensional model, or combination derives from the video data of a plurality of different video images, together with suitable parcel, scale, aligning, etc.
In another embodiment, system can provide unidirectional synchronous.That is, model view can be by being drawn to respond the selection of rest image by the perspective view of selecting.Thereby the control model view obtains any suitable perspective view subsequently, and being used for editor or checking edge, and the rest image in video image window 1010 remains unchanged.The user can be provided with reset controller, and model view being turned back to the perspective view of rest image, and model view can repaint by the perspective view by new images model and continues to respond new images and select.Therefore, the view in video image window 1010 can be controlled the drafting in model view window 1030.Yet, change the rest image not impact of perspective view on showing in video image window 1010 of model view window 1030.
On the other hand, the demonstration of the point 1012 in video image window 1010 can be synchronizeed with the demonstration of point 1032 in model view window 1030.Therefore, the user handles the same point 1032 that point 1012 in video image window 1010 can be used for Renewal model view window 1030, and the point 1032 in user's control model view window 1030 can be used for the more same point 1012 of new video image window 1010.Should be appreciated that in any situation, the user can be in two dimension (corresponding to user interface) selected element, and the x coordinate by will point and y coordinate projection are determined the three-dimensional position of point on the surface of model or the rest image.In any situation, can adopt the information (distortion model that for example is used for camera chin) of relevant camera chain accurately to transform the spatial information for the point between two windows 1010,1030.More generally say, some or all in these windows 1010,1020,1030,1040 can comprise for the instrument of handling point and/or edge line, and any change all is updated in all windows.Should be appreciated that to provide many other arrangements.For example, can not show a little and/or edge line in video control window 1040 or cutaway view window 1020 alternatively.And for example, only be provided for the instrument at control point in one or two (for example video image window 1010 and the model view window 1030) in window.
Use above-mentioned user interface 1000 and instrument, can adopt wide array repeatedly and/or interactive edge labelling process.(rather than mode of restriction) described a kind of such operation now, by way of example.The user can cause the edge labelling processing by the thumbnail image 1042 that selection is used in the video of working region (for example the video image window 1010) demonstrations (as " work sheet picture ") is controlled window 1040.Then, the user can come selected element along edge line with mouse in video image window 1010.The edge labelling system can receive these two dimensions by user interface 1000 and select, and it is associated with the three dimensions of threedimensional model.Use the position/spin data of the image that is used for selection, the respective view of mathematical model can be drawn in addition by system in model view window 1030, together with any corresponding point of selecting in the working area.The user can check point selection and the corresponding edge line in model view window 1030.In addition, the user can the control model view, thereby obtains the available perspective view of any amount on model, to be used for visually verifying its selected edge or point.Then, the user can select another thumbnail obtaining new work sheet picture, and continues repeatedly, derives complete closed loop edge line until recognized enough points.
On the other hand, instrument can be set be used for to handle mathematical model (by carrying out alternately with the model of model view window 1030, video image or these combination in video image window 1010).For example, above-mentioned three-dimensional cursor technology can more generally be applied to process video image (according to single image to) and model view (right according to image is compound) between possible variations.Variations can be to cause in the image aspect the object definition-image variations or by the variations of the right synthetic caused model scope of many different images.In addition, above-mentioned technology can be used for calibration source from the human error of initial operation scanner.For example, flap etc. has hindered the part at edge, or granule etc. produces discontinuously on edge line, and these defectives can or otherwise be synthesized other available surface data (automatically, semi-automatically or manually using above-mentioned interactive model edit tool) and process by extrapolation, interpolation.
Although described the present invention in conjunction with some preferred embodiment, those having ordinary skill in the art will appreciate that other embodiment, and other embodiment contained in this paper.
1. graphical user interface is used for the computer assisted edge labelling that carries out on denture, described interface comprises:
Video Controller, described Video Controller receive the user with a selection as the work sheet picture in a plurality of video images;
The working region, described working region shows described work sheet picture and shows by before the preparation of dental surface relatively and the initial edge line that after preparation, the threedimensional model of the described dental surface in denture generates, and receive the user to the manipulation of one or more points, described one or more points are used for marker edge on described denture; With
3-D view, described 3-D view show the three-dimensional perspective drafting of the mathematical model of described denture.
2. graphical user interface according to claim 1, wherein said Video Controller comprises window slide, described window slide provides a plurality of thumbnail images of described denture and receives the user to the selection of in described a plurality of thumbnail images.
3. graphical user interface according to claim 2, wherein said window slide show each the three-dimensional view in described a plurality of thumbnail images.
4. graphical user interface according to claim 2, wherein said a plurality of thumbnail images are selected according to dependency.
5. graphical user interface according to claim 2, each in wherein said a plurality of thumbnail images comprise the orientation identification to described one in described a plurality of thumbnail images.
6. graphical user interface according to claim 1, wherein said Video Controller comprises the video time axis controller.
7. graphical user interface according to claim 6, wherein said video time axis controller shows the thumbnail of current video image.
8. graphical user interface according to claim 1, wherein said Video Controller comprises the two-dimensional array of thumbnail image.
CN2008800225972A 2007-06-29 2008-06-27 Video-assisted margin marking for dental models CN101686853B (en)
US94701207P true 2007-06-29 2007-06-29
US60/947,012 2007-06-29
PCT/US2008/068584 WO2009006303A2 (en) 2007-06-29 2008-06-27 Video-assisted margin marking for dental models
CN101686853A CN101686853A (en) 2010-03-31
CN101686853B true CN101686853B (en) 2013-05-08
ID=39865434
CN2008800225972A CN101686853B (en) 2007-06-29 2008-06-27 Video-assisted margin marking for dental models
US (2) US20100281370A1 (en)
EP (2) EP2164424B1 (en)
JP (1) JP2010532681A (en)
CN (1) CN101686853B (en)
ES (1) ES2724115T3 (en)
WO (1) WO2009006303A2 (en)
WO2011118839A1 (en) * 2010-03-24 2011-09-29 株式会社アドバンス System for measuring and processing dental replacement
WO2012083960A1 (en) * 2010-12-22 2012-06-28 3Shape A/S System and method for scanning objects being modified
JP5808146B2 (en) * 2011-05-16 2015-11-10 株式会社東芝 image processing system, apparatus and method
DE102012210758A1 (en) * 2012-06-25 2014-01-02 Sirona Dental Systems Gmbh Method for checking tooth positions
JP5837522B2 (en) * 2013-02-15 2015-12-24 株式会社コアデンタルラボ横浜 Abutment design method and abutment manufacturing method
CN110251047A (en) 2014-03-28 2019-09-20 直观外科手术操作公司 The quantitative three-dimensional imaging and printing of surgery implant
CN106535806B (en) * 2014-03-28 2019-06-18 直观外科手术操作公司 The quantitative three-dimensional imaging of surgical scene from multiport visual angle
SE1400260A1 (en) * 2014-05-22 2015-11-23 Arrangeman and method of manufacturing individually designed items such as dental restorations
US20150343708A1 (en) * 2014-05-27 2015-12-03 Osiris Biomed 3D, Llc Medical 3d printing conex
CN106796447A (en) * 2014-07-31 2017-05-31 惠普发展公司，有限责任合伙企业 The model data of the object being placed in movable surface
FR3039986A1 (en) * 2015-08-10 2017-02-17 Lyra Holding Model for aesthetic dental restoration
EP3334371A1 (en) * 2015-08-10 2018-06-20 Lyra Holding Model for cosmetic dental restoration, dental jewellery device
FR3047165A1 (en) * 2016-02-03 2017-08-04 Lyra Holding Device for removable dental pairing
US20190216690A1 (en) 2016-05-27 2019-07-18 3M Innovative Properties Company Coating compositions having particles with differing refractive indices for use in intraoral scanning methods
FR3062741B1 (en) * 2017-02-08 2020-03-27 Universite Clermont Auvergne Surface inspection process
EP3594958A4 (en) * 2017-03-07 2020-03-04 Sony Olympus Medical Solutions Inc Medical information management device, medical information management method, and medical information management system
EP3602263A1 (en) * 2017-03-20 2020-02-05 3Shape A/S 3d scanner system with handheld scanner
CN1852685A (en) * 2003-07-14 2006-10-25 德固萨有限责任公司 Method for representing a dental object and for producing dentures
WO1999060916A2 (en) * 1998-05-28 1999-12-02 Mckinley Optics, Inc. Multiple magnification stereo video telescope objective lens system
AU4976501A (en) * 2000-03-30 2001-10-15 Align Technology Inc System and method for separating three-dimensional models
EP1539019B1 (en) * 2002-07-22 2012-05-30 Cadent Ltd. A method for defining a finish line of a dental prosthesis
DE60226987D1 (en) * 2002-12-30 2008-07-17 St Microelectronics Srl A method for stabilizing the drain voltage in a multi-state nonvolatile memory and associated memory device
US7695275B2 (en) * 2004-06-02 2010-04-13 Fuel Management, Inc. Air:fluid distribution system and method
DE602005004332T2 (en) * 2004-06-17 2009-01-08 Cadent Ltd. Method for providing data related to the oral cavity
CN101365396B (en) * 2005-11-30 2010-12-01 3形状股份有限公司 Impression scanning for manufacturing of dental restorations
JP4892249B2 (en) * 2006-02-15 2012-03-07 株式会社ジーシー Production support device
2008-06-27 WO PCT/US2008/068584 patent/WO2009006303A2/en active Application Filing
2008-06-27 JP JP2010515183A patent/JP2010532681A/en active Pending
2008-06-27 EP EP08772170.0A patent/EP2164424B1/en active Active
2008-06-27 CN CN2008800225972A patent/CN101686853B/en active IP Right Grant
2008-06-27 US US12/664,988 patent/US20100281370A1/en not_active Abandoned
2008-06-27 EP EP19158618.9A patent/EP3527167A1/en active Pending
2008-06-27 ES ES08772170T patent/ES2724115T3/en active Active
2016-06-29 US US15/196,105 patent/US20160302895A1/en active Pending
CN101686853A (en) 2010-03-31
EP2164424B1 (en) 2019-02-27
EP2164424A2 (en) 2010-03-24
EP3527167A1 (en) 2019-08-21
WO2009006303A2 (en) 2009-01-08
JP2010532681A (en) 2010-10-14
ES2724115T3 (en) 2019-09-06
US20100281370A1 (en) 2010-11-04
WO2009006303A3 (en) 2009-10-29
US20160302895A1 (en) 2016-10-20
US10242128B2 (en) 2019-03-26 Tools for customized design of dental restorations
US20180081996A1 (en) 2018-03-22 Designing a virtual preparation and a virtual gingival
JP6616475B2 (en) 2019-12-04 Dental preparation guide
EP2651328B1 (en) 2017-05-17 Method and system for designing and manufacturing custom dental preparation guides
EP2814421B1 (en) 2018-04-04 Modeling a digital design of a denture
EP2620914B1 (en) 2016-03-16 Three-dimensional scan recovery
US20200054419A1 (en) 2020-02-20 Automated production of dental restoration
CN103501727B (en) 2016-01-20 With the method and system that the preparation that CAD/CAM odontology creates customization is instructed
US7065243B2 (en) 2006-06-20 Method and system for creating dental models from imagery
CN106537225B (en) 2020-03-20 Visualization device for interior of oral cavity of patient
Patentee after: Midmark Company
Address before: American Minnesota
Patentee before: 3M Innovation Co., Ltd.