METHODS FOR GENERATING FACIAL LINES FOR DENTAL TREATMENT PLANNING
Systems and methods for planning a treatment for a patient's teeth are provided. In some embodiments, a method includes receiving an image of a patient's face and determining a plurality of facial lines using the image of the patient's face. The plurality of facial lines can represent a target smile for the patient. The method can further include outputting a visualization including the plurality of facial lines overlaid onto a composite image. The composite image can include the image of the patient's face combined with a digital model of the patient's teeth. The digital model can represent a tooth arrangement of a treatment plan to adjust the patient's teeth from an initial arrangement toward a target tooth arrangement corresponding to the target smile.
The present application is a continuation application of International Application No. PCT/US2022/078761, filed Oct. 27, 2022; which claims the benefit of priority to U.S. Provisional Application No. 63/263,139, filed Oct. 27, 2021; U.S. Provisional Application No. 63/265,010, filed Dec. 6, 2021; and U.S. Provisional Application No. 63/374,802, filed Sep. 7, 2022; each of which is incorporated by reference herein in its entirety.
TECHNICAL FIELDThe present technology generally relates to treatment planning, and in particular, to systems and methods for orthodontic and restorative treatment planning.
BACKGROUNDThe aesthetics and/or function of a patient's teeth may be compromised if one or more teeth are chipped, broken, worn down through grinding or other means, or simply malformed. Restorative treatment procedures can be used to repair or correct the shape of a patient's tooth, such as by applying a restorative object to the tooth and/or by removing portions of the tooth. However, patients may be reluctant to undergo restorative treatment for malformed or injured teeth due to the invasive nature of such procedures. Additionally, excessive tooth mass reduction during a restorative treatment procedure may compromise the integrity and vitality of the tooth, thus increasing the risk of complications such as fracture and tooth loss. Accordingly, improved approaches for reducing the invasiveness of restorative treatments are needed.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
Many aspects of the present disclosure can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale. Instead, emphasis is placed on illustrating clearly the principles of the present disclosure.
The present technology relates to systems, methods, and devices for planning a combined orthodontic and restorative treatment, also referred to herein as an “orthodontic-restorative” or “ortho-restorative” treatment. In some embodiments, an ortho-restorative treatment plan includes (1) repositioning one or more teeth and (2) altering the mass of one or more teeth, such as by applying restorative objects (e.g., crowns, veneers, edge bonding, composites, implants, prosthetics) to one or more teeth and/or removing portions of one or more teeth. Ortho-restorative treatments may be less invasive compared to conventional restorative-only treatments because orthodontic repositioning of the teeth may decrease the amount of tooth mass addition and/or reduction needed to achieve the treatment target. Additionally, ortho-restorative treatments may be faster than conventional orthodontics-only treatments because modifying the patient's tooth mass may reduce the amount of orthodontic repositioning needed to achieve the treatment target.
In some embodiments, for example, a method for ortho-restorative treatment planning includes receiving input data representing an initial tooth arrangement of a patient's teeth, and outputting a visualization of a treatment plan for achieving a target tooth arrangement for the patient's teeth. The target tooth arrangement can include a change in mass of at least one tooth. The visualization can show a plurality of intermediate tooth arrangements configured to move the patient's teeth from the initial tooth arrangement toward the target tooth arrangement. The visualization can also show a difference in tooth mass between at least one intermediate tooth arrangement and the target tooth arrangement. Accordingly, a user (e.g., clinician, technician, patient) can use the visualization to evaluate the invasiveness, duration, and/or efficacy of the ortho-restorative treatment plan. The visualization can also allow the user to quickly assess the effects of any changes to the orthodontic and/or restorative aspects of the treatment plan, thus allowing the treatment plan to be customized to the particular patient's goals and preferences. For example, a patient may opt for additional orthodontic treatment stages to reduce the invasiveness of the restorative procedure, or the patient may be willing to undergo larger amounts of tooth mass reduction and/or addition to decrease the time to achieve the target tooth arrangement.
The present technology can provide many advantages over conventional treatment planning approaches. For example, orthodontic work and restoration work are conventionally planned in silos as two disconnected tasks, even though better patient outcomes may be achieved through a combination of both treatments. In some instances, restorative work may benefit from a prior orthodontic setup to achieve the best functional and/or aesthetic results for the patient. However, conventional systems and methods lack integrations that allow for concurrent planning of ortho-restorative procedures, which can result in cumbersome and disconnected workflows, more difficulties in planning combined procedures and/or communicating the benefits of such procedures to the patient, multiple iterations between clinicians and treatment providers to achieve a sufficiently good result for the patient, inefficiency, and/or poorer patient outcomes.
To address these and other challenges, the present technology can provide an integrated ortho-restorative workflow and software platform that allows users to plan orthodontic therapy and restorative work concurrently. For example, the present technology can allow the user to determine an orthodontic treatment plan that provides improved tooth positioning for subsequent restorative procedures (e.g., reduces the invasiveness of tooth mass modifications needed). Accordingly, the present technology can provide better product relevance, improved patient outcomes, more convenient workflows, improved adoption for interdisciplinary practices, and/or flexibility for support by partnered laboratories and/or manufacturers.
Embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings in which like numerals represent like elements throughout the several figures, and in which example embodiments are shown. Embodiments of the claims may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. The examples set forth herein are non-limiting examples and are merely examples among other possible examples.
As used herein, the terms “vertical,” “lateral,” “upper,” and “lower” can refer to relative directions or positions of features of the embodiments disclosed herein in view of the orientation shown in the Figures. For example, “upper” or “uppermost” can refer to a feature positioned closer to the top of a page than another feature. These terms, however, should be construed broadly to include embodiments having other orientations, such as inverted or inclined orientations where top/bottom, over/under, above/below, up/down, and left/right can be interchanged depending on the orientation.
The headings provided herein are for convenience only and do not interpret the scope or meaning of the claimed present technology. Embodiments under any one heading may be used in conjunction with embodiments under any other heading.
I. Systems and Methods for Ortho-Restorative Treatment PlanningThe present technology provides systems and methods for planning an ortho-restorative treatment for a patient. In some embodiments, an ortho-restorative treatment plan includes: (1) an orthodontic treatment procedure in which one or more teeth are repositioned from an initial tooth arrangement toward a target tooth arrangement, and (2) a restorative treatment procedure in which the shape of one or more existing teeth is modified and/or one or more missing teeth are replaced. The orthodontic and restorative treatment procedures can be performed sequentially (e.g., all tooth repositioning is performed before any restorative treatments are performed, or vice-versa), concurrently (e.g., any particular stage of the treatment plan can include both tooth repositioning and restorative treatment), or suitable combinations thereof.
The orthodontic treatment procedure can involve applying a series of orthodontic appliances that are configured to incrementally move the teeth through a series of intermediate tooth arrangements. Some or all of the orthodontic appliances can include a polymeric shell including a plurality of teeth-receiving cavities configured to receive and resiliently reposition the teeth toward a particular intermediate tooth arrangement. Additional details and examples of orthodontic appliances suitable for use with the present technology are provided in Section II below.
The restorative treatment procedure can involve applying at least one restorative object to the patient's arch to increase a mass of an existing tooth or replace a missing tooth (“tooth mass addition”), removing a portion of an existing tooth (“tooth mass reduction”), or suitable combinations thereof. Examples of restorative objects (also referred to herein as “restoratives” or “restorations”) include, but are not limited to, crowns, veneers, edge bonding, composites, implants, and prosthetics. In some instances, to aid the fitting of the restorative object over an existing tooth, a portion of the tooth can be removed to provide a mounting surface to receive the restorative object. Different types of restorative objects may require differing amounts of tooth reduction (e.g., a veneer may require less tooth mass reduction than a crown). The amount of tooth mass reduction can also vary depending on the position of the tooth. Optionally, one or more neighboring teeth may also undergo tooth mass reduction to provide space for the restorative object.
The data input component 102 is configured to receive patient data from one or more input devices. The patient data can include any data relevant to a treatment procedure for the patient. For example, the patient data can include data of the patient's teeth, gingiva, arch, intraoral cavity, jaws, face, and/or any other hard or soft tissues of the craniofacial region. The patient data can include photographs, videos, scan data (e.g., intraoral and/or extraoral scans), magnetic resonance imaging (MRI) data, radiographic data (e.g., standard x-ray data such as bitewing x-ray data, panoramic x-ray data, cephalometric x-ray data, computed tomography (CT) data, cone-beam computed tomography (CBCT) data, fluoroscopy data), motion data, and the like. The patient data can include 2D data (e.g., 2D photographs or videos), 3D data (e.g., 3D photographs, intraoral and/or extraoral scans, digital models), 4D data (e.g., fluoroscopy data, dynamic articulation data, hard and/or soft tissue motion capture data), or suitable combinations thereof.
The data input component 102 can be operably coupled to various peripheral devices (not shown) in order to receive patient data therefrom. The peripheral devices can be associated with and/or operated by a healthcare provider (e.g., a clinician), a technician, a patient, or any other suitable user. The peripheral devices can be or include a computing device (e.g., personal computer, laptop, workstation, server, mobile device) that receives, stores, and/or processes the patient data for transmission to the data input component 102. The patient data can be transmitted to the data input component 102 via any suitable combination of wired and/or wireless communication methods.
In some embodiments, for example, the data input component 102 receives data from a scanner configured to obtain a 3D digital representation (e.g., images, surface topography data) of a patient's teeth, such as via direct intraoral scanning or indirectly via casts, impressions, models, etc. The scanner can include a probe (e.g., a handheld probe) for optically capturing 3D structures (e.g., by confocal focusing of an array of light beams). Examples of scanners suitable for use with the system 100 include, but are not limited to, the iTero® intraoral digital scanner manufactured by Align Technology, Inc., the 3M True Definition Scanner, and the Cerec
Omnicam manufactured by Sirona®. The data obtained by the scanner can be transmitted to a clinician's computing device, which in turn can transmit the data to the data input component 102.
As another example, the data input component 102 can receive patient data from a mobile device (e.g., smartphone, tablet) associated with a patient. In some embodiments, the mobile device includes or is operably coupled to an imaging device (e.g., a camera) that generates 2D and/or 3D image data (e.g., photographs, video) of a patient's teeth, arch, face, head, etc. The mobile device can implement a mobile application that instructs the patient to capture images from one or more views, such as a profile view of the patient's head, a front view of the patient's head with a neutral expression, a front view of the patient's head while smiling, a view of the upper jaw, a view of the lower jaw, a right buccal view with the jaw closed, an anterior view with the jaw closed, a left buccal view with the jaw closed, a right buccal view with the jaw open, an anterior view with jaw open, and/or a left buccal view with the jaw open. Optionally, the mobile application can instruct the patient to capture a video, such as video data showing the patient smiling, speaking, moving their jaws, turning their head, etc. The mobile application can then transmit the image data to the data input component 102.
The treatment planning component 104 is configured to generate a treatment plan for the patient, based on the patient data from the data input component 102. As previously discussed, the treatment plan can include an orthodontic treatment, a restorative treatment, or a combined ortho-restorative treatment. In some embodiments, for example, the treatment planning component 104 is configured to receive a digital representation of an initial tooth arrangement of a patient from the data input component 102. The treatment planning component 104 can then determine a target tooth arrangement to be achieved via orthodontic and/or restorative treatment. The target tooth arrangement can be an arrangement of the patient's teeth that achieves a desired aesthetic and/or functional treatment goal (e.g., correct malocclusions, repair missing, malformed, and/or damaged teeth). Optionally, the target tooth arrangement can be determined based at least in part on patient data, such as a photograph of the patient's smile. The treatment planning component 104 can then generate a treatment plan for achieving the target tooth arrangement, such as a series of intermediate tooth arrangements configured to reposition the teeth from the initial tooth arrangement toward the target tooth arrangement and/or one or more tooth mass modifications. The target tooth arrangement and treatment plan can be determined manually based on input from a technician, automatically using software algorithms, or suitable combinations thereof. Additional details of the processes that can be performed by the treatment planning component 104 are described further below.
The treatment visualization component 106 is configured to output a visualization that graphically represents the treatment plan generated by the treatment planning component 104. For example, in embodiments where the treatment plan includes repositioning the patient's teeth from the initial tooth arrangement toward the target tooth arrangement via a series of intermediate tooth arrangements, the treatment visualization component 106 can output a plurality of 3D models showing the initial tooth arrangement, target tooth arrangement, and/or intermediate tooth arrangements. As another example, in embodiments where the treatment plan includes tooth mass addition and/or reduction, the treatment visualization component 106 can show the amounts and/or locations of tooth mass addition and/or reduction. Optionally, the treatment visualization component 106 can also receive and display patient data received from the data input component 102 (e.g., an image of the patient's smile) to provide additional guidance to a user reviewing the treatment plan. In some embodiments, the treatment visualization component 106 displays multiple types of patient data (e.g., 2D, 3D, and/or 4D data) concurrently using graphical user interface elements such as side-by-side views, overlays (e.g., in which each layer can be independently turned on, turned off, or adjusted in opacity), animations, etc. This approach allows the user to visualize the planned treatment in different contexts, e.g., with respect to the patient's facial features, soft tissues, hard tissues, jaw articulation, etc. Additional details of the processes that can be performed by the treatment visualization component 106 are described further below.
In some embodiments, the treatment plan produced by the treatment planning component 104 is displayed to a user (e.g., clinician, technician, patient) via the visualization produced by the treatment visualization component 106. The treatment visualization component 106 can also provide user interface tools allowing the user to provide feedback on the treatment plan, as described in detail below. For example, the user can modify the treatment plan, such as by changing the positions of one or more teeth, changing an amount of tooth mass addition and/or reduction, changing the shape of a restorative object, changing the number of treatment stages, etc. The feedback can be used to directly update the treatment plan, or can be transmitted to the treatment planning component 104, which can update the treatment plan accordingly. The updated treatment plan can be transmitted back to the treatment visualization component 106 for further user review. This process can be repeated until the user approves the treatment plan.
Optionally, once the treatment plan is approved, the treatment planning component 104 can transmit instructions (e.g., STL files, CLI files, CAD files) to the manufacturing component 108 for fabricating one or more devices for use with the treatment plan. For example, the manufacturing component 108 can produce a series of orthodontic appliances configured to reposition the patient's teeth from the initial tooth arrangement toward the target tooth arrangement. The manufacturing component 108 can also produce attachments, attachment placement templates, and/or other devices to be used in conjunction with an orthodontic appliance, e.g., to improve control over the forces on the patient's teeth. As another example, the manufacturing component 108 can produce one or more restorative objects to be applied to the patient's arch, such as a crown, veneer, prosthetic, implant, etc. In a further example, the manufacturing component 108 can produce a guide or template to be placed in the patient's intraoral cavity to assist a clinician in performing a treatment procedure, such as preparing a tooth for a restorative object, performing tooth mass addition or reduction, placing an attachment or restorative object on a tooth, etc.
In some embodiments, the manufacturing component 108 is configured to fabricate the device(s) using an additive manufacturing technique. Additive manufacturing (also referred to herein as “3D printing”) includes a variety of technologies which fabricate 3D objects directly from digital models through an additive process. In some embodiments, additive manufacturing includes depositing a precursor material (e.g., a polymeric resin) onto a build platform. The precursor material can be cured, polymerized, melted, sintered, fused, and/or otherwise solidified to form a portion of the object and/or to combine the portion with previously formed portions of the object. In some embodiments, the additive manufacturing techniques provided herein build up the object geometry in a layer-by-layer fashion, with successive layers being formed in discrete build steps. Alternatively or in combination, the additive manufacturing techniques described herein can allow for continuous build-up of an object geometry.
Examples of additive manufacturing techniques suitable for use with the methods described herein include, but are not limited to, the following: (1) vat photopolymerization, in which an object is constructed from a vat of liquid photopolymer resin, including techniques such as stereolithography (SLA), digital light processing (DLP), continuous liquid interface production (CLIP), two-photon induced photopolymerization (TPIP), and volumetric additive manufacturing (VAM); (2) material jetting, in which material is jetted onto a build platform using either a continuous or drop on demand (DOD) approach; (3) binder jetting, in which alternating layers of a build material (e.g., a powder-based material) and a binding material (e.g., a liquid binder) are deposited by a print head; (4) fused deposition modeling (FDM), in which material is drawn though a nozzle, heated, and deposited layer-by-layer, and direct ink writing (DIW); (5) powder bed fusion, including techniques such as direct metal laser sintering (DMLS), electron beam melting (EBM), selective heat sintering (SHS), selective laser melting (SLM), and selective laser sintering (SLS); (6) sheet lamination, including techniques such as laminated object manufacturing (LOM) and ultrasonic additive manufacturing (UAM); and (7) directed energy deposition, including techniques such as laser engineering net shaping, directed light fabrication, direct metal deposition, and 3D laser cladding.
In some embodiments, the system 100 is used to monitor and/or update a treatment plan after the treatment procedure has already started. For example, the data input component 102 can receive patient data indicative of a state of the patient's teeth, gingiva, arch, jaws, face, etc., after the start of treatment. The patient data can be transmitted to the treatment planning component 104 for comparison with the original treatment plan. If the treatment planning component 104 determines that the treatment plan should be modified (e.g., the patient's teeth are off-course), the treatment planning component 104 can generate a revised treatment plan. For example, the revised treatment plan can include modifications to the target tooth arrangement and/or to one or more intermediate tooth arrangements. The revised treatment plan can be transmitted to the treatment visualization component 106 for user review. Once the revised treatment plan is approved, the treatment planning component 104 can send instructions to the manufacturing component 108 to fabricate one or more devices for implementing the revised treatment plan (e.g., new orthodontic appliances, attachments, restorative objects, etc.). This process can be repeated as desired until the patient has achieved the desired treatment goal.
The system 100 illustrated in
Although
The method 200 begins at block 202 with receiving a digital representation of an initial tooth arrangement of a patient. In some embodiments, the digital representation is received at a data input component of a software platform for ortho-restorative treatment planning, such as the data input component 102 of the system 100 of
At block 204, the method 200 continues with determining a target tooth arrangement for the patient's teeth. In some embodiments, the target tooth arrangement is determined by a treatment planning component of a software platform for ortho-restorative treatment planning, such as the treatment planning component 104 of the system 100 of
In some embodiments, the ortho-restorative treatment procedure involves completing all orthodontic repositioning before performing any restorative procedures. In such embodiments, the process of block 204 can involve first determining a desired arrangement of the patient's teeth to be achieved through orthodontic repositioning (“final orthodontic position”). The final orthodontic position can be achieved by incrementally moving the teeth from the initial tooth arrangement through a series of intermediate tooth arrangements, as described elsewhere herein. Subsequently, the process of block 204 can involve determining one or more restorative adjustments to the teeth in the final orthodontic position. For example, the shapes of one or more teeth in the final orthodontic position can be modified via tooth mass addition and/or reduction to conform to a desired shape, such as generic shape selected from a library of tooth shapes. Optionally, the generic shape can be altered (e.g., scaled up, scaled down, other changes in tooth geometry) to avoid collisions, maintain sufficient interproximal spacing, avoid excessive changes in tooth mass that might affect vitality, etc. The resulting tooth arrangement with the restorative adjustments can be the target tooth arrangement for the ortho-restorative treatment plan.
The target tooth arrangement can be determined based on orthodontic principles, a prescription from a clinician, patient preference, and/or other relevant considerations. In some embodiments, the target tooth arrangement is designed at least partly based on the patient's unique facial features, also referred to herein as “facially-driven” treatment planning. Facially-driven treatment planning can include, for example, determining one or more facial lines (e.g., smile lines) corresponding to the patient's unique facial anatomy, using the facial lines to determine a target smile for the patient, then generating a target tooth arrangement that would produce the target smile. Additional details of processes for determining a target smile and/or target tooth arrangement for a patient are provided below.
At block 206, the method 200 can include outputting a visualization of a treatment plan for achieving the target tooth arrangement. As discussed above, the treatment plan can include repositioning one or more teeth, altering the mass of one or more teeth, or suitable combinations thereof. For example, the treatment plan can include a plurality of intermediate tooth arrangements representing orthodontic treatment stages for sequentially repositioning the patient's teeth from the initial tooth arrangement toward the target tooth arrangement. In such embodiments, the visualization can include graphical representations (e.g., 3D models) of the initial tooth arrangement, intermediate tooth arrangements, and target tooth arrangement.
In embodiments where the treatment plan includes modifying the mass of one or more teeth, the visualization can also show a difference in tooth mass between the target tooth arrangement and at least one other tooth arrangement (e.g., the initial tooth arrangement or an intermediate tooth arrangement). For example, the visualization can include a graphical representation depicting the amounts and locations of tooth mass addition and/or reduction at each treatment stage relative to the target tooth arrangement. Accordingly, the visualization can also provide guidance for tailoring the treatment plan to achieve the desired balance of invasiveness, duration, and efficacy.
In some embodiments, the visualization is output by a treatment visualization component of a software platform for ortho-restorative treatment planning, such as the treatment visualization component 106 of the system 100 of
At block 208, the method 200 optionally includes generating instructions for fabricating one or more orthodontic appliances. As described in greater detail elsewhere herein, the orthodontic appliances can be configured to incrementally reposition the patient's teeth from the initial tooth arrangement toward the target tooth arrangement according to the treatment plan. In some embodiments, the instructions are configured for manufacturing the orthodontic appliance using direct fabrication, e.g., by directly printing the appliance in accordance with the various additive manufacturing techniques described herein. In other embodiments, the instructions can be configured for indirect fabrication of the appliance, e.g., by thermoforming the appliance over a mold of the patient's teeth.
At block 210, the method 200 optionally includes generating instructions for a restorative treatment procedure. The instructions can include, for example, instructions to a clinician indicating the locations in the patient's arch where restorative objects are to be added and/or where tooth mass is to be removed (e.g., to correct the shape of a tooth or in preparation for applying a restorative object). Alternatively or in combination, the instructions can include manufacturing instructions for fabricating at least one restorative object. For example, the instructions can include a 3D model or other digital representation of the geometry of the restorative object. The instructions can be configured for manufacturing the restorative object via any suitable technique, such as direct fabrication, indirect fabrication, etc. Optionally, the instructions can be configured for manufacturing a guide or template to be placed in the patient's intraoral cavity to assist a clinician in performing the restorative treatment procedure.
The method 200 can be varied in many different ways. For example, some of the processes shown in
The method 300 can be performed using any suitable system or device. In some embodiment, some or all of the processes of the method 300 are implemented as computer-readable instructions (e.g., program code) that are configured to be executed by one or more processors of a computing device. For example, some or all of the processes of the method 300 can be performed by one or more components of the system 100 of
The method 300 begins at block 302 with receiving image data of a patient. The image data can depict the patient's anatomy before the start of a treatment procedure and can be used as a reference for treatment planning, as described further below. For example, the image data can include at least one image of the patient's mouth in one or more positions. The patient's mouth can be in a smiling position (e.g., a social smiling position), a repose position with relaxed muscles and lips slightly parted, an anterior retracted open bite or closed bite position, etc. Optionally, the image data can also depict other parts of the patient's anatomy, such as the patient's face, head, neck, shoulders, and/or torso, or the entire body of the patient. For instance, the image data can include at least one image showing the patient's entire face from a frontal view while the patient is smiling (“full-face smile image”). As another example, the image data can include at least one image showing the patient's entire face from a frontal view while the patient's mouth is in a repose position (“full-face repose image”). In a further example, the image data can include at least one intraoral image (e.g., an intraoral anterior image and/or intraoral buccal image).
The image data can be a single image (e.g., a photograph) or can include a plurality of images (e.g., multiple photographs, a video including multiple image frames). Any suitable type of image data can be used, such as 2D images (e.g., photographs), 3D images (e.g., 3D scans), 4D images (e.g., motion capture data), or suitable combinations thereof. The image data can be obtained using any suitable imaging device, such as a camera, scanner, etc. In some embodiments, the image data is obtained using a remote imaging device (e.g., a camera of a patient's mobile device, a DSLR camera) and is subsequently transmitted to an ortho-restorative treatment planning system (e.g., the data input component 102 of the system 100 of
Optionally, at block 304, the method 300 can include selecting at least one image to be used for treatment planning. This approach can be used in embodiments where the image data includes a plurality of images (e.g., two, three, four, five, 10, 20, 50, or more images). For example, multiple images can be obtained by taking several photographs of the patient or by taking a video of the patient. The process of block 304 can involve selecting one or more of the images that meet certain quality criteria for use in treatment planning. For example, the quality criteria for a full face smile image can include one or more of the following: position of the patient's head (e.g., frontal view), position of the patient's mouth (e.g., wide smile), visibility of the face (e.g., the entire face is visible), visibility of the teeth (e.g., most of the teeth are shown, cutting edges are visible), clarity (e.g., lack of blurriness) of the patient's mouth and/or other facial regions, resolution of the patient's mouth and/or other facial regions, and/or whether the patient's eyes are open. The quality criteria may differ for other types of images (e.g., full-face repose image, intraoral anterior image, intraoral buccal image).
The image selection process of block 304 can be performed in various ways. For example, the image data can be analyzed using computer vision and/or machine learning algorithms to determine whether each image meets the specified quality criteria. In embodiments where a machine learning algorithm is are used, the machine learning algorithm can implement a neural network and/or deep learning model, such as a convolutional neural network (CNN). The machine learning algorithm can be an image classifier that is trained on image data that has been labeled with specific features relevant to image quality (e.g., “head orientation,” “blurriness”) and/or has been classified as either “suitable” or “unsuitable” for treatment planning purposes. The output of the machine learning algorithm can be a binary classification (e.g., “suitable” or “unsuitable”) or can be a score (e.g., a real number between 0 to 1) indicative of the image quality. For example, images having a score above a particular threshold may be selected, while images having a score below the threshold may be rejected. As another example, the images can be ranked based on their score, and one or more of the highest scoring images can be selected.
Optionally, in embodiments where the image data is a temporal sequence of images (e.g., consecutive frames of a video), the temporal information can be taken into account during the image selection process of block 304. For example, if the time interval between images is relatively small, it can be assumed that any changes in patient pose (e.g., head orientation, mouth position), etc., between images would also be relatively small. Accordingly, images that are taken sufficiently close in time to an image in which the patient is in an unsuitable pose may be automatically rejected, since the patient will likely be in the same or a similar unsuitable pose in those images. Optionally, the change in patient pose between images (e.g., head rotation velocity) can be calculated and used to predict which images should be accepted or rejected.
In some embodiments, the image selection process of block 304 is performed in a fully automated manner, e.g., the machine learning algorithm automatically analyzes the image data and selects one or more images to be used for treatment planning. Alternatively, the image selection process can be performed in a semi-automated manner, e.g., the machine learning algorithm automatically analyzes and selects one or more images for review by a user, and the user accepts or rejects the selected images. If none of the images are determined to be of sufficient quality for treatment planning by the machine learning algorithm and/or the user, the user can be instructed to obtain new image data of the patient.
The image selection process of block 304 can provide many advantages. For example, it may be difficult and time-consuming for a user to obtain patient images of sufficient quality by taking individual photographs of the patient. Clinicians may have not enough time to carefully take photographs of the patient and/or re-take photographs if any of them are inappropriate. Moreover, it may be difficult to determine whether the patient is in the proper pose (e.g., correct head orientation and/or mouth opening) for treatment planning purposes. The process of block 304 allows for the automated selection of images from a short video of the patient (or other collection of patient images), thus improving the quality and consistency of images used for treatment planning, while also decreasing the amount of time needed to obtain patient images. Additionally, the image selection process can be highly computationally efficient and can therefore be performed on a mobile device, such as a patient's smartphone or tablet.
Once at least one candidate image 404 has been selected for use in treatment planning, in accordance with the process of block 304, the UI 400 can display one more indicators 408 (e.g., arrows, borders, highlighting) showing the selected image 410. Accordingly, the user can review the selected image 410 and/or candidate images 404 via the UI 400. Optionally, the UI 400 can allow the user to approve the selected image 410, reject the selected image 410, choose a different candidate image 404, and/or obtain new candidate images 404.
Referring again to
The method 500 begins at block 502 with identifying a set of first facial landmarks in an image of a patient's face. The first facial landmarks can be one or more reference points corresponding to various anatomical features of the face, such as the eyes, eyebrows, nose, subnasion, mouth, lips, teeth, gingiva, cheeks, chin, jawline, etc. In some embodiments, the first facial landmarks are reference points that are responsible for perception of facial symmetry but are relatively independent of the patient's facial expression. For example, the first facial landmarks can include one or more landmarks on or near the eyes, nose, and/or subnasion, and/or can exclude one or more landmarks on or near the eyebrows and/or chin. The first facial landmarks can be manually identified by a user (e.g., a technician), automatically identified by a computing device (e.g., using computer vision and/or machine learning algorithms), or suitable combinations thereof (e.g., a computing device automatically identifies candidate landmarks which are subsequently reviewed and/or adjusted by a user), as described in greater detail elsewhere herein.
Referring again to
Referring again to
In some embodiments, the matching process of block 506 includes translating and/or rotating the mirrored image 708 to minimize the sum of squared distances between each first facial landmark in the original image 706 and its corresponding second facial landmark in the mirrored image 708. For example, referring to
Referring again to
Referring again to
Referring again to
At block 924, the method 920 can include determining a face type of the patient. For example,
In an average-type face (
In a tall-type face (
Referring again to
The orthodontic parameters can be calculated in various ways. In some embodiments, for instance, some or all of the orthodontic parameters are calculated from the ratio β using a continuous function. As an example,
As another example, some or all of the orthodontic parameters can be determined based on the face type using a table of discrete values. For example, the CIW can be calculated based on the face type and an intercanthal distance measured between the inner corners of the eyes. The ICW multiplier can be selected from one of a plurality of discrete values based on the face type (e.g., the ICW multiplier is a first value for a very tall face type, the ICW multiplier is a second value for a tall face type, and so on). The RED proportion can also be selected from one of a plurality of discrete values based on the face type (e.g., the RED proportion is a first value for a very tall face type, the RED proportion is a second value for a tall face type, and so on).
Referring again to
At block 930, the method 920 can include determining at least one smile curve. The smile curve can be determined from one or more reference points on the patient's teeth (“tooth reference points”). The tooth reference points can include any locations suitable for defining the curvature of the patient's target smile, such as the cusps or tips of one or more teeth (e.g., central incisors, lateral incisors, canines), midpoints between two teeth (e.g., midpoint between the upper central incisors, midpoint between an upper central incisor and a lower central incisor), etc. The tooth reference points can be automatically or semi-automatically determined from an image of the patient's teeth (e.g., the same image used in the other processes of the method 920) and/or other data of the patient's teeth (e.g., scan data).
In some embodiments, the tooth reference points are determined using a teeth segmentation algorithm. The teeth segmentation algorithm can utilize any suitable computer vision and/or machine learning technique, such as a deep neural network architecture for object recognition based on recurrent neural networks (RNNs). For example,
Optionally, the segmentation mask 1202 can also be used to determine a pixel to mm conversion coefficient. In such embodiments, a tooth dimension (e.g., CIW) can be measured in pixels from the segmentation mask 1202. The conversion coefficient can then be calculated based on statistical data of the tooth dimension (e.g., the average CIW is approximately 9 mm). The conversion coefficient can be used to set distance-based limitations in subsequent treatment planning processes.
Referring again to
Referring again to
The visualization can be displayed to a user (e.g., clinician, technician, patient) so the user can assess how a particular tooth arrangement compares to the target smile defined by the facial lines. For example, the user can use the facial lines as a reference when designing and/or modifying a target tooth arrangement for the patient. Optionally, the user can provide feedback modifying one or more of the facial lines, which in turn can be used to update the treatment plan, as described in greater detail below.
The method 300 can be varied in many different ways. For example, some of the processes shown in
The method 1300 can be performed using any suitable system or device. In some embodiment, some or all of the processes of the method 1300 are implemented as computer-readable instructions (e.g., program code) that are configured to be executed by one or more processors of a computing device. For example, some or all of the processes of the method 1300 can be performed by one or more components of the system 100 of
The method 1300 begins at block 1302 with receiving a digital representation of an initial tooth arrangement. The process of block 1302 can be identical or generally similar to the process of block 202 of the method 200 of
At block 1304, the method 1300 can include determining a target tooth arrangement including a change in tooth mass. The process of block 1304 can be identical or generally similar to the process of block 204 of the method 200 of
In some embodiments, the target tooth arrangement is determined based at least in part on the patient's facial anatomy. For example, the target tooth arrangement can be designed using one or more facial lines (e.g., smile lines) as a reference. As previously described with respect to the method 300 of
The target tooth arrangement can be determined manually by a user (e.g., a clinician, technician), automatically by a computing device (e.g., using a software algorithm implemented by the treatment planning component 104 of
At block 1306, the method 1300 can include generating a series of intermediate tooth arrangements. The series of intermediate tooth arrangements can be configured to adjust the patient's teeth from the initial tooth arrangement toward the target tooth arrangement. Each intermediate tooth arrangement can correspond to an orthodontic treatment stage to be achieved with a respective orthodontic appliance, as described elsewhere herein.
At block 1310, the method 1300 can include determining a difference in tooth mass between the target arrangement and at least one other tooth arrangement, also referred to herein as “tooth mass analysis.” The other tooth arrangement can be the initial tooth arrangement or an intermediate tooth arrangement. Optionally, the process of block 1310 includes performing tooth mass analysis on the initial tooth arrangement and all of the intermediate tooth arrangements.
The tooth mass analysis can be performed in various ways. For example, the tooth mass analysis can involve identifying, for each tooth in the other tooth arrangement (“original tooth”), a corresponding tooth in the target tooth arrangement (“target tooth”). The target tooth can be the same tooth as the original tooth, except that the target tooth has been adjusted via orthodontic repositioning and/or tooth mass modification. The position and/or shape of the original tooth can then be compared to the position and/or shape of the target tooth to identify (1) locations where the original tooth has added mass compared to the target tooth, (2) locations where the original tooth has reduced mass compared to the target tooth, and/or (3) locations where the mass of the original tooth is the same as the mass of the target tooth. These locations can be marked using visual indicators (e.g., different colors, textures, opacities, borders, labels) to provide a visualization of the tooth mass analysis results, as discussed further below.
Referring next to
Referring next to
As shown in
Referring again to
Referring again to block 1310 of
At block 1312, the method 1300 can optionally include receiving user input modifying at least one tooth arrangement, e.g., to adjust the ortho-restorative treatment plan. For example, the user can provide input via the visualization to modify the target tooth arrangement, such as by adjusting the positions of one or more teeth, adding one or more restorative objects to one or more teeth, removing one or more restorative objects from one or more teeth, adjusting the position and/or shape of a restorative object on a tooth, and so on. Subsequently the tooth mass analysis of block 1308 and/or visualization of block 1310 can be updated to reflect the changes to the target tooth arrangement. This process can be repeated to iteratively update the treatment plan based on user feedback.
In some embodiments, once the treatment plan is approved, the method 1300 can further include generating fabrication instructions for manufacturing orthodontic appliances, restorative objects, and/or other devices configured to implement the treatment plan. For example, based on the tooth mass analysis, the user can select the tooth arrangement (e.g., an intermediate tooth arrangement) that is intended to be the final treatment stage for repositioning the patient's teeth. The method 1300 can then determine (1) a series of orthodontic appliances configured to reposition the teeth from the initial tooth arrangement to the selected tooth arrangement, and/or (2) one or more restorative procedures configured to compensate for any differences in mass between the selected tooth arrangement and the target tooth arrangement. For example, if the selected tooth arrangement includes missing tooth mass relative to the target tooth arrangement, one or more restorative objects can be prescribed to fill in the missing tooth mass. As another example, tooth mass reduction can be prescribed if the selected tooth arrangement includes excess tooth mass relative to the target tooth arrangement. The fabrication instructions can be transmitted to a manufacturing system configured to produce the orthodontic appliances and/or restorative objects, as described elsewhere herein.
The method 1300 can be varied in many different ways. For example, some of the processes shown in
The tooth mass analysis techniques described herein can be used to provide guidance for many different aspects of ortho-restorative treatment planning. For example, the tooth mass analysis can be used to estimate the location and geometry of one or more restorative objects to be used in a treatment plan, including both temporary and permanent restorations. Additionally, the tooth mass analysis techniques can be used to estimate the amount and locations of any tooth preparations (e.g., tooth mass reduction) for accommodating a restorative object, before any actual dental work is started. The visualization of the tooth mass analysis results can provide guidance on the benefits of moving teeth before restoring teeth. In some embodiments, the visualization provides a graphical representation of a minimally invasive approach to preserving healthy natural tooth structure, allowing the user to see the effects of a proposed treatment before making decisions. The visualization can also compare the initial occlusion versus the post-orthodontic treatment tooth mass reduction and/or addition needed to achieve a facially-driven aesthetic smile design goal.
Referring first to
The UI 1600 can also include a tool bar 1614 with various tools that allow the user to review and/or modify the treatment plan by manipulating the second tooth model 1610 shown in the tooth model visualization 1608, as described in greater detail below. Modifications can also be made via a modifications panel 1616, as discussed below. The first tooth model 1604 of the in-face visualization 1602 can be dynamically updated along with the second tooth model 1610 of the tooth model visualization 1608, thus allowing the user to assess the effects of the changes on the patient's smile via the in-face visualization 1602. Optionally, the UI 1600 can also include a comments panel 1618 allowing the user to provide written notes to another user (e.g., a technician responsible for finalizing the treatment plan), as well as a history panel 1620 listing any modifications that have been made to the treatment plan.
Optionally, the user can select a “natural” display mode in which the in-face visualization 1602 shows a simulated patient smile with the selected tooth arrangement. In the natural display mode, the first tooth model 1604 of the teeth can be displayed with lighting, coloration, opacity, etc., that mimics the natural appearance of the teeth. Additionally, the portions of the first tooth model 1604 that would be obstructed by the patient's lips and face can be hidden. The natural display mode can allow the user to assess the overall aesthetics of the teeth together with the patient's facial features.
As shown in
Representative examples of changes that can be made to the facial lines 1624 include, but are not limited to, any of the following:
-
- Facial midline: move left, move right, rotate;
- Incisal edge line: decrease curvature of left incisal edge line, increase curvature of left incisal edge line, decrease curvature of right incisal edge line, increase curvature of right incisal edge line, rotate, adjust left and right incisal edge lines together, adjust left and right incisal edge lines independently;
- Gingival line: decrease curvature of left gingival line, increase curvature of left gingival line, decrease curvature of right gingival line, increase curvature of right gingival line, rotate, adjust left and right gingival lines together, adjust left and right gingival lines independently;
- Horizontal line: move up, move down, rotate;
- ICW lines: decrease ICW, increase ICW; and/or
- Tooth proportions: adjust laterals to centrals width ratio, adjust centrals height to width ratio, adjust canines to lateral width ratio.
In some embodiments, the changes to the facial lines 1624 do not automatically produce any corresponding changes to the tooth arrangements of the treatment plan. Instead, the modified facial lines 1624 are used as a visual reference while the user manually adjusts one or more tooth arrangements of the treatment plan. In other embodiments, however, some or all of the tooth arrangements can be automatically updated based on the modified facial lines 1624. For example, the positions and/or shapes of one or more teeth in the target tooth arrangement can be adjusted so the resulting smile conforms to the target smile defined by the modified facial lines 1624; subsequently, some or all of the intermediate tooth arrangements can be adjusted accordingly to account for the changes to the target tooth arrangement.
In the illustrated embodiment, when the restoratives overlay tool is activated, the UI 1600 displays a model 1630 of at least one restorative object (“restoratives model 1630”) overlaid onto the second tooth model 1610 in the tooth model visualization 1608 and/or the first tooth model 1604 of the in-face visualization 1602. The restoratives model 1630 can depict the surfaces and/or volumes of the teeth after the restorative object(s) have been applied. Optionally, the user can choose to display the restoratives model 1630 overlaid on the first tooth model 1604 only, the second tooth model 1610 only, or both.
In some embodiments, the user can adjust the opacity of the restoratives model 1630 shown in the UI 1600. For example, at 100% opacity (
Referring first to
Referring next to
Representative examples of changes to the geometry of a restorative object that can be made include, but are not limited to, any of the following:
-
- Adjusting the scale of a restorative object (e.g., mesial/distal/buccal/lingual, extrusion);
- Adjusting the size of a restorative object (e.g., mesial/distal, buccal/lingual, extrusion); and/or
- Adjusting the shape of a restorative object (e.g., upper third (mesial/distal), upper third (buccal/lingual), middle third (mesial/distal), middle third (buccal/lingual), lower third (mesial/distal), lower third (buccal/lingual), extrusion/intrusion).
Referring next to
Representative examples of changes to the position of a restorative object that can be made include, but are not limited to, any of the following:
-
- Extrusion/intrusion;
- Translation (e.g., buccal/lingual, mesial/distal);
- Rotation (e.g., mesial hinge rotation, distal hinge rotation);
- Crown angulation (e.g., mesial/distal);
- Root torque (e.g., buccal/lingual); and/or
- Crown tip (e.g., buccal/lingual).
Referring next to
Referring next to
Referring next to
The first treatment plan can differ from the second treatment plan with respect to any of the following: treatment modality (e.g., orthodontics only, restorative only, ortho-restorative), number of treatment stages, teeth to be repositioned, tooth movements (e.g., movement type, movement direction, movement velocity), tooth mass addition (e.g., amount, locations), tooth mass reduction (e.g., amount, location), and/or other treatment parameters (e.g., changes to the gingival line). For example, as shown in
In other embodiments, the second in-face visualization 1672 and the third in-face visualization can each independently be selected from any of the following: an orthodontics-only treatment plan, a restorative-only treatment plan, or an ortho-restorative treatment plan. Optionally, the plan comparison tool can be used to compare different stages of a single treatment plan, e.g., the second in-face visualization 1672 can show a first stage of a treatment plan, and the third in-face visualization 1674 can show a second stage of the treatment plan. Additionally, the plan comparison tool can show the treatment plans and/or stages in different formats. For example, the plan comparison tool can show 3D tooth models of the different treatment plans and/or stages, in addition or as an alternative to the in-face visualizations.
The method 1700 can be performed using any suitable system or device. In some embodiment, some or all of the processes of the method 1700 are implemented as computer-readable instructions (e.g., program code) that are configured to be executed by one or more processors of a computing device. For example, some or all of the processes of the method 1700 can be performed by one or more components of the system 100 of
The method 1700 begins at block 1702 with receiving patient data. The patient data can include any data relevant to a treatment procedure for the patient's teeth (e.g., an orthodontic treatment procedure, a restorative treatment procedure, or an ortho-restorative treatment procedure). For example, the patient data can depict the hard and/or soft tissue of the patient's craniofacial region, such as the teeth, gingiva, one or both dental arches, intraoral cavity, jaws, face, etc. The patient data can include a combination of multiple data types, such as one or more of the following: photographs, videos, scan data (e.g., intraoral and/or extraoral scans), MRI data, radiographic data (e.g., bitewing x-ray data, panoramic x-ray data, cephalometric x-ray data, CT data, CBCT data, fluoroscopy data), and/or motion data. Optionally, the patient data can include any suitable combination of 2D data, 3D data, and/or 4D data.
At block 1704, the method 1700 can include identifying one or more anatomical landmarks of the patient, based on the patient data. The anatomical landmarks can include soft tissue landmarks (e.g., facial landmarks, such as the facial landmarks depicted in
At block 1706, the method 1700 can include generating a combined anatomical model, based on the identified anatomical landmarks. The combined anatomical model can be a digital representation of the patient's craniofacial anatomy that incorporates multiple data types (e.g., 2D, 3D, and/or 4D data). For example, different data types (e.g., image data obtained using different modalities, such as photographs, scans, x-ray data, MRI data, motion capture data) can be presented as different layers of the combined anatomical model. The different layers can be selectively displayed, hidden, manipulated, etc., to facilitate visualization. The combined anatomical model can be a static model (e.g., a 2D or 3D model showing the patient anatomy in a single pose) or a dynamic model (e.g., an animated model showing the patient anatomy in multiple poses, such as when smiling, speaking, moving the jaws, etc.). The combined anatomical model can be generated in many different ways. In some embodiments, for example, the model is generated by identifying and matching corresponding anatomical landmarks across different data assets. The different data assets can then be aligned, merged, or otherwise combined with each other based on the matched landmarks. For instance, CBCT data can depict both hard and soft tissues of the patient's craniofacial anatomy, and thus can be aligned to models and/or scans of the patient's teeth (e.g., via matching of hard tissue landmarks), as well as image data of the patient's face (e.g., via matching of soft tissue landmarks).
The user can interact with the combined anatomical model 1720 when planning and/or reviewing a treatment plan, as described elsewhere herein. For example, the appearance (e.g., color, opacity) of the layers 1722, 1724 can be adjusted independently to facilitate visualization. In the illustrated embodiment,
Referring again to
At block 1710, the method 1700 optionally includes generating a treatment plan, based on the combined anatomical model. The treatment plan can be an orthodontic treatment plan, a restorative treatment plan, or an ortho-restorative treatment plan. For example, the treatment plan can include (1) repositioning one or more teeth and/or (2) altering the mass of one or more teeth, as described in greater detail elsewhere herein. In some embodiments, the process of block 1710 includes analyzing the combined anatomical model to automatically detect one or more patient characteristics, such as face type, ethnicity, gender, and/or dental and skeletal class. The patient characteristics can be used as a basis for automated treatment planning, e.g., the treatment plan can account for different ethnicities, genders, face types, etc., in determining a treatment goal for the patient. Alternatively or in combination, the anatomical landmarks identified in block 1704 can also serve as inputs for automated treatment planning. For instance, the anatomical landmarks can be used to calculate facial lines defining a target smile and/or a target tooth arrangement, as previously described.
At block 1712, the method 1700 optionally includes updating the combined anatomical model, based on additional patient data. In some embodiments, the additional patient data includes one or more data assets depicting the patient's anatomy after the treatment procedure has started (e.g., updated photographs, scans, x-rays, etc.). The additional patient data can be incorporated into the combined anatomical model so the model depicts the most recent state of the patient's anatomy. For example, the additional patient data can be merged with the model based on landmark matching, as previously described with respect to blocks 1704 and 1706.
The updated combined anatomical model (“updated model”) can be displayed to a user to provide visual guidance for treatment monitoring and progress tracking. For example, the user can review a visualization of the updated model to evaluate any changes that have occurred, such as orthodontic changes (e.g., surgical and non-surgical), restoratives changes, orthognathic changes, facial changes (e.g., changes in facial symmetry), soft tissue changes (e.g., surgical and non-surgical, such as lip support), etc. Alternatively or in combination, the changes can be automatically detected by comparing the anatomical landmarks in the updated model to the corresponding anatomical landmarks in the original model, e.g., using computer vision techniques, machine learning algorithms, and/or other suitable approaches.
The method 1700 can be varied in many different ways. For example, some of the processes shown in
The method 1800 begins at block 1802 with receiving a digital representation of a target tooth arrangement for a patient. The target tooth arrangement can be a prescribed arrangement of the teeth configured to achieve the patient's desired aesthetic and/or functional treatment goals (e.g., a target smile), and can be determined using any of the techniques described elsewhere herein. In some embodiments, the target tooth arrangement includes at least one tooth that is modified with at least one restorative object.
At block 1804, the method 1800 can continue with determining an amount of tooth mass reduction to accommodate the at least one restorative object. Tooth mass reduction can be prescribed to create a mounting surface on an existing tooth that fits the restorative object. The appropriate amount of tooth mass reduction can depend on various factors, such as the size of the restorative object, the shape of the restorative object, the type of material used for the restorative object, the thickness requirements of the material used for the restorative object, the shape of the existing tooth, the position of the existing tooth (e.g., the initial position and/or the final position after orthodontic repositioning), the shapes of neighboring teeth, the positions of neighboring teeth (e.g., before and/or after orthodontic repositioning), occlusion, etc.
In some embodiments, the process of block 1804 involves receiving a first digital representation depicting the initial geometry of the tooth, and then generating a second digital representation depicting the tooth with one or more portions removed to accommodate the restorative object (“target tooth preparation”). The amounts and locations of tooth mass reduction in the target tooth preparation can be estimated based on any of the above factors, and can be determined using clinical data, clinical protocols, simulations, trained machine learning algorithms, or suitable combinations thereof.
At block 1806, the method 1800 can include receiving a digital representation of a tooth preparation. The tooth preparation can be an actual tooth of the patient that has undergone tooth mass reduction to accommodate the restorative object(s) prescribed by the target tooth arrangement. The digital representation can include any suitable data that depicts the geometry of the tooth preparation. For example, the digital representation can include scan data and/or surface topography data of the tooth preparation generated via an intraoral scanner. Alternatively or in combination, the digital representation can be produced from other types of patient data, such as photographs, x-ray data, etc.
At block 1808, the method 1800 can include analyzing whether the tooth preparation includes sufficient tooth mass reduction to accommodate the at least one restorative object. This process can involve comparing the digital representation of the actual tooth preparation received in block 1806 to the digital representation of the target tooth preparation generated in block 1804. The comparison can be performed using the tooth mass analysis techniques described above in connection with the method 1300 of
Optionally, at block 1810, the method 1800 includes outputting a visualization of the analysis results of block 1808. The visualization can provide a graphical representation of the differences in mass between the actual tooth preparation and the target tooth preparation, and can therefore assist a user in identifying locations where additional tooth mass reduction may be beneficial or necessary. For example, the visualization can include a heatmap overlaid on a digital representation of the actual tooth preparation (e.g., a 3D model of the patient's current tooth arrangement including the tooth preparation) that graphically displays the differences in tooth mass, similar to the visualization described above in connection with the method 1300 of
The method 1800 can be varied in many different ways. For example, some of the processes shown in
The appliance 1900 can fit over all teeth present in an upper or lower jaw, or less than all of the teeth. The appliance 1900 can be designed specifically to accommodate the teeth of the patient (e.g., the topography of the tooth-receiving cavities matches the topography of the patient's teeth), and may be fabricated based on positive or negative models of the patient's teeth generated by impression, scanning, and the like. Alternatively, the appliance 1900 can be a generic appliance configured to receive the teeth, but not necessarily shaped to match the topography of the patient's teeth. In some cases, only certain teeth received by the appliance 1900 are repositioned by the appliance 1900 while other teeth can provide a base or anchor region for holding the appliance 1900 in place as it applies force against the tooth or teeth targeted for repositioning. In some cases, some, most, or even all of the teeth can be repositioned at some point during treatment. Teeth that are moved can also serve as a base or anchor for holding the appliance as it is worn by the patient. In preferred embodiments, no wires or other means are provided for holding the appliance 1900 in place over the teeth. In some cases, however, it may be desirable or necessary to provide individual attachments 1904 or other anchoring elements on teeth 1902 with corresponding receptacles 1906 or apertures in the appliance 1900 so that the appliance 1900 can apply a selected force on the tooth. Representative examples of appliances, including those utilized in the Invisalign® System, are described in numerous patents and patent applications assigned to Align Technology, Inc. including, for example, in U.S. Pat. Nos. 6,450,807, and 5,975,893, as well as on the company's website, which is accessible on the World Wide Web (see, e.g., the url “invisalign.com”). Examples of tooth-mounted attachments suitable for use with orthodontic appliances are also described in patents and patent applications assigned to Align Technology, Inc., including, for example, U.S. Pat. Nos. 6,309,215 and 6,830,450.
In block 2002, a movement path to move one or more teeth from an initial arrangement to a target arrangement is determined. The initial arrangement can be determined from a mold or a scan of the patient's teeth or mouth tissue, e.g., using wax bites, direct contact scanning, x-ray imaging, tomographic imaging, sonographic imaging, and other techniques for obtaining information about the position and structure of the teeth, jaws, gums and other orthodontically relevant tissue. From the obtained data, a digital data set can be derived that represents the initial (e.g., pretreatment) arrangement of the patient's teeth and other tissues. Optionally, the initial digital data set is processed to segment the tissue constituents from each other. For example, data structures that digitally represent individual tooth crowns can be produced. Advantageously, digital models of entire teeth can be produced, including measured or extrapolated hidden surfaces and root structures, as well as surrounding bone and soft tissue.
The target arrangement of the teeth (e.g., a desired and intended end result of orthodontic treatment) can be received from a clinician in the form of a prescription, can be calculated from basic orthodontic principles, and/or can be extrapolated computationally from a clinical prescription. With a specification of the desired final positions of the teeth and a digital representation of the teeth themselves, the final position and surface geometry of each tooth can be specified to form a complete model of the tooth arrangement at the desired end of treatment.
Having both an initial position and a target position for each tooth, a movement path can be defined for the motion of each tooth. In some embodiments, the movement paths are configured to move the teeth in the quickest fashion with the least amount of round-tripping to bring the teeth from their initial positions to their desired target positions. The tooth paths can optionally be segmented, and the segments can be calculated so that each tooth's motion within a segment stays within threshold limits of linear and rotational translation. In this way, the end points of each path segment can constitute a clinically viable repositioning, and the aggregate of segment end points can constitute a clinically viable sequence of tooth positions, so that moving from one point to the next in the sequence does not result in a collision of teeth.
In block 2004, a force system to produce movement of the one or more teeth along the movement path is determined. A force system can include one or more forces and/or one or more torques. Different force systems can result in different types of tooth movement, such as tipping, translation, rotation, extrusion, intrusion, root movement, etc. Biomechanical principles, modeling techniques, force calculation/measurement techniques, and the like, including knowledge and approaches commonly used in orthodontia, may be used to determine the appropriate force system to be applied to the tooth to accomplish the tooth movement. In determining the force system to be applied, sources may be considered including literature, force systems determined by experimentation or virtual modeling, computer-based modeling, clinical experience, minimization of unwanted forces, etc.
The determination of the force system can include constraints on the allowable forces, such as allowable directions and magnitudes, as well as desired motions to be brought about by the applied forces. For example, in fabricating palatal expanders, different movement strategies may be desired for different patients. For example, the amount of force needed to separate the palate can depend on the age of the patient, as very young patients may not have a fully-formed suture. Thus, in juvenile patients and others without fully-closed palatal sutures, palatal expansion can be accomplished with lower force magnitudes. Slower palatal movement can also aid in growing bone to fill the expanding suture. For other patients, a more rapid expansion may be desired, which can be achieved by applying larger forces. These requirements can be incorporated as needed to choose the structure and materials of appliances; for example, by choosing palatal expanders capable of applying large forces for rupturing the palatal suture and/or causing rapid expansion of the palate. Subsequent appliance stages can be designed to apply different amounts of force, such as first applying a large force to break the suture, and then applying smaller forces to keep the suture separated or gradually expand the palate and/or arch.
The determination of the force system can also include modeling of the facial structure of the patient, such as the skeletal structure of the jaw and palate. Scan data of the palate and arch, such as X-ray data or 3D optical scanning data, for example, can be used to determine parameters of the skeletal and muscular system of the patient's mouth, so as to determine forces sufficient to provide a desired expansion of the palate and/or arch. In some embodiments, the thickness and/or density of the mid-palatal suture may be measured, or input by a treating professional. In other embodiments, the treating professional can select an appropriate treatment based on physiological characteristics of the patient. For example, the properties of the palate may also be estimated based on factors such as the patient's age—for example, young juvenile patients can require lower forces to expand the suture than older patients, as the suture has not yet fully formed.
In block 2006, a design for an orthodontic appliance configured to produce the force system is determined. The design can include the appliance geometry, material composition and/or material properties, and can be determined in various ways, such as using a treatment or force application simulation environment. A simulation environment can include, e.g., computer modeling systems, biomechanical systems or apparatus, and the like. Optionally, digital models of the appliance and/or teeth can be produced, such as finite element models. The finite element models can be created using computer program application software available from a variety of vendors. For creating solid geometry models, computer aided engineering (CAE) or computer aided design (CAD) programs can be used, such as the AutoCAD® software products available from Autodesk, Inc., of San Rafael, Calif. For creating finite element models and analyzing them, program products from a number of vendors can be used, including finite element analysis packages from ANSYS, Inc., of Canonsburg, Pa., and SIMULIA (Abaqus) software products from Dassault Systemes of Waltham, Mass.
Optionally, one or more designs can be selected for testing or force modeling. As noted above, a desired tooth movement, as well as a force system required or desired for eliciting the desired tooth movement, can be identified. Using the simulation environment, a design can be analyzed or modeled for determination of an actual force system resulting from use of the candidate appliance. One or more modifications can optionally be made to a candidate appliance, and force modeling can be further analyzed as described, e.g., in order to iteratively determine an appliance design that produces the desired force system.
In block 2008, instructions for fabrication of the orthodontic appliance incorporating the design are generated. The instructions can be configured to control a fabrication system or device in order to produce the orthodontic appliance with the specified design. In some embodiments, the instructions are configured for manufacturing the orthodontic appliance using direct fabrication (e.g., stereolithography, selective laser sintering, fused deposition modeling, 3D printing, continuous direct fabrication, multi-material direct fabrication, etc.), in accordance with the various methods presented herein. In alternative embodiments, the instructions can be configured for indirect fabrication of the appliance, e.g., by thermoforming.
Although the above steps show a method 2000 of designing an orthodontic appliance in accordance with some embodiments, a person of ordinary skill in the art will recognize some variations based on the teaching described herein. Some of the steps may comprise sub-steps. Some of the steps may be repeated as often as desired. One or more steps of the method 2000 may be performed with any suitable fabrication system or device, such as the embodiments described herein. Some of the steps may be optional, and the order of the steps can be varied as desired.
In block 2102, a digital representation of a patient's teeth is received. The digital representation can include surface topography data for the patient's intraoral cavity (including teeth, gingival tissues, etc.). The surface topography data can be generated by directly scanning the intraoral cavity, a physical model (positive or negative) of the intraoral cavity, or an impression of the intraoral cavity, using a suitable scanning device (e.g., a handheld scanner, desktop scanner, etc.).
In block 2104, one or more treatment stages are generated based on the digital representation of the teeth. The treatment stages can be incremental repositioning stages of an orthodontic treatment procedure designed to move one or more of the patient's teeth from an initial tooth arrangement to a target arrangement. For example, the treatment stages can be generated by determining the initial tooth arrangement indicated by the digital representation, determining a target tooth arrangement, and determining movement paths of one or more teeth in the initial arrangement necessary to achieve the target tooth arrangement. The movement path can be optimized based on minimizing the total distance moved, preventing collisions between teeth, avoiding tooth movements that are more difficult to achieve, or any other suitable criteria.
In block 2106, at least one orthodontic appliance is fabricated based on the generated treatment stages. For example, a set of appliances can be fabricated, each shaped according to a tooth arrangement specified by one of the treatment stages, such that the appliances can be sequentially worn by the patient to incrementally reposition the teeth from the initial arrangement to the target arrangement. The appliance set may include one or more of the orthodontic appliances described herein. The fabrication of the appliance may involve creating a digital model of the appliance to be used as input to a computer-controlled fabrication system. The appliance can be formed using direct fabrication methods, indirect fabrication methods, or combinations thereof, as desired.
In some instances, staging of various arrangements or treatment stages may not be necessary for design and/or fabrication of an appliance. As illustrated by the dashed line in
The techniques described herein can be used for the direct fabrication of dental appliances, such as aligners and/or a series of aligners with tooth-receiving cavities configured to move a person's teeth from an initial arrangement toward a target arrangement in accordance with a treatment plan. Aligners can include mandibular repositioning elements, such as those described in U.S. Pat. No. 10,912,629, entitled “Dental Appliances with Repositioning Jaw Elements,” filed Nov. 30, 2015; U.S. Pat. No. 10,537,406, entitled “Dental Appliances with Repositioning Jaw Elements,” filed Sep. 19, 2014; and U.S. Pat. No. 9,844,424, entitled “Dental Appliances with Repositioning Jaw Elements,” filed Feb. 21, 2014; all of which are incorporated by reference herein in their entirety.
The techniques used herein can also be used to manufacture attachment fabrication templates, e.g., appliances used to position pre-fabricated attachments on a person's teeth in accordance with one or more aspects of a treatment plan. Examples of attachment fabrication templates can be found at least in: U.S. application Ser. No. 17/249,218, entitled, “Flexible 3D Printed Orthodontic Device,” filed Feb. 24, 2021; U.S. application Ser. No. 16/366,686, entitled, “Dental Attachment Placement Structure,” filed Mar. 27, 2019; U.S. application Ser. No. 15/674,662, entitled, “Devices and Systems for Creation of Attachments,” filed Aug. 11, 2017; U.S. Pat. No. 11,103,330, entitled, “Dental Attachment Placement Structure,” filed Jun. 14, 2017; U.S. application Ser. No. 14/963,527, entitled, “Dental Attachment Placement Structure,” filed Dec. 9, 2015; U.S. application Ser. No. 14/939,246, entitled, “Dental Attachment Placement Structure,” filed Nov. 12, 2015; U.S. application Ser. No. 14/939,252, entitled, “Dental Attachment Formation Structures,” filed Nov. 12, 2015; and U.S. Pat. No. 9,700,385, entitled, “Attachment Structure,” filed Aug. 22, 2014; all of which are incorporated by reference herein in their entirety.
The techniques described herein can be used to make incremental palatal expanders and/or a series of incremental palatal expanders used to expand a person's palate from an initial position toward a target position in accordance with one or more aspects of a treatment plan. Examples of incremental palatal expanders can be found at least in: U.S. application Ser. No. 16/380,801, entitled, “Releasable Palatal Expanders,” filed Apr. 10, 2019; U.S. application Ser. No. 16/022,552, entitled, “Devices, Systems, and Methods for Dental Arch Expansion,” filed Jun. 28, 2018; U.S. Pat. No. 11,045,283, entitled, “Palatal Expander with Skeletal Anchorage Devices,” filed Jun. 8, 2018; U.S. application Ser. No. 15/831,159, entitled “Palatal Expanders and Methods of Expanding a Palate,” filed Dec. 4, 2017; U.S. Pat. No. 10,993,783, entitled, “Methods and Apparatuses for Customizing a Rapid Palatal Expander,” filed Dec. 4, 2017; and U.S. Pat. No. 7,192,273, entitled, “System and Method for Palatal Expansion,” filed Aug. 7, 2003; all of which are incorporated by reference herein in their entirety.
EXAMPLESThe following examples are included to further describe some aspects of the present technology, and should not be used to limit the scope of the technology.
1. A method comprising:
-
- receiving a treatment plan comprising a target tooth arrangement and a plurality of intermediate tooth arrangements configured to adjust a patient's teeth from an initial tooth arrangement toward the target tooth arrangement, wherein the target tooth arrangement comprises a change in mass of at least one tooth; and
- outputting a graphical user interface comprising a visualization of the treatment plan, wherein the visualization comprises:
- a plurality of digital models, each digital model representing a corresponding intermediate tooth arrangement of the plurality of intermediate tooth arrangements, and
- a heatmap overlaid onto at least one digital model of the plurality of digital models, wherein the heatmap shows a difference in tooth mass between the target tooth arrangement and the corresponding at least one intermediate tooth arrangement of the at least one digital model.
2. The method of Example 1, wherein the change in the mass of the at least one tooth comprises a tooth mass addition, a tooth mass reduction, or a combination thereof.
3. The method of Example 1 or 2, wherein the target tooth arrangement comprises at least one restorative object applied to the at least one tooth.
4. The method of Example 3, wherein the at least one restorative object comprises one or more of the following: a crown, a veneer, edge bonding, a composite, an implant, or a prosthetic.
5. The method of Example 3 or 4, wherein the visualization comprises a restoratives model overlaid onto the at least one digital model and representing the at least one restorative object.
6. The method of Example 5, further comprising receiving user input adjusting an opacity of the restoratives model.
7. The method of any one of Examples 1 to 6, wherein the heatmap shows locations and amounts of tooth mass reduction.
8. The method of any one of Examples 1 to 7, wherein the heatmap shows locations and amounts of tooth mass addition.
9. The method of any one of Examples 1 to 8, wherein the heatmap comprises a plurality of colors representing distances between a surface of the at least one intermediate tooth arrangement and a surface of the target tooth arrangement.
10. The method of Example 9, wherein the plurality of colors comprise a first set of colors representing tooth mass reduction grades, and a second set of colors representing tooth mass addition grades.
11. The method of any one of Examples 1 to 10, wherein the heatmap shows a difference in tooth mass between each of the plurality of intermediate tooth arrangements and the target tooth arrangement.
12. The method of any one of Examples 1 to 11, further comprising: receiving user input indicating a modification to the treatment plan, and updating the heatmap based on the modification.
13. The method of Example 12, wherein the modification comprises one or more of the following: an adjustment to a position of a tooth, an addition of a restorative object to a tooth, a removal of a restorative object from a tooth, an adjustment to a position of a restorative object, an adjustment to a shape of a restorative object, or an adjustment to a gingival margin.
14. The method of any one of Examples 1 to 13, wherein the visualization comprises a patient image.
15. The method of Example 14, wherein the visualization shows one or more smile lines overlaid onto the patient image.
16. The method of Example 15, wherein the one or more smile lines represent parameters of a target smile for the patient.
17. The method of Example 15 or 16, wherein the one or more smile lines comprise one or more of the following: a facial midline, an intercanine width line, a gingival line, an incisal edge line, a horizontal line, or a tooth outline.
18. The method of any one of Examples 15 to 17, further comprising receiving user input modifying the one or more smile lines.
19. The method of any one of Examples 1 to 18, wherein the visualization comprises a composite image comprising the at least one digital model overlaid onto an image of the patient's face.
20. The method of Example 19, further comprising: receiving user input indicating a modification to the treatment plan, and updating the composite image based on the modification.
21. A system for planning a treatment for a patient's teeth, the system comprising:
-
- one or more processors; and
- a memory operably coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
- receiving a treatment plan comprising a target tooth arrangement and a plurality of intermediate tooth arrangements configured to adjust the patient's teeth from an initial tooth arrangement toward the target tooth arrangement, wherein the target tooth arrangement comprises a change in mass of at least one tooth, and
- outputting a graphical user interface comprising a visualization of the treatment plan, wherein the visualization comprises:
- a plurality of digital models, each digital model representing a corresponding intermediate tooth arrangement of the plurality of intermediate tooth arrangements, and
- a heatmap overlaid onto at least one digital model of the plurality of digital models, wherein the heatmap shows a difference in tooth mass between the target tooth arrangement and the corresponding at least one intermediate tooth arrangement of the at least one digital model.
22. A non-transitory computer-readable storage medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:
-
- receiving a treatment plan comprising a target tooth arrangement and a plurality of intermediate tooth arrangements configured to adjust a patient's teeth from an initial tooth arrangement toward the target tooth arrangement, wherein the target tooth arrangement comprises a change in mass of at least one tooth; and
- outputting a graphical user interface comprising a visualization of the treatment plan, wherein the visualization comprises:
- a plurality of digital models, each digital model representing a corresponding intermediate tooth arrangement of the plurality of intermediate tooth arrangements, and
- a heatmap overlaid onto at least one digital model of the plurality of digital models, wherein the heatmap shows a difference in tooth mass between the target tooth arrangement and the corresponding at least one intermediate tooth arrangement of the at least one digital model.
23. A method comprising:
-
- receiving input data representing an initial tooth arrangement of a patient's teeth;
- determining a target tooth arrangement for the patient's teeth, wherein the target tooth arrangement comprises a change in mass of at least one tooth;
- generating a plurality of intermediate tooth arrangements configured to adjust the patient's teeth from the initial tooth arrangement toward the target tooth arrangement; and
- generating instructions to output a visualization showing a difference in tooth mass between at least one intermediate tooth arrangement of the plurality of intermediate tooth arrangements and the target tooth arrangement.
24. The method of Example 23, wherein the change in the mass of the at least one tooth comprises addition of a restorative object to adjust a shape of an existing tooth or to replace a missing tooth.
25. The method of Example 24, wherein the restorative object comprises a temporary restoration or a permanent restoration.
26. The method of Example 24 or 25, wherein the restorative object comprises a crown, a veneer, edge bonding, a composite, an implant, or a prosthetic.
27. The method of any one of Examples 23 to 26, wherein the change in the mass of the at least one tooth comprises removal of a portion of an existing tooth.
28. The method of any one of Examples 23 to 27, wherein determining the target tooth arrangement comprises:
-
- determining a tooth arrangement to be achieved through orthodontic repositioning; and
- generating the target tooth arrangement by applying one or more restorative adjustments to the tooth arrangement.
29. The method of Example 28, wherein the one or more restorative adjustments comprise changing a shape of a tooth in the tooth arrangement.
30. The method of Example 28 or 29, wherein the one or more restorative adjustments are determined based on unique facial features of the patient.
31. The method of any one of Examples 28 to 30, wherein the one or more restorative adjustments are determined based on a plurality of facial lines defining a target smile for the patient.
32. The method of any one of Examples 23 to 31, further comprising comparing the at least one intermediate tooth arrangement to the target tooth arrangement to determine the difference in tooth mass.
33. The method of Example 32, wherein the comparing comprises measuring a distance between a surface of the at least one intermediate tooth arrangement and a surface of the target tooth arrangement.
34. The method of Example 32 or 33, wherein the comparing comprises identifying a region of a tooth in the at least one intermediate tooth arrangement that is protruded or recessed relative to a corresponding region of the tooth in the target tooth arrangement.
35. The method of any one of Examples 23 to 34, wherein the visualization comprises a heatmap overlay.
36. The method of any one of Examples 23 to 35, further comprising:
-
- receiving user input indicating a modification to the target tooth arrangement,
- generating a modified target tooth arrangement based on the modification, and
- generating instructions to update the visualization to show a difference in tooth mass between the at least one intermediate tooth arrangement and the modified target tooth arrangement.
37. The method of Example 36, wherein the modification comprises one or more of the following: an adjustment to a position of a tooth, an addition of a restorative object to a tooth, a removal of a restorative object from a tooth, an adjustment to a position of a restorative object, an adjustment to a shape of a restorative object, or an adjustment to a gingival margin.
38. The method of any one of Examples 23 to 37, further comprising generating instructions for manufacturing a plurality of orthodontic appliances configured to adjust the patient's teeth from the initial tooth arrangement toward the target tooth arrangement.
39. The method of Example 38, wherein the plurality of orthodontic appliances comprise a plurality of polymeric shell aligners.
40. The method of any one of Examples 23 to 39, further comprising generating instructions for applying or manufacturing a restorative object corresponding to change in the mass of the at least one tooth.
41. The method of any one of Examples 23 to 40, further comprising:
-
- receiving user input indicating a selected intermediate tooth arrangement of the plurality of intermediate tooth arrangements, and
- generating a treatment plan for the patient, wherein the treatment plan comprises: (1) a plurality of orthodontic appliances configured to reposition the patient's teeth from the initial tooth arrangement toward the selected intermediate tooth arrangement, and (2) one or more restorative procedures configured to compensate for a difference in tooth mass between the selected intermediate tooth arrangement and the target tooth arrangement.
42. The method of Example 41, wherein the treatment plan comprises: (1) a shorter duration compared to an alternative treatment plan in which the patient's teeth are repositioned from the initial tooth arrangement toward the target tooth arrangement, and (2) a larger change in the mass of the at least one tooth compared to the alternative treatment plan.
43. The method of any one of Examples 23 to 42, further comprising:
-
- receiving image data of the patient's face,
- determining one or more facial lines based on the image data, and
- generating the target tooth arrangement based on the one or more facial lines.
44. The method of Example 43, wherein the image data comprises a single image.
45. The method of Example 43, wherein the image data comprises a plurality of images.
46. The method of Example 45, wherein the plurality of images comprise image frames of a video.
47. The method of Example 45 or 46, further comprising selecting at least one image from the plurality of images, wherein the one or more facial lines are determined using the at least one image.
48. The method of Example 47, wherein the at least one image is selected based on one or more of the following criteria: position of the patient's head, position of the patient's mouth, visibility of the patient's face, visibility of the patient's teeth, clarity of the patient's mouth, resolution of the patient's mouth, or whether the patient's eyes are open.
49. The method of any one of Examples 43 to 48, further comprising adjusting the image data to a vertical orientation before determining the one or more facial lines.
50. The method of any one of Examples 43 to 49, wherein determining the one or more facial lines comprises:
identifying a plurality of facial landmarks in the image data, and
-
- determining the one or more facial lines based on the plurality of facial landmarks.
51. The method of any one of Examples 43 to 50, wherein the one or more facial lines define a target smile for the patient.
52. The method of any one of Examples 43 to 51, where the one or more facial lines comprise one or more of the following: a facial midline, an intercanine width line, an incisal edge line, a gingival edge line, a horizontal line, or a tooth outline.
53. The method of any one of Examples 43 to 52, wherein the visualization comprises the one or more facial lines.
54. The method of Example 53, wherein the visualization is overlaid onto the image data of the patient's face.
55. The method of Example 53 or 54, further comprising receiving user input indicating a modification to the one or more facial lines.
56. The method of any one of Examples 23 to 55, wherein the input data comprises one or more of the following: images, videos, scan data, MRI data, CT data, CBCT data, or motion data.
57. The method of any one of Examples 23 to 56, wherein the input data comprises one or more of the following: 2D data, 3D data, or 4D data.
58. The method of Example 56 or 57, further comprising generating a combined anatomical model based on the input data, wherein the visualization comprises the combined anatomical model.
59. The method of Example 58, wherein the combined anatomical model comprises a plurality of layers, and wherein at least some of the plurality of layers are generated using different data types.
60. The method of Example 58 or 59, wherein the combined anatomical model is a static model.
61. The method of Example 58 or 59, wherein the combined anatomic model is a dynamic model.
62. The method of any one of Examples 56 to 61, further comprising generating a digital representation of the initial tooth arrangement based on the input data.
63. The method of any one of Examples 56 to 62, further comprising determining one or more craniofacial landmarks based on the input data.
64. The method of Example 63, further comprising determining a target smile based on the one or more craniofacial landmarks.
65. The method of any one of Examples 23 to 64, wherein the input data comprises a patient image that is automatically selected from a video.
66. The method of any one of Examples 23 to 65, wherein the input data comprises a patient image that is automatically selected using a trained machine learning algorithm.
67. A system for planning a treatment for a patient's teeth, the system comprising: one or more processors; and
-
- a memory operably coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
- receiving input data representing an initial tooth arrangement of the patient's teeth,
- determining a target tooth arrangement for the patient's teeth, wherein the target arrangement comprises a change in mass of at least one tooth,
- generating a plurality of intermediate tooth arrangements configured to adjust the patient's teeth from the initial tooth arrangement toward the target tooth arrangement, and
- generating instructions to output a visualization showing a difference in tooth mass between at least one intermediate tooth arrangement of the plurality of intermediate tooth arrangements and the target tooth arrangement.
- a memory operably coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
68. A non-transitory computer-readable storage medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:
-
- receiving input data representing an initial tooth arrangement of a patient's teeth;
- determining a target tooth arrangement for the patient's teeth, wherein the target tooth arrangement comprises a change in mass of at least one tooth;
- generating a plurality of intermediate tooth arrangements configured to adjust the patient's teeth from the initial tooth arrangement toward the target tooth arrangement; and
- generating instructions to output a visualization showing a difference in tooth mass between at least one intermediate tooth arrangement of the plurality of tooth arrangements and the target tooth arrangement.
69. A method comprising:
-
- receiving an image of a patient's face;
- determining a plurality of facial lines using the image of the patient's face, wherein the plurality of facial lines represent a target smile for the patient; and
- outputting a visualization comprising the plurality of facial lines overlaid onto a composite image, wherein the composite image comprises the image of the patient's face combined with a digital model of the patient's teeth, and wherein the digital model represents a tooth arrangement of a treatment plan to adjust the patient's teeth from an initial arrangement toward a target tooth arrangement corresponding to the target smile.
70. The method of Example 69, further comprising selecting the image from a plurality of images of the patient's face.
71. The method of Example 70, wherein the plurality of images comprise image frames of a video.
72. The method of Example 70 or 71, wherein the image is selected using a machine learning algorithm.
73. The method of any one of Examples 70 to 72, wherein the image is selected based on one or more of the following criteria: position of the patient's head, position of the patient's mouth, visibility of the patient's face, visibility of the patient's teeth, clarity of the patient's mouth, resolution of the patient's mouth, or whether the patient's eyes are open.
74. The method of any one of Examples 69 to 73, further comprising adjusting the image before determining the plurality of facial lines.
75. The method of Example 74, wherein adjusting the image comprises rotating the image to a vertical orientation.
76. The method of Example 75, wherein rotating the image to the vertical orientation comprises:
-
- identifying a set of first facial landmarks in the image,
- generating a mirrored image comprising a set of second facial landmarks,
- matching each first facial landmark to a corresponding second facial landmark by one or more of rotating or translating the mirrored image,
- determining a matching angle for the mirrored image, and
- rotating the image by the matching angle.
77. The method of any one of Examples 69 to 76, wherein determining the plurality of facial lines comprises:
identifying a plurality of facial landmarks in the image, and
-
- determining the plurality of facial lines based on the plurality of facial landmarks.
78. The method of Example 77, wherein determining the plurality of facial lines comprises:
-
- determining a face type of the patient,
- calculating one or more orthodontic parameters based on the face type, and
- determining at least some of the facial lines based on the one or more orthodontic parameters.
79. The method of Example 78, wherein the one or more orthodontic parameters are calculated using a continuous function relating a value of the one or more orthodontic parameters to the face type of the patient.
80. The method of any one of Examples 69 to 79, where the plurality of facial lines comprise one or more of the following: a facial midline, an intercanine width line, an incisal edge line, a gingival edge line, a horizontal line, or a tooth outline.
81. The method of any one of Examples 69 to 80, further comprising receiving user input indicating a modification to at least one facial line.
82. The method of any one of Examples 69 to 81, wherein the visualization comprises a plurality of digital models representing a plurality of intermediate tooth arrangements configured to adjust a patient's teeth from the initial tooth arrangement toward the target tooth arrangement.
83. The method of Example 82, wherein the target tooth arrangement comprises a change in mass of at least one tooth.
84. The method of Example 83, wherein the change in the mass of the at least one tooth comprises one or more of a tooth mass addition or a tooth mass reduction.
85. The method of Example 83 or 84, wherein the change in the mass of the at least one tooth comprises addition of a restorative object to adjust a shape of an existing tooth or to replace a missing tooth.
86. The method of Example 85, wherein the restorative object comprises a crown, a veneer, edge bonding, a composite, an implant, or a prosthetic.
87. The method of any one of Examples 82 to 86, wherein the composite image is displayed concurrently with at least one digital model of the plurality of digital models.
88. The method of any one of Examples 82 to 87, further comprising receiving user input indicating a modification to the target tooth arrangement, wherein the modification is generated based on the plurality of facial lines.
89. A system for planning a treatment for a patient's teeth, the system comprising:
-
- a processor; and
- a memory operably coupled to the processor and storing instructions that, when executed by the processor, cause the system to perform operations comprising: receiving an image of the patient's face,
- determining a plurality of facial lines using the image of the patient's face, wherein the plurality of facial lines represent a target smile for the patient, and
- outputting a visualization comprising the plurality of facial lines overlaid onto a composite image, wherein the composite image comprises the image of the patient's face combined with a digital model of the patient's teeth, and wherein the digital model represents a tooth arrangement of a treatment plan to adjust the patient's teeth from an initial arrangement toward a target tooth arrangement corresponding to the target smile.
90. A non-transitory computer-readable storage medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:
-
- receiving an image of a patient's face;
- determining a plurality of facial lines using the image of the patient's face, wherein the plurality of facial lines represent a target smile for the patient; and
- outputting a visualization comprising the plurality of facial lines overlaid onto a composite image, wherein the composite image comprises the image of the patient's face combined with a digital model of the patient's teeth, and wherein the digital model represents a tooth arrangement of a treatment plan to adjust the patient's teeth from an initial arrangement toward a target tooth arrangement corresponding to the target smile.
91. A method comprising:
-
- receiving a digital representation of a target tooth arrangement for a patient's teeth, wherein the target tooth arrangement includes at least one tooth that is modified with at least one restorative object;
- determining a target tooth preparation for the at least one tooth to accommodate the at least one restorative object;
- receiving a digital representation of an actual tooth preparation of the at least one tooth; and
- outputting a visualization showing a difference in tooth mass between the target tooth preparation and the actual tooth preparation.
92. The method of Example 91, wherein the at least one restorative object comprises a temporary restoration or a permanent restoration.
93. The method of Example 91 or 92, wherein the at least one restorative object comprises one or more of a crown, a veneer, edge bonding, a composite, an implant, or a prosthetic.
94. The method of any one of Examples 91 to 93, wherein the target tooth preparation comprises tooth mass reduction to accommodate the at least one restorative object.
95. The method of Example 94, wherein the tooth mass reduction is configured to create a mounting surface on the at least one tooth for the at least one restorative object.
96. The method of any one of Examples 91 to 95, wherein determining the target tooth preparation comprises:
receiving a first digital representation depicting an initial geometry of the at least one tooth,
-
- generating a second digital representation depicting the at least one tooth with one or more portions removed to accommodate the at least one restorative object.
97. The method of any one of Examples 91 to 96, wherein the digital representation of the actual tooth preparation comprises intraoral scan data.
98. The method of any one of Examples 91 to 97, further comprising determining the difference in tooth mass by comparing the digital representation of the target tooth representation to the digital representation of the actual tooth preparation.
99. The method of Example 98, wherein the comparing comprises measuring a distance between a surface of the actual tooth preparation and a surface of the target tooth preparation.
100. The method of Example 98 or 99, wherein the comparing comprises identifying a region of the at least one tooth in the actual tooth preparation that is protruded or recessed relative to a corresponding region of the at least one tooth in the target tooth preparation.
101. The method of any one of Examples 91 to 100, wherein the visualization comprises a heatmap overlay showing the difference in tooth mass.
102. The method of Example 101, wherein the heatmap comprises a plurality of colors representing distances between a surface of the actual tooth preparation and a surface of the target tooth preparation.
103. The method of any one of Examples 91 to 102, further comprising identifying one or more locations in the actual tooth preparation where additional tooth mass reduction is prescribed.
104. The method of Example 103, wherein the one or more locations comprise added mass relative to the target tooth preparation that exceeds a predetermined threshold.
105. The method of Example 103 or 104, wherein the visualization includes one or more indicators marking the one or more locations.
106. A system for planning a treatment for a patient's teeth, the system comprising:
-
- a processor; and
- a memory operably coupled to the processor and storing instructions that, when executed by the processor, cause the system to perform operations comprising:
- receiving a digital representation of a target tooth arrangement for the patient's teeth, wherein the target tooth arrangement includes at least one tooth that is modified with at least one restorative object,
- determining a target tooth preparation for the at least one tooth to accommodate the at least one restorative object,
- receiving a digital representation of an actual tooth preparation of the at least one tooth, and
- outputting a visualization showing a difference in tooth mass between the target tooth preparation and the actual tooth preparation.
107. A non-transitory computer-readable storage medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:
-
- receiving a digital representation of a target tooth arrangement for a patient's teeth, wherein the target tooth arrangement includes at least one tooth that is modified with at least one restorative object;
- determining a target tooth preparation for the at least one tooth to accommodate the at least one restorative object;
- receiving a digital representation of an actual tooth preparation of the at least one tooth; and
- outputting a visualization showing a difference in tooth mass between the target tooth preparation and the actual tooth preparation.
Although many of the embodiments are described above with respect to systems, devices, and methods for ortho-restorative treatment planning, the technology is applicable to other applications and/or other approaches, such as other types of dental treatments (e.g., orthodontics-only treatments, restorative-only treatments) or other types of treatments applied to a patient's craniofacial region (e.g., orthognathic treatments, plastic surgery, cosmetics). Moreover, other embodiments in addition to those described herein are within the scope of the technology. Additionally, several other embodiments of the technology can have different configurations, components, or procedures than those described herein. A person of ordinary skill in the art, therefore, will accordingly understand that the technology can have other embodiments with additional elements, or the technology can have other embodiments without several of the features shown and described above with reference to
The various processes described herein can be partially or fully implemented using program code including instructions executable by one or more processors of a computing system for implementing specific logical functions or steps in the process. The program code can be stored on any type of computer-readable medium, such as a storage device including a disk or hard drive. Computer-readable media containing code, or portions of code, can include any appropriate media known in the art, such as non-transitory computer-readable storage media. Computer-readable media can include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage and/or transmission of information, including, but not limited to, random-access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or other memory technology; compact disc read-only memory (CD-ROM), digital video disc (DVD), or other optical storage; magnetic cassettes, magnetic tape, magnetic disk storage, or other magnetic storage devices; solid state drives (SSD) or other solid state storage devices; or any other medium which can be used to store the desired information and which can be accessed by a system device.
The descriptions of embodiments of the technology are not intended to be exhaustive or to limit the technology to the precise form disclosed above. Where the context permits, singular or plural terms may also include the plural or singular term, respectively. Although specific embodiments of, and examples for, the technology are described above for illustrative purposes, various equivalent modifications are possible within the scope of the technology, as those skilled in the relevant art will recognize. For example, while steps are presented in a given order, alternative embodiments may perform steps in a different order. The various embodiments described herein may also be combined to provide further embodiments.
As used herein, the terms “generally,” “substantially,” “about,” and similar terms are used as terms of approximation and not as terms of degree, and are intended to account for the inherent variations in measured or calculated values that would be recognized by those of ordinary skill in the art.
Moreover, unless the word “or” is expressly limited to mean only a single item exclusive from the other items in reference to a list of two or more items, then the use of “or” in such a list is to be interpreted as including (a) any single item in the list, (b) all of the items in the list, or (c) any combination of the items in the list. As used herein, the phrase “and/or” as in “A and/or B” refers to A alone, B alone, and A and B. Additionally, the term “comprising” is used throughout to mean including at least the recited feature(s) such that any greater number of the same feature and/or additional types of other features are not precluded.
To the extent any materials incorporated herein by reference conflict with the present disclosure, the present disclosure controls.
It will also be appreciated that specific embodiments have been described herein for purposes of illustration, but that various modifications may be made without deviating from the technology. Further, while advantages associated with certain embodiments of the technology have been described in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the technology. Accordingly, the disclosure and associated technology can encompass other embodiments not expressly shown or described herein.
Claims
1. A method comprising:
- receiving an image of a patient's face;
- determining a plurality of facial lines using the image of the patient's face, wherein the plurality of facial lines represent a target smile for the patient; and
- outputting a visualization comprising the plurality of facial lines overlaid onto a composite image, wherein the composite image comprises the image of the patient's face combined with a digital model of the patient's teeth, and wherein the digital model represents a tooth arrangement of a treatment plan to adjust the patient's teeth from an initial arrangement toward a target tooth arrangement corresponding to the target smile.
2. The method of claim 1, further comprising selecting the image from a plurality of images of the patient's face.
3. The method of claim 2, wherein the plurality of images comprise image frames of a video.
4. The method of claim 2, wherein the image is selected using a machine learning algorithm.
5. The method of claim 2, wherein the image is selected based on one or more of the following criteria: position of the patient's head, position of the patient's mouth, visibility of the patient's face, visibility of the patient's teeth, clarity of the patient's mouth, resolution of the patient's mouth, or whether the patient's eyes are open.
6. The method of claim 1, further comprising adjusting the image before determining the plurality of facial lines.
7. The method of claim 6, wherein adjusting the image comprises rotating the image to a vertical orientation.
8. The method of claim 7, wherein rotating the image to the vertical orientation comprises:
- identifying a set of first facial landmarks in the image,
- generating a mirrored image comprising a set of second facial landmarks,
- matching each first facial landmark to a corresponding second facial landmark by one or more of rotating or translating the mirrored image,
- determining a matching angle for the mirrored image, and
- rotating the image by the matching angle.
9. The method of claim 1, wherein determining the plurality of facial lines comprises:
- identifying a plurality of facial landmarks in the image, and
- determining the plurality of facial lines based on the plurality of facial landmarks.
10. The method of claim 9, wherein determining the plurality of facial lines comprises:
- determining a face type of the patient,
- calculating one or more orthodontic parameters based on the face type, and
- determining at least some of the facial lines based on the one or more orthodontic parameters.
11. The method of claim 10, wherein the one or more orthodontic parameters are calculated using a continuous function relating a value of the one or more orthodontic parameters to the face type of the patient.
12. The method of claim 1, where the plurality of facial lines comprise one or more of the following: a facial midline, an intercanine width line, an incisal edge line, a gingival edge line, a horizontal line, or a tooth outline.
13. The method of claim 1, further comprising receiving user input indicating a modification to at least one facial line.
14. The method of claim 1, wherein the visualization comprises a plurality of digital models representing a plurality of intermediate tooth arrangements configured to adjust a patient's teeth from the initial tooth arrangement toward the target tooth arrangement.
15. The method of claim 14, wherein the target tooth arrangement comprises a change in mass of at least one tooth.
16. The method of claim 15, wherein the change in the mass of the at least one tooth comprises one or more of a tooth mass addition or a tooth mass reduction.
17. The method of claim 15, wherein the change in the mass of the at least one tooth comprises addition of a restorative object to adjust a shape of an existing tooth or to replace a missing tooth.
18. The method of claim 17, wherein the restorative object comprises a crown, a veneer, edge bonding, a composite, an implant, or a prosthetic.
19. The method of claim 14, wherein the composite image is displayed concurrently with at least one digital model of the plurality of digital models.
20. The method of claim 1, further comprising receiving user input indicating a modification to the target tooth arrangement, wherein the modification is generated based on the plurality of facial lines.
Type: Application
Filed: Oct 27, 2022
Publication Date: Apr 27, 2023
Inventors: Dmitry Yurievich Chekh (Moscow), David Patrick Lopes (El Dorado Hills, CA), Vladislav Andreevich Miryaha (Dolgoprudny), Elena Agilina (New York, NY), Boris Aleksandrovich Vysokanov (Moscow), Vera Vladimirovna Kadrul (Moscow), Alexey Lisitsin (Chelyabinsk), Valery Prokoshev (Vladimir), Aleksandr Sergeevich Karsakov (Moscow), David Khzmalyan (Moscow), Sergey Borisovich Surov (Zelenogradsk)
Application Number: 18/050,295
