Abstract: Systems, methodologies, media, and other embodiments associated with facilitating intra-procedurally determining the position of an internal anatomical target location using an externally measurable parameter are described. One exemplary method embodiment includes pre-procedurally correlating internal anatomy motion with external marker motion. The example method may also include providing computer graphics to an augmented reality system during a percutaneous procedure to facilitate image guiding an interventional device with respect to the internal anatomy.

Abstract: A method for visualization of dynamic three-dimensional (3D) virtual objects comprises storing a plurality of static 3D key-models respectively describing a dynamic 3D object in at least one of a number of poses and shapes; and rendering the dynamic 3D object by interpolation of the 3D key-models by performing the interpolation in a vertex shader program of a programmable graphics processing unit (GPU).

Abstract: A method for local 3-dimensional (3D) reconstruction from 2-dimensional (2D) ultrasound images includes deriving a 2D image of an object; defining a target region within said 2D image; defining a volume scan period; during the volume scan period, deriving further 2D images of the target region and storing respective pose information for the further 2D images; and reconstructing a 3D image representation for the target region by utilizing the 2D images and the respective pose information.

Abstract: A system and method for registering pre-operative images of an object with an intra-operative image of the object is disclosed. Prior to an operative procedure, Digitally Reconstructed Radiographs (DRRs) are generated for the pre-operative images of each individual patient. Signatures are extracted from the DRRs. The signatures are stored in a knowledge base. During the operative procedure, a signature is extracted from the intra-operative image. The intra-operative signature is compared to the stored pre-operative signatures. A pre-operative image having a best signature match to the intra-operative signature is retrieved. The retrieved pre-operative image is registered with the intra-operative image.

Abstract: Exemplary systems and methods for performing registration applications are provided. An exemplary system includes a central processing unit (CPU) for transferring a plurality of images to a graphics processing unit (GPU); wherein the GPU performs a registration application on the plurality of images to produce a registration result, and wherein the GPU returns the registration result to the CPU. An exemplary method includes the steps of transferring a plurality of images from a central processing unit (CPU) to a graphics processing unit (GPU); performing a registration application on the plurality of images using the GPU; transferring the result of the step of performing from the GPU to CPU.

Abstract: Exemplary methods are provided. In one exemplary method, a lower-dimension signature is generated for each of a plurality of data sets of a given dimension. Registration is performed on the lower-dimension signatures. In another exemplary method, a two-dimensional signature is generated for each of a plurality of three-dimensional volumes. Registration is performed on the two-dimensional signatures.

Abstract: A system and method for instrument placement using an image based navigation system is disclosed. A target of interest is identified in a medical image of a patient. An image plane is displayed that goes through a center of the target. The image plane has a configurable orientation. The image plane is used to select a path for an instrument from a position on the patient's skin to the center of the target. A trajectory plane is viewed from a tip of the instrument to the center of the target. The trajectory plane reflects an orientation of the instrument. A particular trajectory plane is selected that is representative of a desired orientation of the instrument. An image of the particular trajectory plane is frozen. The instrument can then be inserted using a virtual guide and is navigated toward the target.

Abstract: A method and system for modifying a radiation therapy treatment plan are disclosed. In one embodiment, a radiation therapy treatment plan based on a first medical diagnostic image of a target in a patient is provided. A second medical diagnostic image of the target is generated while the patient is disposed on a treatment surface of a radiation therapy device. A deformation of the target is determined using the second medical diagnostic image, and the radiation therapy treatment plan is modified based on the determined deformation. Other embodiments are provided, and each of the embodiments described herein can be used alone or in combination with one another.

Abstract: A system and method for registering pre-operative magnetic resonance (MR) images with intra-operative MR images is disclosed. A pre-operative MR image of an object is received. A set of intra-operative MR images of the object is received. The pre-operative MR image is rigidly registered with the initial intra-operative MR image. The subsequent set of intra-operative images is deformably registered. The pre-operative MR image undergoes both rigid and deformation transformation to match specification of each image with in intra-operative MR image set.

Abstract: A system and corresponding method for flexible generation of digitally reconstructed radiograph (DRR) images on a graphics processing unit (GPU) are provided, the system including a processor, an imaging adapter in signal communication with the processor for receiving volumetric data, an integration unit in signal communication with the processor for integrating the volumetric data into incremental line integrals, and a modeling unit in signal communication with the processor for modeling composite line integrals from the incremental line integrals; and the corresponding method including receiving three-dimensional (3D) volumetric data into a graphics pipeline, integrating the 3D volumetric data into incremental line integrals along a plurality of viewing rays, modeling composite line integrals from the incremental line integrals, and adding the incremental line integrals for each composite line integral to form pixels of the DRR image.

Abstract: A method for augmented reality navigation of a medical intervention includes providing a stereoscopic head mounted display, the display including a pair of stereo viewing cameras, at least one tracking camera, and a stereoscopic guidance display. During a medical intervention on a patient, the patient's body pose is determined from a rigid body transformation between the tracking camera and frame markers on the scanning table, and the pose of an intervention instrument with respect to the table is determined. A visual representation of the patient overlaid with an image of the intervention target, the instrument, and a path for guiding the instrument to perform said medical intervention is displayed in the stereoscopic guidance display.

Abstract: A system and method for positioning a patient for radiotherapy is provided. The method comprises: acquiring a first x-ray image sequence of a target inside the patient at a first angle; acquiring first respiratory signals of the patient while acquiring the first x-ray image sequence; acquiring a second x-ray image sequence of the target at a second angle; acquiring second respiratory signals of the patient while acquiring the second x-ray image sequence; synchronizing the first and second x-ray image sequences with the first and second respiratory signals to form synchronized first and second x-ray image sequences; identifying the target in the synchronized first and second x-ray image sequences; and determining three-dimensional (3D) positions of the target through time in the synchronized first and second x-ray image sequences.

Abstract: A method for visualization of ultrasound images comprises the steps of deriving ultrasound images of an object; freezing and storing in space and time selected ones of the images; displaying the selected ones of the images as a set; selectively freezing and adding to the set a further one of the images; and, optionally, selectively removing an image from the set.

Abstract: An ultrasound scanning system having an ultrasound transducer (10) which provides ultrasound images (33), a computer to process the ultrasound information and to render the ultrasound image (33) correctly positioned and scaled for display on a flat panel monitor (29) which has a display size similar to the actual physical size of the ultrasound image (33). A half silvered mirror (30) redirects the image (33) so that the user (32) perceives the image (33) as if it occupied the actual physical location of the structures (34, 35) appearing in the image (33). An illumination (22) unit projects onto a patient (13) a line of light (3) that is within the imaging plane (4) projected by the ultrasound transducer (10) into the patient (13). Alternatively a video camera may be used to display a guide line (15) that is coplanar with the imaging plane (4). A mechanical mount (16) combines the transducer (10), monitor (29), mirror (30), and source of illumination (22) or video camera in a correct geometrical alignment.

Abstract: An apparatus for pose determination using single camera tracking in a workspace includes a computer programmed for making the pose determination and a tracker camera coupled to the computer for providing a tracking image and for which calibration information is stored. A plurality of marker bodies bears markers adapted for attachment to respective objects to be tracked, the markers exhibiting characteristics for providing respective images of themselves in the tracking image, such that the respective images provide sufficient information in the tracking image for respective pose determination for each of the objects in conjunction with the calibration information.

Abstract: A system and method for providing a user interface for three-dimensional data sets includes a processing unit, a tracking unit in signal communication with the processing unit, a registration unit in signal communication with the processing unit, and a display unit in signal communication with the processing unit; where the method includes receiving an image representation of a physical base, registering an image representation of a virtual object of interest relative to the physical base, and providing an image representation of an interface tool relative to the physical base.

Abstract: A method for video assistance for ultrasound guided needle biopsy of a patient, includes the steps of obtaining an ultrasound image of said patient in an ultrasound imaging plane by way of a transducer head; obtaining a body surface video image of said patient including an area wherein said ultrasound imaging plane intersects said body surface, by way of a video camera mounted on said transducer head and having an optical axis lying in said ultrasound imaging plane such that said ultrasound imaging plane corresponds to a line in said video image; and overlaying graphic markers onto said video image for indicating said ultrasound imaging plane as a line of possible entry points for needle biopsy.

Abstract: An ultrasound scanning system having an ultrasound transducer (10) which provides ultrasound images (33), a computer to process the ultrasound information and to render the ultrasound image (33) correctly positioned and scaled for display on a flat panel monitor (29) which has a display size similar to the actual physical size of the ultrasound image (33). A half silvered mirror (30) redirects the image (33) so that the user (32) perceives the image (33) as if it occupied the actual physical location of the structures (34, 35) appearing in the image (33). An illumination (22) unit projects onto a patient (13) a line of light (3) that is within the imaging plane (4) projected by the ultrasound transducer (10) into the patient (13). Alternatively a video camera may be used to display a guide line (15) that is coplanar with the imaging plane (4). A mechanical mount (16) combines the transducer (10), monitor (29), mirror (30), and source of illumination (22) or video camera in a correct geometrical alignment.

Abstract: A method for video assistance for ultrasound guided needle biopsy of a patient, includes the steps of obtaining an ultrasound image of said patient in an ultrasound imaging plane by way of a transducer head; obtaining a body surface video image of said patient including an area wherein said ultrasound imaging plane intersects said body surface, by way of a video camera mounted on said transducer head and having an optical axis lying in said ultrasound imaging plane such that said ultrasound imaging plane corresponds to a line in said video image; and overlaying graphic markers onto said video image for indicating said ultrasound imaging plane as a line of possible entry points for needle biopsy.

Abstract: A method for local 3-dimensional (3D) reconstruction from 2-dimensional (2D) ultrasound images includes deriving a 2D image of an object; defining a target region within said 2D image; defining a volume scan period; during the volume scan period, deriving further 2D images of the target region and storing respective pose information for the further 2D images; and reconstructing a 3D image representation for the target region by utilizing the 2D images and the respective pose information.