Abstract: A system and method configured to better identify patient-specific anatomical landmarks, measure anatomical parameters and features, and predict the patient's need for surgery within a predetermined time period. In some embodiments, the system and method is configured to predict the likelihood or risk that a patient will require total hip arthroplasty. In some embodiments, the present invention includes machine learning technology Some embodiments of the present invention include a first ML machine configured to received medical images as inputs and identify anatomical landmarks as outputs; a measurement module to measure joint space width, hip dysplasia angles, and/or leg length differential; and a second ML machine configured to receive the anatomical measurements and patient demographic data as inputs and produce a risk or likelihood that the patient will require surgery within a certain time frame.

Abstract: A catheter-based imaging apparatus comprises a catheter having a proximal end and a distal end. An optical emitter is configured to emit optical excitation signals from a distal portion of the catheter. One or more ultrasound transducers are configured for: (a) transmission of acoustic excitation signals from the distal portion of the catheter; and (b) detection of ultrasound response signals from an object of interest at or near to the distal portion of the catheter at frequencies which include a lower receive frequency at least as low as 10 MHz and a higher receive frequency at least as high as 35 MHz. The one or more ultrasound transducers are thereby configured to detect response signals comprising photoacoustic response signals from the object of interest at the lower receive frequency and high resolution imaging signals from the object of interest at the higher receive frequency.

Abstract: A method and system for computer assisted orthopedic feedback of at least one surgical object relative a pre-operative plan are disclosed. The pre-operative plan includes a virtual object, which is the virtual representation of the surgical object, and a virtual structure, which is the virtual representation of the patient structure.

Abstract: An apparatus, system, and method are disclosed for monitoring the motion, breathing, heart rate of humans in a convenient and low-cost fashion, and for deriving and displaying useful measurements of cardiorespiratory performance from the measured signals. The motion, breathing, and heart rate signals are obtained through a processing applied to a raw signal obtained in a non-contact fashion, typically using a radio-frequency sensor. Processing into separate cardiac and respiratory components is described. The heart rate can be determined by using either spectral or time-domain processing. The respiratory rate can be calculated using spectral analysis. The sensor, processing, and display can be incorporated in a single device which can be worn or held close to the body while exercising, or alternately placed in a fixed piece of exercise equipment at some distance form the body, and may also be integrated with other sensors, such as position locators.

Abstract: An endoscope can include an elongated endoscope body. An optical fiber can extend along the endoscope body. The optical fiber can direct therapeutic light and illumination light longitudinally along the optical fiber to a distal portion of the endoscope body. The therapeutic light and the illumination light can have different wavelengths. A wavelength-sensitive light separator, disposed at a distal portion of the optical fiber, can direct the illumination light to exit the optical fiber laterally through a lateral side of the optical fiber at the distal portion of the optical fiber and permit the therapeutic light to exit the optical fiber longitudinally through a distal end of the optical fiber. Examples of suitable wavelength-sensitive light separators can include one or more fiber Bragg gratings that can be obliquely angled, or a diffraction grating disposed on a lateral edge of a length of coreless fiber.

Abstract: A method and device for tracking objects by surgical navigation systems. The method includes: capturing an image of the tracked object; determining whether a unique identifiable feature associated with at least one totem pattern is discernible in the image; when the unique identifiable feature is discernible: determining a position or an orientation of the tracked object based on the at least one totem pattern; and registering the at least one totem pattern in the surgical coordinate space; and when the unique identifiable feature is indiscernible: determining a position of each totem pattern relative to other totem patterns such that a combination of totem patterns within the captured image is a marker group detectable as a composite totem pattern; determining a position or an orientation of the tracked object based on the composite totem pattern associated with the tracked object; and registering the composite totem pattern in the surgical coordinate space.

Abstract: A vessel location assistance device having a housing with a proximal portion and a distal portion, an infrared light emitter adapted to emit infrared light from the housing to a patient and an infrared light receiver adapted to receive backscattered infrared light intensity reflected from the patient, wherein the received backscattered infrared light intensity is converted to a voltage and when the voltage is within a calibrated range the device indicates the presence of a blood vessel. The device may further include at least one wing with a slot for capturing the blood vessel.

Abstract: Perfusion angiography combined with photoplethysmography imaging for peripheral vascular disease assessment A device (13) and method for performing perfusion imaging receive image sequences that are acquired simultaneously by an X-ray imaging apparatus (2) and by a photoplethysmography imaging apparatus (3). When temporally aligned, changes in the perfusion states of a perfused organic tissue over time are extracted from the two image sequences and an image is generated for display on a display unit (5) which indicates the changes in the perfusion states at various locations of the perfused organ tissue, thereby capturing both deep organ tissue and superficial organ tissue perfusion properties. A diminution in an image signal strength in the photoplethysmography images caused by a passage of a bolus comprising a previously administered contrast agent (10) can be used to align the two concurrently acquired image sequences in time.

Abstract: Disclosed are a method and a system for visualizing X-ray positioning of a handheld X-ray machine. The method includes: acquiring video acquisition information and distance information from a preset distance acquisition module to an image receiving surface; processing the video acquisition information and the distance information and generating a processing result; and presenting a projection area of the X-ray based on the processing result.

Abstract: Disclosed are various examples and embodiments of systems, devices, components and methods configured to estimate the action potential wave propagation in a patient's heart, and subsequently to detect at least one location or type of at least one source of, or rotational phenomenon associated with, at least one cardiac rhythm disorder using intracardiac electrodes and a modified multi-frame Horn-Schunck algorithm to generate a map corresponding to a spatial map, the map being configured to reveal on a monitor or display to a user the at least one location of the at least one source of the at least one cardiac rhythm disorder.

Abstract: The present disclosure provides a system and method for motion field generation and image correction. The method may include obtaining a plurality of first sets of magnetic resonance (MR) image data of an object generated based on a plurality of first sets of imaging sequences. The method may include obtaining a motion curve of the object. The method may include obtaining position emission tomography (PET) image data of the object generated in a scanning time period. The method may include generating one or more target motion fields corresponding to the scanning time period based on the plurality of first sets of MR image data and the motion curve. The method may include generating one or more corrected PET images by correcting, based on the one or more target motion fields, the PET image data.

Abstract: A method for creating a patient-specific surgical plan includes receiving one or more pre-operative images of a patient having one or more infirmities affecting one or more anatomical joints. three-dimensional anatomical model of the one or more anatomical joints is created based on the one or more pre-operative images. One or more transfer functions and the three-dimensional anatomical model are used to identify a patient-specific implantation geometry that corrects the one or more infirmities. The transfer functions model performance of the one or more anatomical joints as a function of anatomical geometry and anatomical implantation features. surgical plan comprising the patient-specific implantation geometry may then be displayed.

Abstract: A method and system of compensating for body deformation during image acquisition or external beam treatment includes acquiring image data of a body and peak wavelength data from a plurality of fiber Bragg gratings (FBGs) disposed on the body aligned along a predetermined coordinate system on the body, such as a cartesian coordinate system. The method further comprises detecting effective shifts of the Bragg wavelengths of the FBGs caused by body deformation during image acquisition, and controlling the movement of the body through a cavity in a scanning device and controlling the acquisition of the image data or external beam treatment during body deformation based on the effective shifts of the Bragg wavelengths of the FBGs.

Abstract: An exemplary system is configured to obtain anatomical characteristic data representative of a characteristic associated with an anatomical surface to be covered by a physical medical element, the anatomical surface within an internal space of a patient and determine, based on the anatomical characteristic data, a placement guidance parameter set. The placement guidance parameter set may include one or more parameters configured to guide a placement of the physical medical element on the anatomical surface with one or more surgical instruments controlled by a computer-assisted surgical system.

Abstract: A wearable device can present virtual content to the wearer for many applications in a healthcare setting. The wearer may be a patient or a healthcare provider (HCP). Such applications can include, but are not limited to, access, display, and modification of patient medical records and sharing patient medical records among authorized HCPs.

Abstract: A process of monitoring heart valve function involves placing one or more transducers on a patient's body, receiving, using the one or more transducers, one or more signals indicating a blood flow velocity profile associated with a heart of the patient, identifying a first peak in the blood flow velocity profile, and determining a severity of a dysfunction of a first heart valve of the heart based on the first peak.

Abstract: Systems, devices, and methods are disclosed for characterizing joint attention. A method includes dynamically obtaining video streams of participants; dynamically obtaining gaze streams; dynamically providing a cue to the participants to view the object; dynamically detecting a joint gaze based on the gaze streams focusing on the object over a time interval; and dynamically providing feedback based on detecting the joint gaze.

Abstract: An embodiment of the invention provides a system for automatically deriving a parameter of a human heart from ultrasound results. A first neural network is arranged to receive a plurality of echocardiographic images and to classify the images into one of at least a two-chamber view and a four-chamber view. A second neural network is arranged to receive echocardiographic images comprising a two- or four-chamber view and to identify the endocardial border of the left ventricle (LV) for each view. End-systole and end-diastole images are then identified and a parameter such as LV volume, ejection fraction, global longitudinal strain and regional longitudinal strain is calculated.

Abstract: A location pad includes two or more field-generators, and a frame. The field-generators are configured to generate respective magnetic fields at least in a region-of-interest (ROI) of a patient organ, for measuring a position of a medical instrument in the ROI. The frame is coupled with tissue that is at least partially surrounding the organ and is configured to fix the two or more field-generators at respective positions surrounding the ROI.

Abstract: A method comprising capturing a pose of a surgical tool at a surgical site of a patient. The method includes determining a range of movement of the surgical tool at the surgical site, in response to the captured pose. The method includes displaying a representation of the determined range of movement onto an image associated with the surgical site. The method includes providing one or more instructions to limit a movement of a robotic device according to the determined range of movement.

Abstract: Systems, methods, and devices are provided for automatically adjusting the scale or magnification of an intraluminal image on a display of an intraluminal imaging system based on a measured or computed size of the vessel. For example, a system may include a processor configured to receive, from an intraluminal imaging catheter or guidewire, a first intraluminal image of a body lumen, and compute a dimension of an anatomical feature of the body lumen based on the first intraluminal image. The processor computes a scaling factor for the first intraluminal image based on the dimension of the body lumen, scales the first intraluminal image by the scaling factor, and outputs the scaled first intraluminal image to a display in communication with the processor circuit.

Abstract: A system for evaluating a battery cell includes an imaging device configured to take an image of at least part of the battery cell, and a processor. The processor is configured to perform: determining a region of interest in the acquired image, reducing a sharpness of the acquired image to generate a reference image, comparing the acquired image and the reference image, and identifying a discontinuity of the battery cell based on a difference between the acquired image and the reference image.

Abstract: Apparatus and methods are described including tracking a tool portion and a patient marker from a first line of sight, using a first tracking device disposed upon a first head-mounted device that includes a display. The tool portion and the patient marker are tracked from a second line of sight, using a second tracking device. When a portion of the patient marker and the tool portion are both within the first line of sight, an augmented reality image is generated upon the first display based upon data received from the first tracking device and without using data from the second tracking device. When at least the patient marker portion and the tool portion are not both within the first line of sight, a virtual image of the tool and anatomy of the patient is generated using data received from the second tracking device. Other applications are also described.

Abstract: Methods and systems are provided for identifying motion in medical images. In one example, a method includes obtaining projection data of an imaging subject, reconstructing a first image of a location of the imaging subject from the projection data using a first reconstruction technique and reconstructing a second image corresponding to the same location of the imaging subject from the of projection data using a second reconstruction technique, different than the first reconstruction technique in terms of temporal sensitivity, calculating an inconsistency metric quantifying temporal inconsistencies between the first image and the second image, and taking an action based on the inconsistency metric.

Abstract: The invention relates to a method for determining at least one property of an object, the method comprising a step of: a) obtaining first data relative to the object by an ultrasound imaging technique imaging the object at a frame rate superior to 300 Hz, characterized in that the method further comprises a step of: b) obtaining second data relative to the object by imaging the object with at least one of a X-ray and a ?-ray, and c) determining the at least one property of the object based on the first data and the second data.

Abstract: A method for obtaining chemical and/or material specific information of a sample based on scattered light. The method comprises receiving detection data comprising at least two images. Each image is indicative of the intensity of scattered light i) for incident light of a different wavelength, or ii) for incident light of a different polarization state, or iii) of a different polarization state. The scattered light comprises an elastic scattering component that is due to Rayleigh scattering of the incident light in at least a portion of the sample. Alternatively, each image is indicative of the intensity of scattered light i) of a different wavelength, or ii) for incident light of a different polarization state, or iii) of a different polarization state, wherein the scattered light comprises an inelastic scattering component that is due to Raman scattering of the incident light in at least a portion of the sample.

Abstract: A method is provided for auto registration for a robotic endoscopic apparatus. The method comprises: (a) generate a first transformation between an orientation of the robotic endoscopic apparatus and an orientation of a location sensor based at least in part on a first set of sensor data collected using the location sensor; (b) generating a second transformation between a coordinate frame of the robotic endoscopic apparatus and a coordinate frame of a model representing an anatomical luminal network based at least in part on the first transformation and a second set of sensor data; and (c) updating, based at least in part on a third set of sensor data, the second transformation using an updating algorithm.

Abstract: The present disclosure involves object recognition as a method of registration, using a stereoscopic camera on Augmented Reality (AR) glasses or an endoscope as the image capture technology. Exemplary objects include surgical tools, anatomical components or features, such as bone or cartilage, etc. By detecting just a portion of the object in the image data of the surgical scene, the present disclosure may register and track a portion of the patient's anatomy, such as the pelvis, the knee, etc. The present disclosure also optionally displays information on the AR glasses themselves, such as the entire pelvis, the femur, the tibia, etc. The present disclosure may include combinations of the foregoing features, and may eliminate the need for electromagnetic, inertial, or infrared stereoscopic tracking as the tracking technology.

Abstract: A processor for an endoscope includes: an endoscopic image acquisition unit that acquires an endoscopic image of a patient from the endoscope; a virtual endoscopic image acquisition unit that acquires a virtual endoscopic image reconstructed on the basis of a three-dimensional medical image obtained by capturing an image of the patient in advance; a virtual endoscopic image reconstruction unit that reconstructs a corrected virtual endoscopic image that matches most with the endoscopic image on the basis of the degree of matching between the virtual endoscopic image and the endoscopic image; and a diagnosis support information output unit that outputs diagnosis support information based on a feature parameter corrected according to a correspondence between each pixel of the endoscopic image and a distance image obtained from the corrected virtual endoscopic image.

Abstract: A magnetic field generator assembly is configured to be associated with a table supporting a body. The magnetic field generator comprises magnetic field transmitters that are thin (of minimal height) and transparent, or substantially transparent, to x-ray radiation. The magnetic field transmitters are configured to minimally obstruct components of an imaging system and to minimally interfere with image quality.

Abstract: A system for analysis of biopsy samples includes a tissue sample transport mechanism linking a biopsy sample excision tool to a tissue sample holder disposed in a staging area of an analysis unit. The tissue sample is automatically transported from the excision tool to the specimen holder, where the tissue sample is analyzed in the staging area of the analysis unit. The transport mechanism may include tubing and a vacuum source. The tissue sample holder may be configured to slow or temporarily stop a tissue sample for individual analysis, or collect multiple tissue samples for analysis as a group. A tissue sample sorting mechanism may be employed that allows separation of specimens that can be correlated to the analysis.

Abstract: A system and method is provided for obtaining ultrasound images of an interior of an object that includes an image processing unit that receives and processes acquired ultrasound scan data to create ultrasound images derived from ultrasound image data, a motion detection system configured to detect a pattern of inactivity time frames within movement cycles of the object and an ultrasound imaging probe operably connected to the image processing unit to acquire the ultrasound scan data for use by the image processing unit to form the ultrasound images. The motion detection system detects a pattern of one or more inactivity time frames within a first cycle of movement of the object, obtains ultrasound volumetric scan data of the object during the inactivity time frame within a second cycle of movement of the object, and calibrates a location of a scan plane of the ultrasound image within the volumetric ultrasound image.

Abstract: A computerized system for monitoring cancer therapy and a related method. The system comprises an input port (IN) for receiving two or more input images acquired of a subject, the two or more input images capable of recording metabolic activity and extracellular pH level. An evaluator (EVAL) of the system is configured to assess, based on the input images, i) a change over time in metabolic activity and ii) a change over time in extracellular pH level. The evaluator (EVAL) is further configured to establish, based on the assessment, an indication on whether or not there is a response to a cancer therapy in relation to a lesion of the subject or on whether the assessment is inconclusive. The indication is output through an output interface (OUT).

Abstract: Various systems and methods for controlling surgical devices are disclosed. A computer system, such as a surgical hub, can be configured to be communicably coupled to a surgical device and a camera configured to view an operating room. The computer system can be programmed to receive images of surgical staff members and surgical devices within the operating room during a surgical procedure. The computer system can further determine conditions or characteristics associated with the surgical staff members and surgical devices, such as whether a surgical staff member is performing a particular gesture or the pose of a surgical device, such as a surgical instrument, during a surgical procedure. The computer system can then control the paired surgical devices accordingly.

Abstract: A medical scan quality assurance system is operable to utilize artificial intelligence to train at least one computer vision model based on a training set of medical scans. A set of medical scans are received. Quality assurance data is generated for the set of medical scans utilizing artificial intelligence by performing at least one quality assurance function on the set of medical scans by utilizing the at least one computer vision model. A first medical scan is identified in the set of medical scans to include an artifact, detected by performing the at least one quality assurance function, that is determined to obscure at least a threshold percentage of a key anatomical part based on the quality assurance data. An artifact obstruction notification indicating the first medical scan is generated for transmission to a client device for display.

Abstract: Methods, apparatuses, and systems for designing, modifying, and installing a surgical implant optimized for a patient's unique physiology are disclosed. The methods are based upon data from surgical implants installed in other patients. Allowing patient outcomes from previously installed surgical implants to influence the design, placement, and surgical tool path for enable the implanting of surgical implants having the greatest likelihood of a successful patient outcome.

Abstract: The present invention provides a flexible ultrasound transducer for an ultrasound monitoring system for examining a curved object. The ultrasound transducer comprises an integrated circuit structure and a multi-layered structure, said multi-layered structure comprising an array of ultrasound transducing elements arranged in a first layer structure and configured for generating ultrasonic energy propagating along a main transducer axis Z and an array of control circuits arranged in a second layer structure, and wherein the array of control circuits and the integrated circuit structure are configured for operating the array of ultrasound transducing elements in said first layer structure, Further, the multi-layered structure comprises at least one flexible layer arranged so that the bending flexibility of the multi-layered structure permits the ultrasound transducer to form a continuous contact with said curved object during operation.

Abstract: Provided is a radiographic image display device that includes a display on which a first focus highlight to focus on one imaging condition among multiple imaging conditions and a second focus highlight to focus on a button for displaying a taken image are displayed; and a hardware processor. After completion of an imaging session in the one imaging condition, the hardware processor transitions the first focus highlight to an imaging condition for a next imaging session and transitions the second focus highlight to the button for displaying an image taken in the one imaging condition. The hardware processor controls a transition destination of at least one of the first focus highlight and the second focus highlight according to a type of the next imaging session performed after the imaging session in the one imaging condition.

Abstract: Systems and methods are disclosed for determining individual-specific blood flow characteristics. One method includes acquiring, for each of a plurality of individuals, individual-specific anatomic data and blood flow characteristics of at least part of the individual's vascular system; executing a machine learning algorithm on the individual-specific anatomic data and blood flow characteristics for each of the plurality of individuals; relating, based on the executed machine learning algorithm, each individual's individual-specific anatomic data to functional estimates of blood flow characteristics; acquiring, for an individual and individual-specific anatomic data of at least part of the individual's vascular system; and for at least one point in the individual's individual-specific anatomic data, determining a blood flow characteristic of the individual, using relations from the step of relating individual-specific anatomic data to functional estimates of blood flow characteristics.

Abstract: A method and apparatus for manipulating tissue. A tissue control point is displayed over an image of the tissue in a user interface. An input is received that moves the tissue control point within the user interface. A first instrument that is physically associated with the tissue is operated based on the received input to thereby manipulate the tissue.

Abstract: An optoacoustic probe for optoacoustic imaging of a volume, the optoacoustic probe having a distal end operable to contact the volume and a proximal end. The optoacoustic probe includes at least one primary light source and an auxiliary light source that is configured to generate auxiliary light carried through an optical window to a volume. A detection device is configured to detect signals generated from the auxiliary light or primary light reflecting from the volume or the optical window. A microcontroller including one or more processors is also provided, that receives the signals generated from the auxiliary light reflecting from the volume from the detection device, determines contact between the volume and the optoacoustic probe based on the auxiliary light reflecting from the volume, and prevents the at least one primary light source from generating light until the optoacoustic probe is contacting the volume.

Abstract: An interactive image marking method is introduced. The interactive image marking method includes the following steps, displaying a target image and at least one marked region in the target image; receiving an interactive signal, where the interactive signal corresponds to a first pixel of the target image; calculating a correlation between the first pixel and pixels of the target image, and determining a correlation range in the target image according to the correlation; editing the marked region according to the correlate range; and displaying the edited marked region. In addition, an electronic device and a recording medium using the method are also introduced.

Abstract: Systems and methods for generating multi-view synthetic dental radiographs for intraoral tomosynthesis. In some embodiments, the method includes generating or receiving two-dimensional (2D) projection images, manipulating pixel values contained in each of the plurality of 2D projection images, reconstructing a three-dimensional (3D) image space from information available in the plurality of 2D projection images, the 3D image space comprising voxel values, manipulating the voxel values in the 3D image space using one or more tunable weighting algorithms that can be adjusted to emphasize one or more features of interest of each image in the 3D image space, generating a plurality of synthetic dental radiographs from multiple views using information available in the 3D image space, and displaying one or more of the synthetic dental radiographs. In some embodiments, the system includes a display in communication with an image processing system comprising one or more processors for performing the method.

Abstract: A guidance system for performing a percutaneous access incision comprises an access needle comprising a shaft and a tip located at a distal end of the shaft, and a guidance pad comprising a dermal side, an outward side, an opening to receive the access needle, the opening extending between the dermal side and the outward side, and a feedback device viewable from the outward side to provide an indication of a depth of the tip beneath the guidance pad and a trajectory of the shaft from the opening. A method for planning guidance of an access needle into a patient in preparation for a minimally invasive surgical procedure comprises determining a location for an access point on the patient, positioning a guidance pad over the access point, inserting a tip of the access needle through the pad, and displaying guidance information on the guidance pad.

Abstract: A system and method for controlling an emitter assembly for visualizing a surgical site is disclosed. The emitter assembly is configured to emit a pulse pattern of electromagnetic radiation at the surgical site. The electromagnetic radiation pattern can include infrared radiation, visible light, or combinations thereof in either structured or non-structured formats. Further, a receiver assembly is configured to receive the electromagnetic radiation reflected from the surgical site. The control circuit can be configured to control the sequence or pattern in which the electromagnetic radiation is pulsed according to a preset sequence or according to feedback from the surgical site.

Abstract: A navigation system includes a first and second tracker supports independently affixed to a rigid object and separated by a distance. A first plurality of trackable elements are secured to the first tracker support and a second plurality of trackable elements are secured to the second tracker support. A localizer tracks the trackable elements and controller(s) define a tracking arrangement to be tracked based on a combination of the first and second plurality of trackable elements. A geometry of the tracking arrangement is registered relative to the rigid object and the controller(s) track the rigid object by detecting the registered geometry. The controller(s) identify a condition wherein at least one trackable element has been displaced relative to the registered geometry, and in response, generate an instruction to a manipulator controller to interrupt operation of a robotic manipulator.

Abstract: Method for the operation of a cleaning system of a medical imaging facility, wherein the imaging facility has an outer useful surface exposed to contaminating effects of patients and/or operators. During a utilization phase for an examination procedure of a patient, sensor data of a sensor arrangement detecting at least a portion of the useful surface is acquired and by evaluation of the sensor data, a surface map having potentially contaminated regions of the useful surface is determined. During a cleaning phase following the utilization phase, cleaning information of the potentially contaminated regions are output to a cleaner and/or used for actuation of at least one cleaning apparatus of the imaging facility for targeted cleaning of the potentially contaminated regions.

Abstract: A method and apparatus for determining properties of a tissue or tissues imaged by optical coherence tomography (OCT). In one embodiment the backscatter and attenuation of the OCT optical beam is measured and based on these measurements and indicium such as color is assigned for each portion of the image corresponding to the specific value of the backscatter and attenuation for that portion. The image is then displayed with the indicia and a user can then determine the tissue characteristics. In an alternative embodiment the tissue characteristics is classified automatically by a program given the combination of backscatter and attenuation values.

Abstract: Aspects of the disclosure include systems and methods for planning and/or performing an ablation procedure. Volumetric image data including a needle, such as a physical ablation needle or a virtual needle, can be analyzed to segment the needle within the volume. A first cross-sectional, two-dimensional view of the volume showing a first plane in which an axis defined by the needle lies can be generated and displayed. The view can be manipulated to display a generated second cross-sectional, two-dimensional view of the volume showing a second plane through the volume in which the longitudinal axis defined by the virtual needle lies, wherein the second plane is different from the first plane. Additional segmented features such as lesions in the image data, treatment regions, isotherms, and the like can be included in views to be analyzed from a plurality of views that include the needle.

Abstract: A system includes first and second manipulating means, and a means for detecting mounting of an imaging means to the first manipulating means, a means for determining a first reference frame for the imaging means while the imaging means is mounted to the first manipulating means, a means for controlling a tool means relative to the first reference frame by maintaining a position and orientation of a distal portion of the tool means relative to the imaging means in the first reference frame based on a position and orientation of an input means relative to a display means, a means for detecting mounting of the imaging means to the second manipulating means, a means for determining a second reference frame for the imaging means while the imaging means is mounted to the second manipulating means, and a means for controlling the tool means relative to the second reference frame.