Abstract: A method of generating a 3D ultrasound image includes acquiring a 3D volumetric data set corresponding to a 3D imaging volume of an ultrasound probe in a 3D detection volume; acquiring a position of the ultrasound probe with respect to the 3D detection volume; acquiring a position of an interventional medical device with respect to the 3D detection volume; determining a position of the interventional medical device relative to the 3D imaging volume of the ultrasound probe; determining an interventional medical device-aligned plane that intersects with a longitudinal axis of the interventional medical device; extracting a texture slice from the 3D imaging volume for a corresponding interventional medical device-aligned plane positional and rotational orientation; mapping the texture slice onto the interventional medical device-aligned plane; and rendering the interventional medical device-aligned plane as a 3D ultrasound image and displaying the rendered 3D ultrasound image on a display screen.

Abstract: A method includes, in a processor, receiving example representations of geometrical shapes of a given type of organ. In a training phase, a neural network model is trained using the example representations. In a modeling phase, the trained neural network model is applied to a set of location measurements acquired in an organ of the given type, to produce a three-dimensional model of the organ.

Abstract: In the present invention, a system and method for selection of an optimal catheter for use in a medical procedure relative to the anatomy of a patient includes the steps of providing a system including a scanning device capable of obtaining image data on a ROI within the anatomy of a patient and reconstructing a 3D image of the ROI from the image data, a display capable of illustrating the 3D image and a 3D catheter model, and a CPU operably connected to the scanning device and the display and operable to analyze the 3D image in comparison with the 3D catheter model, obtaining image data of the ROI of the patient, reconstructing a 3D image of the ROI from the image data and comparing the 3D catheter model with the 3D image of the ROI to determine the catheter with the optimal configuration for use in the procedure.

Abstract: A cognitive optical system for dynamically refining imaging during a medical procedure, involving a processor operable by a set of executable instructions storable in relation to a non-transitory memory device. The processor is configured to automatically adjust an image by automatically compensating for at least one external factor affecting an anatomical area being viewed, automatically adjusting at least one imaging parameter, and automatically adjusting at least one internal control of an optical chain, whereby a quality of the image is improvable in real time.

Abstract: In a method and magnetic resonance (MR) apparatus for generating a combined MR image of an examination object, a first image data record of an examination object, generated from magnetic resonance data recorded with a first reception coil, is loaded into a computer. A second image data record of the examination object, generated from magnetic resonance data recorded with a second reception coil, wherein the first and the second reception coils are different reception coils, is also loaded into a computer. At least one interim image data record is generated by the computer by applying a mask function to the first and/or second image data record. An interim image data record is combined in the computer with the image data record to which no mask function was applied, or with the other interim image data record, to form a combined MR image.

Abstract: A method of evaluating a vessel of a patient is provided. The method includes outputting, to a display device, a screen display including: a visualization based on pressure measurements obtained from a first instrument and a second instrument positioned within the vessel of the patient while the second instrument is moved longitudinally through the vessel and the first instrument remains stationary within the vessel; and a visual representation of a vessel; receiving a user input to modify the visualization to simulate a therapeutic procedure; and updating the screen display, in response to the user input, including modifying the visualization based on the user input. A system for evaluating a vessel of a patient is also provided. The system includes first and second instruments sized and shaped for introduction into the vessel of the patient; and a processing system communicatively coupled to the first and second instruments and a display device.

Abstract: A detection device including: a detector that detects an object from one viewpoint; a reliability calculator that calculates reliability information on the object at the one viewpoint by using a detection result of the detector; and an information calculator that calculates shape information on the object at the one viewpoint by using the detection result of the detector and the reliability information and calculates texture information on the object at the one viewpoint by using the detection result, the information calculator generates model information on the object at the one viewpoint based on the shape information and the texture information.

Abstract: An approach is provided for image guided procedures. The approach includes acquiring image data of at least one object of a subject, in which the acquired image data is registered to one or more coordinate systems. The approach includes receiving the acquired image data. The approach includes displaying, on one or more smartglasses, one or more superimposed images over a portion of the subject. The one or more superimposed images may be related to the acquired image data. The approach includes aligning the one or more superimposed images to correspond with a position of the at least one object.

Abstract: A robot arm and method for using the robot arm. Embodiments may be directed to an apparatus comprising: a robot arm; an end effector coupled at a distal end of the robot arm and configured to hold a surgical tool; a plurality of motors operable to move the robot arm; and an activation assembly operable to send a move signal allowing an operator to move the robot arm.

Abstract: A method comprises providing a current state image and at least one reference image, taken from a similar angle range. The image and the at least one reference image are superimposed and a visual representation visualizing the relation between the image and the reference image is provided in order to track displacements of the bone during subsequent operation steps. A system is provided which can use the image data to track displacements and determine deviation from a current state of the elements in question to a target state.

Abstract: In another embodiment, a hip joint navigation jig is provided that includes an anatomical interface comprising a bone engagement portion. A registration jig is also provided that is coupled, e.g., removeably, with the anatomical interface. A rotatable member is provided for rotation about an axis that is not vertical when the jig is mounted to the bone adjacent to a hip joint and the registration jig is coupled with the anatomical interface. An anatomy engaging probe is coupled with the rotatable member for rotation about the axis and is translatable to enable the probe to be brought into contact with a plurality of anatomical landmarks during a procedure. An inertial sensor is coupled with the probe to indicate orientation related to the landmarks, the sensor being disposed in a different orientation relative to horizontal when the probe is in contact with the landmarks.

Abstract: A simulator for manual tasks comprising a first robot arm, a second robot arm and a controller. The first robot arm has a connector (730) at a distal end for connecting to a tool (762) and the second robot arm having a connector (740) at a distal end for connecting to the tool. The controller is operable to simulate at least two different procedures in response to the attachment of different tools to the robot arms.

Abstract: Embodiments herein provide a method for stereo-visual localization of an object by a stereo-visual localization apparatus. The method includes generating, by a stereo-visual localization apparatus, a stereo-visual interface displaying the first stereo image of the object and the first stereo image of the subject in a first portion and the second stereo image of the object and the second stereo image of the subject in a second portion. Further, the method includes detecting, by the stereo-visual localization apparatus, a movement of the subject to align the subject in the field of view with the object. Furthermore, the method includes visually aligning, by the stereo-visual localization apparatus, the subject with the object based on the movement by simultaneously changing apparent position of the first and the second stereo images of the subject in each of the first portion and the second portion in the stereo-visual interface.

Abstract: An intervention system employing an interventional robot (30), an interventional imaging modality (10) and an interventional controller (70). In 5 operation, the interventional controller (70) navigates an anatomical roadmap (82) of an anatomical region of a patient in accordance with an interventional plan to thereby control a navigation of the interventional robot (30) within the anatomical region in accordance with the anatomical roadmap (82).

Abstract: Systems and methods for estimating anatomic alignment between two or more bones are described herein. An example method can include registering an anatomic reference frame. Additionally, the method can include establishing a respective rotational relationship between each of one or more bones and an orientation sensor attached to each of the one or more bones. The method can also include receiving, from each of the orientation sensors, orientation information, and then calculating an orientation of a bone relative to the anatomic reference frame. The method can further include calculating, using the respective orientations of the bones relative to the anatomic reference frame, an anatomic alignment parameter between first and second bones.

Abstract: Aspects of this disclosure relate to directing the movement of instrument such as medical devices. For example, data regarding an ongoing physical of an instrument that is configured to gather spatial data via physical manipulation of the instrument for a procedure is received. A current orientation of the instrument is determined. Additional spatial data to gather for the procedure is determined. A subsequent physical manipulation on how to physically maneuver the instrument relative to the current orientation to gather the additional spatial data is determined. Real-time feedback on how to execute the subsequent physical manipulation is provided.

Abstract: An example method includes obtaining, a virtual model of a portion of an anatomy of a patient obtained from a virtual surgical plan for an orthopedic joint repair surgical procedure to attach a prosthetic to the anatomy; identifying, based on data obtained by one or more sensors, positions of one or more physical markers positioned relative to the anatomy of the patient; and registering, based on the identified positions, the virtual model of the portion of the anatomy with a corresponding observed portion of the anatomy.

Abstract: The present disclosure involves object recognition as a method of registration, using a stereoscopic camera on Augmented Reality (AR) glasses or an endoscope as the image capture technology. Exemplary objects include surgical tools, anatomical components or features, such as bone or cartilage, etc. By detecting just a portion of the object in the image data of the surgical scene, the present disclosure may register and track a portion of the patient's anatomy, such as the pelvis, the knee, etc. The present disclosure also optionally displays information on the AR glasses themselves, such as the entire pelvis, the femur, the tibia, etc. The present disclosure may include combinations of the foregoing features, and may eliminate the need for electromagnetic, inertial, or infrared stereoscopic tracking as the tracking technology.

Abstract: A magnetic resonance imaging apparatus according to an embodiment includes sequence control circuitry and processing circuitry. The sequence control circuitry performs multi-frame acquisition where FOVs (Field Of Views) of at least two acquired frames are overlapped in a first direction. Then, based on the multi-frame acquisition performed by the sequence control unit, the processing unit generates data regarding the components in the first direction of flow of a fluid.

Abstract: The present disclosure relates to a tracking system for augmented reality in a clinical setting. Specifically, the present disclosure relates to an approach for combining hardware-based tracking and computer vision-based tracking in order to accurately overlay a projected image onto a video image.

Abstract: A surgical instrument having a position sensor that may be detachable, disposable, partially isolated from movement of the main body of the surgical instrument, and/or configured to display feedback lighting. The orientation of the surgical instrument may be mimicked either virtually or by a mechanical device with a second surgical instrument. The instruments of the present disclosure may be used in any procedure or treatment that would benefit from position feedback for the instruments.

Abstract: A method of performing surgery on a bone includes providing a robotically controlled bone preparation system and creating at least one hole in the bone with the robotically controlled bone preparation system prior to machining the bone. The bone hole aligns with a hole or a post in a guide for a manual cutting tool. If the robot fails during surgery, or if the surgeon does not wish to complete the procedure with the robot, the guide is attached to the bone after aligning the guide hole with the bone hole. The surgery is completed manually after the guide is attached to the bone, and the robot is not used after the guide is attached to the bone.

Abstract: A method for locating a plurality of elements comprising a flexible ultrasound phased array. The method includes constructing a matrix of traveltimes by iteratively transmitting a signal from one element of the plurality and receiving the signal at each of the other elements of the plurality. Traveltimes are derived from each received signal and arrayed in a matrix. Relative positions of the first element of the plurality and the last element of the plurality are established and the locations of the remaining elements of the plurality are iteratively modeled to fit the matrix of traveltimes.

Abstract: A transmitting element for generating a magnetic field for tracking of an object includes a first spiral trace that extends from a first outer origin inward to a central origin in a first direction. A second spiral trace can extend from the central origin outward to a second outer origin in the first direction. The second spiral trace can extend from the central origin to the second outer origin in the first direction. The first spiral trace and the second spiral trace can be physically connected at the central origin to form the fluorolucent magnetic transmitting element and at least a portion of the first spiral trace overlaps at least a portion of the second spiral trace.

Abstract: The present disclosure includes systems for surgical navigation, the system comprising a tracking array attachable to a medical instrument, an image capturing device, and a navigation system that communicates with the image capturing device and generates tracking information of the medical device.

Abstract: A sterilizable device comprising electromagnetic transponders separated from one another by a flexible spacer material enclosed within radiofrequency-transparent sterilizable tubing for target tracking during prostate treatments, and method of use thereof.

Abstract: Disclosed is a reader device, system, and method for communicating with a wireless sensor. The reader device may be configured to communicate wirelessly with an implant device associated with a proprietary system provided by a first entity. An external device, that may not be associated with said first entity, is provided and is configured to be calibrated to communicate with the implant device that is located within a patient. The external device may be used in place of an existing reader device that was initially calibrated to communicate with the implant device prior to the implant device being placed within the patient. The external device may be particularly useful for implant devices that communicate wirelessly with external devices where said implant devices are intended to be located within the human body on a permanent or indefinite duration of time.

Abstract: Methods and systems are provided for adjusting settings of an ultrasound exam based on monitoring of the exam with an optical camera. One example method includes acquiring images of an ultrasound exam via a camera, analyzing the acquired images in real-time to build a spatial exam model, and adjusting settings of the ultrasound exam in real-time based on the spatial exam model.

Abstract: A system for assembling a vehicle platform includes a robotic assembly system having at least two robotic arms, a vision system capturing images of an assembly frame, and a control system configured to control the robotic assembly system to assemble the vehicle platform based on images from the vision system, force feedback from the at least two robotic arms, and a component location model. The control system is further configured to identify assembly features of a first component and a second component of the vehicle platform from the images, operate the robotic arms to orient the first component and the second component to respective nominal positions based on the images and the component location model, and operate the robotic arms to assemble the first component to the second component based on the force feedback.

Abstract: Provided are a system and method for informing of attachment positions of electrocardiogram (ECG) electrodes to improve the quality of ECG data. The system includes a judgment indicator extractor configured to extract a plurality of judgment indicator values from ECG data obtained through ECG electrodes, a reference value setter configured to, in a user-specific reference value setting mode, collect the judgment indicator values for a plurality of pieces of ECG data extracted by the judgment indicator extractor and set user-specific reference values for each judgment indicator, a similarity determiner configured to, in an ECG measurement mode, determine similarity by comparing a plurality of judgment indicator values extracted by the judgment indicator extractor with the user-specific reference values, and an electrode attachment position guide configured to inform a user of attachment positions of the ECG electrodes according to a similarity determination result of each of the judgment indicator values.

Abstract: Techniques for aligning a medical instrument for percutaneous access to a location within the human anatomy can include determining an orientation of the medical instrument, determining a target location within the human anatomy, and determining a target trajectory for percutaneous access of the target location. Further, the techniques can include causing display of an interface that includes an instrument-alignment element indicative of an alignment of the orientation of the medical instrument to the target trajectory.

Abstract: The disclosed method encompasses moving an object such as a medical device or instrument to a desired spatial position based on tracking data provided by a tracking system. Once it is determined from the tracking data that the object has reached the desired spatial position, a projection image is generated, which is registered with the desired spatial position and shows the object. Based on the image data, it is possible to verify whether the object has actually reached the desired position, or whether the object's actual position deviates from the desired position due to errors or inaccuracies, allowing measures to be taken to compensate for these errors or inaccuracies.

Abstract: Systems, methods and devices for use in tracking are described, using optical modalities to detect spatial attributes or natural features of objects, such as, tools and patient anatomy. Spatial attributes or natural features may be known or may be detected by the tracking system. The system, methods and devices can further be used to verify a calibration of a tool either by a computing unit or by a user. Further, the disclosure relates to detection of spatial attributes, including depth information, of the anatomy for purposes of registration or to create a 3D surface profile of the anatomy.

Abstract: A method for supporting a user, a corresponding computer program product, a corresponding data medium, and a corresponding imaging system are provided. According to the method, a three-dimensional (3D) data set depicting a target object is provided, and at least one two-dimensional (2D) image of the target object is automatically acquired. The 2D image and the 3D data set are automatically registered with each other by a 2D/3D registration. A spatial direction in which the 2D/3D registration exhibits greatest uncertainty is automatically specified. A signal for aligning an instrument that is provided for the purpose of examining the target object is then automatically generated and output as a function of the specified spatial direction in order to support the user.

Abstract: Disclosed are systems, devices, and methods for registering a luminal network to a 3D model of the luminal network. An example method comprises generating a 3D model of a luminal network, identifying a target within the 3D model, determining locations of a plurality of carinas in the luminal network proximate the target, displaying guidance for navigating a location sensor within the luminal network, tracking the location of the location sensor, comparing the tracked locations of the location sensor and the portions of the 3D model representative of open space, displaying guidance for navigating the location sensor a predetermined distance into each lumen originating at the plurality of carinas proximate the target, tracking the location of the location sensor while the location sensor is navigated into each lumen, and updating the registration of the 3D model with the luminal network based on the tracked locations of the location sensor.

Abstract: Methods and systems for presenting an object on a screen of a head mounted display (HMD) include receiving an image of a real-world environment in proximity of a user wearing the HMD. The image is received from one or more forward facing cameras of the HMD and processed for rendering on a screen of the HMD by a processor within the HMD. A gaze direction of the user wearing the HMD, is detected using one or more gaze detecting cameras of the HMD that are directed toward one or each eye of the user. Images captured by the forward facing cameras are analyzed to identify an object captured in the real-world environment that is in line with the gaze direction of the user, wherein the image of the object is rendered at a first virtual distance that causes the object to appear out-of-focus when presented to the user. A signal is generated to adjust a zoom factor for lens of the one or more forward facing cameras so as to cause the object to be brought into focus.

Abstract: Apparatuses and methods are provided for augmented reality-assisted assessment of three-dimensional (3D) fit of physical objects within a physical environment in different positions. According to an embodiment, an augmented reality (AR) device obtains 3D dimensions of a virtual object representative of a real-world physical object and displays a 3D representation of the virtual object in an AR space depicted by a user interface of the AR device that is representative of a real-world physical environment in a field of view of the AR device. The 3D representation of the virtual object is proportionally dimensioned relative to the physical environment based on the obtained 3D dimensions of the virtual object and the virtual object is repositionable in the AR space responsive to input received by the AR device to allow assessment of 3D fit of the virtual object within the physical environment in different positions.

Abstract: A wearable antenna is described, for wirelessly receiving sensor data generated by an implantable sensor device implanted in a uterus, the wearable antenna, in use, extending around the waist of the wearer's body, and having a downwardly extending portion for location at the front of the wearer's body. In this way, an improved electromagnetic interaction between the wearable antenna and the implantable sensor can be achieved. Further, the wearable antenna may have an undulating shape around at least a portion of the wearer's waist, to permit expansion and contraction of the wearable antenna about the wearer's waist.

Abstract: A system for aiding surgery on a patient is described including a display device and a storage device that stores an image of at least a portion of the anatomy of the patient, including one or more surgical navigation markers positioned on the patient, for display on the display device. An analyser is adapted to receive positional data of a probe based on positioning of the probe relative to the one or more markers on the patient. Based on the positional data, the analyser outputs correctional data to adjust an alignment of the image on the display device to match locations of said one or more markers.

Abstract: A system for constructing fluoroscopic-based three-dimensional volumetric data of a target area within a patient from two-dimensional fluoroscopic images including a structure of markers, a fluoroscopic imaging device configured to acquire a sequence of images of the target area and of the structure of markers, and a computing device. The computing device is configured to estimate a pose of the fluoroscopic imaging device for at least a plurality of images of the sequence of images based on detection of a possible and most probable projection of the structure of markers as a whole on each image of the plurality of images. The computing device is further configured to construct fluoroscopic-based three-dimensional volumetric data of the target area based on the estimated poses of the fluoroscopic imaging device.

Abstract: A system and method for navigating to a target using fluoroscopic-based three dimensional volumetric data generated from two dimensional fluoroscopic images, including a catheter guide assembly including a sensor, an electromagnetic field generator, a fluoroscopic imaging device to acquire a fluoroscopic video of a target area about a plurality of angles relative to the target area, and a computing device. The computing device is configured to receive previously acquired CT data, determine the location of the sensor based on the electromagnetic field generated by the electromagnetic field generator, generate a three dimensional rendering of the target area based on the acquired fluoroscopic video, receive a selection of the catheter guide assembly in the generated three dimensional rendering, and register the generated three dimensional rendering of the target area with the previously acquired CT data to correct the position of the catheter guide assembly.

Abstract: A patient tracking device for insertion into an oral cavity includes a sensor housing comprising a first surface shaped to correspond to a pallet within the oral cavity. At least a portion of the first surface affixes the sensor housing to the oral cavity. An electromagnetic sensor is coupled to the sensor housing.

Abstract: A localization and attitude estimation method using magnetic fields includes the following steps. First, in three-dimensional coordinates, at least three magnetic landmarks arbitrarily disposed around a moving carrier are selected, wherein any two of the at least three magnetic landmarks have different magnetic directions. One set of at least five tri-axes magnetic sensors is used to sense the magnetic fields of the at least three magnetic landmarks. Three magnetic components on three axes of a current position of each of the tri-axes magnetic sensors are respectively generated by a demagnetization method. Five non-linear magnetic equations are solved to obtain position information and magnetic moment information of the at least three magnetic landmarks in the three-dimensional coordinates. Position vectors and attitude vectors of the set of at least five tri-axes magnetic sensors in a three-dimensional space are estimated based on tri-axes magnetic moment vectors of the magnetic landmarks.

Abstract: A method is described for performing a percutaneous operation on a patient to remove an object from a cavity within the patient. The method includes advancing a first alignment sensor into the cavity through a patient lumen. The first alignment sensor provides its position and orientation in free space in real time. The alignment sensor is manipulated until it is located in proximity to the object. A percutaneous opening is made in the patient with a surgical tool, where the surgical tool includes a second alignment sensor that provides the position and orientation of the surgical tool in free space in real time. The surgical tool is directed towards the object using data provided by both the first and the second alignment sensors.

Abstract: A system and method for providing image guidance for placement of one or more medical devices at a target location. The system can determine one or more intersections between a medical device and an image region based at least in part on first emplacement data and second emplacement data. Using the determined intersections, the system can cause one or more displays to display perspective views of image guidance cues, including an intersection indicator in a virtual 3D space.

Abstract: Devices, apparatus and methods for patient-specific MIS procedures. A patient-specific, MIS navigation guide device may include a main body having a proximal surface and a distal surface, wherein the distal surface is configured to face target tissue upon placement of said MIS navigation guide device. Anchors extend distally of the distal surface, and distal ends of the anchors lie on a three dimensional surface that matches contours of the target tissue in locations where the anchors are designed to contact. An operational guide is configured to guide the performance of a surgical operational step on the target tissue along an optimal pathway predefined by the operational guide relative to the main body. A position indicator on the device is interpretable by a surgeon to know when the anchors have not yet been contacted to the target tissue in a predetermined orientation and to know when the anchors have been contacted to the target tissue in the predetermined orientation.

Abstract: The present invention relates to a system SY for determining a position of an RF transponder circuit RTC respective an ultrasound emitter unit UEU. The RF transponder circuit RTC emits RF signals that are modulated based on received ultrasound signals that are emitted or reflected by the ultrasound emitter unit UEU. The position of the RF transponder circuit RTC respective the ultrasound emitter unit UEU is determined based on a time difference ?T1 between the emission of an ultrasound signal by the ultrasound emitter unit UEU and the detection by the RF detector unit RFD of a corresponding modulation in the RF signal emitted or reflected by the RF transponder circuit (RTC).

Abstract: A remote operation-type surgery system is disclosed, which includes a multiple-degree freedom slave arm, which is able to be mounted with a medical instrument including a shaft portion and an end effector disposed at a distal end of the shaft portion; a first input device configured to receive a first input to operate the multiple-degree freedom slave arm; a second input device configured to receive a second input to operate the multiple-degree freedom slave arm and different from the first input device; a touch panel configured to set an operation mode for the multiple-degree freedom slave arm operated by the second input device; and a controller configured to control the multiple-degree freedom slave arm based on the first input or second input, wherein the controller is configured to: determine whether or not an in-operation signal is turned on.

Abstract: A dual mode augmented reality surgical system configured to operate in both a tracking and a non-tracking mode includes a head mounted display configured to provide an optical view of a patient and to inject received data content over top of the optical view to form an augmented reality view of the patient, and comprising internal tracking means configured to determine a surgeon's position as well as angle and direction of view relative to the patient. The system further includes an augmented reality computing system comprising one or more processors, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors.

Abstract: A system and a method are disclosed where an autonomous robot captures an image of an object to be transported from a source to a destination. The robot generates a bounding box within the image surrounding the object. The robot applies a machine-learned model to the image with the bounding box, the machine-learned model configured to identify an object type of the object, and to identify features of the object based on the identified object type and the image. The robot determines which of the identified features of the object are visible to the autonomous robot, and determines a three-dimensional pose of the object based on the features determined to be visible to the autonomous robot.