Abstract: A system and method for image-based monitoring of an object inserted into a patient is disclosed. A model can be trained for an object configured to be inserted into a patient as part of a medical procedure, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with spatial information of the object. An imaging computer system can receive one or more images of the object inserted within the patient captured by an imaging device positioned external to the patient. The imaging computer system can further determine, based on applying the trained model to the one or more images of the object, current spatial information of the object within the patient. A display can output the one or more images and the current spatial information of the object.

Abstract: A system and method is disclosed for displaying augmented image data for invasive medical devices. A current orientation and a current position of the invasive medical device within a patient can be determined by applying a trained model of the invasive medical device to unannotated images of the invasive medical device as captured by an imaging device. The images of the invasive medical device can be displayed and overlaid with the current orientation and current position of the invasive medical device. User input can be received to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.

Abstract: A system and method is disclosed for augmenting image data of an invasive medical device using optical imaging. An optical imaging sensor, separate from the invasive medical device, can generate images of the medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with orientation and distance information of the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient to determine a current orientation and a current distance of the invasive medical device. The images of the invasive medical device as captured by the optical imaging sensor, visual orientation information representing the current orientation of the invasive medical device, and visual distance information representing the current distance of the invasive medical device within the patient can be displayed.

Abstract: A system and method for augmenting unlabeled imaging data of invasive medical devices is disclosed. An imaging device can generate images of the invasive medical device inside a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device having labels indicating orientation and position information. An imaging computer system can apply the trained model to unlabeled images of the invasive medical device within the patient to determine a current orientation and a current position of the invasive medical device inside the patient. The images of the invasive medical device, visual orientation information representing the current orientation of the invasive medical device, and visual position information representing the current position of the invasive medical device inside the patient can be outputted to a display.

Abstract: A system and method is disclosed for augmenting image data of an invasive medical device having non-medical structures. An invasive medical device having markers with distinct physical shapes relative to other portions of the invasive medical device can be inserted in a patient. An imaging device can generate images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker and spatial information. An imaging computer system can apply the trained model to images of the invasive medical device having depictions of the markers to determine current spatial information. The depictions of the markers can be identified and correlated with the spatial information from the annotated images. The images and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Abstract: A system and method is disclosed for guiding an invasive medical device with radiation absorbing markers. The invasive medical device can include markers with different radiation absorbing properties relative to other portions of the invasive medical device. An imaging device can generate images of the invasive medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker information identifying the markers and spatial information for the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient including depictions of the markers to determine current spatial information of the invasive medical device inside the patient. The images of the invasive medical device and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Abstract: A system and method is disclosed for guiding invasive medical devices relative to anatomical structures. An imaging device can generate one or more images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device within the patient to determine at least one of a current orientation and a current position of the invasive medical device relative to the one or more anatomical structures within the patient. The images of the invasive medical device, visual orientation information representing the current orientation, and visual position information representing the current position of the invasive medical device relative to the anatomical structures within the patient can be outputted to a display.

Abstract: A system and method for guiding invasive medical devices relative to other medical devices is disclosed. An imaging device can generate images of the invasive medical device within a body. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device to determine at least one of a current orientation and a current position of the invasive medical device relative to another medical device within the body. At least one of visual orientation information representing the current orientation of the invasive medical device relative to the other medical device and visual position information representing the current position of the invasive medical device relative to the other medical device within the body can be outputted.

Abstract: A system and method is disclosed for automatically determining position information for an invasive medical device based on imaging data. An imaging device can generate 2D images of the invasive medical device within the patient from a vantage point relative to the patient. A trained model for the invasive medical device can be trained on annotated 2D images of the invasive medical device with position information. An imaging computer system can apply the trained model to unannotated 2D images of the invasive medical device within the patient to determine a current position of the invasive medical device. The 2D images of the invasive medical device and visual position information representing the current position of the invasive medical device can be outputted to a display.

Abstract: A method of determining the position and orientation of an invasive medical device is described using altered devices and a machine learning algorithm for detecting the position and orientation of such devices from imagery. Such predictions can subsequently be displayed to an operator to improve the speed and accuracy by which they perform procedures.

Abstract: A system and method is disclosed for guiding an invasive medical device with radiation absorbing markers. The invasive medical device can include markers with different radiation absorbing properties relative to other portions of the invasive medical device. An imaging device can generate images of the invasive medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker information identifying the markers and spatial information for the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient including depictions of the markers to determine current spatial information of the invasive medical device inside the patient. The images of the invasive medical device and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Abstract: A system and method is disclosed for augmenting image data of an invasive medical device having non-medical structures. An invasive medical device having markers with distinct physical shapes relative to other portions of the invasive medical device can be inserted in a patient. An imaging device can generate images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker and spatial information. An imaging computer system can apply the trained model to images of the invasive medical device having depictions of the markers to determine current spatial information. The depictions of the markers can be identified and correlated with the spatial information from the annotated images. The images and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Abstract: A system and method for augmenting unlabeled imaging data of invasive medical devices is disclosed. An imaging device can generate images of the invasive medical device inside a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device having labels indicating orientation and position information. An imaging computer system can apply the trained model to unlabeled images of the invasive medical device within the patient to determine a current orientation and a current position of the invasive medical device inside the patient. The images of the invasive medical device, visual orientation information representing the current orientation of the invasive medical device, and visual position information representing the current position of the invasive medical device inside the patient can be outputted to a display.

Abstract: A system and method is disclosed for automatically determining position information for an invasive medical device based on imaging data. An imaging device can generate 2D images of the invasive medical device within the patient from a vantage point relative to the patient. A trained model for the invasive medical device can be trained on annotated 2D images of the invasive medical device with position information. An imaging computer system can apply the trained model to unannotated 2D images of the invasive medical device within the patient to determine a current position of the invasive medical device. The 2D images of the invasive medical device and visual position information representing the current position of the invasive medical device can be outputted to a display.

Abstract: A system and method is disclosed for guiding invasive medical devices relative to anatomical structures. An imaging device can generate one or more images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device within the patient to determine at least one of a current orientation and a current position of the invasive medical device relative to the one or more anatomical structures within the patient. The images of the invasive medical device, visual orientation information representing the current orientation, and visual position information representing the current position of the invasive medical device relative to the anatomical structures within the patient can be outputted to a display.

Abstract: A system and method is disclosed for augmenting image data of an invasive medical device using optical imaging. An optical imaging sensor, separate from the invasive medical device, can generate images of the medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with orientation and distance information of the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient to determine a current orientation and a current distance of the invasive medical device. The images of the invasive medical device as captured by the optical imaging sensor, visual orientation information representing the current orientation of the invasive medical device, and visual distance information representing the current distance of the invasive medical device within the patient can be displayed.

Abstract: A system and method for guiding invasive medical devices relative to other medical devices is disclosed. An imaging device can generate images of the invasive medical device within a body. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device to determine at least one of a current orientation and a current position of the invasive medical device relative to another medical device within the body. At least one of visual orientation information representing the current orientation of the invasive medical device relative to the other medical device and visual position information representing the current position of the invasive medical device relative to the other medical device within the body can be outputted.

Abstract: A system and method is disclosed for displaying augmented image data for invasive medical devices. A current orientation and a current position of the invasive medical device within a patient can be determined by applying a trained model of the invasive medical device to unannotated images of the invasive medical device as captured by an imaging device. The images of the invasive medical device can be displayed and overlaid with the current orientation and current position of the invasive medical device. User input can be received to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.

Abstract: A method of determining the position and orientation of an invasive medical device is described using altered devices and a machine learning algorithm for detecting the position and orientation of such devices from imagery. Such predictions can subsequently be displayed to an operator to improve the speed and accuracy by which they perform procedures.

Abstract: A method of determining the position and orientation of an invasive medical device is described using altered devices and a machine learning algorithm for detecting the position and orientation of such devices from imagery. Such predictions can subsequently be displayed to an operator to improve the speed and accuracy by which they perform procedures.