Abstract: Aspects of the technology described herein relate to displaying indications of anatomical regions that have been imaged and/or that should be imaged next. In some embodiments, ultrasound data collected from a subject by an ultrasound device may be received, an automatic determination may be made that the ultrasound data was collected from a particular anatomical location, and an indication of the anatomical location may be displayed. In some embodiments, a plurality of anatomical locations may be determined for imaging, an anatomical location from among the plurality of anatomical locations may be automatically selected, and an indication of the anatomical location may be displayed. Displaying an indication of an anatomical location may include displaying or modifying a marker on a frame of a video of the subject such that the marker appears in the frame of the video to be located at the anatomical location on the subject.

Abstract: A system and method for image-based monitoring of an object inserted into a patient is disclosed. A model can be trained for an object configured to be inserted into a patient as part of a medical procedure, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with spatial information of the object. An imaging computer system can receive one or more images of the object inserted within the patient captured by an imaging device positioned external to the patient. The imaging computer system can further determine, based on applying the trained model to the one or more images of the object, current spatial information of the object within the patient. A display can output the one or more images and the current spatial information of the object.

Abstract: Aspects of the technology described herein relate to determining, by a processing device in operative communication with an ultrasound device, a position and/or orientation of the ultrasound device relative to the processing device, and displaying on a display screen of the processing device, based on the position and/or orientation of the ultrasound device relative to the processing device, an instruction for moving the ultrasound device.

Abstract: Some aspects of the technology described herein relate to configuring an ultrasound device to perform a three-dimensional ultrasound imaging sweep, and displaying ultrasound images and segmented portions of the ultrasound images as the ultrasound images are collected during the three-dimensional ultrasound imaging sweep. Certain aspects relate to displaying an ultrasound image collected by an ultrasound device and configuring the ultrasound device to perform a three-dimensional ultrasound imaging sweep based on the ultrasound image collected by the ultrasound device.

Abstract: Aspects of the technology described herein relate to automatically calculating and displaying a prediction of a collective opinion of a group of individuals regarding imaging data and/or an output based on the imaging data. In some embodiments, the prediction may be a prediction of the collective opinion of a group of individuals regarding the usability of imaging data, regarding a segmentation of an image, or regarding a measurement performed based on the imaging data.

Abstract: Aspects of the technology described herein include determining, during ultrasound imaging, that an anatomical region is clipped by a field of view of an ultrasound image, and providing a notification, during the ultrasound imaging, that the anatomical region is clipped by the field of view of the ultrasound image. Aspects of the technology described herein also include determining that an anatomical region is clipped by a field of view of at least one ultrasound image collected during a three-dimensional ultrasound imaging sweep, and providing a notification that the anatomical region is clipped by the field of view of the at least one ultrasound image collected during the three-dimensional ultrasound imaging sweep.

Abstract: A system and method is disclosed for displaying augmented image data for invasive medical devices. A current orientation and a current position of the invasive medical device within a patient can be determined by applying a trained model of the invasive medical device to unannotated images of the invasive medical device as captured by an imaging device. The images of the invasive medical device can be displayed and overlaid with the current orientation and current position of the invasive medical device. User input can be received to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.

Abstract: A system and method is disclosed for augmenting image data of an invasive medical device using optical imaging. An optical imaging sensor, separate from the invasive medical device, can generate images of the medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with orientation and distance information of the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient to determine a current orientation and a current distance of the invasive medical device. The images of the invasive medical device as captured by the optical imaging sensor, visual orientation information representing the current orientation of the invasive medical device, and visual distance information representing the current distance of the invasive medical device within the patient can be displayed.

Abstract: A system and method for augmenting unlabeled imaging data of invasive medical devices is disclosed. An imaging device can generate images of the invasive medical device inside a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device having labels indicating orientation and position information. An imaging computer system can apply the trained model to unlabeled images of the invasive medical device within the patient to determine a current orientation and a current position of the invasive medical device inside the patient. The images of the invasive medical device, visual orientation information representing the current orientation of the invasive medical device, and visual position information representing the current position of the invasive medical device inside the patient can be outputted to a display.

Abstract: A system and method is disclosed for guiding an invasive medical device with radiation absorbing markers. The invasive medical device can include markers with different radiation absorbing properties relative to other portions of the invasive medical device. An imaging device can generate images of the invasive medical device within a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker information identifying the markers and spatial information for the invasive medical device. An imaging computer system can apply the trained model to images of the invasive medical device within the patient including depictions of the markers to determine current spatial information of the invasive medical device inside the patient. The images of the invasive medical device and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Abstract: A system and method is disclosed for guiding invasive medical devices relative to anatomical structures. An imaging device can generate one or more images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device within the patient to determine at least one of a current orientation and a current position of the invasive medical device relative to the one or more anatomical structures within the patient. The images of the invasive medical device, visual orientation information representing the current orientation, and visual position information representing the current position of the invasive medical device relative to the anatomical structures within the patient can be outputted to a display.

Abstract: A system and method is disclosed for augmenting image data of an invasive medical device having non-medical structures. An invasive medical device having markers with distinct physical shapes relative to other portions of the invasive medical device can be inserted in a patient. An imaging device can generate images of the invasive medical device within the patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device annotated with marker and spatial information. An imaging computer system can apply the trained model to images of the invasive medical device having depictions of the markers to determine current spatial information. The depictions of the markers can be identified and correlated with the spatial information from the annotated images. The images and visual spatial information representing the spatial information of the invasive medical device can be outputted to a display.

Abstract: A system and method for guiding invasive medical devices relative to other medical devices is disclosed. An imaging device can generate images of the invasive medical device within a body. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device with at least one of orientation and position information. An imaging computer system can apply the trained model to unannotated images of the invasive medical device to determine at least one of a current orientation and a current position of the invasive medical device relative to another medical device within the body. At least one of visual orientation information representing the current orientation of the invasive medical device relative to the other medical device and visual position information representing the current position of the invasive medical device relative to the other medical device within the body can be outputted.

Abstract: A system and method is disclosed for automatically determining position information for an invasive medical device based on imaging data. An imaging device can generate 2D images of the invasive medical device within the patient from a vantage point relative to the patient. A trained model for the invasive medical device can be trained on annotated 2D images of the invasive medical device with position information. An imaging computer system can apply the trained model to unannotated 2D images of the invasive medical device within the patient to determine a current position of the invasive medical device. The 2D images of the invasive medical device and visual position information representing the current position of the invasive medical device can be outputted to a display.

Abstract: Aspects of the technology described herein relate to methods and apparatuses for enable a user to manually modify an input to a calculation performed based at least in part on an ultrasound image. In some embodiments, manually modifying the input comprises manually modifying a trace on the image. In some embodiments, manually modifying the input comprises manually selecting an ultrasound image from a series of ultrasound images on which a calculation is to be performed.

Abstract: Aspects of the technology described herein relate to guiding collection of ultrasound data collection using motion and/or orientation data. A first instruction for rotating or tilting the ultrasound imaging device to a default orientation may be provided. Based on determining that the ultrasound imaging device is in the default orientation, a second instruction for translating the ultrasound imaging device to a target position may be provided. Based on determining that the ultrasound imaging device is in the target position, a third instruction for rotating or tilting the ultrasound imaging device to a target orientation may be provided.

Abstract: Aspects of the technology described herein relate to configuring an ultrasound system with imaging parameter values. In particular, certain aspects relate to configuring an ultrasound system to produce a plurality of sets of ultrasound images, each respective set of the plurality of sets of ultrasound images being produced with a different respective set of a plurality of sets of imaging parameter values; obtaining, from the ultrasound system, the plurality of sets of ultrasound images; determining a set of ultrasound images from among the plurality of sets of ultrasound images that has a highest quality; and based on determining the set of ultrasound images from among the plurality of sets of ultrasound images that has the highest quality, automatically configuring the ultrasound system to produce ultrasound images using a set of imaging parameter values with which the set of ultrasound images that has the highest quality was produced.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images using an image processing neural network system. One of the system includes a shared encoder neural network implemented by one or more computers, wherein the shared encoder neural network is configured to: receive an input image from a target domain; and process the input image to generate a shared feature representation of features of the input image that are shared between images from the target domain and images from a source domain different from the target domain; and a classifier neural network implemented by the one or more computers, wherein the classifier neural network is configured to: receive the shared feature representation; and process the shared feature representation to generate a network output for the input image that characterizes the input image.

Abstract: Aspects of the technology described herein relate to enhancing ultrasound data. Some embodiments include receiving ultrasound data and automatically determining, with a processing device, that the ultrasound data depicts an anatomical view or one of a set of anatomical views. Based on automatically determining that the ultrasound data depicts the anatomical view or one of the set of anatomical views, an option is enabled to perform ultrasound data enhancement specific to the anatomical view or the set of anatomical views. Based on receiving the selection of the option, the ultrasound data, a portion thereof, and/or subsequently-collected ultrasound data is enhanced using the ultrasound data enhancement specific to the anatomical view or the set of anatomical views.