Abstract: A user-interface for visualizing a colonoscopy procedure includes a video region and a navigational map upon which coverage annotations are displayed. A live video feed received from a colonoscope is displayed in the video region. The navigational map depicts longitudinal sections of a colon. The coverage annotations are presented on the navigation map and indicate whether one or more of the longitudinal sections is deemed adequately inspected or inadequately inspected during the colonoscopy procedure.

Abstract: A user-interface for aiding navigation of an endoscope through a lumen of a tubular anatomical structure during an endoscopy procedure includes a video region in which a live video feed received from the endoscope is displayed and an observation location map. The observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope longitudinally traverses the tubular anatomical structure within the lumen during the endoscopy procedure.

Abstract: Described are systems and methods for training machine learning models of an ensemble of models that are de-correlated. For example, two or more machine learning models may be concurrently trained (e.g., co-trained) while adding a decorrelation component to one or both models that decreases the pairwise correlation between the outputs of the models. Unlike traditional approaches, in accordance with the disclosed implementations, only the negative results need to be decorrelated.

Abstract: Disclosed are systems and method for training an ensemble of machine learning models with a focus on feature engineering. For example, the training of the models encourages each machine learning model of the ensemble to rely on a different set of input features from the training data samples used to train the machine learning models of the ensemble. However, instead of telling each model explicitly which features to learn, in accordance with the disclosed implementations, ML models of the ensemble may be trained sequentially, with each new model trained to disregard input features learned by previously trained ML models of the ensemble and learn based on other features included in the training data samples.

Abstract: A user-interface for visualizing a colonoscopy procedure includes a video region and a navigational map upon which coverage annotations are displayed. A live video feed received from a colonoscope is displayed in the video region. The navigational map depicts longitudinal sections of a colon. The coverage annotations are presented on the navigation map and indicate whether one or more of the longitudinal sections is deemed adequately inspected or inadequately inspected during the colonoscopy procedure.

Abstract: Embodiments of a system, a machine-accessible storage medium, and a computer-implemented method are described in which operations are performed. The operations comprising receiving a plurality of image frames associated with a video of an endoscopy procedure, generating a probability estimate for one or more image frames included in the plurality of image frames, and identifying a transition in the video when the endoscopy procedure transitions from a first phase to a second phase based, at least in part, on the probability estimate for the one or more image frames. The probability estimate includes a first probability that one or more image frames are associated with a first phase of the endoscopy procedure.

Abstract: A user-interface for aiding navigation of an endoscope through a lumen of a tubular anatomical structure during an endoscopy procedure includes a video region in which a live video feed received from the endoscope is displayed and an observation location map. The observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope longitudinally traverses the tubular anatomical structure within the lumen during the endoscopy procedure.

Abstract: Multiple video files that are captured by calibrated imaging devices may be annotated based on a single annotation of an image frame of one of the video files. An operator may enter an annotation to an image frame via a user interface, and the annotation may be replicated from the image frame to other image frames that were captured at the same time and are included in other video files. Annotations may be updated by the operator and/or tracked in subsequent image frames. Predicted locations of the annotations in subsequent image frames within each of the video files may be determined, e.g., by a tracker, and a confidence level associated with any of the annotations may be calculated. Where the confidence level falls below a predetermined threshold, the operator may be prompted to delete or update the annotation, or the annotation may be deleted.

Abstract: The motion of objects within a scene may be detected and tracked using digital (e.g., visual and depth) cameras aligned with fields of view that overlap at least in part. Objects may be identified within visual images captured from the scene using a tracking algorithm and correlated to point clouds or other depth models generated based on depth images captured from the scene. Once visual aspects (e.g., colors or other features) of objects are correlated to the point clouds, shapes and/or positions of the objects may be determined and used to further train the tracking algorithms to recognize the objects in subsequently captured frames. Moreover, a Kalman filter or other motion modeling technique may be used to enhance the prediction of a location of an object within subsequently captured frames.

Abstract: Multiple video files that are captured by calibrated imaging devices may be annotated based on a single annotation of an image frame of one of the video files. An operator may enter an annotation to an image frame via a user interface, and the annotation may be replicated from the image frame to other image frames that were captured at the same time and are included in other video files. Annotations may be updated by the operator and/or tracked in subsequent image frames. Predicted locations of the annotations in subsequent image frames within each of the video files may be determined, e.g., by a tracker, and a confidence level associated with any of the annotations may be calculated. Where the confidence level falls below a predetermined threshold, the operator may be prompted to delete or update the annotation, or the annotation may be deleted.

Abstract: The motion of objects within a scene may be detected and tracked using digital (e.g., visual and depth) cameras aligned with fields of view that overlap at least in part. Objects may be identified within visual images captured from the scene using a tracking algorithm and correlated to point clouds or other depth models generated based on depth images captured from the scene. Once visual aspects (e.g., colors or other features) of objects are correlated to the point clouds, shapes and/or positions of the objects may be determined and used to further train the tracking algorithms to recognize the objects in subsequently captured frames. Moreover, a Kalman filter or other motion modeling technique may be used to enhance the prediction of a location of an object within subsequently captured frames.

Abstract: Techniques for analyzing stored video upon a request are described. For example, a method of receiving a first application programming interface (API) request to analyze a stored video, the API request to include a location of the stored video and at least one analysis action to perform on the stored video; accessing the location of the stored video to retrieve the stored video; segmenting the accessed video into chunks; processing each chunk with a chunk processor to perform the at least one analysis action, each chunk processor to utilize at least one machine learning model in performing the at least one analysis action; joining the results of the processing of each chunk to generate a final result; storing the final result; and providing the final result to a requestor in response to a second API request is described.

Abstract: Techniques for analyzing stored video upon a request are described. For example, a method of receiving a first application programming interface (API) request to analyze a stored video, the API request to include a location of the stored video and at least one analysis action to perform on the stored video; accessing the location of the stored video to retrieve the stored video; segmenting the accessed video into chunks; processing each chunk with a chunk processor to perform the at least one analysis action, each chunk processor to utilize at least one machine learning model in performing the at least one analysis action; joining the results of the processing of each chunk to generate a final result; storing the final result; and providing the final result to a requestor in response to a second API request is described.

Abstract: Multiple video files that are captured by calibrated imaging devices may be annotated based on a single annotation of an image frame of one of the video files. An operator may enter an annotation to an image frame via a user interface, and the annotation may be replicated from the image frame to other image frames that were captured at the same time and are included in other video files. Annotations may be updated by the operator and/or tracked in subsequent image frames. Predicted locations of the annotations in subsequent image frames within each of the video files may be determined, e.g., by a tracker, and a confidence level associated with any of the annotations may be calculated. Where the confidence level falls below a predetermined threshold, the operator may be prompted to delete or update the annotation, or the annotation may be deleted.

Abstract: A method of defining a heart region from imaging data is provided. Received imaging data is projected into a first plane. A first threshold is applied to the first plane of data to eliminate data associated with air. A largest first connected component is identified from the first threshold applied data. A first center of mass of the identified largest first connected component is calculated to define a first coordinate and a second coordinate of the heart region. The received imaging data is projected into a second plane, wherein the second plane is perpendicular to the first plane. A second threshold is applied to the second plane of data to eliminate data associated with air. A largest second connected component is identified from the second threshold applied data. A second center of mass of the identified largest second connected component is calculated to define a third coordinate of the heart region.

Abstract: A method of defining a heart region from imaging data is provided. Received imaging data is projected into a first plane. A first threshold is applied to the first plane of data to eliminate data associated with air. A largest first connected component is identified from the first threshold applied data. A first center of mass of the identified largest first connected component is calculated to define a first coordinate and a second coordinate of the heart region. The received imaging data is projected into a second plane, wherein the second plane is perpendicular to the first plane. A second threshold is applied to the second plane of data to eliminate data associated with air. A largest second connected component is identified from the second threshold applied data. A second center of mass of the identified largest second connected component is calculated to define a third coordinate of the heart region.

Abstract: A method of defining a heart region from imaging data is provided. Received imaging data is projected into a first plane. A first threshold is applied to the first plane of data to eliminate data associated with air. A largest first connected component is identified from the first threshold applied data. A first center of mass of the identified largest first connected component is calculated to define a first coordinate and a second coordinate of the heart region. The received imaging data is projected into a second plane, wherein the second plane is perpendicular to the first plane. A second threshold is applied to the second plane of data to eliminate data associated with air. A largest second connected component is identified from the second threshold applied data. A second center of mass of the identified largest second connected component is calculated to define a third coordinate of the heart region.

Abstract: A method and a system for identifying a data quality issue associated with medical diagnostic data is provided. The system includes, but is not limited to, an imaging apparatus configured to generate imaging data and a processor operably coupled to the imaging apparatus to receive the imaging data. The processor is configured to analyze the received imaging data; to identify a data quality issue associated with the received imaging data based on the analysis of the received imaging data; to generate a message including the identified data quality issue; and to send the generated message to a user.

Abstract: A method of identifying a calcium and/or a soft plaque deposit in a blood vessel using imaging data of the blood vessel is provided. A first threshold is applied to a slice of three-dimensional imaging data of a blood vessel to define voxels above the first threshold. A maximum intensity of the blood vessel is identified from the defined voxels. A distance from the identified maximum intensity to a center of the blood vessel is calculated and is compared with a distance threshold. If the calculated distance is greater than the distance threshold, a calcium deposit is identified. A second threshold is applied to the slice to define voxels below the second threshold. If a calcium deposit is identified or if the defined voxels below the threshold have a half-moon shape, a soft plaque deposit is identified.

Abstract: A method of automatically performing a triple rule-out procedure using imaging data is provided. Imaging data is received that includes a heart region, a pulmonary artery region, an ascending aorta region, and a thoraco-abdominal aorta region of a patient. The heart region, an ascending aorta object, an abdominal aorta object, a left main pulmonary artery object, and a right main pulmonary artery object are identified from the imaging data. The identified heart region is analyzed to detect a coronary pathology. The identified ascending aorta object and the identified abdominal aorta object are analyzed to detect an aortic dissection. The identified left main pulmonary artery object and the identified right main pulmonary artery object are analyzed to detect a pulmonary embolism. A report is generated that includes any detected coronary pathology, any detected aortic dissection, and/or any detected pulmonary embolism.