Abstract: A cross reality system enables any of multiple devices to efficiently and accurately access previously persisted maps of very large scale environments and render virtual content specified in relation to those maps. The cross reality system may quickly determine whether a 2D set of features derived from images acquired with a portable device match a set of 3D features of an environment map and, if so, determine the relative pose of the feature sets. The pose may be used in quickly and accurately localizing the portable device to the environment map. Pairs of features in the 2D and 3D features sets may be identified based on matching feature descriptors and may be scored in a neural network trained to assess the quality of the match. Poses may be identified based on subsets of the matching features weighted towards pairs of features with high quality.

Abstract: Medical procedure video searching is described. A system can include a computing system. The computing system can include one or more processors, coupled with memory. The computing system can receive a search request including an image of a medical procedure and an indication of a type of the medical procedure. The computing system can generate, responsive to the search request, a search query based at least on the image with a model established for the type of the medical procedure. The computing system can identify, based at least on the search query, one or more videos of the type of the medical procedure from a collection of videos. The computing system can display, via a graphical user interface, the one or more videos of the type of the medical procedure.

Abstract: Various of the disclosed embodiments relate to systems and methods for determining and for presenting surgical examination data of an internal body structure, such as a large intestine. For example, various of the disclosed methods may create a three-dimensional computer model using the examination data and then coordinate playback of the examination data based upon the reviewer's interaction with the model. In some embodiments, the model's rendering may be adjusted to reflect various aspects of the examination, including scoring metrics, identified landmarks, and lacunae in the surgical examination review.

Abstract: Various of the disclosed embodiments contemplate systems and methods for assessing structural complexity within an intra-surgical environment. For example, in some embodiments, surface characteristics from three-dimensional models of a patient interior, such as a colon, bronchial tube, esophagus, etc. may be used to infer the surface's level of complexity. Once determined, complexity may inform a number of downstream operations, such as assisting surgical operators to identify complex regions requiring more thorough review, the automated recognition of healthy or unhealthy tissue states, etc. While some embodiments apply to generally cylindrical internal structures, such as a colon or branching pulmonary pathways, etc., other embodiments may be used within other structures, such as inflated laparoscopic regions between organs, joints, etc. Various embodiments also consider graphical and feedback indicia for representing the complexity assessments.

Abstract: A cross reality system enables any of multiple devices to efficiently and accurately access previously persisted maps of very large scale environments and render virtual content specified in relation to those maps. The cross reality system may quickly determine whether a 2D set of features derived from images acquired with a portable device match a set of 3D features of an environment map and, if so, determine the relative pose of the feature sets. The pose may be used in quickly and accurately localizing the portable device to the environment map. Pairs of features in the 2D and 3D features sets may be identified based on matching feature descriptors and may be scored in a neural network trained to assess the quality of the match. Poses may be identified based on subsets of the matching features weighted towards pairs of features with high quality.