Abstract: A technology is described for aligning an image data set with a patient using an augmented reality (AR) headset. A method may include obtaining an image data set representing an anatomical structure of a patient. A two-dimensional (2D) X-ray generated image of at least a portion of the anatomical structure of the patient in the image data set and a visible marker may be obtained. The image data set can be aligned to the X-ray generated image by using data fitting. A location of the visible marker may be defined in the image data set using alignment with the X-ray generated image. The image data set may be aligned with a body of the patient, using the visible marker in the image data set as referenced to the visible marker seen on the patient through the AR headset.

Abstract: A technology is described for aligning an image data set with a patient using an augmented reality (AR) headset. A method may include obtaining an image data set representing an anatomical structure of a patient. A two-dimensional (2D) X-ray generated image of at least a portion of the anatomical structure of the patient in the image data set and a visible marker may be obtained. The image data set can be aligned to the X-ray generated image by using data fitting. A location of the visible marker may be defined in the image data set using alignment with the X-ray generated image. The image data set may be aligned with a body of the patient, using the visible marker in the image data set as referenced to the visible marker seen on the patient through the AR headset.

Abstract: A technology is described for using an augmented reality (AR) headset to co-localize an image data set with a body of a person. A method may include registering one or more initial visible markers attached to the body of the person, and the optical code may be located in a fixed position relative to the image visible marker. The coordinate system of the one or more initial visible markers may be transferred to the one or more additional visible markers. The use of the one or more additional visible markers may be emphasized to align of the image data set with the body of the person.

Abstract: Technology is described to adjust for eye location variations of a user when using an augmented reality (AR) headset. The method can include registering a position and size of an optical code using a visual camera and the AR headset. An alignment marker may be projected through the AR headset to be aligned with the optical code for a right eye and left eye of a user of the AR headset. Right eye and left eye adjustments to the alignment marker may be received independently to align the alignment marker with a portion of the optical code as viewed by either the right eye or left eye of the user. The left eye adjustments and right eye adjustments may be applied to virtual images displayed through the AR headset in order to improve the accuracy of alignment between objects in the physical view and the virtual images displayed using the AR headset.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: A technology is described for using a medical implement or a fluoroscopic image with reference to an image data set and a body of a person. A method may include detecting visual image data of a body of a patient and a medical implement. The optical codes on the body of the patient and on the medical implement may be identified. One operation is aligning the image data set with the body of the person using one or more optical codes on the body of the person and the fixed position of an image visible marker with respect to the optical code. A position of the medical implement with respect to the body of the person may be determined using one or more optical codes on the medical implement and the body of the person to reference the medical implement to the image data set and the body of the person.

Abstract: An AR headset is described to co-localize an image data set with a body of a person. The image data set of a portion of the body may be identified. The image data set can include a virtual anatomical marker to identify an anatomical location. A spatial location may be identified using a physical pointer object in a field of view of the AR headset. A spatial location of a visible anatomical feature as identified using the physical pointer object may be recorded. The registration may be triggered based on an input that the physical pointer object is located at a visible anatomical feature of the body of the person. Further, the image data set may be aligned with the body of the person using the spatial location recorded for the visible anatomical feature as referenced to the virtual anatomical marker in the image data set.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: An AR headset is described to co-localize an image data set with a body of a person. One method can include identifying optical codes with a contrast medium in a tubing on the body of the person using the AR headset. The image data set can be aligned with the body of the person using the fixed position of the image visible marker with the contrast medium in the tubing with respect to the optical code referenced to a representation of the image visible marker. In one configuration, an image data set can be scaled by comparing a measured size of the image visible marker (e.g., gadolinium tubing) in the captured image data set to the known size of the image visible marker. In addition, a center of an optical code may be identified to more accurately align the image data set with a body of a person.

Abstract: A technology is described for using a medical implement or a fluoroscopic image with reference to an image data set and a body of a person. A method may include detecting visual image data of a body of a patient and a medical implement. The optical codes on the body of the patient and on the medical implement may be identified. One operation is aligning the image data set with the body of the person using one or more optical codes on the body of the person and the fixed position of an image visible marker with respect to the optical code. A position of the medical implement with respect to the body of the person may be determined using one or more optical codes on the medical implement and the body of the person to reference the medical implement to the image data set and the body of the person.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: An AR headset is described to co-localize an image data set with a body of a person. One method can include identifying optical codes with a contrast medium in a tubing on the body of the person using the AR headset. The image data set can be aligned with the body of the person using the fixed position of the image visible marker with the contrast medium in the tubing with respect to the optical code referenced to a representation of the image visible marker. In one configuration, an image data set can be scaled by comparing a measured size of the image visible marker (e.g., gadolinium tubing) in the captured image data set to the known size of the image visible marker. In addition, a center of an optical code may be identified to more accurately align the image data set with a body of a person.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: An AR headset is described to co-localize an image data set with a body of a person. One method can include identifying optical codes with a contrast medium in a tubing on the body of the person using the AR headset. The image data set can be aligned with the body of the person using the fixed position of the image visible marker with the contrast medium in the tubing with respect to the optical code referenced to a representation of the image visible marker. In one configuration, an image data set can be scaled by comparing a measured size of the image visible marker (e.g., gadolinium tubing) in the captured image data set to the known size of the image visible marker. In addition, a center of an optical code may be identified to more accurately align the image data set with a body of a person.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: Aligning image data of a patient with actual views of the patient using an optical code affixed to the patient. In some embodiments, a method may include affixing an optical code to a patient, affixing a pattern of markers to the patient, capturing image data of the patient, sensing the optical code affixed to the patient and a position of the optical code in a 3D space, accessing the image data, calculating the position of the pattern of markers in the 3D space, registering the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, and displaying in real-time, in an alternate reality (AR) headset, the inner layer of the patient from the image data projected onto actual views of the patient.

Abstract: Aligning image data of a patient with actual views of the patient using an optical code affixed to the patient. In some embodiments, a method may include affixing an optical code to a patient, affixing a pattern of markers to the patient, capturing image data of the patient, sensing the optical code affixed to the patient and a position of the optical code in a 3D space, accessing the image data, calculating the position of the pattern of markers in the 3D space, registering the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, and displaying in real-time, in an alternate reality (AR) headset, the inner layer of the patient from the image data projected onto actual views of the patient.