Abstract: A technology is described for aligning an image data set with a patient using an augmented reality (AR) headset. A method may include obtaining an image data set representing an anatomical structure of a patient. A two-dimensional (2D) X-ray generated image of at least a portion of the anatomical structure of the patient in the image data set and a visible marker may be obtained. The image data set can be aligned to the X-ray generated image by using data fitting. A location of the visible marker may be defined in the image data set using alignment with the X-ray generated image. The image data set may be aligned with a body of the patient, using the visible marker in the image data set as referenced to the visible marker seen on the patient through the AR headset.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: A technology is described for using a medical implement or a fluoroscopic image with reference to an image data set and a body of a person. A method may include detecting visual image data of a body of a patient and a medical implement. The optical codes on the body of the patient and on the medical implement may be identified. One operation is aligning the image data set with the body of the person using one or more optical codes on the body of the person and the fixed position of an image visible marker with respect to the optical code. A position of the medical implement with respect to the body of the person may be determined using one or more optical codes on the medical implement and the body of the person to reference the medical implement to the image data set and the body of the person.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: An AR headset is described to co-localize an image data set with a body of a person. One method can include identifying optical codes with a contrast medium in a tubing on the body of the person using the AR headset. The image data set can be aligned with the body of the person using the fixed position of the image visible marker with the contrast medium in the tubing with respect to the optical code referenced to a representation of the image visible marker. In one configuration, an image data set can be scaled by comparing a measured size of the image visible marker (e.g., gadolinium tubing) in the captured image data set to the known size of the image visible marker. In addition, a center of an optical code may be identified to more accurately align the image data set with a body of a person.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: Aligning image data of a patient with actual views of the patient using an optical code affixed to the patient. In some embodiments, a method may include affixing an optical code to a patient, affixing a pattern of markers to the patient, capturing image data of the patient, sensing the optical code affixed to the patient and a position of the optical code in a 3D space, accessing the image data, calculating the position of the pattern of markers in the 3D space, registering the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, and displaying in real-time, in an alternate reality (AR) headset, the inner layer of the patient from the image data projected onto actual views of the patient.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: Technology is described for incorporating statistical strength from neighboring voxels in an fMRI image. The method can include the operation of capturing an fMRI image of a human organ and the fMRI image includes statistical values for voxels in order to detect changes associated with blood flow representing organ activity. The statistics of the fMRI image can be upsampled to a larger coordinate size. Another operation can be resampling the statistical values of the fMRI image to improve the statistical strength for target voxels in the fMRI by identifying strong statistical values in neighboring voxels in a defined neighborhood of the target voxels and improving statistical values of the target voxels using the strong statistical values. The statistics of the fMRI image can integrated into a region of interest identified for the human organ to improve data values of the target voxels while retaining regional boundaries.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

Abstract: A method for monitoring productivity may include monitoring performance of a medical procedure at a local device. Medical procedure data may be received at the local device from a management device. The medical procedure data may include relative value units (RVUs) associated with the medical procedure. Medical professional productivity data related to the medical procedure may be provided for display at the local device based on the monitoring of the performance of the medical procedure and the medical procedure data. A procedure completion notification may be transmitted from the local device to the management device when the medical procedure is completed.

Abstract: Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Abstract: A method of creating a panoramic peripheral image may include identifying a virtual observer at a position in a modeled scene. Peripheral images of the modeled scene may be obtained, including views at multiple angles from the virtual observer. The peripheral images may be arranged to depict a panoramic peripheral view of the modeled scene.

Abstract: An image processing method may include capturing images of a subject using an image capture device. The images may be aligned and one image may be subtracted from another to obtain a remainder image. The remainder image may be marked and then recombined with one of the images.

Abstract: A method of creating a panoramic peripheral image may include identifying a virtual observer at a position in a modeled scene. Peripheral images of the modeled scene may be obtained, including views at multiple angles from the virtual observer. The peripheral images may be arranged to depict a panoramic peripheral view of the modeled scene.

Abstract: A method for monitoring productivity may include monitoring performance of a medical procedure at a local device. Medical procedure data may be received at the local device from a management device. The medical procedure data may include relative value units (RVUs) associated with the medical procedure. Medical professional productivity data related to the medical procedure may be provided for display at the local device based on the monitoring of the performance of the medical procedure and the medical procedure data. A procedure completion notification may be transmitted from the local device to the management device when the medical procedure is completed.