Abstract: A system and method for setting a shared anchor point for a plurality of AR headsets for displaying an augmented reality presentation that may include live and simulated images to all of the AR headsets based on the perspective of the shared anchor point. The system and method can be used to support a plurality of users for simulating or performing a medical procedure on a particular patient.

Abstract: A system and method for utilizing MD6DM models built from a SNAP case to generate an interactive four-dimensional (“4D”) angiogram, the 4th dimension including the dimension of time. By introducing such a 4th dimension to the angiogram, the example systems and methods enable visualization of a patient anatomy, such as blood flow over time, to be presented to a user in an interactive manner. This allows a user, such as a surgeon, to more effectively visualize and determine, for example, various anatomical features, such as the structure of an arteriovenous malformation (“AVM”).

Abstract: A system and method for converting medical images of a particular patient into high resolution, 3D dynamic and interactive images interacting with medical tools including medical devices by coupling a model of tissue dynamics and tool characteristics to the patient specific imagery for simulating a medical procedure in an accurate and dynamic manner. The method includes a tool to add and/or to adjust the dynamic image of tissues and ability to draw and add geometric shapes on the dynamic image of tissues. The system imports the 3D surgery plan (craniotomy, head position, approach etc.). The surgeon establishes multiple views, rotates and interacts with the navigation image to see behind pathology and vital structures. The surgeon can make structures such as tumors, vessels and tissue transparent to improve visualization and to be able to see behind the pathology. The System can warn on proximity of tools to specific anatomical structure.

Abstract: A dual mode augmented reality surgical system configured to operate in both a tracking and a non-tracking mode includes a head mounted display configured to provide an optical view of a patient and to inject received data content over top of the optical view to form an augmented reality view of the patient, and comprising internal tracking means configured to determine a surgeon's position as well as angle and direction of view relative to the patient. The system further includes an augmented reality computing system comprising one or more processors, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors.

Abstract: A navigation system that utilizes existing mobile computing and mapping technologies and provides a user with a unique and customized augmented reality navigation experience to support user appointments from an arbitrary starting point into the facility where the user has the appointment and ultimately to the destination appointment room. For medical patients, the system can accommodate medical information and instructions regarding the patient using the system.

Abstract: A system and method for providing an imaging system utilizing black bone MRI scanning data of a particular patient. Post processing software is provided for executing on a computer system to process the Black Bone MRI dataset into a 360VR model. This model highlights bone structures of the particular patient. The post processing software first inverts the dataset and then utilizes an auto detection algorithm that detects the pixels of intensity range similar to that of bone. Additional tools such as an erase tool that removes pixels out of intensity range within the designated bounds of the area, were developed to help further clean up the model, thereby providing a model useful for planning or performing medical procedures on the patient.

Abstract: A plurality of methods of registering and matching biological tissue images from a dynamic 3D medical model generated using medical images taken of biological tissues of a particular patient with a live video feed of the biological tissues of the particular patient, and a computer system for implementing such methods.

Abstract: A system and method comprising a computer system and database configured using artificial intelligence software for storing historical histograms derived from images of particular biological features of different patients. The stored histograms are each associated with a transfer function that can be used in a 3D model of the biological features to allow users of the model to better observe particular features of the model. The system will automatically determine a transfer function for a new scan(s) by deriving a current histogram of the new scan, comparing this current histogram with the historical histograms stored in the database, and selecting the histogram that is closest to the current histogram based on certain features. The transfer function associated with the closest histogram is then used to obtain a new transfer function for the current histogram for use in a 3D model of the new scan(s).

Abstract: An image alignment system and method which generates X-ray aligned patient specific 3D models. In particular, the image alignment system combines a CT scan and an X-ray into a single patient specific 3D model that, leveraging the benefits of both types of images and providing a surgeon with a single model for diagnosing a spinal deformity, for engaging and education a patient about the spinal deformity, and for preparing for spinal surgery. The system allows the CT scan to be done with the patient in the prone condition while the X-ray can be done with the patient in a vertical, e.g., standing, position to capture impacts on the spine from that vertical position.

Abstract: A system for modeling neurological activity includes a computer having one or more processors, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices. The program instructions are configured to receive electroencephalogram (“EEG”) data generated by an EEG device coupled to a plurality of electrodes disposed on a brain, the EEG data comprising a plurality of waveforms representative of electrical activity detected by the plurality of electrodes over a period of time; generate a graphical brain model representative of the brain; to convert the EEG data into a graphical EEG model representative of electrical activity; integrate the EEG model with the brain model, thereby enabling visualization of and interaction with the EEG model within the context of the brain model; and communicate the integrated EEG and brain model to a display.

Abstract: A tumor tracking system and method which leverages an image generator and an MD6DM model for tracking and monitoring a status of a tumor over time. In particular, the tumor tracking system enables a physician, or a group of physicians, in collaboration, to visualize and interact with an integrated representation of data relating to a patient's tumor and associated treatment history and also to plan future treatments of the tumor. An integrated and interactive tumor board generated by the tumor tracking system provides a single interface that compiles and organizes information from multiple sources to enable efficient tumor tracking and treatment planning.

Abstract: A system and method for providing an imaging system comprising an image generator and a MD6DM model, for creating a synchronized augmented reality view of a subject. In particular, the imaging system enables augmenting and overlaying the MD6DM model over top of a corresponding physical model. Moreover, the imaging system anchors the MD6DM model to the physical model and synchronizes the two, such that a new image is created and overplayed over top of the physical model according to movement around the model, such as using a physical probe. This is accomplished by streaming the image generator directly to an HMD, tracking a position and location of the HMD, and adjusting the image generator based on the tracked movement. Thus, a dependency is created between the virtual model and the physical model. Guides can be provided to the user to enable the user to simulate and practice placing a virtual accessory, such as a model of an implantable screw, into a desired location in the physical model.

Abstract: An artificial intelligence surgical planning system is configured to receive as input historical surgical procedure data relating to a plurality of surgical procedures previously performed for a plurality of patients; generate a surgical procedures parameters algorithm using one or more artificial intelligence machine learning algorithms based on the received historical surgical procedure data, wherein the surgical procedures parameters algorithm is configured to identify recommended a surgical parameter for a surgical procedure to be performed for a current patient based on current surgical procedure data; receive current surgical procedure data for a patient for which a surgical procedure is to be performed; apply the generated surgical procedures parameters algorithm to the received current surgical procedure data in order to identify a recommended surgical parameter for the surgical procedure to be performed for the current patient; and output the recommended surgical parameter to the display.

Abstract: A virtual reality surgical navigation method includes the steps of preparing a multi dimension virtual model associated with an anatomy inside of patient; receiving data indicative of a surgeon's current head position, including direction of view and angle of view; rendering a first virtual three-dimensional image from the virtual model, the virtual three-dimensional image being representative of an anatomical view from a first perspective at a location inside the patient, wherein the perspective is determined by data indicative of the surgeon's current head position; communicating the first rendered virtual image to a virtual headset display; receiving data input indicative of the surgeon's head moving to a second position, wherein the head movement comprises at least one of a change in angle of view and a change in direction of view; and rendering a second virtual three-dimensional image from the virtual model, the second virtual three-dimensional image being representative of an anatomical view from a seco

Abstract: A plurality of methods of registering and matching biological tissue images from a dynamic 3D medical model generated using medical images taken of biological tissues of a particular patient with a live video feed of the biological tissues of the particular patient, and a computer system for implementing such methods.

Abstract: A method includes obtaining medical images of the internal anatomy of a particular patient; preparing a three dimensional virtual model of the patient; generating a virtual reality environment using said virtual model of the patient to provide a realistic three dimensional images of actual tissues of the patient; providing an interface to receive user input defining a path through the internal anatomy of the patient within the virtual reality environment to capture various perspectives of the realistic three dimensional images of the internal anatomy of actual tissues of the patient; and generating a patient video capturing the defined path through the internal anatomy of the patient within the virtual reality environment, said patient video showing views of various perspectives of the realistic three dimensional images of the internal anatomy of actual tissues of the patient, said patient video being configured to play on a general purpose computing device.

Abstract: A system and method for selecting and/or designing a tool for a medical procedure by converting static/still medical images of a particular patient into dynamic and interactive images interacting with selected medical tools including medical devices by coupling a model of tissue dynamics and tool characteristics to the patient specific imagery for simulating a medical procedure in an accurate and dynamic manner by coupling a model of tissue dynamics to patient specific imagery for simulating the medical procedure.

Abstract: A method includes: receiving synchronization and navigation data from a navigation system; generating a physical frame of reference with respect to a registered physical model based on the synchronization and navigation data; registering an augmented reality head mounted display with the navigation system using the synchronization and navigation data; receiving data representative of a virtual model; anchoring the virtual model to the physical frame of reference; receiving tracking data indicative of the position and angle of view of the augmented reality head mounted display with respect to the physical frame of reference; and responsive to determining that the physical model is within a field of view of the augmented reality head mounted display: rendering a virtual image from the virtual model in real time based on the received tracking data; and streaming the virtual image to the augmented reality head mounted display, thereby generating a synchronized and augmented realty view.

Abstract: A system and method for converting static/still medical images of a particular patient into dynamic and interactive images interacting with medical tools including medical devices by coupling a model of tissue dynamics and tool characteristics to the patient specific imagery for simulating a medical procedure in an accurate and dynamic manner by coupling a model of tissue dynamics to patient specific imagery for simulating cerebral aneurysm clipping surgery.

Abstract: A dual mode augmented reality surgical system configured to operate in both a tracking and a non-tracking mode includes a head mounted display configured to provide an optical view of a patient and to inject received data content over top of the optical view to form an augmented reality view of the patient, and comprising internal tracking means configured to determine a surgeon's position as well as angle and direction of view relative to the patient. The system further includes an augmented reality computing system comprising one or more processors, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors.