Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: Disclosed are various embodiments for a guidance and tracking system that facilitate templated and targeted biopsy and/or treatment. A guidance and tracking system may include a catheter having a six-degree-of-freedom magnetic tracking sensor, where the catheter can be positioned and anchored in an organ or a natural passage of an organ such as the urethral passage in the prostate of a patient. Using tracking sensors, a computing device may be employed to track a location and orientation of an organ and medical instruments during a treatment or diagnostic procedure. The computing device may determine a position and orientation of the medical instrument relative to the organ of interest. A graphical user interface including real, three-dimensional objects to overlay and adjust biopsy templates onto a real three-dimensional organ or lesion that is manually reconstructed prior to the biopsy procedure. A simulator or simulator mode can be provided for training.

Abstract: Techniques and systems are described for providing modularity, tracking and simulation features of a mixed reality simulator. A modular approach to tracking systems, tracked instruments, and interchangeable modular physical models is described. Enhanced indicators and indicator interfaces improve imaging probe and instrument orientation and alignment with respect to a physical target, including but not necessarily within a combined physical and virtual system; these include anisotropy indicators, indicators of alignment in both in-plane and out-of-plane ultrasound or other imaging techniques, and perpendicularity indicators for better placement of probes and instruments over curved surfaces. A universal needle hub is described that integrates tracking system components and simulation feedback components usably with varying needle types.

Abstract: Techniques and systems are described for providing modularity, tracking and simulation features of a mixed reality simulator. A modular approach to tracking systems, tracked instruments, and interchangeable modular physical models is described. Enhanced indicators and indicator interfaces improve imaging probe and instrument orientation and alignment with respect to a physical target, including but not necessarily within a combined physical and virtual system; these include anisotropy indicators, indicators of alignment in both in-plane and out-of-plane ultrasound or other imaging techniques, and perpendicularity indicators for better placement of probes and instruments over curved surfaces. A universal needle hub is described that integrates tracking system components and simulation feedback components usably with varying needle types.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: A computer-implemented method and system for guiding the placement of orthodontic brackets are provided. The system can include an at least one indexing tool designed to conform to at least a portion of a patient's teeth or alveolar process. The system can receive signals from a sensor at the indexing tool as well as signals from a sensor at a bracket positioning tool in order to track spatial location—and/or orientation of one or more brackets relative to the surface of the patient's actual or modeled teeth. A method for guiding the placement of orthodontic brackets involves detecting the location and/or orientation of a bracket with respect to at least one tooth of a patient and notifying the orthodontist that the actual bracket position and/or orientation meets specified criteria with respect to planned placement coordinates for the bracket. The method can further include collecting the planned placement coordinates for each bracket tooth combo during a planning phase.

Abstract: Techniques and systems are described for providing modularity, tracking and simulation features of a mixed reality simulator. A modular approach to tracking systems, tracked instruments, and interchangeable modular physical models is described. Enhanced indicators and indicator interfaces improve imaging probe and instrument orientation and alignment with respect to a physical target, including but not necessarily within a combined physical and virtual system; these include anisotropy indicators, indicators of alignment in both in-plane and out-of-plane ultrasound or other imaging techniques, and perpendicularity indicators for better placement of probes and instruments over curved surfaces. A universal needle hub is described that integrates tracking system components and simulation feedback components usably with varying needle types.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: Systems and techniques are provided in which the orientation of an ultrasonic image display is configured to match the ultrasound probe orientation for ease of interpretation. The position and the orientation of an ultrasound probe are tracked using a tracking device having one or more position and orientation sensors. The orientation of a displayed ultrasound image is automatically adjusted to reflect the position and orientation of the ultrasound probe relative to the body structure being imaged. In some embodiments, a background image (with possible landmarks) is provided based on the location and orientation of the tracked ultrasound probe.

Abstract: The subject invention provides a panoramic, interactive, seamless, intuitive, high-resolution and yet extensive simulation tool capable of simulating dynamic events that alter the panoramic view in response to the user's actions or inaction. The dynamic panorama simulation can generate and display novel scenes that are not limited to static “canned” content that has been previously photographed, rendered, recorded, captured or filmed thus providing great flexibility, contextual authenticity and liveliness and, in some instances, unanticipated and surprising but accurate developments in the simulation.

Abstract: An interactive mixed reality simulator is provided that includes a virtual 3D model of internal or hidden features of an object; a physical model or object being interacted with; and a tracked instrument used to interact with the physical object. The tracked instrument can be used to simulate or visualize interactions with internal features of the physical object represented by the physical model. In certain embodiments, one or more of the internal features can be present in the physical model. In another embodiment, some internal features do not have a physical presence within the physical model.

Abstract: The subject invention provides a panoramic, interactive, seamless, intuitive, high-resolution and yet extensive simulation tool capable of simulating dynamic events that alter the panoramic view in response to the user's actions or inaction. The dynamic panorama simulation can generate and display novel scenes that are not limited to static “canned” content that has been previously photographed, rendered, recorded, captured or filmed thus providing great flexibility, contextual authenticity and liveliness and, in some instances, unanticipated and surprising but accurate developments in the simulation.

Abstract: A method, system and apparatus for simulating a pneumatic system. The method can include dividing a pneumatic system into logical component sections. Each of the logical component sections can be visually rendered in a graphical user interface. Also, user modification of control element settings in the logical component sections can be permitted. Subsequently, gas flows within the logical component sections can be animated using individually rendered gas molecule icons coupled to corresponding animation scripts. Each of the scripts can determine an animation direction and animation rate for a corresponding one of the gas molecule icons. In particular, the actual pneumatic system can be an anesthesia machine.

Abstract: A method, system and apparatus for simulating a pneumatic system. The method can include dividing a pneumatic system into logical component sections. Each of the logical component sections can be visually rendered in a graphical user interface. Also, user modification of control element settings in the logical component sections can be permitted. Subsequently, gas flows within the logical component sections can be animated using individually rendered gas molecule icons coupled to corresponding animation scripts. Each of the scripts can determine an animation direction and animation rate for a corresponding one of the gas molecule icons. In particular, the actual pneumatic system can be an anesthesia machine.