Abstract: An augmented reality trigger system (10) comprising a primary augmented reality device (30) and a trigger action controller (40) for implementing an augmented reality trigger method based on a medical tool (20) and/or a tool identifier (21) associated with the medical tool (20). In operation, the primary augmented reality device (30) generates a camera image of the real world, which may or may not at any time include the medical tool (20) and/or the tool identifier (21). The trigger action controller (40) recognizes a generation by the primary augmented reality device (30) of the camera image of the real world including the medical tool (20) and/or the tool identifier (21) and in response to such recognition, triggers a medical procedure action by the primary augmented reality device (30) and/or a medical device (50) in support of a medical procedure involving the medical tool (20).

Abstract: A computer-implemented method of providing an endovascular coil specification of an endovascular coil for treating an aneurysm in a coil embolization procedure, includes: inputting (S120) X-ray image data (110), comprising one or more X-ray images including an aneurysm (120), into a neural network (130, 230) trained to predict, from the X-ray image data (110), endovascular coil data (140, 150) of an endovascular coil for treating the aneurysm (120); and outputting (S130) the endovascular coil data (140, 150) to provide the endovascular coil specification.

Abstract: An augmented reality trigger system (10) comprising a primary augmented reality device (30) and a trigger action controller (40) for implementing an augmented reality trigger method based on a medical tool (20) and/or a tool identifier (21) 5 associated with the medical tool (20). In operation, the primary augmented reality device (30) generates a camera image of the real world, which may or may not at any time include the medical tool (20) and/or the tool identifier (21). The trigger action controller (40) recognizes a generation by the primary augmented reality device (30) of the camera image of the real world including the medical tool (20) and/or the tool 10 identifier (21) and in response to such recognition, triggers a medical procedure action by the primary augmented reality device (30) and/or a medical device (50) in support of a medical procedure involving the medical tool (20).

Abstract: A controller for augmenting reality in a three-dimensional (3D) space includes a memory that stores instructions; and a processor that executes the instructions. The controller controls a display system configured to present virtual objects in the 3D space. When executed by the processor, the instructions cause the controller to perform a process. The process includes detecting a first action by a user relative to an object or a virtual object in the 3D space. The process also includes selectively enabling or disabling a virtual operation member based on detecting the first action between the user and the object or virtual object in the 3D space. The virtual operational member is configured, when operated, to control operation of a machine in the 3D space.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: A torque detection vascular therapy system employing a vascular therapy device (101) and a torque detection controller (130). The vascular therapy device (101) is operable to be transitioned from a pre-deployed state to a post-deployed state, and includes a matrix of imageable markers representative of a geometry of the vascular therapy device (101).

Abstract: A medical instrument includes a first device (108) including shape-sensed flexible instrument, a second device (102) disposed over the first device and a third device (109) disposed over the first device and a portion of the second device. The second and third devices include a geometric relationship such that a position of the second device and the third device is determined from shape sensing information of the first device and the geometric relationship.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: A mixed reality device (30) employing a mixed reality display (40) for visualizing a virtual augmentation of a physical anatomical model, and a mixed reality controller (50) for controlling a visualization by the mixed reality display (40) of the virtual augmentation of the physical anatomical model including a mixed reality interaction between the physical anatomical model and a virtual anatomical model. The mixed reality controller (50) may employ a mixed reality registration module (51) for controlling a spatial registration between the physical anatomical model within a physical space and the virtual anatomical model within a virtual space, and a mixed reality interaction module for controlling the mixed reality interaction between the physical anatomical model and the virtual anatomical model based on the spatial registration between the physical anatomical model within the physical space and the virtual anatomical model within the virtual space.

Abstract: An augmented reality system includes a head-mountable augmented reality platform (152) having a display to provide guidance to a user. A prediction module (115) is trained in a procedure and is configured to predict a next activity in the procedure based on a current condition. An image generation module (148) is responsive to the prediction module to provide a visual cue of a predicted next activity to the user through the head-mountable augmented reality platform.

Abstract: A controller for augmenting reality in a three-dimensional ( 3D) space includes a memory that stores instructions; and a processor that executes the instructions. The controller controls a display system configured to present virtual objects in the 3D space. When executed by the processor, the instructions cause the controller to perform a process. The process includes detecting a first action by a user relative to an object or a virtual object in the 3D space. The process also includes selectively enabling or disabling a virtual operation member based on detecting the first action between the user and the object or virtual object in the 3D space. The virtual operational member is configured, when operated, to control operation of a machine in the 3D space.

Abstract: A system and method for determining the position of a non-shape-sensed guidewire (102) and for visualizing the guidewire. The system includes a shape-sensed catheter (104) having a lumen (103) that is configured to receive the non-shape-sensed guidewire. A measurement module (122) is configured to measure a distance that the non-shape-sensed guidewire moves. The measurement module may receive signals from a sensor (124) associated with a measurement assembly that is configured to receive at least a portion of the non-shape-sensed guidewire and/or the shape-sensed catheter. A location module (126) is configured to determine a position of the non-shape-sensed guidewire. The system is configured to generate a virtual image (101) of the guidewire, including a portion of the non-shape-sensed guidewire that does not extend along a shape-sensing optical fiber.

Abstract: A controller for augmenting reality in a three-dimensional (3D) space includes a memory that stores instructions; and a processor that executes the instructions. The controller controls a display system configured to present virtual objects in the 3D space. When executed by the processor, the instructions cause the controller to perform a process. The process includes detecting a first action by a user relative to an object or a virtual object in the 3D space. The process also includes selectively enabling or disabling a virtual operation member based on detecting the first action between the user and the object or virtual object in the 3D space. The virtual operational member is configured, when operated, to control operation of a machine in the 3D space.

Abstract: An augmented reality device (50) employing an augmented reality display (53) for displaying a virtual object relative to a view of a physical object within a physical world. The device (50) further employs a virtual object positioning controller (60) for autonomously controlling a positioning of the virtual object within the augmented reality display (53) based on a decisive aggregation implementation of spatial positioning rule(s) regulating the positioning of the virtual object within the augmented reality display (53) and a sensing of the physical world (e.g., an object detection of physical object(s) within the physical world, a pose detection of the augmented reality display (53) relative to the physical world, and/or an ambient detection of an operating environment of the augmented reality display (53) relative to the physical world). The decisive aggregation may further include an operational assessment and/or virtual assessment of the augmented reality display (53).

Abstract: A system (300) for radiation dose monitoring in a medical environment (305) includes an imaging device (310) for directing radiation (312) onto a patient (315) and a radiation dose measuring device (325) for measuring a radiation dose of at least one medical personnel (320) within the medical environment (305). The system further includes a processor (327) for receiving radiation dose information of the patient or of the at least one medical personnel, and for rendering, in real-time, a virtual object (401) associated with each radiation dose measuring device (325), the virtual object (401) representing radiation dose information. The system can further include a display (340) for displaying distribution of radiation (505) in the medical environment (305).

Abstract: A medical instrument includes a first device (108) including shape-sensed flexible instrument, a second device (102) disposed over the first device and a third device (109) disposed over the first device and a portion of the second device. The second and third devices include a geometric relationship such that a position of the second device and the third device is determined from shape sensing information of the first device and the geometric relationship.

Abstract: A controller for augmenting reality includes a memory that stores instructions, and a processor that executes the instructions. The controller receives, from at least one device that provides output via a display, an information feed comprising first visual information from the at least one device. When executed by the processor, the instructions cause the controller to execute a process comprising controlling generation of first visual information in a first shared portion of a three-dimensional (3D) space by a first augmented reality device as augmented reality, and controlling generation of the first visual information in the first shared portion of the 3D space by a second augmented reality device as augmented reality.

Abstract: A mixed reality device (30) employing a mixed reality display (40) for visualizing a virtual augmentation of a physical anatomical model, and a mixed reality controller (50) for controlling a visualization by the mixed reality display (40) of the virtual augmentation of the physical anatomical model including a mixed reality interaction between the physical anatomical model and a virtual anatomical model. The mixed reality controller (50) may employ a mixed reality registration module (51) for controlling a spatial registration between the physical anatomical model within a physical space and the virtual anatomical model within a virtual space, and a mixed reality interaction module for controlling the mixed reality interaction between the physical anatomical model and the virtual anatomical model based on the spatial registration between the physical anatomical model within the physical space and the virtual anatomical model within the virtual space.

Abstract: A controller for augmenting reality in a three-dimensional (3D) space includes a memory that stores instructions; and a processor that executes the instructions. The controller controls a display system configured to present virtual objects in the 3D space. When executed by the processor, the instructions cause the controller to perform a process. The process includes detecting a first action by a user relative to an object or a virtual object in the 3D space. The process also includes selectively enabling or disabling a virtual operation member based on detecting the first action between the user and the object or virtual object in the 3D space. The virtual operational member is configured, when operated, to control operation of a machine in the 3D space.

Abstract: A torque detection vascular therapy system employing a vascular therapy device (101) and a torque detection controller (130). The vascular therapy device (101) is operable to be transitioned from a pre-deployed state to a post-deployed state, and includes a matrix of imageable markers representative of a geometry of the vascular therapy device (101).