Abstract: A computer assisted system is disclosed that includes an optical tracking system. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted surgical system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, register pre-operative and/or intra-operative data to the color images using the fiducial locations, and generate an augmented reality (AR) image of the environment by overlaying the data over the color image. The computer assisted surgical system can further include a monitor or a head-mounted display (HMD) configured to present the AR image.

Abstract: A system is disclosed that includes an optical tracking device and a surgical computing device. The optical tracking device includes a structured light module and an optical module that includes an image sensor and is spaced from the structured light module at a known distance. The surgical computing device includes a display device, a non-transitory computer readable medium including instructions, and processor(s) configured to execute the instructions to generate a depth map from a first image captured by the image sensor during projection of a pattern into a surgical environment by the structured light module. The pattern is projected in a near-infrared (NIR) spectrum. The processor(s) are further configured to execute the stored instructions to reconstruct a 3D surface of anatomical structure(s) based on the generated depth map. Additionally, the processor(s) are configured to execute the stored instructions to output the reconstructed 3D surface to the display device.

Abstract: A high-speed optical tracking with compression and CMOS windowing for tracking applications that require high-speed and/or low latency when delivering pose (orientation and position) data. The high-speed optical tracking with compression and CMOS windowing generally includes an optical tracking system (10) that sense fiducial (22) and by extension markers (20). The markers can either be integrated on tools (20) handled by an operator (e.g. surgeon) (50) or fixed on the subject to track (e.g. patient) (40). The low-level processing (101, 107, 140) is realized within the tracking system to reduce the overall data to be transferred and considerably reduce the processing efforts. Pose data (127) are finally computed and transferred to a PC/monitor (30,31) or to tablet (60) to be used by an end-user application (130).

Abstract: A system is disclosed that includes an optical tracking device and a surgical computing device. The optical tracking device includes a structured light module and an optical module that includes an image sensor and is spaced from the structured light module at a known distance. The surgical computing device includes a display device, a non-transitory computer readable medium including instructions, and processor(s) configured to execute the instructions to generate a depth map from a first image captured by the image sensor during projection of a pattern into a surgical environment by the structured light module. The pattern is projected in a near-infrared (NIR) spectrum. The processor(s) are further configured to execute the stored instructions to reconstruct a 3D surface of anatomical structure(s) based on the generated depth map. Additionally, the processor(s) are configured to execute the stored instructions to output the reconstructed 3D surface to the display device.

Abstract: A high-speed optical tracking with compression and CMOS windowing for tracking applications that require high-speed and/or low latency when delivering pose (orientation and position) data. The high-speed optical tracking with compression and CMOS windowing generally includes an optical tracking system (10) that sense fiducial (22) and by extension markers (20). The markers can either be integrated on tools (20) handled by an operator (e.g. surgeon) (50) or fixed on the subject to track (e.g. patient) (40). The low-level processing (101, 107, 140) is realized within the tracking system to reduce the overall data to be transferred and considerably reduce the processing efforts. Pose data (127) are finally computed and transferred to a PC/monitor (30,31) or to tablet (60) to be used by an end-user application (130).

Abstract: An optical tracking system is provided. The optical tracking system comprises an autoclavable fiducial marker assembly including an opaque housing, a light source, a window panel configured to refract light rays from the light source therethrough, and a metallized coating forming a hermetic seal at an interface of the window panel and the opaque housing. The fiducial marker assembly is configured to shield a peripheral edge of the window panel from the light rays. The system further comprises a tracking device comprising at least two optical sensors configured to detect a position of a light ray emitted by the light source. The system further comprises a processor configured to receive the position of the light rays from the optical sensors, shift the position of each light ray based on a calculated refraction deviation, and triangulate the location of the light source based on the shifted position of each light ray.

Abstract: A system is disclosed that includes an optical tracking device and a surgical computing device. The optical tracking device includes a structured light module and an optical module that includes an image sensor and is spaced from the structured light module at a known distance. The surgical computing device includes a display device, a non-transitory computer readable medium including instructions, and processor(s) configured to execute the instructions to generate a depth map from a first image captured by the image sensor during projection of a pattern into a surgical environment by the structured light module. The pattern is projected in a near-infrared (NIR) spectrum. The processor(s) are further configured to execute the stored instructions to reconstruct a 3D surface of anatomical structure(s) based on the generated depth map. Additionally, the processor(s) are configured to execute the stored instructions to output the reconstructed 3D surface to the display device.

Abstract: An optical tracking system is provided. The optical tracking system comprises an autoclavable fiducial marker assembly including an opaque housing, a light source, a window panel configured to refract light rays from the light source therethrough, and a metallized coating forming a hermetic seal at an interface of the window panel and the opaque housing. The fiducial marker assembly is configured to shield a peripheral edge of the window panel from the light rays. The system further comprises a tracking device comprising at least two optical sensors configured to detect a position of a light ray emitted by the light source. The system further comprises a processor configured to receive the position of the light rays from the optical sensors, shift the position of each light ray based on a calculated refraction deviation, and triangulate the location of the light source based on the shifted position of each light ray.

Abstract: A system is disclosed that includes an optical tracking device and a surgical computing device. The optical tracking device includes a structured light module and an optical module that includes an image sensor and is spaced from the structured light module at a known distance. The surgical computing device includes a display device, a non-transitory computer readable medium including instructions, and processor(s) configured to execute the instructions to generate a depth map from a first image captured by the image sensor during projection of a pattern into a surgical environment by the structured light module. The pattern is projected in a near-infrared (NIR) spectrum. The processor(s) are further configured to execute the stored instructions to reconstruct a 3D surface of anatomical structure(s) based on the generated depth map. Additionally, the processor(s) are configured to execute the stored instructions to output the reconstructed 3D surface to the display device.

Abstract: A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

Abstract: An optical tracking system is provided. The optical tracking system comprises an autoclavable fiducial marker assembly including an opaque housing, a light source, a window panel configured to refract light rays from the light source therethrough, and a metallized coating forming a hermetic seal at an interface of the window panel and the opaque housing. The fiducial marker assembly is configured to shield a peripheral edge of the window panel from the light rays. The system further comprises a tracking device comprising at least two optical sensors configured to detect a position of a light ray emitted by the light source. The system further comprises a processor configured to receive the position of the light rays from the optical sensors, shift the position of each light ray based on a calculated refraction deviation, and triangulate the location of the light source based on the shifted position of each light ray.

Abstract: A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

Abstract: A system is disclosed that includes an optical tracking device and a surgical computing device. The optical tracking device includes a structured light module and an optical module that includes an image sensor and is spaced from the structured light module at a known distance. The surgical computing device includes a display device, a non-transitory computer readable medium including instructions, and processor(s) configured to execute the instructions to generate a depth map from a first image captured by the image sensor during projection of a pattern into a surgical environment by the structured light module. The pattern is projected in a near-infrared (NIR) spectrum. The processor(s) are further configured to execute the stored instructions to reconstruct a 3D surface of anatomical structure(s) based on the generated depth map. Additionally, the processor(s) are configured to execute the stored instructions to output the reconstructed 3D surface to the display device.

Abstract: A high-speed optical tracking with compression and CMOS windowing for tracking applications that require high-speed and/or low latency when delivering pose (orientation and position) data. The high-speed optical tracking with compression and CMOS windowing generally includes an optical tracking system (10) that sense fiducial (22) and by extension markers (20). The markers can either be integrated on tools (20) handled by an operator (e.g. surgeon) (50) or fixed on the subject to track (e.g. patient) (40). The low-level processing (101, 107, 140) is realized within the tracking system to reduce the overall data to be transferred and considerably reduce the processing efforts. Pose data (127) are finally computed and transferred to a PC/monitor (30,31) or to tablet (60) to be used by an end-user application (130).

Abstract: A high-speed optical tracking with compression and CMOS windowing for tracking applications that require high-speed and/or low latency when delivering pose (orientation and position) data. The high-speed optical tracking with compression and CMOS windowing generally includes an optical tracking system (10) that sense fiducial (22) and by extension markers (20). The markers can either be integrated on tools (20) handled by an operator (e.g. surgeon) (50) or fixed on the subject to track (e.g. patient) (40). The low-level processing (101, 107, 140) is realized within the tracking system to reduce the overall data to be transferred and considerably reduce the processing efforts. Pose data (127) are finally computed and transferred to a PC/monitor (30,31) or to tablet (60) to be used by an end-user application (130).

Abstract: A computer assisted system is disclosed that includes an optical tracking system. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted surgical system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, register pre-operative and/or intra-operative data to the color images using the fiducial locations, and generate an augmented reality (AR) image of the environment by overlaying the data over the color image. The computer assisted surgical system can further include a monitor or a head-mounted display (HMD) configured to present the AR image.

Abstract: A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

Abstract: The present invention relates to a redundant reciprocal tracking system composed of at least two trackers 10. A first tracker is able to sense partial or full pose data (orientation and position) of a second tracker in a first reference frame and the second tracker is able to sense partial or full pose data of the first tracker in a second reference frame. Pose data of first and second trackers are further transferred to a central processor 30, which is able to compute the transformation between first and second reference frame. Data generated by the trackers are such designed that they define an over-determined mathematical system (e.g. more than 6 degrees of freedom in a 3D setup). The over-determined information can be used to qualify and/or improve the transformation of the reference frame. In an embodiment of the invention, the tracking system is an optical one and the over-determined information defines an error metric used to check the validity of the transformation.

Abstract: A high-speed optical tracking with compression and CMOS windowing for tracking applications that require high-speed and/or low latency when delivering pose (orientation and position) data. The high-speed optical tracking with compression and CMOS windowing generally includes an optical tracking system (10) that sense fiducial (22) and by extension markers (20). The markers can either be integrated on tools (20) handled by an operator (e.g. surgeon) (50) or fixed on the subject to track (e.g. patient) (40). The low-level processing (101, 107, 140) is realized within the tracking system to reduce the overall data to be transferred and considerably reduce the processing efforts. Pose data (127) are finally computed and transferred to a PC/monitor (30,31) or to tablet (60) to be used by an end-user application (130).

Abstract: The optical tracking system for mobile surgical navigation generally includes An Optical Tracking System {10} which is able to sense Fiducials (21) located on Markers (20) via Optical Sensors (11). The Optical Tracking System has processing means to compute the pose (position+translation) of the Markers (2.0) and transfer them to a Tablet computer (40) via Communication Means (30). These metrological data are finally used by a surgical application.