Abstract: Systems and methods are disclosed for an automated touchless registration of patient anatomy for surgical navigation systems. An example method includes: acquiring a plurality of images of the patient; determining relevant objects from a plurality of poses; and processing the received images through a photogrammetry module. The photogrammetry module may provide camera calibration and facilitate camera registration. As such, manual movement or robotic movement capabilities of the camera head, and digital visualization capabilities of a digital surgical microscope disclosed herein can be extended to allow near-automated or fully automated touchless registration for traditional surgical navigation.

Abstract: A stereoscopic camera with fluorescence strobing based visualization is disclosed herein. In an example, a stereoscopic camera is configured to provide a visible light mode for a first specified number of frames over a cycle by causing visible light reflected from a surgical site to be provided to left and right image sensors by activating a visible light source. The stereoscopic camera is also configured to provide a fluorescence mode for a second specified number of frames over the cycle by causing fluorescence emission light from the surgical site to be provided to the left and right image sensors by activating a near-ultraviolet light source. The stereoscopic camera switches between the visible light mode and the fluorescence mode based on the first and second specified number of frames. A processor superimposes image data corresponding to the fluorescence mode on subsequently received image data corresponding to the visible light mode.

Abstract: A stereoscopic camera with fluorescence strobing based visualization is disclosed herein. In an example, a stereoscopic camera is configured to provide a visible light mode for a first specified number of frames over a cycle by causing visible light reflected from a surgical site to be provided to left and right image sensors by activating a visible light source. The stereoscopic camera is also configured to provide a fluorescence mode for a second specified number of frames over the cycle by causing fluorescence emission light from the surgical site to be provided to the left and right image sensors by activating a near-ultraviolet light source. The stereoscopic camera switches between the visible light mode and the fluorescence mode based on the first and second specified number of frames. A processor superimposes image data corresponding to the fluorescence mode on subsequently received image data corresponding to the visible light mode.

Abstract: Systems and methods for registration degradation correction for surgical procedures are disclosed. An example system includes a processor and a surgical camera configured to record images of a patient. The processor is configured to perform an initial patient registration that registers a patient volume space of virtual positional data points to physical positional points of at least a portion of the patient. The processor also identifies or receives an indication of an identification of a natural patient mark using recorded images of the patient and records a virtual mark in the patient volume space in response to a received activation action based on the identification of the natural patient mark. The processor then causes the patient volume space of virtual positional data points and the recorded virtual mark to be displayed in an overlaid manner over the recorded images on a single display.

Abstract: New and innovative systems and methods for an integrated surgical navigation and visualization are disclosed. An example system comprises: a single cart providing mobility; a stereoscopic digital surgical microscope; one or more computing devices (e.g., including a single computing device) housing and jointly executing a surgical navigation module and a surgical visualization module, and powered by a single power connection, thus reducing operating room footprint; a single unified display; a processor; and memory. In one embodiment, the system may control a position of a stereoscopic digital surgical microscope with a given reference; provide navigation of a surgical site responsive to user input; provide visualization of the surgical site via a single unified display; and synchronize, in real time, the visualization by integrating navigation information and the visualization of the surgical via the single unified display.

Abstract: New and innovative systems and methods for registration degradation correction for surgical procedures are disclosed. An example system includes a surgical marking pen including a first trackable target and a registration plate including a second trackable target. The system also includes a navigation camera and a processor configured to perform a pen registration that determines a transformation between a tip of the surgical marking pen and the first trackable target when the tip of the surgical marking pen is placed on the registration plate. The pen registration enables the processor to record virtual marks at locations of the pen tip that correspond to physical marks drawn by the pen. Locations of the virtual marks are later compared to images of the physical marks to correct any registration degradation by moving a surgical camera or robotic arm connected to the surgical camera.

Abstract: Systems and methods are disclosed for an automated touchless registration of patient anatomy for surgical navigation systems. An example method includes: acquiring a plurality of images of the patient; determining relevant objects from a plurality of poses; and processing the received images through a photogrammetry module. The photogrammetry module may provide camera calibration and facilitate camera registration. As such, manual movement or robotic movement capabilities of the camera head, and digital visualization capabilities of a digital surgical microscope disclosed herein can be extended to allow near-automated or fully automated touchless registration for traditional surgical navigation.

Abstract: The present disclosure provides new and innovative systems and apparatuses for a surgical registration probe that provides improved detection by a surgical navigation system (e.g., localizer). An example apparatus includes a surgical registration probe; a localizer configured to track the surgical registration probe; and a surgical visualization system (e.g., localizer) configured to display a surgical site responsive to the tracking. The surgical registration probe may include: a marker shaft with at least one marker or fiducial; wherein the marker or fiducial causes the localizer to detect the surgical registration probe; and a probe shaft having at least three sections that are bent at a defined angle with respect to each other. In some embodiments, the apparatus may further comprise a calibration plate for securing the surgical registration probe.

Abstract: The present disclosure relates generally to a system, method, and apparatus for tracking a tool via a digital surgical microscope. Cameras on the digital surgical microscope may capture a scene view of a medical procedure in real time, and present the scene view to the surgeon in a digitized video stream with minimal interference from the surgeon. The digital surgical microscope may process image data from each scene view in real time and use computer vision and machine learning models (e.g., neural networks) to detect and track one or more tools used over the course of the medical procedure in real-time. As the digital surgical microscope detects and tracks the tools, and responds accordingly, the surgeon can thus indirectly control, using the tools already in the surgeon's hands, various parameters of the digital surgical microscope, including the position and orientation of the robotic-arm-mounted digital surgical microscope.

Abstract: New and innovative systems and methods for registration degradation correction for surgical procedures are disclosed. An example system includes a surgical marking pen including a first trackable target and a registration plate including a second trackable target. The system also includes a navigation camera and a processor configured to perform a pen registration that determines a transformation between a tip of the surgical marking pen and the first trackable target when the tip of the surgical marking pen is placed on the registration plate. The pen registration enables the processor to record virtual marks at locations of the pen tip that correspond to physical marks drawn by the pen. Locations of the virtual marks are later compared to images of the physical marks to correct any registration degradation by moving a surgical camera or robotic arm connected to the surgical camera.

Abstract: New and innovative systems and methods for auto-navigation in an integrated surgical navigation and visualization system are disclosed. An example system comprises: a single cart providing motility; a stereoscopic digital surgical microscope comprising a surgical visualization camera and a localizer; one or more computing devices (e.g., a single computing device powered by a single power connection) housing and jointly executing a surgical navigation module and a surgical visualization module, wherein the localizer is associated with the surgical navigation module, and wherein the surgical visualization camera is associated with the surgical visualization module; a single unified display; a processor; and memory.

Abstract: The present disclosure relates generally a hand-centric controller that provides a user (e.g., surgeon) with the ability to control a number of microscope movement controls, non-movement microscope controls, image and color controls, media controls, and hyperspectral controls without having to reach beyond the space surrounding the surgical tool being used or the space surrounding the surgeon's hands. In some embodiments, the hand-centric controller is a limited button (e.g., one, two, three buttons) controller. In other embodiments, the hand-centric controller is an extended hand-centric controller. The hand-centric controller may be configured to provide microscope movement (e.g., x-y axis movement, lock-to-target movement, yaw movement, physical focus movement, and gross general movement), non-movement microscope control (e.g., zoom, focus, autofocus, and white light), image and color controls (e.g., next image and previous image modes), media controls (e.g.

Abstract: A system for video game physical interaction is provided for a host device with an associated interactive application by a plurality of physical building blocks each having at least one input connection point and one output connection point operable for connection to one or more of the remaining blocks. Detectable connection paths through the plurality of blocks allow determination of the shape of a structure created by the blocks and interfacing of the connection paths of the plurality of blocks to the host device creates an input to the interactive application. The application is then altered responsive to the connection paths.

Abstract: Disclosed herein are systems, apparatus, and methods for real-time image capture with variable density display, high resolution electronic zoom, and improved depth of field. The systems, apparatus, and methods used to view a target site include: at least one image sensor with an energy receiving surface having X pixels for producing one or more signals that correspond to the target site; at least one display for presenting N fields of view, wherein each field of view is comprised of at least one image produced by the signals; and an electronic zoom mechanism that can switch between N fields of view with little or no loss of resolution, wherein the first field of view is comprised of input from no more than X/N non-adjacent pixels and at least one zoom field of view is comprised of input from no more than X/N adjacent active pixels.

Abstract: An unmanned integrated RES 12 integrates all of its components except the reflector 22 into a single console 30 that is positioned at the side of a road and has a CPU 36 that controls calibration, verification and data gathering. The RES's source 32 and receiver 34 are preferably stacked one on top of the other such that the IR beam 24 traverses a low and high path as it crosses the road 14. This allows the RES to detect both low and high ground clearance vehicles. To maintain the vehicle processing and identification throughput, the speed sensor 54 and ALPR 48,50 detect the passing vehicles at steep angles, approximately 20 to 35 degrees. In a preferred system, a manned control center 16 communicates with a large number of the unmanned integrated RES to download emissions data, perform remote diagnostics, and, if necessary, dispatch a technician to perform maintenance on a particular RES.

Abstract: An unmanned integrated RES 12 integrates all of its components except the reflector 22 into a single console 30 that is positioned at the side of a road and has a CPU 36 that controls calibration, verification and data gathering. The RES's source 32 and receiver 34 are preferably stacked one on top of the other such that the IR beam 24 traverses a low and high path as it crosses the road 14. This allows the RES to detect both low and high ground clearance vehicles. To maintain the vehicle processing and identification throughput, the speed sensor 54 and ALPR 48,50 detect the passing vehicles at steep angles, approximately 20 to 35 degrees. In a preferred system, a manned control center 16 communicates with a large number of the unmanned integrated RES to download emissions data, perform remote diagnostics, and, if necessary, dispatch a technician to perform maintenance on a particular RES.

Abstract: An unmanned integrated RES 12 integrates all of its components except the reflector 22 into a single console 30 that is positioned at the side of a road and has a CPU 36 that controls calibration, verification and data gathering. The RES's source 32 and receiver 34 are preferably stacked one on top of the other such that the IR beam 24 traverses a low and high path as it crosses the road 14. This allows the RES to detect both low and high ground clearance vehicles. To maintain the vehicle processing and identification throughput, the speed sensor 54 and ALPR 48,50 detect the passing vehicles at steep angles, approximately 20 to 35 degrees. In a preferred system, a manned control center 16 communicates with a large number of the unmanned integrated RES to download emissions data, perform remote diagnostics, and, if necessary, dispatch a technician to perform maintenance on a particular RES.