Abstract: A camera (10) comprising an image sensor (24) for capturing image data with a plurality of pixels, a first processing unit (30) for reading out the image data of the image sensor (24) in an image data stream comprising groups of adjacent pixels, a second processing unit (32) for processing the image data, and a memory (34) for storing at least one of the image data and processing results from the image data, wherein a neural network (38) is implemented on at least one of the first processing unit (30) and the second processing unit (32) and wherein the first processing unit (30) is configured to already process groups of pixels with at least a first layer (42) of the neural network while further groups of the image data are still being read out from the image sensor (24).

Abstract: Systems and methods for defining a relationship between a surgical object and a tracker coupled to the surgical object. A first optical sensor senses light in an infrared spectrum or a near-infrared spectrum. A second optical sensor senses light in a visible light spectrum. Controller(s) acquire one or more first images of the tracker from the first optical sensor and acquire one or more second images of the surgical object from the second optical sensor. The controller(s) recognize a pose of the tracker based on the one or more first image and recognize a geometry of the surgical object based on the one or more second images. The controller(s) correlate the recognized pose of the tracker and the recognized geometry of the surgical object to define a relationship between the tracker and the surgical object.

Abstract: Systems and methods for calibration of a surgical tool having a tracker. At least one camera captures images of the tracker at a first exposure and captures images of the surgical tool at a second exposure with a different exposure time and/or illumination than the first exposure. Controller(s) recognize a pose of the tracker based on the first exposure images and recognize a geometry of the surgical tool based on the second exposure images. The controller(s) correlate the recognized pose of the tracker and the recognized geometry of the surgical tool to define a relationship between the tracker and the surgical tool and calibrate the surgical tool based on the defined relationship.

Abstract: Systems and methods for calibration of a surgical tool having a tracker. At least one camera captures images of the tracker at a first exposure and captures images of the surgical tool at a second exposure with a different exposure time and/or illumination than the first exposure. Controller(s) recognize a pose of the tracker based on the first exposure images and recognize a geometry of the surgical tool based on the second exposure images. The controller(s) correlate the recognized pose of the tracker and the recognized geometry of the surgical tool to define a relationship between the tracker and the surgical tool and calibrate the surgical tool based on the defined relationship.

Abstract: Navigation systems and methods for tracking physical objects near a target site during a surgical procedure are provided, the navigation system comprises a robotic device and an instrument attached to the robotic device; a process of optical registration and calibration can improve operation results by increasing accuracy and speed and eliminate the need for additional reference trackers, such as a pointer.

Abstract: A method for reading optical codes (12) with distortions caused by an uneven background of the code (12), the method comprising the steps of acquiring image data including the code (12), locating a region including the code (12) in the image data, and reading the code content of the code (12) from image data in the region, wherein the code (12) is read from image data at sampling points arranged in a sampling pattern corresponding to the distortions.

Abstract: A camera (10) comprising an image sensor (24) for capturing image data with a plurality of pixels, a first processing unit (30) for reading out the image data of the image sensor (24) in an image data stream comprising groups of adjacent pixels, a second processing unit (32) for processing the image data, and a memory (34) for storing at least one of the image data and processing results from the image data, wherein a neural network (38) is implemented on at least one of the first processing unit (30) and the second processing unit (32) and wherein the first processing unit (30) is configured to already process groups of pixels with at least a first layer (42) of the neural network while further groups of the image data are still being read out from the image sensor (24).

Abstract: A method for reading optical codes (12) with distortions caused by an uneven back-ground of the code (12), the method comprising the steps of acquiring image data including the code (12), locating a region including the code (12) in the image data, and reading the code content of the code (12) from image data in the region, wherein the code (12) is read from image data at sampling points arranged in a sampling pattern corresponding to the distortions.

Abstract: A surgical navigation system is provided. The surgical navigation system comprises a camera system comprising at least one camera. The camera system is capable of capturing images of light that is filtered through at least three different polarization angles. The surgical navigation system further comprises a processor having access to three dimensional image data of a surgical object. The processor is configured to determine first surface normals from the three dimensional image data of the surgical object. The processor is further configured to determine second surface normals from at least three images captured by the camera system of the surgical object under different polarization angles. The processor is configured to align the first surface normals with the second surface normals. Furthermore, a method for operating a surgical navigation system is provided.

Abstract: Navigation systems and methods for tracking physical objects near a target site during a surgical procedure are provided, the navigation system comprises a robotic device and an instrument attached to the robotic device; a process of optical registration and calibration can improve operation results by increasing accuracy and speed and eliminate the need for additional reference trackers, such as a pointer.

Abstract: A surgical navigation system is provided. The surgical navigation system comprises a camera system comprising at least one camera. The camera system is capable of capturing images of light that is filtered through at least three different polarization angles. The surgical navigation system further comprises a processor having access to three dimensional image data of a surgical object. The processor is configured to determine first surface normals from the three dimensional image data of the surgical object. The processor is further configured to determine second surface normals from at least three images captured by the camera system of the surgical object under different polarization angles. The processor is configured to align the first surface normals with the second surface normals. Furthermore, a method for operating a surgical navigation system is provided.

Abstract: An X-ray image processing device for providing segmentation information with reduced X-ray dose that includes an interface unit, and a data processing unit. The interface unit is configured to provide a sequence of time series angiographic 2D images of a vascular structure obtained after a contrast agent injection. The data processing unit is configured to determine an arrival time index of a predetermined characteristic related to the contrast agent injection for each of a plurality of determined pixels along the time series, and to compute a connectivity index for each of the plurality of the determined pixels based on the arrival time index. The data processing unit is configured to generate and provide segmentation data of the vascular structure from the plurality of the determined pixels, wherein the segmentation data is based on the connectivity index of the pixels.

Abstract: A technique for determining a transformation between a navigation reference coordinate system (302) for navigation of a surgical device (150) relative to patient image data and an image coordinate system (304) in which the patient image data define a shape of a patient surface is provided. A computer-implemented method implementation of that technique comprises receiving multiple data sets that have been taken from different perspectives of the patient surface. Feature coordinates of multiple features (170) identifiable in the picture data sets are determined from the picture data sets and in the navigation reference coordinate system (302). From the feature coordinates, a shape model of the patient surface in the navigation reference coordinate system (302) is determined.

Abstract: A technique for determining a transformation between a navigation reference coordinate system (302) for navigation of a surgical device (150) relative to patient image data and an image coordinate system (304) in which the patient image data define a shape of a patient surface is provided. A computer-implemented method implementation of that technique comprises receiving multiple data sets that have been taken from different perspectives of the patient surface. Feature coordinates of multiple features (170) identifiable in the picture data sets are determined from the picture data sets and in the navigation reference coordinate system (302). From the feature coordinates, a shape model of the patient surface in the navigation reference coordinate system (302) is determined.

Abstract: The present invention relates to vessel segmentation. In order to provide an improved way of providing segmentation information with reduced X-ray dose, an X-ray image processing device (10) is provided that comprises an interface unit (12), and a data processing unit (14). The interface unit is configured to provide a sequence of time series angiographic 2D images of a vascular structure obtained after a contrast agent injection. The data processing unit is configured to determine an arrival time index of a predetermined characteristic related to the contrast agent injection for each of a plurality of determined pixels along the time series, and to compute a connectivity index for each of the plurality of the determined pixels based on the arrival time index. The data processing unit is configured to generate segmentation data of the vascular structure from the plurality of the determined pixels, wherein the segmentation data is based on the connectivity index of the pixels.