Abstract: A computer program product is provided including instructions which, when executed on a processing unit of a system, cause the system to receive one X-ray image, a 3D data set describing a region of interest within a patient's anatomy, and a 3D model of the surgical object. The X-ray image is a 2D projection image depicting at least part of a surgical object including an anchor point as well as the region of interest. The computer program product is configured to determine a 2D position of the anchor point in the X-ray image and an imaging direction onto the region of interest based on the X-ray image. Based on this information, a 3D position of the anchor point in a 3D coordinate system defined by the 3D data set is determined. Further, a 3D position and 3D orientation of the surgical object relative to the region of interest is determined by means of the computer program product based on the 3D model of the surgical object and the 3D position of the anchor point in the 3D coordinate system.

Abstract: Systems and methods are provided for a continual automatic registration of bone or bone-fragments, instruments, and implants based on only one additional X-ray without the need of changing the position of the X-ray source. A two-dimensional X-ray image is received, which X-ray image shows a surgical region of interest. Artificial intelligence assisted automatic detection and localization of objects such as bone or bone-fragments, tools (e.g., a drill) and/or implants combined with a priori information about the surgical procedure are used to compute their relative three-dimensional positions and orientations at any desired point in time. This registration of the objects can be repeated multiple times and can thus provide guidance in near real time.

Abstract: A device and a method configured to process X-ray images is provided where a processing unit performs: receiving an X-ray image being a projection image, the projection image showing an at least partially visible tool and an at least partially visible object, identifying a point, wherein a 3D position of the point relative to the object is known, localizing the object in the X-ray image, defining a coordinate system in fixed relation to the tool, identifying an axis of the tool in the coordinate system, and determining a 3D orientation of the tool relative to the object based on the X-ray image, the localization of the object in the X-ray image, knowledge of the 3D position of the point relative to the object, and knowledge that the axis of the tool runs through the point or knowledge about the distance between the point and the axis of the tool.

Abstract: Systems and methods are provided for a continual automatic registration of bone or bone-fragments, instruments, and implants based on only one additional X-ray without the need of changing the position of the X-ray source. A two-dimensional X-ray image is received, which X-ray image shows a surgical region of interest. Artificial intelligence assisted automatic detection and localization of objects such as bone or bone-fragments, tools (e.g., a drill) and/or implants combined with a priori information about the surgical procedure are used to compute their relative three-dimensional positions and orientations at any desired point in time. This registration of the objects can be repeated multiple times and can thus provide guidance in near real time.