Abstract: Systems and methods are provided for a continual automatic registration of bone or bone-fragments, instruments, and implants based on only one additional X-ray without the need of changing the position of the X-ray source. A two-dimensional X-ray image is received, which X-ray image shows a surgical region of interest. Artificial intelligence assisted automatic detection and localization of objects such as bone or bone-fragments, tools (e.g., a drill) and/or implants combined with a priori information about the surgical procedure are used to compute their relative three-dimensional positions and orientations at any desired point in time. This registration of the objects can be repeated multiple times and can thus provide guidance in near real time.

Abstract: A device and a method configured to process X-ray images is provided where a processing unit performs: receiving an X-ray image being a projection image, the projection image showing an at least partially visible tool and an at least partially visible object, identifying a point, wherein a 3D position of the point relative to the object is known, localizing the object in the X-ray image, defining a coordinate system in fixed relation to the tool, identifying an axis of the tool in the coordinate system, and determining a 3D orientation of the tool relative to the object based on the X-ray image, the localization of the object in the X-ray image, knowledge of the 3D position of the point relative to the object, and knowledge that the axis of the tool runs through the point or knowledge about the distance between the point and the axis of the tool.

Abstract: Systems and methods are provided for a continual automatic registration of bone or bone-fragments, instruments, and implants based on only one additional X-ray without the need of changing the position of the X-ray source. A two-dimensional X-ray image is received, which X-ray image shows a surgical region of interest. Artificial intelligence assisted automatic detection and localization of objects such as bone or bone-fragments, tools (e.g., a drill) and/or implants combined with a priori information about the surgical procedure are used to compute their relative three-dimensional positions and orientations at any desired point in time. This registration of the objects can be repeated multiple times and can thus provide guidance in near real time.