Abstract: Systems and methods are provided for a continual automatic registration of bone or bone-fragments, instruments, and implants based on only one additional X-ray without the need of changing the position of the X-ray source. A two-dimensional X-ray image is received, which X-ray image shows a surgical region of interest. Artificial intelligence assisted automatic detection and localization of objects such as bone or bone-fragments, tools (e.g., a drill) and/or implants combined with a priori information about the surgical procedure are used to compute their relative three-dimensional positions and orientations at any desired point in time. This registration of the objects can be repeated multiple times and can thus provide guidance in near real time.

Abstract: A device and a method configured to process X-ray images is provided where a processing unit performs: receiving an X-ray image being a projection image, the projection image showing an at least partially visible tool and an at least partially visible object, identifying a point, wherein a 3D position of the point relative to the object is known, localizing the object in the X-ray image, defining a coordinate system in fixed relation to the tool, identifying an axis of the tool in the coordinate system, and determining a 3D orientation of the tool relative to the object based on the X-ray image, the localization of the object in the X-ray image, knowledge of the 3D position of the point relative to the object, and knowledge that the axis of the tool runs through the point or knowledge about the distance between the point and the axis of the tool.

Abstract: A system with a processing unit for processing X-ray images may be utilized for assisting in humerus surgery based on X-ray images. Firstly, at least two X-ray images are received having been generated with different imaging directions and showing a proximal portion of a humerus. Then, (i) the X-ray images are registered, (ii) an approximation of at least a part of the 2D outline of the humerus head in both images is determined, (iii) a 3D approximation of the humerus head based on the approximated 2D outlines and the registered images is determined, and (iv) 2D image coordinates of a total of at least three different points in the X-ray images are determined. Finally, an approximation of an anatomical neck is determined as a curve on the 3D approximation of the humerus head based on the at least three determined points.

Abstract: Systems and methods are provided for determining an implantation curve or path, along which an implant such as a nail or a screw may be inserted and implanted into a bone, and/or to determine an entry point, which is the point at which the surgeon opens the bone for inserting the implant. According to the invention, a 2D X-ray image is received, which X-ray image shows a surgical region of interest. In that X-ray image, a first point associated with a structure of interest as well as an implantation path within the bone for an implant intended to be implanted may be determined. An entry point for an insertion of the implant into the bone is located on the implantation path. It is noted that the first point may not be the entry point.

Abstract: Systems and methods are provided for processing X-ray images, wherein the methods are implemented as a software program product executable on a processing unit of the systems. Generally, an X-ray image is received by the system, the X-ray image being a projection image of a first object and a second object. The first and second objects are classified and a respective 3D model of the objects is received. At the first object, a geometrical aspect like an axis or a line is determined, and at the second object, another geometrical aspect like a point is determined. Finally, a spatial relation between the first object and the second object is determined based on a 3D model of the first object, a 3D model of the second object, and the information that the point of the second object is located on the geometrical aspect of the first object.

Abstract: Systems and methods are provided for processing X-ray images, wherein the methods are implemented as a software program product executable on a processing unit of the systems. Generally, an X-ray image is received by the system, the X-ray image being a projection image of a first object and a second object. The first and second objects are classified, and a respective 3D model of the objects is received. At the first object, a geometrical aspect like an axis or a line is determined, and at the second object, another geometrical aspect like a point is determined. Finally, a spatial relation between the first object and the second object is determined based on a 3D model of the first object, a 3D model of the second object, and the information that the point of the second object is located on the geometrical aspect of the first object.

Abstract: Device and Method for assisting in fracture diagnosis are provided. The device comprises a processing unit and a computer program product, when executed on the processing unit, causes the device to receive image data, to interpret the image data, and to provide an output based on the image data interpretation. The received image data represents an anatomical region including an injured part of a human body. It may be emphasized that the image data may include data of a single X-ray projection image. Interpreting the image data includes estimating the likelihood of a fracture, wherein, when the likelihood is below a predetermined value, the provided output includes information of an imaging direction allowing a further assessment of the injured part of the human body, and wherein, when the likelihood is above the predetermined value, the provided output includes information of an imaging direction allowing a confirmation of the fracture.

Abstract: Methods and systems are described which allow a classification of first and second objects in an X-ray projection image. A respective representation and localization of both objects are determined by applying the models to match the objects in the X-ray image and a spatial relation of the classified objects is obtained. Such methods and systems take advantage of artificial intelligence.

Abstract: Supported by artificial intelligence, an object is classified in an X-ray projection image. A 3D representation as well as a localization of the classified object can be determined by matching a model of the classified object to a visualization of the classified object in the X-ray image.

Abstract: Device and methods are provided for augmenting image information of an endoscope. The devices comprise at least a data processing unit. The endoscope is configured to provide video images of at least a part of an outer surface of an anatomy of interest in front of a distal tip thereof. The data processing unit is configured to determine a 3D position and orientation of the endoscope relative to the anatomy of interest, to receive a model of the anatomy of interest, and to augment a video image provided by the endoscope with information of the model of the anatomy of interest. The 3D position and orientation of the endoscope may be determined by a tracking device and/or based on at least one X-ray image. The model of the anatomy of interest may be based on an anatomy scan.

Abstract: A method of treating a bone fracture includes taking a first 2D image of an implant and a reference body with an imaging device; creating a 3D orientation of the reference body and the implant based on the 2D image; determining an actual axis of delivery of a bone screw through an opening extending through the implant; determining an optimal axis of delivery of the bone screw through the opening such that the optimal axis of delivery guides the bone screw toward a medically optimal location; and moving the implant such that the optimal axis of delivery and the actual axis of delivery coincide.

Abstract: A method of treating a bone fracture includes taking a first 2D image of an implant and a reference body with an imaging device; creating a 3D orientation of the reference body and the implant based on the 2D image; determining an actual axis of delivery of a bone screw through an opening extending through the implant; determining an optimal axis of delivery of the bone screw through the opening such that the optimal axis of delivery guides the bone screw toward a medically optimal location; and moving the implant such that the optimal axis of delivery and the actual axis of delivery coincide.

Abstract: A computer assisted surgical system that includes an apparatus for imaging a region of interest of a portion of an anatomy of a subject; a memory containing executable instructions; and a processor programmed using the instructions to receive two or more two-dimensional images of the region of interest taken at different angles from the apparatus and process the two or more two-dimensional images to produce three dimensional information associated with the region of interest.

Abstract: Methods and systems are described which allow a classification of first and second objects in an X-ray projection image. A respective representation and localization of both objects are determined by applying the models to match the objects in the X-ray image and a spatial relation of the classified objects is obtained. Such methods and systems take advantage of artificial intelligence.

Abstract: Method and apparatus are provided for assisting with bone fracture detection. In particular, image data of a medical image is received in a processing unit from a device, which may be an imaging device, a data detection device or an image storage device. A bone structure is identified in the medical image. A fracture line in the identified bone structure is determined. A bone feature, which may include a portion of an outline of the identified bone structure, a point of the fracture line on an outline of the identified bone structure, a relative displacement of bone parts of the identified bone structure, or a combination thereof is detected. The bone feature may be classified and a corresponding output generated.

Abstract: Systems and methods are provided for image guided surgery. Such systems and methods receive a model of an anatomical structure as well as a model of an object, and process a projection image generated by an imaging device from an imaging direction, wherein the projection image includes at least a part of the anatomical structure and at least a part of the object. Based on (i) the projection image, (ii) the imaging direction, (iii) the model of the object, and (iv) the model of the anatomical structure, the systems and methods determine a spatial position and orientation of the object relative to a space of movement. The space of movement may be defined in relation to the anatomical structure.

Abstract: Systems and methods for autonomous robotic surgery are provided to control a movement of a robotic device so as to perform a surgical procedural step, wherein controlling of the movement is based on information including a spatial position and orientation of at least a part of the robotic device. A trigger information may cause the system to pause or stop the surgical procedural step and cause the system to receive a projection image. Further, the projection image may be processed so as to determine a spatial position and orientation of at least the part of the object or of the robotic device.

Abstract: Methods and systems are described which allow a classification of first and second objects in an X-ray projection image. A respective representation and localization of both objects are determined by applying the models to match the objects in the X-ray image and a spatial relation of the classified objects is obtained. Such methods and systems take advantage of artificial intelligence.

Abstract: Method and apparatus are provided for assisting with bone fracture detection. In particular, image data of a medical image is received in a processing unit from a device, which may be an imaging device, a data detection device or an image storage device. A bone structure is identified in the medical image. A fracture line in the identified bone structure is determined. A bone feature, which may include a portion of an outline of the identified bone structure, a point of the fracture line on an outline of the identified bone structure, a relative displacement of bone parts of the identified bone structure, or a combination thereof is detected. The bone feature may be classified and a corresponding output generated.

Abstract: Based on deep neural net and possible on an active shape model approach, an outline of an anatomy may be at least partially determined and classified. Based on certain features, an algorithm may assess whether the viewing angle of the C-arm is sufficient or not. In a further step, an algorithm may estimate how far away from the desired viewing angle the current viewing angle is and may provide guidance on how to adjust the c-arm position to reach the desired viewing angle.