ADJUSTABLE REGISTRATION FRAME
A system for determining the position and orientation of a medical device relative to an image space during image-guided medical procedures. The system comprises a flexible pad mounted on the subject such that a part covers the region of interest. The pad incorporates detectable registration members. Prior to the procedure, the device is coupled to the pad, which is then rigidized, so that there is no movement of the registration members relative to each other and relative to the device. The fixed relation-ship between the device and the registration members is determined from initial images, for example using detectable markers attached to the device, enabling the pose of the device relative to the image space of images of the region of interest to be determined later, even if the device is remote from the region of interest. This minimizes exposure of the subject and medical staff to radiation.
This application is a Continuation of U.S. Ser. No. 17/022,509, filed on Sep. 16, 2020, which is a Continuation of U.S. Ser. No. 16/065,007 filed on Jun. 22, 2018, now U.S. Pat. No. 10,806,523, which is a National Phase of PCT Patent Application No. PCT/IL2016/051396 filed on Dec. 28, 2016, which claims the benefit of priority to U.S. 62/387,317 filed on Dec. 28, 2015. The contents of the above applications are all incorporated by reference as if fully set forth herein in their entirety.
FIELD OF THE INVENTIONThe present disclosure relates to the field of image-guided interventional procedures, and specifically to systems and methods for determining the position and orientation of an automated medical device relative to the image space during image-guided procedures.
BACKGROUNDMany routine treatments employed in modern clinical practice involve percutaneous insertion of medical tools, such as needles and catheters, for biopsy, drug delivery and other diagnostic and therapeutic procedures. The aim of an insertion procedure is to place the tip of an appropriate medical tool safely and accurately in a target region, which could be a lesion, tumor, organ or vessel. Examples of treatments requiring insertion of such medical tools include vaccinations, blood/fluid sampling, regional anesthesia, tissue biopsy, catheter insertion, cryogenic ablation, electrolytic ablation, brachytherapy, neurosurgery, deep brain stimulation and various minimally invasive surgeries.
Guidance and steering of needles in soft tissue is a complicated task that requires good three-dimensional coordination, knowledge of the patient's anatomy and a high level of experience. Therefore, image-guided automated (e.g., robotic) systems have been proposed for performing these functions. Among such systems are those described in U.S. Pat. No. 7,008,373 to Stoianovici, for “System and method for robot targeting under fluoroscopy”, U.S. Pat. No. 8,348,861 to Glozman et al, for “Controlled Steering of a Flexible Needle”, U.S. Pat. No. 8,663,130 to Neubach et al, for “Ultrasound Guided Robot for Flexible Needle Steering”, U.S. Application Publication No. 2006/0229641 to Gupta et al, for “Guidance and Insertion System”, U.S. Application Publication No. 2014/0371584 to Cleary et al, for “Patient Mounted MRI and CT Compatible Robot for Needle Guidance in Interventional Procedures”, and U.S. Patent Application Publication No. 2016/0249990 to Glozman et al, for “Needle Steering by Shaft Manipulation”.
When automated insertion devices are used, the exact position of the device relative to the image space must be known in order to correctly and accurately steer the medical tool, usually from a remote location, towards the target. The determination of the position of the device relative to the image space is typically done using fiducial markers, which are positioned at various locations on the device, and which are manufactured from material/s that can be detected in an image taken using an imaging system (e.g., X-Ray, CT, MRI). Detection and identification of these markers in acquired image/s is a crucial step in the process of registering the device to the image space, which allows the user to know the exact position and/or orientation of the device relative to the image space at any point throughout the procedure.
Since the registration markers are located on the device itself, in order to enable the registration process to take place, it is required that at least a portion of the device that includes marker/s thereon is included in the scans taken during the procedure. However, in some cases, due to the required insertion angle, for example, there may be a significant physical distance between the device and the region of interest of the subject. Consequently, scanning a volume sufficiently large so as to include both the region of interest and at least a portion of the device which has marker/s thereon (typically, a robotic end effector), exposes the patient and medical staff to significant amounts of radiation, when imaging modalities such as X-ray and CT are utilized in image-guided procedures.
Thus, there is a need for systems and methods that can determine the insertion device's position and orientation relative to the image space at any given moment during the insertion procedure (real-time), without necessitating inclusion of the device, or any part thereof, in the scanned volume.
The disclosures of each of the publications mentioned in this section and in other sections of the specification, are hereby incorporated by reference, each in its entirety.
SUMMARYThere are disclosed systems and methods which enable the determination of the position and orientation of an automated medical device relative to the image space at any point during an image-guided medical procedure (real-time), when the device is outside the scanned volume.
In some implementations, the automated insertion device includes a robotic arm, or a mounting base, which may be coupled to the patient's bed, for example. In other implementations, the insertion device may be body-mounted, i.e., positioned directly on the patient's body and secured thereto. In the latter case, the insertion device moves together with the patient as he/she moves (e.g., due to coughing, position adjustment, etc.).
According to some implementations, in addition to registration markers positioned on the insertion device itself, there are provided registration members positioned in/on a mounting pad, which is configured for mounting on the subject's body. The mounting pad is further configured for coupling to the insertion device. These registration members may be referred to hereinafter as “a registration frame” or “an adjustable registration frame”. The mounting pad should be mounted on the subject's body such that at least a portion of the adjustable registration frame is located over or very close to the region of interest.
The adjustable registration frame may include several degrees of freedom, so that it can adjust itself together with the mounting pad as the pad adjusts to the shape of the patient's body independent of its location on the body. Following placement on the body, the mounting pad and/or the adjustable registration frame may be forced to adopt a more rigid condition in a certain spatial structure. Once the mounting pad and adjustable registration frame assume their more rigid state, the position of the adjustable registration frame relative to the insertion device, is fixed and unchangeable.
According to some implementations, the adjustable registration frame is placed within a medium that can be manipulated to prevent the frame from moving relative to the insertion device. For example, it can be placed inside a flexible mounting pad which can stiffen upon application of vacuum, cooling/heating, etc. Such a mounting pad may be filled, at least in part, with granules, which are pressed against each other upon application of vacuum, for example, thus causing the mounting pad to stiffen. It is to be understood that the term “granules” may refer to any suitable type of granules, natural or artificial, such as coffee beans, rice, sand, plastic beads, etc.
U.S. Patent Application Publication No. 2012/0266898 to Vogele, for “Immobilization Device”, discloses a moldable vacuum manipulated cushion. However, the cushion is used for immobilizing the patient and it does not include an adjustable registration frame. Further, in Vogele the markers are fixed to an adapter plate attached externally to the cushion, such that they protrude away from the adapter plate. Such protruding markers may obstruct the clinician's view or actions. Further, they are at risk of being damaged or even broken. Moreover, protruding markers which are visible to the patient may appear intimidating and have a negative psychological effect on the patient.
In some implementations, the disclosed adjustable registration frame is positioned inside the mounting pad, such that it is not in the clinician's way, it is less likely to sustain damage or be broken and it is not visible to the patient. Even in implementations where the registration members are external to the mounting pad, they are small and flat enough to be unobtrusive to both the patient and the clinician.
In some implementations, the adjustable registration frame itself may be configured to stiffen or “freeze”, e.g., by cooling/heating, etc. For example, it may have joints which can be locked remotely, or it may be fabricated from a material that is flexible yet can be remotely manipulated to become stiff.
In some implementations, the registration members which form together the adjustable registration frame, are configured as articulated rod assemblies, each articulated rod assembly being made up of one or more rods. In such implementations, the insertion device's position and orientation relative to the current image space (i.e., its position in terms of the coordinate system of the current image) may be determined based on the position and orientation of the rods relative to the current image space and the previously calculated (and fixed) position and orientation of the rods relative to the insertion device.
In some implementations, the registration members are configured as semi-flexible elements/strips (the terms “semi-flexible elements” and “semi-flexible strips” may be used in this disclosure interchangeably), and the insertion device's position and orientation relative to the current image space is determined based on the position and orientation of the semi-flexible strips relative to the current image space and the previously calculated (and fixed) position and orientation of the semi-flexible strips relative to the insertion device.
According to some implementations, the registration method using the disclosed adjustable registration frame is as follows:
-
- Preparation stage: after the insertion device is coupled to the mounting pad, and the mounting pad and/or the adjustable registration frame, are caused to assume their more structurally stable states, an initial scan is obtained. The term “scan” may refer to one or more image frames taken within the scanned volume. The terms “image frame”, “frame” and “slice” are used interchangeably throughout the disclosure. The initial scan includes the entire registration frame and the insertion device, so that the position and orientation (also referred to as “translation and rotation” or “transformation”) of the insertion device in terms of the coordinate system (“CS”) of the initial image space, as well as the position and orientation of the registration frame in terms of the coordinate system of the initial image space, can be calculated. Once the position and orientation of the insertion device and of the registration frame in terms of the coordinate system of the initial image space have been calculated, the position and orientation of the registration frame in terms of the insertion device's coordinate system, i.e., its location and orientation relative to the insertion device, can be calculated. The position and orientation of the registration frame in terms of the insertion device's coordinate system remains constant until the mounting pad and/or the adjustable registration frame is caused to return to its moldable state.
- Real-time: in case a body-mounted insertion device is employed, the position and orientation of the insertion device relative to the image space may change after the initial scan is taken, due to patient movements (e.g., due to coughing, position adjustment). However, the position and orientation of the registration frame relative to the insertion device remains unchanged as long as the mounting pad and/or registration frame remain in their more structurally stable state. Thus, movement of the registration frame necessarily indicates identical movement of the insertion device. The real time scans are minimized in volume to include only the region of interest and a minimally necessary portion of the registration frame. Each real-time image includes at least a portion of the registration frame, so the transformation of the registration frame in terms of the real-time image CS can be calculated. This transformation, together with the transformation of the registration frame in terms of the insertion device CS, which is known from the initial scan, are used for determining the transformation of the insertion device in terms of the CS of each real-time image obtained throughout the insertion procedure.
The disclosed devices, systems and methods, allow to limit the scanned volume, as the scanned volume, instead of including the insertion device, which may be far from the region of interest or which due to the angle of insertion, requires a large volume to be scanned, includes only a minimal portion of the adjustable frame which can be placed over or very close to the region of interest. Thus, exposure of the patient and the medical staff to radiation is minimized.
There is thus provided in accordance with an exemplary implementation of the devices described in this disclosure, a system for determining the position and orientation of an automated medical device relative to an image space during image-guided procedures, the system comprising:
-
- (i) a mounting apparatus comprising:
- at least one flexible element adapted for mounting on a body of a subject and for coupling the automated medical device thereto, and
- one or more registration members positioned either on or inside the at least one flexible element,
- wherein at least one of the at least one flexible element and the one or more registration members are transformable from a moldable state to a more structurally stable state, such that upon the transformation there is substantially no relative movement between the one or more members and the automated medical device and no relative movement amongst the one or more registration members, and
- (ii) a processor configured to:
- detect at least a portion of the one or more registration members in images obtained from an imaging system,
- determine the position and orientation of the at least a portion of the one or more registration members relative to the image space, and
- determine the position and orientation of the automated medical device relative to the image space based on the determined position and orientation of the at least a portion of the one or more registration members relative to the image space and a predetermined relationship between the automated medical device and the one or more registration members.
- (i) a mounting apparatus comprising:
In such a system, the at least one flexible element may comprise a granular material enclosed within a flexible covering. In such a case, the at least one flexible element may be configured to transform from the moldable state to the more structurally stable state by means of application of vacuum to the at least one flexible element. Furthermore, the one or more registration members may be coupleable to the flexible covering of the at least one flexible element.
In other implementations of such a system, the one or more registration members may comprise articulated rod assemblies, each articulated rod assembly comprising one or more rods. In such a system, the processor should be further configured to calculate the spatial angle between any two of the one or more rods. It may be further configured to calculate the minimal distance between any two of the one or more rods, or even to calculate the minimal distance points on each of the two rods, and a rod coordinate system of the two rods in the image space. In the latter case, the processor being configured to determine the position and orientation of the at least a portion of the one or more registration members relative to the image space, may comprise the processor being configured to calculate the position and orientation of at least one rod coordinate system relative to the image space.
In any of the above described systems, the one or more registration members may comprise semi-flexible elements, and the processor may then be further configured to determine, for each of the semi-flexible elements, a plane containing a pre-defined portion of the semi-flexible element in the image space. The pre-defined portion of the semi-flexible element should then be the line connecting the central points of the width of the semi-flexible element along the length of the semi-flexible element, in which case the processor may be further configured to calculate the angle between any two of the planes in the image space, or the intersection line of any two of the planes. In the latter case, the processor may be further configured to calculate, for any two of the intersection lines, the minimal distance points on at least one of the two intersection lines, and an intersection line coordinate system of the two intersection lines. If such a processor is configured to determine the position and orientation of the at least a portion of the one or more registration members relative to the image space, it may be configured to calculate the position and orientation of at least one intersection line coordinate system relative to the image space.
According to a further such implementation comprising semi-flexible elements, the one or more registration members may further include one or more threads positioned substantially horizontally to the one or more semi-flexible elements, and wherein the processor is further configured to detect at least one point of intersection between the one or more semi-flexible elements and the one or more threads. Additionally, the processor may be further configured to calculate one or more coordinate systems of the at least one intersection point. In the latter case, the processor being configured to determine the position and orientation of the at least a portion of the one or more registration members relative to the image space may comprise the processor being configured to calculate the position and orientation of the one or more coordinate systems of the at least one intersection point relative to the image space.
In yet further implementations of the above described systems, the processor is further configured to obtain the images from the imaging system.
Additional implementations can include systems such as described above, in which the mounting apparatus further comprises a base plate coupleable to the at least one flexible element, the base plate being configured to receive the automated medical device. In such a case the at least one flexible element may comprise a placement element and a registration element separate from the placement element, and wherein the placement element includes the base plate, and the registration element includes the one or more registration members.
Furthermore in any of the previously described systems, the mounting apparatus may further comprise one or more straps configured to secure the at least one flexible element to the body of the subject. Finally, the imaging system may be any one of an X-ray fluoroscopic system, a CT system, a cone beam CT system, a CT fluoroscopy system, an MRI system and an ultrasonic system.
Alternative implementations of exemplary systems according to the present disclosure may further involve a system for determining the position and orientation of an automated medical device relative to an image space during image-guided procedures, the system comprising:
-
- (i) a mounting apparatus comprising:
- at least one flexible element adapted for mounting on a body of a subject and for coupling the automated medical device thereto, and
- one or more registration members positioned either on or inside the at least one flexible element, and
- (ii) a processor configured to:
- obtain one or more initial images of the mounting apparatus and the automated medical device coupled thereto,
- detect the one or more registration members in the one or more initial images,
- calculate one or more predetermined geometric parameters, to define the relationship between the one or more registration members,
- store the calculated values of the one or more predetermined geometric parameters,
- calculate the position and orientation of the one or more registration members relative to the image space of the one or more initial images,
- calculate the position and orientation of the automated medical device relative to the image space of the one or more initial images,
- determine the position and orientation of the one or more registration members relative to the automated medical device based on the calculated positions and orientations of the automated medical device and of the one or more registration members relative to the image space of the one or more initial images,
- obtain one or more real-time images of a region of interest, the one or more real-time images including at least two portions of at least one of the one or more registration members,
- detect the at least two portions of the at least one of the one or more registration members in the one or more real-time images,
- calculate the one or more predetermined geometric parameters in real-time, to define the relationship between the at least two portions of the at least one of the one or more registration members in the one or more real-time images,
- compare the real-time values of the one or more predetermined geometric parameters to the stored values of the one or more predetermined geometric parameters and identify the at least one of the one or more registration members,
- calculate the position and orientation of the identified at least one of the one or more registration members relative to the image space of the one or more real-time images, and
- determine the position and orientation of the automated medical device relative to the image space of the one or more real-time images based on the calculated position and orientation of the identified at least one of the one or more registration members relative to the image space of the one or more real-time images and the determined position and orientation of the at least one of the one or more registration members relative to the automated medical device.
- (i) a mounting apparatus comprising:
In such a system, the at least one flexible element may be configured to transform from a moldable state to a more structurally stable state, and upon transformation of the at least one flexible element into its more structurally stable state, there should be substantially no movement of the one or more registration members relative to each other and relative to the automated medical device. Alternatively or additionally, the one or more registration members are configured to transform from a moldable state to a more structurally stable state, such that upon the transformation, there should be substantially no movement of the one or more registration members relative to each other and relative to the automated medical device.
In the systems described in the previous two paragraphs, the one or more registration members may comprise articulated rod assemblies, each articulated rod assembly comprising one or more rods. Alternatively, the one or more registration members may comprise semi-flexible elements. Additionally, the predetermined geometric parameters may include one or more of angles, distances, lengths, shapes, planes, relative positions and coordinate systems. Finally any of these systems may further comprise one or more registration markers attached to the automated medical device, the processor being further configured to detect the one or more registration markers.
Still other example implementations may involve a method for determining the position and orientation of an automated medical device relative to an image space during image-guided procedures, using a system comprising a processor and a mounting apparatus having at least one flexible element adapted for mounting on a body of a subject and for coupling the automated medical device thereto, and one or more registration members positioned either on or inside the at least one flexible element, wherein at least one of the at least one flexible element and the one or more registration members is transformable from a moldable state to a more structurally stable state, such that upon the transformation there is substantially no movement of the one or more registration members relative to each other and relative to the automated medical device, the method comprising:
-
- (i) detecting at least two portions of at least one of the one or more registration members in images obtained from an imaging system, following the transformation of the at least one of the at least one flexible element and the one or more registration members from the moldable state to the more structurally stable state,
- (ii) determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space, and
- (iii) determining the position and orientation of the automated medical device relative to the image space based on the determined positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space, and a predetermined relationship between the automated medical device and the one or more registration members.
In such a method, the one or more registration members may comprise articulated rod assemblies, each articulated rod assembly comprising one or more rods. In such a situation, the step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may include:
-
- calculating the minimal distance between at least two of the one or more rods, the minimal distance points on the at least two rods, and a rod coordinate system of the at least two rods, and
- calculating the position and orientation of the rod coordinate system relative to the image space.
The method may further comprise the step of calculating the spatial angles between at least two of the one or more rods. Furthermore, the one or more registration members may comprise semi-flexible elements, in which case, the step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may include finding, for at least two of the semi-flexible elements, a plane containing at least a pre-defined portion of the semi-flexible element. The step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may then further include finding the intersection line of any two of the planes. If this is performed, then the step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space further may include calculating, for any two of the intersection lines, the minimal distance between the two intersection lines, the minimal distance points on at least one of the two intersection lines, and an intersection line coordinate system of the two intersection lines. The step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may then further include calculating the position and orientation of the intersection line coordinate system relative to the image space.
Any of the above described methods may further comprise the step of calculating the angle between any two of the planes.
Furthermore in any of the above described methods in which the one or more registration members comprise semi-flexible elements, the one or more registration members may further include one or more threads positioned substantially horizontally to the one or more semi-flexible elements, and wherein the step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may include detecting at least one point of intersection between the one or more semi-flexible elements and the one or more threads. In such a situation, the step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may further include calculating one or more coordinate systems of the at least one intersection point. The step of determining the positions and orientations of the at least two portions of the at least one of the one or more registration members relative to the image space may then further include calculating the position and orientation of the one or more coordinate systems of the at least one intersection point relative to the image space.
Finally any of the above described methods may further comprise the step of obtaining the images from the imaging system.
Yet other implementations perform a method for determining the position and orientation of an automated medical device relative to an image space, using a mounting apparatus having at least one flexible element adapted for mounting on a body of a subject and for coupling of the automated medical device thereto, and one or more registration members positioned either on or inside the at least one flexible element, and a processor, the method comprising:
-
- obtaining one or more initial images of the mounting apparatus and the automated medical device coupled thereto,
- detecting the one or more registration members in the one or more initial images,
- calculating one or more predetermined geometric parameters, to define the relationship between the one or more registration members,
- storing the calculated values of the one or more predetermined geometric parameters,
- calculating the position and orientation of the one or more registration members relative to the image space of the one or more initial images,
- calculating the position and orientation of the automated medical device relative to the image space of the one or more initial images,
- determining the position and orientation of the one or more registration members relative to the automated medical device based on the calculated positions and orientations of the automated medical device and of the one or more registration members relative to the image space of the one or more initial images,
- obtaining one or more real-time images of a region of interest, the one or more real-time images including at least two portions of at least one of the one or more registration members,
- detecting the at least two portions of the at least one of the one or more registration members in the one or more real-time images,
- calculating the one or more predetermined geometric parameters in real-time, to define the relationship between the at least two portions of the at least one of the one or more registration members in the one or more real-time images,
- comparing the real-time values of the one or more predetermined geometric parameters to the stored values of the one or more predetermined geometric parameters and identifying the at least one of the one or more registration members,
- determining the position and orientation of the identified at least one of the one or more registration members relative to the image space of the one or more real-time images, and
- determining the position and orientation of the automated medical device relative to the image space of the one or more real-time images based on the determined position and orientation of the identified at least one of the one or more registration members relative to the image space of the one or more real-time images and the determined position and orientation of the at least one of the one or more registration members relative to the automated medical device.
In such a method, the at least one flexible element may be configured to transform from a moldable state to a structurally more stable state, and upon transformation of the at least one flexible element into the structurally more stable state, there should be substantially no movement of the one or more registration members relative to each other and relative to the automated medical device. Alternatively or additionally, the one or more registration members may be configured to transform from a moldable state to a structurally more stable state, and upon transformation of the one or more registration members into the more structurally stable state, there should be substantially no movement of the one or more registration members relative to each other and relative to the automated medical device.
In any of the latter methods, the one or more registration members may comprise articulated rod assemblies, each articulated rod assembly comprising one or more rods, and the one or more registration members may comprise semi-flexible elements.
Finally, in these methods, the predetermined geometric parameters may include one or more of: angles, distances, lengths, shapes, planes, relative positions and coordinate systems.
According to yet further implementations of the systems of the present disclosure, there is provided a system for determining the position and orientation of an automated medical device relative to an image space during image-guided procedures, the system comprising:
-
- (i) at least one registration marker attached to the automated medical device,
- (ii) a mounting apparatus comprising:
- at least one flexible element adapted for mounting on a body of a subject and for coupling the automated medical device thereto,
- an adjustable registration frame comprised of one or more registration members positioned either on or inside at least one of the at least one flexible elements, wherein at least one of the at least one flexible element and the adjustable registration frame is transformable from a moldable state to a more structurally stable state, such that upon the transformation there is substantially no relative movement between the adjustable registration frame and the automated medical device and substantially no relative movement amongst the registration members of the adjustable registration frame, and
- (iii) a processor configured to:
- obtain one or more initial images of the mounting apparatus and the automated medical device coupled thereto,
- detect the at least one registration marker and the adjustable registration frame in the one or more initial images,
- determine the position and orientation of the automated medical device relative to the image space of the one or more initial images,
- determine the position and orientation of the adjustable registration frame relative to the image space of the one or more initial images,
- determine the position and orientation of the adjustable registration frame relative to the automated medical device based on the determined positions and orientations of the automated medical device and of the adjustable registration frame relative to the image space of the one or more initial images,
- obtain one or more real-time images of a region of interest, the one or more real-time images including at least a portion of the adjustable registration frame,
- detect the at least a portion of the adjustable registration frame in the one or more real-time images,
- determine the position and orientation of the at least a portion of the adjustable registration frame relative to the one or more real-time images, and
- determine the position and orientation of the automated medical device relative to the one or more real-time images based on the determined position and orientation of the at least a portion of the adjustable registration frame relative to the one or more real-time images and the determined position and orientation of the adjustable registration frame relative to the automated medical device.
In this system, the one or more registration members may comprise articulated rod assemblies, each articulated rod assembly comprising one or more rods. Alternatively and additionally, the one or more registration members may comprise semi-flexible elements.
Still other exemplary implementations described in this disclosure involve a method for determining the position and orientation of an automated medical device relative to an image space during image-guided procedures, using a system comprising at least one registration marker attached to the automated medical device, a mounting apparatus having at least one flexible element adapted for mounting on a body of a subject and for coupling the automated medical device thereto and an adjustable registration frame positioned either on or inside the at least one flexible element, and at least one processor, the method comprising:
-
- obtaining one or more initial images of the mounting apparatus and the automated medical device coupled thereto,
- detecting the at least one registration marker and the adjustable registration frame in the one or more initial images,
- determining the position and orientation of the automated medical device relative to the one or more initial images,
- determining the position and orientation of the adjustable registration frame relative to the one or more initial images,
- determining the position and orientation of the adjustable registration frame relative to the automated medical device based on the determined positions and orientations of the automated medical device and of the adjustable registration frame relative to the one or more initial images,
- obtaining one or more real-time images of a region of interest, the one or more real-time images including at least a portion of the adjustable registration frame,
- detecting the at least a portion of the adjustable registration frame in the one or more real-time images,
- determining the position and orientation of the at least a portion of the adjustable registration frame relative to the one or more real-time images, and
- determining the position and orientation of the automated medical device relative to the one or more real-time images based on the determined position and orientation of the at least a portion of the adjustable registration frame relative to the one or more real-time images and the determined position and orientation of the adjustable registration frame relative to the automated medical device.
In such a method, the at least one flexible element may be configured to transform from a moldable state to a structurally more stable state, and upon transformation of the at least one flexible element into the structurally more stable state, there should be substantially no relative movement between the adjustable registration frame and the automated medical device. Additionally, in this method, the adjustable registration frame may be configured to transform from a moldable state to a structurally more stable state, and upon transformation of the adjustable registration frame into the structurally stable state, there should be substantially no relative movement between the adjustable registration frame and the automated medical device.
In any of the latter methods, the adjustable registration frame may comprise one or more articulated rod assemblies, each articulated rod assembly comprising one or more rods. Alternatively or additionally, the adjustable registration frame may comprise one or more semi-flexible elements.
Implementations of the systems and methods described above may further include any of the features described in the present disclosure, including any of the features described hereinabove in relation to other system or method implementation.
It is to be understood that although the examples used throughout this disclosure relate to systems and methods for insertion of a needle into a subject's body, the systems and methods are not meant to be limited to insertion of a needle but are understood to include insertion of any tool intended to be inserted into a subject's body for diagnostic and/or therapeutic purposes, including a needle, port, introducer, catheter (e.g., ablation catheter), cannula, surgical tool, fluid delivery tool, or any other such insertable tool.
Further, it is to be understood that although the examples used throughout this disclosure relate to insertion devices and insertion procedures, the disclosed systems and methods may be implemented in any medical device and in any procedure that is image-guided and requires registration of a device to the image space.
The terms “user”, “doctor”, “physician”, “clinician”, “technician”, “medical personnel” and “medical staff” are used interchangeably throughout this disclosure and they may refer to any person taking part in the performed medical procedure.
Some exemplary implementations of the methods and systems of the present disclosure are described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or substantially similar elements.
In some implementations, the system 10 may include an imaging system, or it may be configured to operate in conjunction with an imaging system, such that the insertion procedure is image-guided. The utilized imaging modality may be any one of X-ray fluoroscopy, CT, cone beam CT, CT fluoroscopy, MRI, ultrasound, or any other suitable imaging modality.
The insertion device 100 may be configured to be mounted directly on the subject's body 15, as shown in
The system 10 further comprises a computer 130, including at least one processor (not shown) for image processing, calculation of the optimal needle insertion path, etc., and a display 131. The computer 130 may be a personal computer (PC), a laptop, a tablet, a smartphone or any other processor-based device. The computer 130 may also include a user interface 132, which may be in the form of buttons, switches, keys, keyboard, computer mouse, joystick, touch-sensitive screen, etc. The display 131 and user interface 132 may be two separate components, or they may form together a single component, in case a touch-sensitive screen (“touch screen”), for example, is utilized.
The computer 130 may be configured, inter alia, to receive, process and visualize on the display 131 images from the imaging system, to calculate the optimal pathway for the needle 110 based on input from the user, i.e., entry point, target and areas to avoid en route, and to control needle steering in a closed-loop manner, i.e., generate motion commands to the insertion device 100 and receive feedback regarding the actual location of the needle 110, which is then used for real-time pathway corrections. The optimal pathway may be calculated in a two-dimensional plane or in a three-dimensional space.
The system 10 further includes a controller 120 (e.g., robot controller) for controlling the movement of the insertion device 100 and steering of the needle 110 towards the target (e.g., lesion or tumor) within the subject's body 15. The controller 120 may be a separate component, as shown in
During the needle insertion procedure, several scans may be required in order to verify the needle's actual position, and adjust the trajectory accordingly, if needed. In order to minimize the exposure of the patient and medical staff to radiation, the scanned volume 4 is typically chosen to be as small as possible. Thus, in some cases, for example when the optimal trajectory for reaching the target 8 requires a moderate/large insertion angle relative to the axial frames of the CT system (i.e., frames generated in the axial plane, perpendicular to the long axis of the patient's body), such as larger than 25-30 degrees, the insertion device 100 may be located entirely outside the scanned volume 4, as shown in
According to some implementations, the mounting pad 30 may be configured as a flexible sac/cushion filled, at least in part, with granules 322, either natural or artificial, such as coffee beans, rice, sand, plastic beads, etc. The mounting pad 30 may further include a vacuum valve 324, such that when vacuum is applied to the mounting pad 30 via the valve 324, the granules 322 are pressed against each other and the mounting pad 30 stiffens. After vacuum is applied, the shape of the mounting pad 30 cannot be altered until the vacuum is cancelled and air is allowed back into the pad. It is to be understood that the use of vacuum in order to stiffen the mounting pad is merely an example, and the mounting pad may be caused to stiffen using any other suitable method, such as heating or cooling. The mounting pad 30 further includes one or more registration members 328 (e.g., fiducial markers), which form together an adjustable registration frame for determining the insertion device's 100 position/movement, as will be explained in detail below.
In some implementations, the registration members 328 may be provided inside the mounting pad 30, together with the granules 322, such that when the pad is in its flexible/moldable form, for example, prior to application of vacuum, the registration members 328 can move around inside the mounting pad 30, or inside a limited portion of the mounting pad 30. In other implementations, the registration members 328 may be coupled to the mounting pad's cover, either as an integral part of the cover or removably coupled thereto, and either to the cover's external surface, such that the registration members 328 face the external environment, or to its internal surface, such that the registration members 328 face the granules 322 within the pad 30. In case the registration members 328 are coupled to the mounting pad's cover, then when the pad is in its flexible form, the registration members 328 can only move together with the cover. Once vacuum is applied to the mounting pad 30, and the mounting pad 30 transforms into its more solidified/rigid form, the registration members 328 can no longer move, not relative to one another, not relative to the mounting pad's cover and granules and not relative to the insertion device 100. Further, once vacuum is applied, the bottom portion of the pad 30 may conform to the shape and contours of the subject's body 15, thus providing stability to the insertion device 100 and minimizing discomfort to the subject. In some implementations, once vacuum is applied, the combination of fastened straps 312 and the mounting pad receiving the shape of the subject's body may prevent the entire mounting pad 30, and the insertion device coupled thereto, from moving relative to the subject's body during the insertion procedure. In some implementations, the mounting pad 30 may be configured such that only a portion of the pad 30 conforms to the shape of the subject's body 15 upon application of vacuum. For example, only the portion which includes the base plate 310 may conform to the shape of the subject's body 15, whereas the portion which includes the registration members 328 may remain slightly hovered above the subject's body, e.g., by having a rigid bottom portion that is configured to remain slightly elevated from the surface to which the mounting pad 30 is attached, such that movements due to breathing, for example, will not result in movement of that portion of the mounting pad 30. This may be of utmost importance in case the area of the body on which the base plate portion of the pad is positioned is not affected by breathing (i.e., does not move), for example, but the area of the body on which the portion of the pad which includes the registration members is positioned is affected by breathing, and thus detected movement of the markers might wrongfully be determined as corresponding movement of the insertion device 100, when in fact there is no movement of insertion device 100.
The registration members 328 are manufactured, at least in part, from material/s that can be detected in an image taken using an imaging system (e.g., X-Ray, CT, MRI), and are clearly distinguished from all other mounting pad elements, such as the cover and the granules. Further, the registration members' material/s should be chosen such that they will not cause imaging artifacts. In case a CT system is utilized, for example, such materials may be carbon, aluminum, polyether ether ketone (PEEK), etc. It is to be understood that the registration members 328 are provided in addition to markers positioned on the insertion device 100 itself (not shown).
The mounting pad 30 may be provided in a variety of shapes and sizes. It may be symmetrical, such as having a U-like shape, as shown in
Reference is now made to
In the implementation shown in
Once vacuum is applied to the mounting pad 40, as shown in
Although not shown in
After the mounting pad 40 has been secured to the subject's body, the insertion device 100 has been coupled to the mounting pad 40, and vacuum has been applied to the mounting pad 40, the clinician can initiate the initial stage of the registration procedure, also referred to as “the preparation stage”.
In step 501, an initial scan of the entire registration frame and the insertion device is obtained. The initial scan includes the entire registration frame (all the articulated rod assemblies together constitute the registration frame) and the insertion device. The number of images taken during the initial scan and the spacing between the images may be determined by the user, or they may be dictated by the system software. The images may be retrieved from the imaging system in any applicable method, such as directly (i.e., an embedded system), using a communication module (e.g., transferring DICOM file(s) over a local area network) or using an external storage unit, such as a CD, DVD, USB portable drive, etc. In some implementations, the scanning may be initiated manually by the user. In other implementations, the scanning may be initiated automatically by the insertion system's software.
In step 502, the fiducial markers of the insertion device are detected using image processing techniques. These markers, which are attached to the insertion device, have known parameters, such as size and shape.
In step 503, the position and orientation of the insertion device in terms of the coordinate system of the initial image space are calculated.
In step 504, all the rods are detected in the initial scan using image processing techniques. As previously noted, the rods, which constitute the registration frame, are manufactured, at least in part, from material/s that can be identified in an image taken by an imaging system (e.g., X-Ray, CT, MRI).
In step 505, the minimal distances and spatial angles between every two rods of the registration frame are calculated and stored. This data defines each rod pair. In some implementations, the above calculations are carried out for each and every two rod combination in the registration frame. In other implementations, the above calculations are not carried out for rod pairs which are deemed impossible or very unlikely to appear in the same scan, after a filtering/screening process is executed. Such pairs may be, for example, pairs of two rods which belong to the same articulated rod assembly but are not adjacent (i.e., rods that are not connected by a joint).
The minimal distance in three-dimensional space between two rods, if the two rods are not parallel and neither they nor their extended lines intersect each other, is the length of the segment which is uniquely simultaneously perpendicular to both rods. If two rods, or their extended lines, intersect then the minimal distance between them is zero. The spatial angles between every two rods are random and distinct. Thus, if the minimal distance and spatial angle are known, any rod pair can later be traced.
In step 506, for every two rods for which the minimal distance and spatial angle were calculated and stored in step 505, the minimal distance points (hereinafter also referred to as “MDPs”) are calculated and stored. The MDPs are the unique points on the two rods at which the two rods are closest to each other, i.e., these are the two points which are joined by the segment which is uniquely simultaneously perpendicular to both rods, if the two rods are not parallel and do not intersect each other, and the length of which is the minimal distance between the two rods. The MDPs may be on the rods themselves, or they may be on the extended infinite lines of the rods (i.e., outside the range of the rods), which are restricted subsets of those lines. If two rods, or their extended infinite lines, intersect, then their MDPs are conjoined.
Each rod may have multiple MDPs, depending on the number of other rods with which it is paired. For example, if the registration frame is composed of three articulated rod assemblies each having five rods, such that the registration frame is made up of fifteen rods altogether, then each rod may have fourteen MDPs, since it may be paired up with each of the other fourteen rods, including the four rods which belong to its articulated rod assembly.
Also calculated and stored in step 506 for each rod pair is the rod pair coordinate system (hereinafter also referred to as “RPCS”) in terms of the coordinate system of the initial image space, i.e., the position and orientation of the RPCS relative to the image space coordinate system. The origin of the RPCS is at the rod's MDP, and its XYZ vectors are defined by the rod or its extended line, the vector to the coupled rod's MDP, and the cross product of the first two vectors, as shown in
In some implementations, if the registration frame comprises n rods, theoretically each rod may be paired up with each of the remaining n−1 rods, such that for each rod n−1 MDPs and RPCSs are found and stored. For example, if the registration frame is composed of three articulated rod assemblies each having five rods, then each rod may have fourteen MDPs and fourteen RPCSs. In other implementations, there may be certain limitations to the pairing resulting in less than n−1 MDPs and RPCSs calculated for each rod. For example, a filtering process may be executed such that each rod may be paired up with all other rods in the reference frame excluding, for example, the rods which are part of the same articulated rod assembly as that specific rod. Further, in some implementations only one RPCS is calculated for each rod pair, as demonstrated in
In step 507, after having calculated the positions and orientations of the insertion device and of the RPCSs in terms of the coordinate system of the initial image space, in steps 503 and 506 respectively, the positions and orientations of the RPCSs in terms of the coordinate system of the insertion device are calculated, based on the above two calculations.
Since there is no relative movement between the registration frame and the insertion device after vacuum is applied to the mounting pad, the positions and orientations of the RPCSs in terms of the coordinate system of the insertion device will remain unchanged until the vacuum is cancelled. This enables the insertion device to be positioned outside the scanned volume, as the position and orientation of the insertion device in terms of the coordinate systems of each of the images obtained throughout the insertion procedure can be calculated based on the known positions and orientations of the RPCSs in terms of the coordinate system of the insertion device, and the calculation of the positions and orientations of the RPCSs that are included in the scanned volume in terms of the coordinate system of a specific new image, as described in detail in
During the insertion procedure, real-time scans are taken, which are limited in volume in order to minimize radiation exposure to the subject and to the medical staff. The number of frames taken during the scan and the spacing between the frames may be determined by the user (e.g., physician), or they may be a system requirement.
The scanned volume 700 may be transverse, as shown in
In step 801, a scan of the region of interest, including a portion of the registration frame, as shown in
In step 802, all the rods which are included in the scan are detected using image processing techniques. All the rods which are included in a specific scan may be referred to as “rod set”.
In step 803, the minimal distances and spatial angles between every two rods which are included in the scan, i.e., every rod pair in the rod set, are calculated. It is to be understood that if the rod set includes more than two rods, it may be sufficient to calculate the minimal distances and spatial angles for only several two rod subsets in order to uniquely define the rod set. For example, if a rod set includes three rods: rod a, rod b and rod c, it may be sufficient to calculate the minimal distances and spatial angles between rod a and rod b and between rod a and rod c, for example, since the minimal distance and spatial angle between rod b and rod c are dictated by the minimal distances and spatial angles between rod a and rod b and between rod a and rod c.
It can be appreciated that in order to determine the minimal distance and the spatial angle between two rods, there is a need for at least two image frames taken within the scanned volume.
In step 804, the calculated minimal distances and spatial angles are compared to the minimal distances and spatial angles which were calculated and stored during the preparation stage of the registration procedure (see step 505 in
It can be appreciated that this step may comprise several iterations until the best matching rod set is determined as the reference rod set. Due to noise in the scan, the calculated minimal distances and spatial angles may produce, when compared to the stored minimal distances and spatial angles, several possible reference rod pairs. However, some rod pairs' combinations (i.e., two or more rod pairs together) may be impossible geographically, i.e., they may be located on the registration frame such that it is impossible for them to be included together in the scanned volume. Thus, the reference rod set may be the rod set which is determined, after several iterations, to be the best matching set in terms of both calculated values—minimal distances and spatial angles—and geographic logic.
It can further be appreciated, in light of the above, that in order to achieve effective identification of the reference rod set, the registration frame should preferably be designed such that at least three rods are always included in the scanned volume, regardless of how the scanned volume is selected, and/or the scanned volume should be selected such that at least three rods are included in it.
In step 805, for every two rods in the reference rod set, the MDPs and the position and orientation of the RPCS(s) in terms of the coordinate system of the current image are calculated.
In step 806, the position and orientation of the insertion device in terms of the coordinate system of the current image space is calculated. Since there is no relative movement between the registration frame and the insertion device after vacuum is applied to the mounting pad and as long as the vacuum is not cancelled, the positions and orientations of the RPCSs in terms of the coordinate system of the insertion device, as calculated in the preparation stage of the registration procedure (see
Since the position and orientation in terms of the coordinate system of the current image is calculated in step 805 for each RPCS individually, then, in some implementations, in order to calculate the position and orientation of the insertion device in terms of the current image coordinate system, all the positions and orientations of the RPCSs calculated in step 805 are combined together to determine the optimized transformation which yields the smallest overall error (e.g., using the least squares method). In other implementations, the insertion device's position and orientation in terms of the current image coordinate system is calculated based on the position and orientation of each RPCS separately, and the calculated positions and orientations of the insertion device according to each RPCS are then combined to determine the optimized transformation of the insertion device in terms of the current image coordinate system.
Once the position and orientation of the insertion device in terms of the coordinate system of the current image space has been determined, the operator of the insertion system can provide the insertion device with accurate instructions for steering the medical tool (e.g., needle) towards the target.
Reference is now made to
After the mounting pad has been secured to the subject's body, the insertion device 100 has been coupled to the mounting pad 90, and vacuum has been applied to the mounting pad 90, the clinician can initiate the initial/preparation stage of the registration procedure.
In step 1001, an initial scan of the entire registration frame and insertion device is obtained. The number of images taken during the initial scan and the spacing between the images may be determined by the user, or they may be dictated by the system software. The images may be retrieved from the imaging system in any applicable method, such as directly (i.e., an embedded system), using a communication module (e.g., transferring DICOM file(s) over a local area network) or using an external storage unit, such as a CD, DVD, USB portable drive, etc. In some implementations, the scanning may be initiated manually by the user. In other implementations, the scanning may be initiated automatically by the insertion system's software.
In step 1002, all the markers coupled to the insertion device are detected using image processing techniques.
In step 1003, the position and orientation of the insertion device in terms of the coordinate system of the initial image space are calculated.
In step 1004, all the semi-flexible elements (or—strips) are detected in the initial scan using image processing techniques.
In step 1005, for each semi-flexible element, a plane which contains the element, as defined below, is found. Since the semi-flexible elements may have width as opposed to being configured as one dimensional strings, the plane which contains the semi-flexible element may refer, for example, to the plane which contains its longitudinal centerline, i.e., the line connecting the central points of the element's width along the length of the element. Since the semi-flexible elements are flexible only in one direction and are rigid in the direction perpendicular to the first direction (i.e., they cannot bend sideways), only one such plane exists for each semi-flexible element. It can be understood that any plane which is parallel to the plane described above can be found instead, as long as there is consistency in the planes used for all of the elements.
In step 1006, for every two planes found in step 1005, the angle between the two planes is calculated and stored. Since for each semi-flexible element there exists only one plane which contains the longitudinal centerline of that element, the angle between the two planes is unique and can thus be used to trace the semi-flexible elements appearing in subsequent scans.
It can be appreciated that using the angle between the planes in order to identify which semi-flexible elements are included in a particular scan, i.e., by comparing calculated angles to stored angles, as will be described hereinafter, is merely one example of how the semi-flexible elements can be identified. The semi-flexible elements may be identified using any other suitable method, such as adding identifying marks to several or all of the elements (e.g., small protrusions, bristles, etc.), using elements having different characteristics (e.g., width) or materials, calculating and comparing the angle between the different planes' intersection lines (see below), and so forth.
In step 1007, for every two planes found in step 1005, the line where the two planes intersect is found. Since for each semi-flexible element there exists only one plane which contains the longitudinal centerline of that element, the line where such planes of two elements intersect is single and unique.
In step 1008, for every two intersection lines found in step 1007, the minimal distance points (“MDPs”) and the position and orientation of the intersection lines' coordinate system (hereinafter also referred to as “ILCS”) in terms of the coordinate system of the initial image space is calculated. If two intersection lines intersect each other, then the minimal distance between them is zero and there is a single MDP—the intersection point.
In step 1009, the positions and orientations of the ILCSs in terms of the coordinate system of the insertion device are calculated, based on the position and orientation of the insertion device in terms of the coordinate system of the initial image space, as calculated in step 1003, and the positions and orientations of the ILCSs in terms of the coordinate system of the initial image space, as calculated in step 1008.
Since there is no relative movement between the registration frame and the insertion device after vacuum is applied to the mounting pad, the positions and orientations of the ILCSs in terms of the coordinate system of the insertion device remain unchanged, until the vacuum is cancelled. This enables the insertion device to be positioned outside the scanned volume, as the position and orientation of the insertion device in terms of the coordinate systems of each of the images obtained throughout the insertion procedure can be calculated based on the known positions and orientations of the ILCSs in terms of the coordinate system of the insertion device, and the calculation of the positions and orientations of the ILCSs that are included in the scanned volume in terms of the coordinate system of the specific new image, as described in detail in
In
In step 1201, a scan of the region of interest, including a portion of the registration frame, as shown in
In step 1202, all the semi-flexible elements (or—strips), or portions therefrom, which are included in the scan are detected using image processing techniques.
In step 1203, for each semi-flexible element in the scan, the plane which contains that semi-flexible element, or any other plane parallel to that plane, is found. As previously stated with regard to step 1005 in
In step 1204, for every two planes found in step 1203, the angle between the two planes is calculated. As previously stated, since for each semi-flexible element there exists only one plane which contains the longitudinal centerline of that element, for example, the angle between those two planes is unique and can thus be used to trace the semi-flexible elements appearing in the scan. It can be appreciated that in order to find the described unique planes, there is a need for at least two image frames taken within the scanned volume.
In step 1205, the calculated angles are compared to the angles which were calculated and stored during the preparation stage of the registration procedure (see step 1006 in
It can be appreciated that using the angle between the planes in order to identify which semi-flexible elements are included in a particular scan is merely one example of how the semi-flexible elements can be identified. The semi-flexible elements may be identified using any other suitable method, such as identifying marks on several or all of the elements (e.g., small protrusions, bristles, etc.), using elements having different characteristics (e.g., width) or materials, and so forth.
Once it has been determined which semi-flexible elements appear in the scan, the position and orientation of those elements relative to the current image space is calculated, as follows:
-
- In step 1206, for every two planes found in step 1203, the line where the two planes intersect is found. Since for each semi-flexible element there exists only one plane which contains the longitudinal centerline of that element, there also exists only one line where two such planes intersect.
- In step 1207, for every two intersection lines found in step 1206, the minimal distance points (“MDPs”) and the position and orientation of the intersection lines' coordinate System (“ILCS”) in terms of the coordinate system of the current image space is calculated.
- In step 1208, the position and orientation of the insertion device in terms of the coordinate system of the current image space is calculated. Since there is no relative movement between the registration frame and the insertion device after vacuum is applied to the mounting pad, and as long as the vacuum is not cancelled, the positions and orientations of the ILCSs in terms of the coordinate system of the insertion device, as calculated in the preparation stage of the registration procedure (see
FIG. 10 ), remain unchanged. Thus, the position and orientation of the insertion device in terms of the coordinate system of the current image space can be calculated using the known positions and orientations of the ILCS s relating to the semi-flexible elements included, at least in part, in the reference section in terms of the coordinate system of the insertion device, and the calculated positions and orientations of those ILCSs in terms of the coordinate system of the current image space (see step 1207).
The transformation of the insertion device in terms of the current image coordinate system is calculated in step 1207 for each ILCS individually, in case there is more than one ILCS, i.e., if there are more than three semi-flexible elements within the scanned volume. Therefore, in some implementations, in order to calculate the transformation of the insertion device in terms of the current image coordinate system, all the transformations of the ILCS s calculated in step 1207 are combined together to determine one optimized transformation which yields the smallest overall error (e.g., using the least squares method). In other implementations, the insertion device's transformation in terms of the current image CS is calculated based on the transformation of each ILCS separately, and the calculated transformations of the insertion device are then combined to determine the optimized transformation of the insertion device in terms of the current image CS.
Once the position and orientation of the insertion device in terms of the coordinate system of the current image space has been determined, the operator of the insertion system can provide the insertion device with accurate instructions for steering the medical tool toward the target.
In an alternative implementation, the registration frame may include, in addition to the semi-flexible strips, one or more threads which cross the semi-flexible strips substantially horizontally. The threads may be stretched across the semi-flexible strips in straight lines or as arches, i.e., forming together with the semi-flexible strips a cobweb-like pattern, for example. The threads should be made up from a material that is visible by the imaging system (e.g., CT, MRI), such as silk.
In this implementation, the points of intersection between the threads and the semi-flexible strips may be detected in the initial scan carried out after vacuum is applied to the mounting pad. The initial scan includes both the insertion device and the entire registration frame, similarly to the above-described implementations. A plurality of coordinate systems, each having its origin at an intersection point (thus also referred to as “intersection point coordinate system” or “IPCS”), may then be calculated relative to the initial image space. In some implementations, The X′Y′Z′ vectors of the IPCS may be defined by the semi-flexible strip, the vector perpendicular to the plane formed by the semi-flexible strip and the thread at least at the immediate surrounding of the intersection point, and the cross product of the first two vectors.
The transformation of the insertion device relative to the initial image space is also calculated, and based on these two calculations, the transformation of the IPCSs in terms of the insertion device coordinate system, is calculated. Since after vacuum is applied to the mounting pad there is no relative movement between the registration frame and the insertion device, the transformation of the IPCSs in terms of the insertion device coordinate system remains unchanged until the vacuum is cancelled.
The transformation of the insertion device in terms of the image space in consecutive real-time scans taken during the medical procedure may then be calculated based on the fixed transformation of the IPCSs in terms of the insertion device coordinate system and the newly calculated transformations of the IPCSs in terms of the new image.
It should be noted that after the intersection points are detected in a real-time scan, and before the IPCSs are calculated, there may be a need for an additional step of image processing (e.g., surface matching), in order to correctly identify the mounting pad section appearing in the scan, and its orientation, and thus correctly determine which intersection points are the intersection points detected in the scan. The additional image processing step may be carried out on the entire mounting pad section included in the scan, or it may be carried out on the immediate surrounding of each intersection point separately. Further, the additional image processing step may be carried out first on the entire mounting pad section included in the scan, and then on the immediate surrounding of each intersection point, for fine tuning purposes. This additional image processing step may be done, for example, using visual/image descriptors, such as distinct edges or corners in the semi-flexible strips, distinct patterns in the surface of the mounting pad or distinct patterns in the granules located in the scanned volume.
Although particular implementations have been disclosed herein in detail, this has been done by way of example for purposes of illustration only, and is not intended to be limiting with respect to the scope of the appended claims, which follow. In particular, it is contemplated that various substitutions, alterations, and modifications may be made without departing from the spirit and scope of the disclosure as defined by the claims. For example, the logic flows depicted in the accompanying figures and described herein do not necessarily require the particular order shown, or sequential order, to achieve desirable results. Other aspects, advantages, and modifications are considered to be within the scope of the following claims. The claims presented are representative of the implementations and features disclosed herein. Other unclaimed implementations and features are also contemplated. Accordingly, other implementations are within the scope of the following claims.
Claims
1. A method for determining the real-time position and orientation of an automated medical device relative to an image space during an image-guided procedure, using a mounting apparatus configured for mounting on a body of a subject and for coupling the automated medical device thereto, at least one registration frame comprising at least one semi-flexible strip coupled to the mounting apparatus, and a processor, the method comprising:
- (a) obtaining one or more initial images of the mounting apparatus and the automated medical device coupled thereto;
- (b) calculating the position and orientation of the automated medical device relative to the image space in the one or more initial images;
- (c) detecting the at least one semi-flexible strip in the one or more initial images;
- (d) identifying which of the at least one semi-flexible strip is included in a scan of the one or more initial images;
- (e) calculating the position and orientation of the at least one semi-flexible strip relative to the image space in the one or more initial images;
- (f) determining the position and orientation of the at least one semi-flexible strip relative to the automated medical device based on the calculated positions and orientations of the automated medical device and of the at least one semi-flexible strip relative to the image space in the one or more initial images;
- (g) obtaining one or more real-time images of a region of interest, the one or more real-time images including a portion of the at least one registration frame;
- (h) detecting the at least one semi-flexible strip of the portion of the at least one registration frame in the one or more real-time images;
- (i) determining the real-time position and orientation of the at least one semi-flexible strip relative to the image space in the one or more real-time images, wherein determining which semi-flexible elements are included in the scan may be based on an highest correlation found between calculated position and orientation of the at least one semi-flexible strip relative to the image space in the one or more real time images and calculated position and orientation of the at least one semi-flexible strip relative to the image space in the one or more initial images; and
- (j) determining the real-time position and orientation of the automated medical device relative to the image space in the one or more real-time images based on the real-time position and orientation of the at least one semi-flexible strip of the at least one registration frame relative to the image space of said one or more real time images and the position and orientation of the at least one at least one semi-flexible strip of the at least one registration frame relative to the automated medical device determined based on the one or more initial images.
2. The method of claim 1, comprising, upon identifying which of the at least one semi-flexible strip is included in a scan of the one or more initial images, calculating initial values of one or more predetermined geometric parameters for the at least one registration member.
3. The method of claim 1, comprising, identifying which of the at least one semi-flexible strip is included in the scan of the one or more initial images, identifying initial values of one or more predetermined material parameters for the at least one registration member.
4. The method of claim 2, comprising, upon detecting the at least one semi-flexible strip of the portion of the at least one registration frame in the one or more real-time images, calculating real-time values of the one or more predetermined geometric parameters for the at least one semi-flexible strip of the portion of the registration frame.
5. The method of claim 2, comprising, upon detecting the at least one semi-flexible strip of the portion of the at least one registration frame in the one or more real-time images, calculating real-time values of the one or more predetermined material parameters for the at least one semi-flexible strip of the portion of the at least one registration frame.
6. The method of claim 4, comprising comparing the real-time values of the one or more predetermined geometric parameters to the initial values of the one or more predetermined geometric parameters and identifying the at least one semi-flexible strip of the portion of the at least one registration frame based on the highest correlation found between real-time values and initial values.
7. The method of claim 2, wherein the predetermined geometric parameters comprise one or more of: angle, distance, length, shape, plane, relative position and coordinate system.
8. The method of claim 1, comprising detecting in the one or more initial images, one or more registration markers attached to the automated medical device.
9. The method of claim 1, wherein the registration frame configured to be coupled to the mounting apparatus either as an integral part of the mounting apparatus or removably coupled thereto.
10. A method for determining the real-time position and orientation of an automated medical device relative to an image space during an image-guided procedure, the method comprising:
- providing a system comprising: a mounting apparatus configured for mounting on a body of a subject and for coupling the automated medical device thereto; at least one registration frame configured as at least one semi-flexible element and coupled to the mounting apparatus, such that during the image-guided procedure, there is substantially no relative movement between the at least one semi-flexible element and the automated medical device coupled to the mounting apparatus; and at least one processor;
- obtaining one or more real-time images of a region of interest in the body of the subject, the one or more real-time images including a portion of the at least one registration frame having the at least one semi-flexible strip;
- detecting the at least one semi-flexible strip of the at least one registration frame in the one or more obtained real-time images;
- determining the real-time position and orientation of the of the at least one semi-flexible strip relative to the image space; and
- determining the real-time position and orientation of the automated medical device relative to the image space based on the determined real-time position and orientation of the portion of the at least one semi-flexible strip relative to the image space and a predetermined relationship between the automated medical device and the at least one semi-flexible strip of the at least one registration frame.
11. The method of claim 10, wherein the step of determining the real-time position and orientation of the at least one semi-flexible strip relative to the image space comprises finding for each of the at least one semi flexible strip a plane which contains the at least on semi flexible strip, and calculating an angle between every two planes.
12. The method of claim 11, wherein the step of determining the real-time position and orientation of the at least one semi flexible strip relative to the image space comprises:
- calculating for every two planes a line where the two plants intersection is found;
- calculating the minimal distance between the two intersection lines, the minimal distance points and the position and orientation of the intersection lines' coordinate system of the coordinate system of the image space; and
- calculating the real-time position and orientation of the intersection lines' coordinate system relative to the image space.
13. The method of claim 10, further comprising determining the predetermined relationship between the automated medical device and the at least one at least one semi-flexible element using one or more initial images.
14. A system for determining the real-time position and orientation of an automated medical device relative to an image space during image-guided procedures, the system comprising:
- a mounting apparatus configured for mounting on a body of a subject and for coupling the automated medical device thereto;
- at least one registration frame coupled to the mounting apparatus; and
- a processor configured to: detect a portion of the at least one registration frame in one or more real-time images obtained from an imaging system; determine the real-time position and orientation of the portion of the at least one registration frame relative to the image space; and determine the real-time position and orientation of the automated medical device relative to the image space based on the determined real-time position and orientation of the portion of the at least one registration frame relative to the image space and a predetermined relationship between the automated medical device and the at least one registration frame.
15. The system of claim 14, wherein the processor is configured to determine the predetermined relationship between the automated medical device and the at least one registration frame using one or more initial images obtained from the imaging system.
16. The system of claim 14, wherein the at least one registration member comprises at least one semi-flexible element.
17. The system of claim 14, further comprising one or more registration markers attached to the automated medical device, and wherein the processor is configured to detect the one or more registration markers in one or more images obtained from the imaging system.
Type: Application
Filed: May 10, 2023
Publication Date: Sep 7, 2023
Inventors: Ido ROTH (Pardes Hanna), Moran SHOCHAT (Zichron Yaakov), Chen LEVIN (Ramat Gan)
Application Number: 18/195,424