Surgical viewing system
A surgical viewing system including an X-ray source, a screw placing surgical tool, a detector, a fiducial marker, and an image correction system. The X-ray source creates a beam of radiation, and the surgical tool is coupled thereto. The X-ray detector detects an image, the detected image resulting from receiving a portion of the radiation. There is at least one fiducial marker coupled to a part of the surgical tool, the fiducial marker being radiopaque and blocking a portion of the beam of radiation from the detector to produce a profile on the detected image. The surgical tool has an axis of rotation and the fiducial marker is axially symmetric to the axis of rotation. The image correction system takes the detected image and produces a corrected image by using a shape of the profile of the fiducial marker and/or a location of the profile of the fiducial marker.
This is a continuation of U.S. patent application Ser. No. 15/441,759, entitled “SURGICAL VIEWING SYSTEM”, filed, Feb. 24, 2017, which is incorporated herein by reference.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates to a surgical viewing system, and, more particularly, to a surgical viewing system coupled to a screw placing surgical tool.
2. Description of the Related Art
Currently there are methods and devices that are used to assist the professional during the installation of an intramedullary nail. An intramedullary nail is designed to be inserted through the center of a bone and affixed to the bone via screws that are installed through the bone. The nail has pre-existing holes along its length, but when the nail is inserted to a bone, the holes are no longer visible. One option uses a fluoroscope to sight the hole, then the user places the drill based on the image seen on a monitor. The fluoroscope is then moved out of the way, the drill is then rotated into position and drilling is started. This involves a significant amount of practice and skill, since there is no visual feedback after the fluoroscope is moved and drilling starts. One option uses magnetics to sense the holes in the nail. Another option involves a drilling template that is affixed to one end (the proximal end) of the nail. This is ineffective, since the template can become easily misaligned and the nail sometimes bends upon insertion to the bone, rendering the template useless. A bent nail or misaligned template results in an incorrectly drilled hole. An incorrectly drilled hole results in longer surgery, higher potential for infection, and other trauma that can cause post-op complications.
Surgeons can also use pedicle probes to open up a path for screw placement, with an awl or high-speed burr being used to cut through dense cortical shell of vertebrae before using the probe.
The viewing of the alignment of the drill and screw can be misaligned if the transmitter and receiver are not aligned with each other.
What is needed in the art is an easy to operate surgical viewing system that uses a detector that is not necessarily perfectly aligned with an X-ray source.
SUMMARY OF THE INVENTIONThe present invention provides a system that interprets a misalignment of the detector and compensates the image for the misalignment.
The invention in one form is directed to a surgical viewing system including an X-ray source, a screw placing surgical tool, a detector, a fiducial marker, and an image correction system. The X-ray source creates a beam of radiation, and the screw placing surgical tool is coupled thereto. The X-ray detector detects a projected image resulting in a detected image, the detected image resulting from receiving at least some of the beam of radiation. There is at least one fiducial marker coupled to a part of the screw placing surgical tool, the fiducial marker being radiopaque and blocking a portion of the beam of radiation from the detector to produce a profile on the detected image. The screw placing surgical tool has an axis of rotation and the fiducial marker is axially symmetrical to this axis of rotation. The image correction system takes the detected image and produces a corrected image by using a shape of the profile of the fiducial marker and/or a location of the profile of the fiducial marker.
The invention in yet another form is directed to a method of viewing a surgical item in an animal, the method including the steps of creating a beam, coupling a screw placing surgical tool, detecting a projected image, coupling a fiducial marker, and correcting an image. The creating a beam step creates a beam of radiation from an X-ray source. The coupling a screw placing surgical tool step couples a screw placing surgical tool with the X-ray source. The detecting a projected image detects a projected image with an X-ray detector resulting in a detected image, the detected image resulting from receiving at least some of the beam of radiation by the detector. The coupling at least one fiducial marker step couples the fiducial marker to a part of the screw placing surgical tool, the at least one fiducial marker being radiopaque and blocking a portion of the beam of radiation from reaching the detector to produce a profile on the detected image. The screw placing surgical tool has an axis of rotation and the fiducial marker is axially symmetrical to this axis of rotation. The correcting step corrects the detected image and produces a corrected image with an image correction system using at least one of a shape of the profile of the fiducial marker and a location of the profile of the fiducial marker.
An advantage of the present invention is that the fiducial maker is associated with the tool and projects a profile on the detector to allow the correction system to skew the image data to a true image for the surgeon.
Another advantage of the present invention is that the detector does not have to be aligned as in prior art systems.
Yet another advantage of the present invention is that there is no need to use a positioning system to either align the detector or to detect the orientation of the detector.
The above-mentioned and other features and advantages of this invention, and the manner of attaining them, will become more apparent and the invention will be better understood by reference to the following description of embodiments of the invention taken in conjunction with the accompanying drawings, wherein:
Corresponding reference characters indicate corresponding parts throughout the several views. The exemplifications set out herein illustrate embodiments of the invention and such exemplifications are not to be construed as limiting the scope of the invention in any manner.
DETAILED DESCRIPTION OF THE INVENTIONThe system 10 uses an X-ray source 12 and imager 80, a drill driver 14 as shown in
In orthopedics, a broken or damaged bone 70 can be reinforced with an intramedullary nail 72 inserted through one end of the bone. Intramedullary nails have been used in the medical field for years and are well known in the art. The nail 72 can be either curved or straight but is typically round on the outside. The nail 72 is an elongate member with a proximal end and a distal end 108 as shown in
When a source of x-ray radiation is coupled with a device to receive and display the radiation (such as a radiograph), the user can see things that are internal to the visually opaque material. This is useful because fractures and breaks in bones are not always detectable otherwise. An x-ray source 12 is made up of a housing 20 as shown in
An imager 80 is made up of a panel 82 and a display 84 as shown in
A cannulated drill 68 as shown in
Optionally, a standard medical drill 14 can be used in conjunction with an offset cannulated adapter 24 as shown in
A medical cannulated drill bit 26 is a drill bit that is built similar to the standard drill bit and includes a radiolucent passage 104 (as shown in
While a standard nail 72 may have transverse holes that are used for alignment, a fiducial marker 50, as shown in
Instead of a cannulated drill 68 or cannulated attachment 24, a drill guide could be implemented. The drill guide locates the axis of x-ray radiation to the drilling axis by a set distance. With the known distance in the guide matching a known distance between a fiducial marker in the nail 72 and the transverse hole 74, a standard drill bit can be attached to a drill driver 14. A hole 116 can be drilled by setting the guide to be offset from the transverse hole 74 by the same known distance. A drill guide gives the option of using a standard drill and drill bit. Alignment is accomplished by aligning the offset fiducial marker to the hole 116 being drilled.
In order to make the hole 116 coaxial to transverse hole 74, the x-ray source 12 is installed into the rear of the cannulated drill 68 or cannulated attachment 24 such that the central axis of the source 86 is coaxial with the central axis of passage 66. Next, a cannulated drill bit 26 is installed to the drill via the chuck 64. This arrangement makes the driving axes 62 of the drill source 86, and drill bit 36 coaxial. The assembly with a cannulated drill, as described, is shown in
In the event the chuck 64 is radiopaque (or is very radiodense), a portion of radiation 100 is all that passes through the radiolucent passage 104 of the drill bit. This results in an image that only shows the hole 74 when the drill bit is in sufficient proximity and alignment. In the event the chuck 64 is radiolucent (or has radiolucent properties), radiation 100 passes through the hole 104 in the drill (as shown in
Drill bits 120 with radiopaque 122 and radiolucent 124 portions as shown in
Alternatively, the location or modification of the x-ray source 12 is possible. As shown in
It is also possible to use multiple x-ray generators that are off axis as shown in
Further, a generator 140 can be moveable around the central axis 146 of the drill. This allows a similar result as the multiple generator embodiment, but with a single source.
When multiple generators 140, 142, 144 or a moving generator is used, the image as viewed by the user could be unintelligible because of overlap or movement. Utilizing a system to process the control, the sources, and generated images, improves the image as produced on the display 84. A control system as incorporated in the display 84 or imager 80 can enable individual generators and overlay individual images as received on the panel 82 to form a composite image. By using multiple or a moving source, the occluded area 138 can be reduced or eliminated. For example (
An annular x-ray source can be implemented instead of multiple generators or a moving generator. The annular x-ray source would cover a similar area as the multiple generators 140, 142, and 144 but be a continuous ring of x-ray radiation instead of individual sources.
Now, additionally referring to
Additionally referring to
Now, additionally referring to
Looking at image 230 the distortion or skewed image is detected by several elements of the image that are projected from the end of chuck 210/bit assembly 212. The “I” suffix to each element number indicates that it is the detected image of the reference number that precedes the “I”. Here image 2161 is an oval, while the known shape of the cross-section of bit 216 is known to be circular. Additionally, the shape of images 2181 and their relative location and known geometrical positioning fiducial markers 218 also provide information to viewing system 202 to correct the image. Yet further, the overall footprint of radiation beam 101 coming from the circular end of chuck 210, which is the outer illuminated boundary 2341 of image 230 also provides information. Boundary 2341 is established, in this example, by the end of chuck 210, but it can be established by other elements of system 200, such as collimator 90. It should be noted that all of the discussed imaged elements are coupled to tool assembly 204. In contrast, the image 721 of intramedullary nail 72 cannot be relied upon to correct for distortion in the image, because intramedullary nail 72 may itself be misaligned, and the image of a feature of intramedullary nail 72 may be properly skewed because of such a misalignment.
Additionally referring to
Controller 252 is coupled to display 84 and detector 222, and may be coupled to source 220. When source 220 is activated at step 302, controller 252 receives information from detector 222 in step 304. In step 306 fiducial marks are used to correct a received image 230 into corrected image 232. The corrected image 232 is then displayed on display 84 at step 308. The surgeon then uses tool 204, guided by corrected image 232 to move tool 204 and to carry out the surgical procedure, which is depicted herein as a drilling operation. Method 300 repeats itself so that the surgeon receives feedback as he/she manipulates tool 204.
Image correction system 250 has known geometric information on the position of fiducial markers 218 and boundary information of the end of chuck 210 that forms boundary 2341 and bit 216, so that the pixel information that is created is created into a plan view as if detector 222 were substantially or even perfectly normal to axis 224. Once the pixel information of the fiducial markers 218C are positioned where they should be in the corrected image then the intervening pixels are populated with data representative of the information in the pixels between the fiducial makers 2181. Techniques of interpolation and spatial mathematics are employed to create corrected image 232.
As bit 216 is rotated clockwise as indicated by arrow 236, tails appear on the marker images 2181, which can be displayed as marker images 218C in the corrected image 232. The shape of outer boundary 234 is used as a fiducial marker. In that as chuck 210 rotates the image is not blurred, and the line remains distinct, due to its axial symmetry about the axis of rotation 224. The elliptical shape in
It is also contemplated that image 232 can be kept approximately the same overall size as screw placing surgical tool 204 is moved toward or away from detector 222. This compensation takes into consideration that radiation beam 101 is somewhat conical in shape causing differing intersecting area of beam 101 to contact detector 222 as tool 204 is moved toward and away from detector 222.
To correct the perspective distortion present in this system 200, two aspects are included: (1) A fiducial marker of a known shape (in this embodiment, the inner opaque boundary of chuck 210) is fixed to the X-ray source 220 at a known location and orientation. The fiducial marker is positioned in front of the X-ray source 220, such that the marker image 2341 is projected onto the image plane when the X-ray source 220 is directed at the imager 222. (2) An image processor 250 with algorithm 300 and/or 400 is connected to the imager 222 and the display 84. The processor 250 receives the image from the imager 222, the algorithm 300, 400 performs a transformation on the image based on the information contained in the image 230, and the transformed image 232 is output to the display 84.
One aspect of the fiducial marker 234 is that it remains fixed with respect to the X-ray source axis 224. Thus, as the source 220 moves with respect to the imager 222 and the skew angle changes, the image of the fiducial 2341 in the radiograph is predictable and the skew angle can be deduced from the fiducial image 230.
Fiducial marker designs can be classified as to whether they are attached to the rotating chuck assembly 210 or not. Those that do not rotate with the chuck assembly have the advantage that their projected shape is not affected by the chuck's rotation. One example is a polygon-shaped collimator limiting the field of view, such as a square or hexagon. Another example is a set of points on the periphery of the field of view, such as individual spheres or notches in the collimator edge. From an image processing point of view, these examples are composed of straight lines and points.—Image elements composed of straight lines and points generally take fewer computational resources to identify and extract their position.
Fiducial markers that rotate with the chuck 210 have the advantage of being more easily integrated into the mechanical system. However, the chuck rotation can affect the appearance of the fiducial marker in the image. For example, fiducial markers that are polygon-shaped or a set of points may not appear the same when the chuck is rotating. Circular (or axially symmetric) fiducial markers will appear the same in the image regardless of whether the chuck is rotating. Circular designs have the disadvantage that they require a more resource-intensive algorithm to identify the curved boundary. Examples of suitable fiducial markers include the edge of a circular collimator, the edge of the chuck 210 and the edge of the drill bit 216. The drill bit 216 adds the disadvantage that it requires the bit or an equivalent shape to be present, so the system would not work when the bit is not in place.
It is also possible for the fiducial marker to be fixed to the imager instead of the X-ray source. However, this presents some limitations, notably that the X-ray source must illuminate the fiducial regardless of the position of the source. In addition, the fiducial must be placed some distance in front of the imager to provide the relief necessary to identify the perspective distortion. These requirements place additional restrictions on the design of the X-ray source and detector that limit the performance and utility of the system. All of which is overcome in the inventive solution of the present invention. The prior art does not disclose the placement of a screw through the hole of a nail or a plate located on or within a bone as discussed and claimed herein. Applicant's invention advantageously allows a surgeon to align a rotating tool and drill a hole and/or place a screw through a hole in nail 72.
The algorithm 400 applies image-processing techniques to the image data to identify the position and shape of the fiducial mark in the image. The identified shape is compared to the ideal shape, and the parameters for a homographic transform are calculated. An outline of the algorithm is shown in
Method 400 receives an image from the detector 222 and finds the region of interest, step 402, by thresholding for example. The region dimensions such as size, center, maximum and minimum intensity values are found for later use. Pixels outside the region of interest may be discarded to reduce the resources required for further processing.
Candidate features in the image are identified, at step 404, by using image processing algorithms, which can include edge, corner, line, circle and other detection techniques, or combinations of techniques.
At step 406, the expected size, shape and position of the fiducial marker in the image within the region of interest are used to extract the location of the fiducial features from the candidate features identified.
At step 408, a homography matrix is calculated using image-processing algorithms. Such algorithms find the optimal 3×3 orthogonal matrix that will map the fiducial features locations in the input image 230 to the desired location in the output image 232. At step 410, the homography matrix is applied to the input image, warping it to the desired perspective. The output image is sent to the display, at step 412.
One of the features of the present invention is the space between the X-ray source 220 and the shank of the drill bit (or tool) 216. Typically a spot size of the X-ray source 220 is less than 1 mm and a drill bit for a typical IM nail application is 4 mm or more in diameter, a significant distance between the spot 220 and the shank end of the bit 216 is necessary to be able to image the hole, which may typically be 5 mm, without the hole being occluded by the drill bit. In the inventive solution of the present invention at least 150 mm exists between X-ray source 220 and the shank of bit 216, preferably more than approximately 200 mm, or approximately around 200 mm is most preferable.
Prior art X-ray systems, whether diagnostic or interventional (surgical), flood the detector with radiation. Prior art sources teach that the detector should be flooded and the field of illumination should be wide, say 45 degrees. However, the present invention uses an application of X-rays that is narrow and limited, because the tool is used at a point in the procedure where the only important information is the target axis and closely surrounding tissue, so the present invention advantageously eliminates unnecessary radiation. Another advantage of the present invention is the reduction in the use of radiolucent materials that is possible since a narrow field of illumination is used, to thereby reduce the wide spread use of radiolucent materials that are required to have a wide field of illumination. Typically radiolucent materials are not as durable as conventional materials and they do not hold up well to autoclave cycles, so eliminating them improves reliability of the overall system. Furthermore, the narrow field of illumination allows the present invention to use the edge of the field as the fiducial marker. Advantageously the present invention depends on not flooding the detector so that the edge of the field of illumination is contained in the detected image. To avoid unnecessary exposure, the present invention has limited the field of illumination to a minimum practical size. In a current embodiment of the invention, the hardware surrounding the X-ray source axis is radiopaque to limit the radiation exiting the tool to a narrow cone. Hardware components including the bearings and gears surrounding the chuck, the chuck itself, and the offset drive housing block the radiation. In one embodiment of the present invention the field of view is limited to a solid angle of about 8 degrees and a diameter of about 25 mm at the end of the tool, but the optimal field of illumination will vary with the needs of the specific application. Generally, a field of view of up to 50 mm in diameter and a solid angle of up to 20 degrees will work for screw placement. This is substantially less than what the prior art suggests.
While this invention has been described with respect to at least one embodiment, the present invention can be further modified within the spirit and scope of this disclosure. This application is therefore intended to cover any variations, uses, or adaptations of the invention using its general principles. Further, this application is intended to cover such departures from the present disclosure as come within known or customary practice in the art to which this invention pertains and which fall within the limits of the appended claims.
Claims
1. A surgical viewing system, comprising:
- an X-ray source creating a beam of radiation;
- a handheld screw placing surgical tool with the X-ray source connected thereto, the screw placing surgical tool having an axis of rotation;
- an X-ray detector positioned to detect a projected image resulting in a detected image, the detected image resulting from receiving at least some of the beam of radiation by the detector;
- at least one fiducial marker coupled to a part of the handheld screw placing surgical tool, the at least one fiducial marker being radiopaque and blocking a portion of the beam of radiation from the detector to produce a profile on the detected image; and
- an image correction system taking the detected image and producing a corrected image by using at least one of a shape of the profile of the fiducial marker and a location of the profile of the fiducial marker.
2. The viewing system of claim 1, wherein the fiducial marker is axially symmetric to the axis of rotation.
3. The viewing system of claim 1, wherein the detector is at a non-normal angle relative to the beam of radiation.
4. The viewing system of claim 3, wherein the screw placing surgical tool includes a radiopaque tool portion that is configured to enter an animal body to perform a function therein, the radiopaque tool portion serving as a marker, the image correction system also using a projection of the radiopaque tool portion on the detected image to produce the corrected image.
5. The viewing system of claim 4, wherein the radiopaque tool portion is a drill bit.
6. The viewing system of claim 1, wherein the at least one fiducial marker includes a plurality of fiducial markers arranged in a geometrical pattern.
7. The viewing system of claim 6, wherein the fiducial markers are arranged in a plane that is substantially perpendicular to the beam of radiation.
8. The viewing system of claim 6, wherein the relative locations of the fiducial markers is used by the image correction system to produce the corrected image from the detected image.
9. The viewing system of claim 1, wherein the screw placing surgical tool further includes a radiolucent shank that holds one of a drill bit, a pedicle probe, an awl and a burr.
10. The viewing system of claim 9, wherein the at least one fiducial marker is a plurality of fiducial markers that are embedded in the radiolucent shank radially outward from the drill bit, the pedicle probe, the awl or the burr.
11. A method of viewing a surgical item in an animal, the method comprising the steps of:
- creating a beam of radiation from an X-ray source that is connected to a screw placing surgical tool, the screw placing surgical tool having an axis of rotation, the beam of radiation being generally centered about the axis of rotation;
- detecting a projected image with an X-ray detector resulting in a detected image, the detected image resulting from receiving at least some of the beam of radiation by the detector;
- coupling at least one fiducial marker to a part of the screw placing surgical tool, the at least one fiducial marker being radiopaque and blocking a portion of the beam of radiation from reaching the detector to produce a profile on the detected image, the fiducial marker being axially symmetric to the axis of rotation; and
- correcting the detected image and producing a corrected image with an image correction system using at least one of a shape of the profile of the fiducial marker and a location of the profile of the fiducial marker.
12. The method of claim 11, further comprising the step of displaying the corrected image on a display coupled to the screw placing surgical tool.
13. The method of claim 11, wherein the detector is at a non-normal angle relative to the beam of radiation.
14. The method of claim 13, wherein the screw placing surgical tool includes a radiopaque tool portion that is configured to enter the animal to perform a function therein, the radiopaque tool portion serving as a marker, the image correction system also using a projection of the radiopaque tool portion on the detected image to produce the corrected image.
15. The method of claim 14, wherein the radiopaque tool portion is a drill bit.
16. The method of claim 11, wherein the at least one fiducial marker is a plurality of fiducial markers arranged in a geometrical pattern.
17. The method of claim 16, wherein the fiducial markers are arranged in a plane that is substantially perpendicular to the beam of radiation.
18. The method of claim 16, wherein the relative locations of the fiducial markers is used by the image correction system to produce the corrected image from the detected image.
19. The method of claim 16, wherein the screw placing surgical tool further includes a radiolucent shank that holds one of a drill bit, a pedicle probe, an awl and a burr.
20. The method of claim 19, wherein the fiducial markers are embedded in the radiolucent shank radially outward from the drill bit, the pedicle probe, the awl or the burr.
5478343 | December 26, 1995 | Ritter |
6477400 | November 5, 2002 | Barrick |
8942345 | January 27, 2015 | Dennerlein et al. |
20020193800 | December 19, 2002 | Kienzle, III |
20040167391 | August 26, 2004 | Solar |
20090054910 | February 26, 2009 | Zheng |
20100241129 | September 23, 2010 | Markey |
20120022544 | January 26, 2012 | Chang et al. |
20120059376 | March 8, 2012 | Rains et al. |
20140107471 | April 17, 2014 | Haider et al. |
20140148808 | May 29, 2014 | Inkpen et al. |
Type: Grant
Filed: Feb 28, 2017
Date of Patent: Oct 10, 2017
Inventor: David B. Rich (Warsaw, IN)
Primary Examiner: Christopher Beccia
Application Number: 15/445,215
International Classification: A61B 17/17 (20060101); A61B 90/00 (20160101);