ARTICULATE AND SWAPPABLE ENDOSCOPE FOR A SURGICAL ROBOT
The present invention is directed to an articulate minimally invasive surgical endoscope with a flexible wrist having at least one degree of freedom. When used with a surgical robot having a plurality of robot arms, the endoscope can be used with any of the plurality of arms thereby allowing the use a universal arm design. The endoscope in accordance to the present invention is made more intuitive to a user by attaching a reference frame used for controlling the at least one degree of freedom motion to the flexible wrist for wrist motion associated with the at least one degree of freedom. The endoscope in accordance to the present invention attenuates undesirable motion at its back/proximal end by acquiring the image of the object in association with the at least one degree of freedom based on a reference frame rotating around a point of rotation located proximal to the flexible wrist.
This application is a continuation of U.S. patent application Ser. No. 14/663,854, filed on Mar. 20, 2015, which is a continuation of U.S. patent application Ser. No. 13/434,485, filed on Mar. 29, 2012, now U.S. Pat. No. 9,005,112, which is a continuation of U.S. patent application Ser. No. 11/319,011, filed on Dec. 27, 2005, now abandoned, which is a continuation-in-part of U.S. patent application Ser. No. 11/071,480, filed on Mar. 3, 2005, now abandoned, which is a continuation-in-part of U.S. patent application Ser. No. 10/726,795, filed on Dec. 2, 2003, now U.S. Pat. No. 7,320,700, which claims priority from U.S. Provisional Patent Application No. 60/431,636, filed on Dec. 6, 2002. U.S. patent application Ser. No. 11/319,011 is also a continuation-in-part of U.S. patent application Ser. No. 10/980,119, filed on Nov. 1, 2004, now U.S. Pat. No. 7,736,356, which is a divisional of U.S. patent application Ser. No. 10/187,248, filed on Jun. 28, 2002, now U.S. Pat. No. 6,817,974, which claims priority from U.S. Provisional Application No. 60/301,967, filed on Jun. 29, 2001 and U.S. Provisional Application No. 60/327,702, filed on Oct. 5, 2001. This application is related to the following patents and patent applications, the full disclosures of which are incorporated herein by reference:
U.S. Pat. No. 6,699,235, entitled “Platform Link Wrist Mechanism”, issued on Mar. 2, 2004;
U.S. Pat. No. 6,786,896, entitled “Robotic Apparatus”, issued on Sep. 7, 2004;
U.S. Pat. No. 6,331,181, entitled “Surgical Robotic Tools, Data Architecture, and Use”, issued on Dec. 18, 2001;
U.S. Pat. No. 6,799,065, entitled “Image Shifting Apparatus and Method for a Telerobotic System”, issued on Sep. 28, 2004;
U.S. Pat. No. 6,720,988, entitled “Stereo Imaging System and Method for Use in Telerobotic System”, issued on Apr. 13, 2004;
U.S. Pat. No. 6,714,839, entitled “Master Having Redundant Degrees of Freedom”, issued on Mar. 30, 2004;
U.S. Pat. No. 6,659,939, entitled “Cooperative Minimally Invasive Telesurgery System”, issued on Dec. 9, 2003;
U.S. Pat. No. 6,424,885, entitled “Camera Referenced Control in a Minimally Invasive Surgical Apparatus”, issued on Jul. 23, 2002;
U.S. Pat. No. 6,394,998, entitled “Surgical Tools for Use in Minimally Invasive Telesurgical Applications”, issued on May 28, 2002; and
U.S. Pat. No. 5,808,665, entitled “Endoscopic Surgical Instrument and Method for Use”, issued on Sep. 15, 1998; and
U.S. Pat. No. 6,522,906, entitled “Devices and Methods for Presenting and Regulating Auxiliary Information on An Image Display of a Telesurgical System to Assist an Operator in Performing a Surgical Procedure”, issued on Feb. 18, 2003.
U.S. Pat. No. 6,364,888 entitled “Alignment of Master and Slave in a Minimally Invasive Surgical Apparatus”, issued on Apr. 2, 2002.
BACKGROUND OF THE INVENTIONThe present invention relates generally to endoscopes and, more particularly, to steerable/articulate and swappable endoscopes for performing robotic surgery.
Advances in minimally invasive surgical technology could dramatically increase the number of surgeries performed in a minimally invasive manner Minimally invasive medical techniques are aimed at reducing the amount of extraneous tissue that is damaged during diagnostic or surgical procedures, thereby reducing patient recovery time, discomfort, and deleterious side effects. The average length of a hospital stay for a standard surgery may also be shortened significantly using minimally invasive surgical techniques. Thus, an increased adoption of minimally invasive techniques could save millions of hospital days, and millions of dollars annually in hospital residency costs alone. Patient recovery times, patient discomfort, surgical side effects, and time away from work may also be reduced with minimally invasive surgery.
The most common form of minimally invasive surgery may be endoscopy. Probably the most common form of endoscopy is laparoscopy, which is minimally invasive inspection and surgery inside the abdominal cavity. In standard laparoscopic surgery, a patient's abdomen is insufflated with gas, and cannula sleeves are passed through small (approximately ½ inch) incisions to provide entry ports for laparoscopic surgical instruments. The laparoscopic surgical instruments generally include a laparoscope (for viewing the surgical field) and working tools. The working tools are similar to those used in conventional (open) surgery, except that the working end or end effector of each tool is separated from its handle by an extension tube. As used herein, the term “end effector” means the actual working part of the surgical instrument and can include clamps, graspers, scissors, staplers, and needle holders, for example. To perform surgical procedures, the surgeon passes these working tools or instruments through the cannula sleeves to an internal surgical site and manipulates them from outside the abdomen. The surgeon monitors the procedure by means of a monitor that displays an image of the surgical site taken from the laparoscope. Similar endoscopic techniques are employed in, e.g., arthroscopy, retroperitoneoscopy, pelviscopy, nephroscopy, cystoscopy, cistemoscopy, sinoscopy, hysteroscopy, urethroscopy and the like.
There are many disadvantages relating to current minimally invasive surgical (MIS) technology. For example, existing MIS instruments deny the surgeon the flexibility of tool placement found in open surgery. Most current laparoscopic tools have rigid shafts, so that it can be difficult to approach the worksite through the small incision. Additionally, the length and construction of many endoscopic instruments reduces the surgeon's ability to feel forces exerted by tissues and organs on the end effector of the associated tool. The lack of dexterity and sensitivity of endoscopic tools is a major impediment to the expansion of minimally invasive surgery.
Minimally invasive telesurgical robotic systems are being developed to increase a surgeon's dexterity when working within an internal surgical site, as well as to allow a surgeon to operate on a patient from a remote location. In a telesurgery system, the surgeon is often provided with an image of the surgical site at a computer workstation. While viewing a three-dimensional image of the surgical site on a suitable viewer or display, the surgeon performs the surgical procedures on the patient by manipulating master input or control devices of the workstation. The master controls the motion of a servomechanically operated surgical instrument. During the surgical procedure, the telesurgical system can provide mechanical actuation and control of a variety of surgical instruments or tools having end effectors such as, e.g., tissue graspers, needle drivers, or the like, that perform various functions for the surgeon, e.g., holding or driving a needle, grasping a blood vessel, or dissecting tissue, or the like, in response to manipulation of the master control devices.
While minimally invasive surgical robotic systems such as the da Vinci® from Intuitive Surgical Inc. of Sunnyvale, Calif. can provide surgeons with much more articulation and much improved quality 2D and 3D video images during surgeries than conventional laparoscopy, currently such surgical robotic systems may be more limited in terms of flexibility in certain functions. In particular, due to their size and weight, a surgical robot architecture with a “dedicated” robot arm is required to hold the endoscope and its camera heard such as that described in U.S. Pat. No. 6,451,027. As a result, surgeons cannot exchange the endoscope between ports as typically occurred in conventional laparoscopy. Moreover, the size and weight of the endoscope causes difficulty in dismounting and manually maneuvering the endoscope especially to see difficult-to-reach or hidden areas. This loss of flexibility means that while minimally invasive surgical robotic systems excel in difficult reconstructive surgeries in confined areas such as the heart and pelvis, they become less applicable for procedures involving access to large anatomical areas (e.g., multiple quadrants of the abdomen) and/or access from different directions.
Furthermore, current robotic endoscopes are rigid, pointing either straight ahead (i.e., zero (0) degree angle) or at a thirty (30) degree angle from the long axis of the endoscope which allows the surgeon to more easily look down or up. Consequently, during many surgical procedures, the surgeon may require to switch back and forth numerous times between a straight ahead scope and a thirty-degree scope to obtain different perspectives inside the surgical site. Such scope switching increases the surgical procedure's duration, operational and logistic complexity, and even safety concerns. However, even with scope switching, the surgeon is still limited to only a few visual perspectives and therefore a smaller area of visibility. Additionally, the surgeon may yet be prevented from getting a desired view of the body tissues that are hidden around obstacles (e.g., during gynecological procedures) or between tissue that requires some tunneling (e.g., during atrial fibrillation or endoluminal diagnosis and treatment).
Thus, a need exists for a surgical robotic endoscope system and method that allows for simplification of future surgical robot architectures, provides more flexible port placement, provides a greater area of visibility, provide multiple visual perspectives without added operational and logistic complexity or safety concerns, and provides the most desirable view of hidden body tissues.
BRIEF SUMMARY OF THE INVENTIONAccordingly, the present invention provides an articulate and swappable surgical robotic endoscope system and method that allows for simplification of future surgical robot architectures, provides more flexible port placement, provides a greater area of visibility, provide multiple visual perspectives without added operational and logistic complexity or safety concerns, and provides the most desirable view of hidden body tissues.
The present invention meets the above need with a minimally invasive articulate surgical endoscope comprising an elongate shaft, a flexible wrist, an endoscopic camera lens, and a plurality of actuation links. The elongate shaft has a working end, a proximal end, and a shaft axis between the working end and the proximal end. The flexible wrist has a distal end and a proximal end. The proximal end of the wrist is connected to the working end of the elongate shaft. The endoscopic camera lens is installed at the distal end of the wrist. The plurality of actuation links are connected between the wrist and the proximal end of the elongate shaft such that the links are actuatable to provide the wrist with at least one degree of freedom (e.g., both wrist pitching and yawing motions) wherein a reference frame used for controlling the at least one degree of freedom motion is attached to the flexible wrist for wrist motion associated with the at least one degree of freedom to provide more intuitiveness to the user during the at least one degree of freedom motion. Conversely, the reference frame used for controlling other degrees of freedom (e.g., Cartesian space insertion/extraction motion and shaft rotation) associated with the endoscope is attached to the object. The minimally invasive articulate surgical endoscope is releasably coupled to any of the plurality of arms and is designed to be swapped between the plurality of arms such that one standard arm design is used for the surgical robotic system.
When the articulate surgical endoscope is used to acquire an image (e.g., an orbital image) of an anatomy in association with the at least one degree of freedom, the reference frame for such image is one that rotates around a point of rotation located proximal to the flexible wrist to minimize undesirable motion at the proximal end of the endoscope. Such undesirable motion is further attenuated when the reference frame used for controlling the at least one degree of freedom is attached to the flexible wrist.
All the features and advantages of the present invention will become apparent from the following detailed description of its preferred embodiments whose description should be taken in conjunction with the accompanying drawings.
As used herein, “end effector” refers to an actual working distal part that is manipulable by means of the wrist member for a medical function, e.g., for effecting a predetermined treatment of a target tissue. For instance, some end effectors have a single working member such as a scalpel, a blade, or an electrode. Other end effectors have a pair or plurality of working members such as forceps, graspers, scissors, or clip appliers, for example. In certain embodiments, the disks or vertebrae are configured to have openings which collectively define a longitudinal lumen or space along the wrist, providing a conduit for any one of a number of alternative elements or instrumentalities associated with the operation of an end effector. Examples include conductors for electrically activated end effectors (e.g., electrosurgical electrodes; transducers, sensors, and the like); conduits for fluids, gases or solids (e.g., for suction, insufflation, irrigation, treatment fluids, accessory introduction, biopsy extraction and the like); mechanical elements for actuating moving end effector members (e.g., cables, flexible elements or articulated elements for operating grips, forceps, scissors); wave guides; sonic conduction elements; fiberoptic elements; and the like. Such a longitudinal conduit may be provided with a liner, insulator or guide element such as a elastic polymer tube; spiral wire wound tube or the like.
As used herein, the terms “surgical instrument”, “instrument”, “surgical tool”, or “tool” refer to a member having a working end which carries one or more end effectors to be introduced into a surgical site in a cavity of a patient, and is actuatable from outside the cavity to manipulate the end effector(s) for effecting a desired treatment or medical function of a target tissue in the surgical site. The instrument or tool typically includes a shaft carrying the end effector(s) at a distal end, and is preferably servomechanically actuated by a telesurgical system for performing functions such as holding or driving a needle, grasping a blood vessel, and dissecting tissue.
The various embodiments of the flexible wrist described herein are intended to be relatively inexpensive to manufacture and be capable of use for cautery, although they are not limited to use for cautery. For MIS applications, the diameter of the insertable portion of the tool is small, typically about 12 mm or less, and preferably about 5 mm or less, so as to permit small incisions. It should be understood that while the examples described in detail illustrate this size range, the embodiments may be scaled to include larger or smaller instruments.
Some of the wrist embodiments employ a series of disks or similar elements that move in a snake-like manner when bent in pitch and yaw (e.g.,
In some embodiments, each disk has twelve evenly spaced holes for receiving actuation cables. Three cables are sufficient to bend the wrist in any desired direction, the tensions on the individual cables being coordinated to produce the desired bending motion. Due to the small wrist diameter and the moments exerted on the wrist by surgical forces, the stress in the three cables will be quite large. More than three cables are typically used to reduce the stress in each cable (including additional cables which are redundant for purposes of control). In some examples illustrated below, twelve or more cables are used (see discussion of
Some wrists are formed from a tubular member that is sufficiently flexible to bend in pitch and yaw (e.g.,
In specific embodiments, the tubular member includes a plurality of axial sliding members each having a lumen for receiving an actuation cable (e.g.,
A. Wrist Having Wires Supported by Wire Wrap
B. Wrist Having Flexible Tube Bent by Actuation Cables
The tube 42 typically may be made of a plastic material or an elastomer with a sufficiently low modulus of elasticity to permit adequate bending in pitch and yaw, and may be manufactured by a multi-lumen extrusion to include the plurality of lumens, e.g., twelve lumens. It is desirable for the tube to have a high bending stiffness to limit undesirable deflections such as S-shape bending, but this increases the cable forces needed for desirable bending in pitch and yaw. As discussed below, one can use a larger number of cables than necessary to manipulate the wrist in pitch and yaw (i.e., more than three cables) in order to provide sufficiently high cable forces to overcome the high bending stiffness of the tube.
In Example 1, the number of cables 44 in the wrist 40.1 is equal to four (n1=4) with each cable individually terminated by a distal anchor 44.5, set in a countersunk bore in the distal termination plate 41, each cable extending through a respective lateral cable lumen 43 in the distal termination plate 41 and the flexible tube 42. The anchor 44.5 may be a swaged bead or other conventional cable anchor.
In Example 2, the number of cables 44′ in the wrist 40.2 is equal to sixteen (n2=16), with the cables arranged as eight symmetrically spaced pairs of portions 44′, each pair terminated by a distal “U-turn” end loop 45 bearing on the distal termination plate 41′ between adjacent cable lumens 43′. The edges of the distal termination plate 41′ at the opening of lumens 43′ may be rounded to reduce stress concentration, and the loop 45 may be partially or entirely countersunk into the distal termination plate 41. The diameters of the sixteen cables 44′ are ½ the diameters of the four cables 44, so that the total cross-sectional cable area is the same in each example.
Comparing Examples 1 and 2, the employment of termination loop 45 eliminates the distal volume devoted to a cable anchor 44.5, and tends to permit the cable lumen 43′ to be closer to the radius R of the tube 42 than the cable lumen 43. In addition, the smaller diameter of each cable 44′ brings the cable centerline closer to the outer edge of the cable lumen 43′. Both of these properties permit the cables in Example 2 to act about a larger moment arm L2 relative to the center of tube 42 than the corresponding moment arm L1 of Example 1. This greater moment arm L2 permits lower cable stresses for the same overall bending moment on the tube 42 (permitting longer cable life or a broader range of optional cable materials), or alternatively, a larger bending moment for the same cable stresses (permitting greater wrist positioning stiffness). In addition, smaller diameter cables may be more flexible than comparatively thicker cables. Thus a preferred embodiment of the wrist 40 includes more that three cables, preferably at least 6 (e.g., three pairs of looped cables) and more preferably twelve or more.
Note that the anchor or termination point shown at the distal termination plate 41 is exemplary, and the cables may be terminated (by anchor or loop) to bear directly on the material of the tube 42 if the selected material properties are suitable for the applied stresses. Alternatively, the cables may extend distally beyond the tube 42 and/or the distal termination plate 41 to terminate by connection to a more distal end effector member (not shown), the cable tension being sufficiently biased to maintain the end effector member securely connected to the wrist 40 within the operational range of wrist motion.
One way to reduce the stiffness of the tube structurally is to provide cutouts, as shown in
In another embodiment illustrated in
C. Wrist Having Axial Tongue and Groove Sliding Members
D. Wrist Having Overlapping Axial Spring Members
In one alternative, the springs are biased to a fully compressed solid height state by cable pre-tension when the wrist is neutral or in an unbent state. A controlled, coordinated decrease in cable tension or cable release on one side of the wrist permits one side to expand so that the springs on one side of the wrist 100 expand to form the outside radius of the bent wrist 100. The wrist is returned to the straight configuration upon reapplication of the outside cable pulling force.
In another alternative, the springs are biased to a partially compressed state by cable pre-tension when the wrist is neutral or in an unbent state. A controlled, coordinated increase in cable tension or cable pulling on one side of the wrist permits that side to contract so that the springs on one side of wrist 100 shorten to form the inside radius of the bent wrist 100. Optionally this can be combined with a release of tension on the outside radius, as in the first alternative above. The wrist is returned to the straight configuration upon restoration of the original cable pulling force.
E. Wrist Having Wave Spring Members
The wave spring segments 122 as illustrated each have two opposite high points and two opposite low points which are spaced by 90 degrees. This configuration facilitates bending in pitch and yaw. Of course, the wave spring segments 122 may have other configurations such as a more dense wave pattern with additional high points and low points around the circumference of the wrist 120.
F. Wrist Having Disks with Spherical Mating Surfaces
In alternate embodiments, each cable in the wrist 160 may be housed in a spring wind 162 as illustrated in
G. Wrist Having Disks Separated by Elastomer Members
H. Wrist Having Alternating Ribs Supporting Disks for Pitch and Yaw Bending
In
I. Wrist Employing Thin Disks Distributed Along Coil Spring
J. Wrist Having Outer Braided Wires
The flexible wrist depends upon the stiffness of the various materials relative to the applied loads for accuracy. That is, the stiffer the materials used and/or the shorter the length of the wrist and/or the larger diameter the wrist has, the less sideways deflection there will be for the wrist under a given surgical force exerted. If the pulling cables have negligible compliance, the angle of the end of the wrist can be determined accurately, but there can be a wandering or sideways deflection under a force that is not counteracted by the cables. If the wrist is straight and such a force is exerted, for example, the wrist may take on an S-shape deflection. One way to counteract this is with suitable materials of sufficient stiffness and appropriate geometry for the wrist. Another way is to have half of the pulling cables terminate halfway along the length of the wrist and be pulled half as far as the remaining cables, as described in U.S. patent application Ser. No. 10/187,248. Greater resistance to the S-shape deflection comes at the expense of the ability to withstand moments. Yet another way to avoid the S-shape deflection is to provide a braided cover on the outside of the wrist.
K. Wrist Cover
The above discloses some armors or covers for the wrists.
Thus,
L. Articulate/Steerable and Endoscope
Reference is now made to
Endoscope 310 has a cap 312 to cover and protect endoscope lens 314 at the tip of the distal end of flexible wrist 10′. Cap 312, which may be hemispherical, conical, etc., allows the instrument to deflect away tissue during maneuvering inside/near the surgery site. Cap 312, which may be made out of glass, clear plastic, etc., is transparent to allow endoscope 310 to clearly view and capture images. Under certain conditions that allow for clear viewing and image capturing, cap 312 may be translucent as well. In an alternate embodiment, cap 312 is inflatable (e.g., to three times its normal size) for improved/increased viewing capability of endoscope 310. An inflatable cap 312 may be made from flexible clear polyethylene from which angioplasty balloons are made out or a similar material. In so doing, the size of cap 312 and consequently the minimally invasive surgical port size into which endoscope 310 in inserted can be minimized. After inserting endoscope 310 into the surgical site, cap 312 can then be inflated to provide increased/improved viewing. Accordingly, cap 312 may be coupled to a fluid source (e.g., saline, air, or other gas sources) to provide the appropriate pressure for inflating cap 312 on demand
Flexible wrist 10′ has at least one degree of freedom to allow endoscope 310 to articulate and maneuver easily around internal body tissues, organs, etc. to reach a desired destination (e.g., epicardial or myocardial tissue). Flexible wrist 10′ may be any of the embodiments described relative to
M. Articulating Endoscope with Releasably Attached Ablation Catheter/Device
As an extension of the above articulate endoscope, a catheter may be releasably coupled to the articulate endoscope to further assist in the placement of the ablation catheter on a desired cardiac tissue.
In an alternate embodiment, instead of a device/catheter itself, catheter guide 331 may be releasably attached to endoscope 310. As illustrated in
N. Articulating Instrument With Lumen To Guide Endoscope
In yet another embodiment, instead of having an articulate endoscope, an end effector is attached to the flexible wrist to provide the instrument with the desired articulation. This articulate instrument was described for example in relation to
Reference is now made to
The articulate instruments/endoscopes described above may be covered by an optional sterile sheath much like a condom to keep the articulate instrument/endoscope clean and sterile thereby obviating the need to make these instruments/endoscopes sterilizable following use in a surgical procedures. Such a sterile sheath needs to be translucent to allow the endoscope to clearly view and capture images. Accordingly, the sterile sheath may be made out of a latex-like material (e.g., Kraton®, polyurethane, etc.). In one embodiment, the sterile sheath and cap 312 may be made from the same material and joined together as one piece. Cap 312 can then be fastened to shaft 14′ by mechanical or other type of fasteners.
Hence,
O. Articulate/Steerable and Swappable Endoscope
Reference is now made to
To achieve this objective, the endoscope needs to be made smaller and lighter. In accordance to the present invention, an endoscopic camera lens is implemented at the distal end of flexible wrist 10″. A lumen (not shown) runs along the length of shaft 14″ which connects the distal end of flexible wrist 10″ with housing 53″. In the preferred “chip-on-a-stick” embodiment, the imaging sensor(s) of endoscope 310″ may be mounted at the distal end of flexible wrist 10′ with either hardwire or wireless electrical connections to a camera control unit coupled to connector 314″ at the end of housing 53″. The imaging sensor(s) may be two-dimensional (2D) or three-dimensional (3D). Some sophisticated signal processing technology can be used to derive a 3D image from a 2D imaging sensor(s). Some exemplary commercially available chip-on-a-stick endoscope solutions include Olympus America, Inc. of Melville, N.Y., Visionsense of Petach Tiqua, Israel, and others. Such a chip-on-a-stick embodiment may reduce the size of the endoscope to a fraction of its former size and reduce its weight by an order of magnitude. Accordingly, the size and weight of the endoscope no longer presents difficulty in mounting/dismounting as well as maneuvering the endoscope. In an alternate “fiber scope” embodiment, imaging sensor(s) of endoscope 310″, such as Charge Coupled Devices (CCDs), may be mounted inside housing 53″ with connected optical fibers running inside the lumen along the length of shaft 14″ and ending at substantially the distal end of flexible wrist 10″.
Endoscope 310″ may have a cap 312″ to cover and protect endoscope lens 314″ at the tip of the distal end of flexible wrist 10″. Cap 312″, which may be hemispherical, conical, etc., allows the instrument to deflect away tissue during maneuvering inside/near the surgery site. Cap 312″, which may be made out of glass, clear plastic, etc., is transparent to allow endoscope 310″ to clearly view and capture images. Under certain conditions that allow for clear viewing and image capturing, cap 312″ may be translucent as well. In an alternate embodiment, cap 312″ is inflatable (e.g., to three times its normal size) for improved/increased viewing capability of endoscope 310″. An inflatable cap 312″ may be made from flexible clear polyethylene from which angioplasty balloons are made out or a similar material. In so doing, the size of cap 312″ and consequently the minimally invasive surgical port size into which endoscope 310″ is inserted can be minimized After inserting endoscope 310″ into the surgical site, cap 312″ can then be inflated to provide increased/improved viewing. Accordingly, cap 312″ may be coupled to a fluid source (e.g., saline, air, or other gas sources) to provide the appropriate pressure for inflating cap 312″ on demand.
Flexible wrist 10″ provides additional degrees of freedom to allow endoscope 310 to articulate and maneuver easily around internal body tissues, organs, etc. to reach a desired destination (e.g., epicardial or myocardial tissue). Flexible wrist 10″ may be any of the embodiments described relative to
P. Camera-Reference Control Paradigm of Slave Instruments
It is desirable to provide surgeons with intuitive methods to control complex surgical robots. As a surgeon becomes engrossed in a delicate and complex surgical procedure, he needs not be aware of how a surgical robot performs its duties and perhaps sometimes forgets that he is using a robot to perform the surgical procedure due to the intuitiveness of the way the robot manipulates and performs its tasks as directed by the surgeon. As a simplistic exemplary illustration of intuitive versus counter-intuitive, consider
The first of such paradigm is discussed next. When the endoscope in accordance to the present invention undergoes a pitching or yawing motion, if the image is viewed from the camera-reference frame, the view may be counterintuitive to a surgeon. This is because if the endoscope is pitched up, the view from the camera-reference frame appears to be a look-down rather than a look-up view that the surgeon intuitively expects. If the endoscope is pitched down, the view from the camera-reference frame appears to be a look-up rather than a look-down that the surgeons intuitively expects. Similarly, if the endoscope is yawed left, the view from the camera appears to be a look-right rather than a look-left that the surgeons intuitively expects. If the endoscope is yawed right, the view from the camera appears to be a look-left rather than a look-right that the surgeon intuitively expects. Such counter-intuitiveness is unexpected and requires a change of reference frame for the slave surgical instruments from a camera-reference frame to that of a world/image-reference for the endoscope's pitching and yawing motion to retain the intuitiveness desired in the present invention. The reference frame for the slave surgical instruments remains the camera-reference frame for all other endoscope's degrees of freedom (e.g., x, y, and z Cartesian insertion/extraction motion and instrument shaft roll motion) in the present invention. In other words, the reference frame for the additional degrees of freedom is decoupled from that for the traditional degrees of freedom associated with a surgical robotic endoscope. Nevertheless, it is to be appreciated that in accordance to the present invention, for some applications it may be advantageous to afford a choice between a camera-reference frame and an world-reference frame for controlling each and any of the six degrees of freedom of the articulating/steerable and swappable endoscope. In other words, any or all of the six degrees of freedom of the articulating/steerable and swappable endoscope can be controlled in either the camera reference frame or the world reference frame.
In a master-slave surgical robotic system such as the da Vinci® system, if any (or all) of the six degrees of freedom is controlled in the camera-reference frame, then the reference frame is changing along with the camera movement in terms of position and/or orientation. In other words, the master (i.e.,surgeon's eye) relationship relative to the slave (e.g., endoscope camera) is changing due to the camera's movement which may adversely effect the intuitiveness of the surgeon's perception relative to his input unless such change is compensated. This compensation is performed by repositioning the master input device through control transformations. More specifically, the master/eye transform is adjusted to match the changing slave/camera transform. Preferably, such master alignment compensation is carried out continuously and incrementally (via incremental transforms) during camera control (i.e., in or near real-time) rather than making larger compensation following camera control (i.e., sequential) because the associated lag time is minimized. It is appreciated that such master alignment compensation is not required in non-flexible and non-steerable endoscopic systems or in the case in which all six degrees of freedom are controlled in the world-reference frame because the reference frame is constant in these cases.
A master input device such as that described in U.S. Pat. No. 6,714,839, which is herein incorporated by reference in its entirety, can be maneuvered with at least six (6) degrees of freedom. If a separate master input device is used for a user's left and right hand as shown in
It should be clear to person of ordinary skill in the art that any mathematical changes (e.g., reference frame position/orientation transformation) as well as control system changes (e.g., control algorithm) associated with such a frame of reference change can be derived and implemented in view of the relevant detailed descriptions of the '888 patent and '885 patent. Accordingly, for the sake of brevity and clarity no additional discussion on this is provided herein.
Q. Point of Rotation for Pitch and Yaw Motion
A second control paradigm involves the selection of a point of rotation for the articulating/steerable and swappable endoscope. The point of rotation is a point about which the reference frame of an endoscopic image view rotates. This point of rotation is selected to provide a sense of intuitiveness as well as the most optimal view of the surgical site for surgeons. For the articulating and swappable endoscope in accordance to the present invention, the additional pitch and yaw motions (whether individually or both simultaneously) of the camera lens in combination with a properly selected point of rotation can be used to maneuver the endoscope (possibly in combination with other degrees of freedom) to provide an orbital view of an anatomy (similar to the view observed by a satellite orbiting a planet) inside a surgical site relative to the camera-reference frame. It is noted that such a selection of a point of rotation is not required for traditional robotic surgical endoscopes (e.g., an endoscope without the pitch and yaw motions) and is therefore not anticipated. The point of rotation candidates include: an assumed center of the surgical site which may be a point within the maximum working range of an endoscope (e.g., approximately thirty-eight (38) mm from the distal tip of an Olympus endoscope), a point in the proximate area of flexible wrist 10″, the endoscope surgical site entry point, etc.
Reference is now made to
The assumed center point of rotation may be the most logical because most activities in a surgical site will likely occur in the proximate area surrounding the tip of the endoscope and given the six degrees of freedom of the articulating/steerable endoscope of the present invention together with zooming capability, minor adjustments can be made quickly to obtain the desired optimal view. However, there is a drawback in such selection involving the over-active motion associated with the proximal end (back end) of endoscope 310″ and more significantly the robot arm that the endoscope is releasably coupled to when a pitching and/or yawing motion of the camera lens is made. The over-active motion of the robot arm carrying endoscope 310″ may be undesirable as it may get in the way of other robot arms of the system all of which may be moving concurrently during a procedure resulting in an arm collision.
Moving the point of rotation to the endoscope surgical site entry point appears to attenuate robot arm motion because the distance between the point of rotation and the robot arm is greatly reduced (by reducing the amount of coupled rotation and translation motion) but also appears to produce less optimal viewing images of the surgical site due to physical and geometric constraints. In comparison, with the point of rotation being around the center of flexible wrist 10″, the distance between the point of rotation and the robot arm is reduced thereby the arm motion is also attenuated but with improved viewing images due to fewer physical and geometric constraints. Hence, a point about the center of flexible wrist 10″ is the preferred point of rotation for the articulating swappable endoscope of the present invention. An exemplary implementation of a point of rotation is provided in the '885 patent which describes the mapping of master control point to slave control point.
The above-described arrangements of apparatus and methods are merely illustrative of applications of the principles of this invention and many other embodiments and modifications may be made without departing from the spirit and scope of the invention as defined in the claims. The scope of the invention should, therefore, be determined not with reference to the above description, but instead should be determined with reference to the appended claims along with their full scope of equivalents.
Claims
1-16. (canceled)
17. A system comprising:
- an input device movable in at least one degree of freedom by an operator;
- at least one slave movable in at least one degree of freedom in response to movement of the input device, the at least one slave comprising an articulate endoscope having a flexible wrist movable in pitch and yaw, said endoscope further comprising a camera configured to acquire an image, the camera coupled to the distal end of the flexible wrist;
- a display configured to show the acquired image; and
- a processor coupling the input device to the at least one slave, the processor programmed to maneuver the articulate endoscope to provide an orbital view of a fixed site.
18. The system of claim 17, wherein the orbital view is based on a point of rotation located proximal to the flexible wrist.
19. The system of claim 17, wherein the orbital view is based on a point of rotation located within a maximal working range of the endoscope.
20. The system of claim 17, wherein the orbital view is based on a point of rotation located at a surgical entry site of the endoscope.
21. The system of claim 17, further comprising a plurality of slave arm assemblies, wherein a standard design is used for each of the plurality of slave arm assemblies such that the endoscope may be releasably swapped among the plurality of slave arm assemblies.
22. The system of claim 17, wherein the input device is further used to control at least one function of the camera.
23. The system of claim 22, the at least one function comprising focus of the camera.
24. The system of claim 22, the at least one function comprising aperture of a lens of the camera.
25. The system of claim 17, wherein a master alignment compensation is carried out continuously and incrementally during a movement of the camera to maintain master-slave intuitiveness between the input device and the camera.
26. The system of claim 17, wherein at least one degree of freedom of the slave is position or velocity controlled.
27. The system of claim 17, wherein a world-reference frame is selected if the flexible wrist is moved by the input device in a first degree of freedom, and wherein a camera-reference frame is selected if the flexible wrist is moved by the input device in a second degree of freedom.
28. The system of claim 27, the at least one slave further comprising a manipulator arm coupled to an end effector, the world-reference frame and camera-reference frame each defining a relationship between movement of the input device and movement of the end effector, wherein the relationships defined by the world-reference and camera-reference frames are distinct from each other.
29. The system of claim 28, wherein a world-reference frame is selected if the flexible wrist is moved in pitch or yaw, and wherein a camera-reference frame is selected if the flexible wrist is moved in a degree of freedom other than pitch or yaw.
30. The system of claim 17, the at least one degree of freedom of the input device comprising a left and right movement of the input device, the at least one degree of freedom of the at least one slave comprising a left and right movement and an up and down movement.
31. The system of claim 17, wherein the world-reference frame is defined as being level with a gaze of the operator, and the camera-reference frame is defined as being attached to the camera.
Type: Application
Filed: Dec 10, 2019
Publication Date: Apr 9, 2020
Inventors: Christopher J. Hasser (Los Altos, CA), Nitish Swarup (Sunnyvale, CA), Thomas G. Cooper (Menlo Park, CA), S. Christopher Anderson (San Francisco, CA)
Application Number: 16/708,746