Abstract: In one embodiment of the invention, a method for a minimally invasive surgical system is disclosed. The method includes capturing and displaying camera images of a surgical site on at least one display device at a surgeon console; switching out of a following mode and into a masters-as-mice (MaM) mode; overlaying a graphical user interface (GUI) including an interactive graphical object onto the camera images; and rendering a pointer within the camera images for user interactive control. In the following mode, the input devices of the surgeon console may couple motion into surgical instruments. In the MaM mode, the input devices interact with the GUI and interactive graphical objects. The pointer is manipulated in three dimensions by input devices having at least three degrees of freedom. Interactive graphical objects are related to physical objects in the surgical site or a function thereof and are manipulatable by the input devices.

Abstract: A combined teleoperative-cooperative controllable robotic system includes a robotic actuator assembly, a control system adapted to communicate with the robotic actuator assembly, and a teleoperation unit adapted to communicate with the control system. The control system is configured to control at least a first portion of the robotic actuator assembly in response to at least one of a force or a torque applied to at least a second portion of the robotic actuator assembly by a first user for cooperative control. The control system is further configured to control at least a third portion of the robotic actuator assembly in response to input by a second user from the teleoperation unit for teleoperative control.

Abstract: A device includes first and second sheets of first and second elastic materials, respectively, and a control wire. The first sheet has a first thickness and a first length and is shaped to have a first cross-section having a first inner periphery and a first outer periphery. The second sheet has a second thickness and a second length and is shaped to have a second cross-section having a second inner periphery and a second outer periphery. One of the first sheet and the second sheet has a spacing disposed in along one of the first length and the second length, respectively. The first outer periphery is less than or equal to the second inner periphery. The second sheet surrounds the first sheet. The control wire has an end constrained to one of the first sheet the first material and the second sheet. The control wire is disposed within the spacing.

Abstract: A system and method for tool exchange during surgery for cooperatively controlled robots comprises a tool holder for receiving a surgical tool adapted to be held by a robot and a surgeon, a tool holding element for constraining downward motion of the tool while allowing low force removal of the surgical tool from the holder, a first sensor for detecting if the surgical tool is docked within the tool holder, and a selector for automatically selecting different movements or actions of the tool holder to be performed based upon information detected by the first sensor. The system and method of the present invention provides an advantage to an often slow moving cooperative robot, by increasing the speed by which the tool holder may move in the direction away from the patient.

Abstract: A force-sensing tool includes a tool shaft that has a proximal end and a distal end, a flexure section attached at a first end to the distal end of the tool shaft, a tool tip operatively connected to the flexure section such that axial forces applied to the tool tip are coupled primarily to a first portion of the flexure section and transverse forces applied to the tool tip are coupled primarily to a second portion of the flexure section, an axial force sensor coupled to the first portion of the flexure section, and a transverse force sensor coupled to the second portion of the flexure section. The axial force sensor responds to axial forces applied to the tool tip substantially independently of the transverse forces applied to the tool tip under a designed operating range of forces, and the transverse force sensor responds to transverse forces applied to the tool tip substantially independently of the axial forces applied to the tool tip under the designed operating range of forces.

Abstract: A method and system for micro-force guided cooperative control that assists the operator in manipulating tissue in the direction of least resistance. A tool holder receives a surgical tool adapted to be held by a robot and a surgeon. A first sensor measures interaction forces between a tip of the surgical tool and tissue of a region of interest. A second sensor measures interaction forces between the surgeon and a handle to the surgical tool. A data processor is configured to perform an algorithm to actively guide the surgical tool by creating a bias towards a path of least resistance and limit directional tool forces of the surgical tool as a function of handle input forces and tip forces. This function offers assistance to challenging retinal membrane peeling procedures that require a surgeon to delicately delaminate fragile tissue that is susceptible to hemorrhage and tearing due to undesirable forces.

Abstract: A LUS robotic surgical system is trainable by a surgeon to automatically move a LUS probe in a desired fashion upon command so that the surgeon does not have to do so manually during a minimally invasive surgical procedure. A sequence of 2D ultrasound image slices captured by the LUS probe according to stored instructions are processable into a 3D ultrasound computer model of an anatomic structure, which may be displayed as a 3D or 2D overlay to a camera view or in a PIP as selected by the surgeon or programmed to assist the surgeon in inspecting an anatomic structure for abnormalities. Virtual fixtures are definable so as to assist the surgeon in accurately guiding a tool to a target on the displayed ultrasound image.

Abstract: A LUS robotic surgical system is trainable by a surgeon to automatically move a LUS probe in a desired fashion upon command so that the surgeon does not have to do so manually during a minimally invasive surgical procedure. A sequence of 2D ultrasound image slices captured by the LUS probe according to stored instructions are processable into a 3D ultrasound computer model of an anatomic structure, which may be displayed as a 3D or 2D overlay to a camera view or in a PIP as selected by the surgeon or programmed to assist the surgeon in inspecting an anatomic structure for abnormalities. Virtual fixtures are definable so as to assist the surgeon in accurately guiding a tool to a target on the displayed ultrasound image.

Abstract: A LUS robotic surgical system is trainable by a surgeon to automatically move a LUS probe in a desired fashion upon command so that the surgeon does not have to do so manually during a minimally invasive surgical procedure. A sequence of 2D ultrasound image slices captured by the LUS probe according to stored instructions are processable into a 3D ultrasound computer model of an anatomic structure, which may be displayed as a 3D or 2D overlay to a camera view or in a PIP as selected by the surgeon or programmed to assist the surgeon in inspecting an anatomic structure for abnormalities. Virtual fixtures are definable so as to assist the surgeon in accurately guiding a tool to a target on the displayed ultrasound image.

Abstract: A surgical system provides hands-free control of at least one surgical tool includes a robot having a tool connector, a smart tool attached to the tool connector of the robot, and a feedback control system configured to communicate with the smart tool to provide feedback control of the robot. The smart tool includes a tool that has a tool shaft having a distal end and a proximal end, a strain sensor arranged at a first position along the tool shaft, at least one of a second strain sensor or a torque-force sensor arranged at a second position along the tool shaft, the second position being more towards the proximal end of the tool shaft than the first position, and a signal processor configured to communicate with the strain sensor and the at least one of the second strain sensor or the torque-force sensor to receive detection signals therefrom.

Abstract: A cooperative-control robot includes a base component, a mobile platform arranged proximate the base component, a translation assembly operatively connected to the base component and the mobile platform and configured to move the mobile platform with translational degrees of freedom substantially without rotation with respect to said the component, a tool assembly connected to the mobile platform, and a control system configured to communicate with the translation assembly to control motion of the mobile platform in response to forces by a user applied to at least a portion of the cooperative-control robot. The translation assembly includes at least three independently operable actuator arms, each connected to a separate position of the mobile platform. A robotic system includes two or more the cooperative-control robots.

Abstract: A system and method for tool exchange during surgery for cooperatively controlled robots comprises a tool holder for receiving a surgical tool adapted to be held by a robot and a surgeon, a tool holding element for constraining downward motion of the tool while allowing low force removal of the surgical tool from the holder, a first sensor for detecting if the surgical tool is docked within the tool holder, and a selector for automatically selecting different movements or actions of the tool holder to be performed based upon information detected by the first sensor. The system and method of the present invention provides an advantage to an often slow moving cooperative robot, by increasing the speed by which the tool holder may move in the direction away from the patient.

Abstract: A multi-force sensing instrument includes a tool that has a tool shaft having a distal end and a proximal end, a strain sensor arranged at a first position along the tool shaft, at least one of a second strain sensor or a torque-force sensor arranged at a second position along the tool shaft, the second position being more towards the proximal end of the tool shaft than the first position, and a signal processor configured to communicate with the strain sensor and the at least one of the second strain sensor or the torque-force sensor to receive detection signals therefrom. The signal processor is configured to process the signals to determine a magnitude and position of a lateral component of a force applied to the tool shaft when the position of the applied force is between the first and second positions.

Abstract: A cooperatively controlled robotic system includes a main robot assembly, and an arm assembly comprising a proximal end and a distal end. The arm assembly is connected to the main robot assembly at the proximal end. The system also includes a tool assembly connected to the arm assembly at the distal end, a first force sensor between the distal end of the arm assembly and the tool assembly, and a second force sensor between the proximal end of the arm assembly and the main robot assembly. The system includes a control system that is configured to determine a force applied at the first force sensor based on a force detected by the second force sensor, and to compare the determined force to a force detected by the first force sensor to detect a failure of at least one of the first and second force sensors.

Abstract: An observation system for viewing light-sensitive tissue includes an illumination system configured to illuminate the light-sensitive tissue, an imaging system configured to image at least a portion of the light-sensitive tissue upon being illuminated by the illumination system, and an image display system in communication with the imaging system to display an image of the portion of the light-sensitive tissue.

Abstract: According to some embodiments of the invention, an ultrasound imaging system having real-time tracking and image registration includes a fiducial-marker system comprising an ultrasound transmitter structured to provide a localized ultrasound pulse at an optically observable localized spot on a body of interest.

Abstract: A shape sensor system includes a deflection sensor comprising an optical fiber having at least one fiber Bragg grating (FBG) written therein and a substrate, the fiber being attached to the substrate with a selected bias distance from a neutral plane of the deflection sensor. The system further includes an optical source coupled to the fiber to provide input light to be at least partially reflected by the FBG, and an optical detection and processing system arranged to receive at least a portion of the output light and to determine a wavelength shift resulting from a change of an amount of deflection of the deflection sensor. The optical detection and processing system determines a relative amount of deflection of the deflection sensor at the FBG based on the wavelength shift. The selected bias distance is selected based on an expected range of deflection angles to be detected.

Abstract: According to some embodiments of the present invention, a system for stereo reconstruction from a monoscopic endoscope is provided. The monoscopic endoscope comprising an image pick-up element at a distal end thereof and a working channel defined by a body of the monoscopic endoscope. The working channel provides a port at the distal end of the monoscopic endoscope. The system for stereo reconstruction comprises a light patterning component configured to be disposed within the working channel of the monoscopic endoscope such that a light emitting end of the light patterning component will be fixed with a defined relative distance from the distal end of the image pick-up element. The system for stereo reconstruction also includes a data processor adapted to be in communication with the image pick-up element. The light patterning component forms a pattern of light that is projected onto a region of interest.

Abstract: A sensing system for implant surgery includes an insertion device for moving an implant into a narrow cavity in a patient's body. A sensor measures the distance from an end of the insertion device to anatomic surfaces at a distance from the end of the insertion device. An optical coherence tomography (OCT) system integrates the sensor and produces OCT images, which can be quantified to distance measurements. The system is particularly useful for cochlear implant surgery.

Abstract: An observation system for viewing light-sensitive tissue includes an illumination system configured to illuminate the light-sensitive tissue, an imaging system configured to image at least a portion of the light-sensitive tissue upon being illuminated by the illumination system, and an image display system in communication with the imaging system to display an image of the portion of the light-sensitive tissue. The illumination system is configured to illuminate the light-sensitive tissue with a reduced amount of light within a preselected wavelength range compared to multispectral illumination light, and the image of the portion of the light-sensitive tissue is compensated for the reduced amount of light within the preselected frequency range to approximate an image of the light-sensitive tissue under the multispectral illumination.