Abstract: A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed.

Abstract: Imaging systems comprising x-ray image reconstruction systems combined with optical imaging and/or tracking systems. In some embodiments, the imaging system may comprise an x-ray image reconstruction system configured to generate three-dimensional image data of at least an internal portion of a target object under a surface of the target object and a three-dimensional optical imaging system configured to reconstruct an image of at least a portion of the surface of the target object by generating surface three-dimensional image data. The three-dimensional optical imaging system may be registered to the x-ray tomosynthesis image reconstruction system such that three-dimensional image data from the x-ray tomosynthesis image reconstruction system and three-dimensional image data from the three-dimensional optical imaging system may be used as a constraint to improve image quality of an image of the target object.

Abstract: A system for visualizing and guiding a surgical device having a first imaging device of a first type and has a first image output. The first imaging device is positioned to image an area being subject to surgery. A second imaging device of a second type has a second image output. The second imaging device is positioned to image an area being subject to surgery. A computer is coupled to receive the first and second image outputs and a computer software program, resident in the computer receives and displays information received from the surgical device and/or for guiding the operation of the surgical device and for generating a graphic user interface including selectable menu and submenu items. The surgical device is coupled to the computer.

Abstract: An interface according to an embodiment may be arranged between a driver provided to a robotic arm and a manual surgical instrument. The interface includes: a driven unit to be connected to the driver and be driven by a driving force transmitted from the driver provided to the robotic arm; a manipulation portion to be driven by a driving force transmitted by the driven unit to manipulate an operation-target portion of the manual surgical instrument; and a surgical instrument holder configured to hold the manual surgical instrument in a state where the operation-target portion of the manual surgical instrument is positioned with respect to the manipulation portion.

Abstract: Disposable controls, re-usable devices, and their methods of use. The disposable controls and reusable devices are adapted to in operable communication during a procedure or process, and thereafter the disposable control can be discarded while the reusable device can be reused in a subsequent procedure or process. The disposable controller and reusable portion can be part of an intubation system.

Abstract: A control system for an elongate member actuated via a pull wire comprises a chassis fixable in place relative to the elongate member during use and a pulley carried by the chassis, the pulley having a first pull wire-supporting surface structurally configured to support the pull wire, the pulley being rotatable about a first axis. The system further comprises a wall carried by the chassis and a capstan carried by the chassis and rotatable about a second axis aligned at an orthogonal angle relative to the first axis, the capstan having a second pull wire-supporting surface that permits the pull wire to wrap around the capstan, wherein the wall extends circumferentially around the capstan and includes a slit through which the pull wire extends.

Abstract: The present invention provides a surgical robot system which includes a workstation, a robotic arm, a scanning module, a guiding module and the like. Fast registration may be completed by means of the scanning module. The system improves the speed and accuracy of registration and shortens the period of the operation.

Abstract: A system augments a surgical procedure by providing information to the user about regions of a surgical site the user is viewing on a displayed endoscopic image. The system uses an eye tracker to determine the region of the displayed image being viewed by the user, and applies computer vision to the image data to identify structures, conditions or disease states within the region. The system provides information to the user, generates alerts, or modifies operational settings for surgical devices based on the identified structures, conditions or disease states.

Abstract: A medical system including a medical device having an outer diameter, a display device, and a controller. The controller is configured to acquire data regarding a biological lumen such as an airway structure, acquire an image of the airway structure, generate an overlay representing the outer diameter of the medical device, and display, on the display device, the overlay representing the outer diameter of the medical device on the acquired image of the airway structure. The overlay is scaled relative to a diameter of the airway structure at a focal plane of the airway structure based on the acquired data.

Abstract: A system for customizing an implant is provided. The system includes a processor configured to: i) obtain one or more medical image stacks of a joint; ii) obtain a three-dimensional image representation of the joint based on at least one of said medical image stacks; iii) determine damage to the joint by analyzing said medical image stacks; iv) select an implant template from a predefined set of implant templates having predetermined types and sizes; v) generate a 3D model, in which the marked damage is visualized together with the selected implant template in a proposed position; vi) display the 3D model; vii) receive an approval for said selected implant template in said proposed position; and viii) determine the final shape and dimensions of a customized implant based on said selected implant template and said proposed position.

Abstract: A method for robot-assisted minimally invasive surgery involves calculating, based on a surgical plan, an insertion vector for an MIS port; causing a robotic arm to hold the MIS port in a pose that corresponds to the insertion vector; detecting, with a sensor on the robotic arm, a force applied to the robotic arm via the MIS port; maintaining the MIS port in the pose when the detected force is lower than a predetermined threshold; and generating an alert when the detected force exceeds the predetermined threshold.

Abstract: A surgical stapling device includes a tool assembly and a drive assembly for actuating the tool assembly. The tool assembly includes an anvil assembly that defines a notch and a cartridge assembly that includes a staple cartridge having a cartridge body that supports staples and pushers and an actuation sled that supports a knife. The drive assembly supports a lockout mechanism that is movable between unlocked position and locked positions. The knife includes a protrusion that engages the lockout mechanism to move the lockout mechanism to the unlocked position as the drive assembly is moved from a retracted position towards an advanced position. When a knife is not present within the staple cartridge, the lockout mechanism remains in the unlocked position to prevent advancement of the drive assembly.

Abstract: A method for transferring an end effector of a robot between an end effector pose and a further end effector pose, for at least one axis of the robot includes specifying the same uniform progression of the position of the axis, particularly in advance, for the transfer between the one end effector pose and the one further end effector pose, and for transfers between the one end effector pose and a group of other further end effector poses, more particularly in dependence on activation of a control operating mode. For at least one further axis of the robot, different progressions of the position of the further axis are commanded, more particularly during the transferring, for the transfer between the one end effector pose and the one further end effector pose and the transfer between the one end effector pose and the at least one of the further end effector poses.

Abstract: A surgical robotic tool used with a surgical robotic system can include cables that effect movement in the surgical robotic tool. A brake in any of these cables can be detected by checking a plurality of conditions. A process can compare a) a tension error against a first threshold, b) a rate of change of the sensed tension of the cable against a second threshold, and c) a rate of change of a cable extension error against a third threshold. If all thresholds are exceeded, the process can disable the respective actuator.

Abstract: The present application provides a sensor-based surgery set and a method for determining the position of a holding device for a surgical instrument. The surgery set includes at least one holding device, an initialization station, and a number of sensors. The initialization station has a number of sensor slots, wherein each sensor is assigned to one sensor slot and wherein the initialization station is coupled to a storage unit in which initialization information is assigned to each sensor slot. A number of sensor slots are arranged on the holding device, wherein each sensor slot is assigned to one sensor slot of the initialization station. In an initialization arrangement, a specific number of sensors is in engagement with the sensor slots of the initialization station and are coupled to the storage unit for initialization and data transmission. In use, however, the sensors are in engagement with the sensor slots.

Abstract: A robotic catheter navigation system, and a method for operating the robotic catheter navigation system, are provided. The robotic catheter navigation system comprises a catheter handle, a motor, and a torque transfer disk. The catheter handle comprises a set of gears coupled to a first shaft. The motor is for rotating a second shaft. The torque transfer disk is coupled to the first shaft and the second shaft for transferring the rotation of the second shaft to the first shaft to thereby rotate the set of gears for steering a catheter.

Abstract: A control device (120) according to the present application includes a limitation portion that is provided in a joint portion, which joins two or more links, of a robot and that physically limits motion of the links, and a control unit (122f) that limits movable ranges of the links by controlling the limitation portion corresponding to a predetermined joint portion on the basis of a task executed by the robot. With this configuration, it becomes possible to secure safety of when the robot executes a task.

Abstract: A surgical tool includes a drive housing having an elongate shaft extending therefrom and an end effector arranged at a distal end of the shaft, a drive input rotatably mounted to the drive housing and having an input shaft extending therefrom, and upper and lower capstans mounted to the input shaft. First and second drive cables are coupled to the upper and lower capstans, respectively, and extend to the end effector, and a clutch feature is arranged to mate the upper capstan to the lower capstan and is movable between an engaged position, where rotation of the input shaft in either angular direction correspondingly rotates the upper and lower capstans in the same angular direction, and a disengaged position, where the upper and lower capstans are rotatable independent of each other in at least one angular direction.

Abstract: Methods and systems providing guidance for operation of a biopsy needle based on ultrasonic imaging. Ultrasonic waves are emitted and detected by a ultrasonic transducer to generate image data. A biopsy needle is identified within the generated image data, and the biopsy needle may be in a pre-fire configuration. Based on the identification of the biopsy needle, the methods and systems may determine a predicted location of the biopsy needle based at least in part on biopsy needle properties. The predicted location of the biopsy needle may be the predicated location of the biopsy needle in its post-fire configuration. At least one indicator may be displayed indicating the determined predicted location.

Abstract: A connector system is provided to connect a carriage that includes a rotatable drive member to a surgical instrument that includes a driven member, comprising. a mechanical interface that includes a drive transmission member configured to receive a rotational drive force provided by the drive member at the internal surface region and to provide a corresponding rotational drive force to the driven member at the external surface region; and a support to mount an end portion of an optical fiber to the mechanical interface with a center axis of the first end portion aligned with an axis of rotation of the drive transmission member.

Abstract: The disclosure relates to a display apparatus for displaying an augmented and/or virtual reality. The display apparatus has a sensor unit configured to capture a user input. The display apparatus is further configured to receive a medical planning dataset and receive a medical image dataset having at least one projection mapping. The display apparatus is further configured to generate and display the augmented and/or virtual reality based on the planning dataset and the at least one projection mapping. The display apparatus is further configured to adapt a virtual spatial positioning of the planning dataset relative to the at least one projection mapping in the augmented and/or virtual reality based on the user input. The disclosure further relates to a system, a method for registering a planning dataset with an image dataset, and a computer program product.

Abstract: The present disclosure relates to a dual hybrid electromagnet module for controlling a microrobot. More specifically, the present disclosure relates to an electromagnetic field system in which a dual hybrid electromagnet module including a permanent magnet and an electromagnet is used for controlling a microrobot so that it is possible to reduce the number of used electromagnets so as to reduce power consumption and the amount of heat generated from the electromagnet module. The electromagnetic field system is capable of being used for various medical procedures and surgeries using a microrobot.

Abstract: An instrument system includes a flexible shaft having a proximal portion and a distal portion, a backend mechanism coupled to the proximal portion of the flexible shaft, and a plurality of tendons. The backend mechanism includes a plurality of capstans. Each capstan engages a respective drive motor that rotates to cause rotation of the capstan. A first capstan of the plurality of capstans is engageable with a first respective drive motor while a second capstan of the plurality of capstans is disengaged from a second respective drive motor. Each of the plurality of tendons includes a proximal section coupled to one of the plurality of capstans and a distal section coupled to a member disposed at the distal portion of the flexible shaft.

Abstract: A surgical robotic system comprising: a surgical robot; a user interface console coupled to the surgical robot whereby a user can control motion of the surgical robot; a data logger for logging data from a surgical procedure performed by means of the robot; and a portable user terminal; the system further comprising: a display controllable by one of the data logger and the user terminal, that one of the data logger and the user terminal being configured for displaying a machine-readable code whereby the data logger or a user of the user terminal can be identified; and a camera coupled to the other of the data logger and the user terminal; the said other of the data logger and the user terminal being configured to, on receiving from the camera an image of a machine-readable code, decode that code to identify the data logger or a user of the user terminal and to cause the identified entity to be logged in association with a procedure performed by means of the robot.

Abstract: A surgical tool for use in a system for removing bone from vertebrae to relieve stenosis is provided. In one embodiment, the surgical tool includes a drill bit having a proximal end and a distal end, a drive shaft having a proximal rod portion and a distal tubular portion, the drill bit and the drive shaft configured to rotate about a horizontal axis in a clockwise direction; and an engagement system disposed between the drill bit and the drive shaft; wherein the engagement system is configured to selectively engage the drill bit to the drive shaft for powered rotation when the drill bit contacts a first material at a first predetermined resistance and to disengage the drill bit from the drive shaft when the drill bit engages a second material at a second predetermined resistance; and wherein the first predetermined resistance is greater than the second predetermined resistance.

Abstract: Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Abstract: A medical robot system including a memory and a central processing unit that performs operations including receiving measurement signals of forces measured at two or more points on one or both of a surgical tool and a slave device that supports the surgical tool, generating image information for displaying information of the forces as images in association with the two or more points at which the forces are measured, based on the measurement signals, and outputting the image information that is generated to a display device that displays the image information in a second display region of the display device which is different from a first display region of the display device in which information on operation of the surgical tool is displayed.

Abstract: A system according to at least one embodiment of the present disclosure includes an imaging source; an imaging detector; a depth sensor; and a controller, where the controller receives image information from the depth sensor, determines a gesture in relation to a working volume, and moves the imaging source and the imaging detector relative to the working volume based on the gesture.

Abstract: A power transmission system for driving a robot joint includes a driving part including a first driving unit and a second driving unit, a first force transmission part including a first sheath formed to have a predetermined length, flexibility, and a hollow shape and a first wire which is inserted into the first sheath and of which one end is fixed to a joint of a robot and the other end is connected to the first driving unit, and a second force transmission part including a second sheath formed to have a predetermined length, flexibility, and a hollow shape and a second wire which is inserted into the second sheath and of which one end is fixed to the joint of the robot and the other end is connected to the second driving unit.

Abstract: A mixed reality presentation system identifies an operating condition associated with an operation performed on a body while an active imaging device captures imagery of an internal view of the body. The mixed reality presentation system also determines, based on the identified operating condition, that a display device is to toggle a display of a shape overlay that is displayed together with an external view of the body and that is indicative of an extent of a field of view of the active imaging device relative to the body. Based on the determining that the display device is to toggle the display of the shape overlay, the mixed reality presentation system directs the display device to toggle the display of the shape overlay. Corresponding systems and methods are also disclosed.

Abstract: A method for positioning an input device of a workstation for use by a seated user in controlling a robotic surgery system is disclosed. The input device is operable to generate input signals representing a position of a hand controller moveable within an input device workspace. The method involves determining a vertical position of the hand controller within the input device workspace for an input signal received from the input device while a seated user's hand is grasping the hand controller in an initialization position defined with respect to the user's body. The method also involves determining a user ergonomic height of the input device based on the vertical position of the hand controller at the initialization position, and causing a platform of the workstation on which the input device is mounted to move vertically with respect to a base of the workstation to position the input device at the ergonomic height.

Abstract: A system, method, and apparatus are provided for a robotic system effecting autonomous therapy or treatment of a body having soft and/or hard tissue. A system, method, and apparatus are provided for a robotic control system having a fused sensing stream for predicting the deformation of a robotic end effector and the tissue that the end effector is in contact with using, e.g., a Finite Element Analysis (FEA) model. The model updates provide adjustment parameters for the control system to compensate for changes in the mechanical nature of the robotic end effector and the characteristics and/or movement of the tissue being treated by the robotic end effector.

Abstract: An instrument can include a shaft with a proximal end portion and a distal end portion, an end effector at the distal end portion of the shaft, and a transmission mechanism at the proximal end portion of the shaft. The transmission mechanism can include a driven input device engageable with an external drive mechanism. The instrument can include an indicator operably coupled to the driven input device and moveable through each of a plurality of consecutive positions, each of the plurality of consecutive positions being associated with a unique indicium of a non-zero number of available uses left of the instrument. In response to the driven input device being driven, the indicator moves from a current position of the plurality of positions to a subsequent position of the plurality of positions. The instrument can also include a device configured to record occurrence of a change in an environmental condition to which the instrument is subjected.

Abstract: An input control device is disclosed. The input control device includes a central portion coupled to a multi-axis force and torque sensor, which is configured to receive input control motions from a surgeon. The central portion is flexibly supported on a base. The input control device also includes a rotary joint coupled to a rotary sensor. The input control device is configured to provide control motions to a robotic arm and/or a robotic tool based on input controls detected by the multi-axis force and torque sensor and the rotary sensor.

Abstract: Media, systems, and methods for reducing latency in a head-mounted display for the remote operation of machinery. A remote camera sends raw video to a graphics processing unit which processes the video and transmits the updated video to a head-mounted display with limited latency such that the control of remote devices may be improved. The image may be spherically rendered and projected onto the head-mounted display with a rectangular view. The graphics processing unit may determine a rotation matrix based on a pose of the remote camera and a pose of the head-mounted display, and the image may be projected based on the rotation matrix.

Abstract: An accessory device and an immobilization system including the device are provided for positioning at least a portion of a patient's body relative to an immobilization device including a low temperature thermoplastic sheet. The accessory device may include a patient fixation portion and a lock portion. The patient fixation portion is attached to or inserted in the patient during use. The lock portion may extend distally from the patient fixation portion generally along a lock portion axis. The lock portion includes a shape, surface feature, or configuration, such that the low temperature thermoplastic sheet may be conformed to the outer surface of the lock portion of the accessory device, such that unintended separation of the accessory device from the low temperature thermoplastic sheet is prevented. Methods of forming the accessory device and immobilization system are also provided.

Abstract: An autonomous endoscopic system capable of controlling movement of an endoscope inserted into a protective sheath installed in the body of a patient includes: an endoscope operating device capable of operating a relative position of the endoscope with respect to the protective sheath, a rolling angle of the endoscope, and a bending angle of a bending portion which is located at the end of the endoscope and is bendable; and a control unit for controlling the endoscope operating device, wherein the control unit controls the endoscope operating device on the basis of a driving record of the endoscope.

Abstract: Methods of operating a surgical instrument are disclosed herein.

Abstract: A force sensing device is provided for use with a surgical instrument shaft having a two degree-of-freedom wrist mounted end effector portion having a working surface; a housing defines an annular collar sized to snugly fit about the two degree-of-freedom wrist and defines a cap sized to snugly fit about the end effector portion; an optical fiber including a segment is embedded within the annular collar and including a segment embedded within the cap; a first fiber Bragg grating (FBG) formed in the segment of the optical fiber embedded within the cap.

Abstract: Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Abstract: User interface devices for manipulating a robotic surgical tool in a surgical robotic system are described. A user interface device can include a device body containing a tracking sensor to generate a spatial state signal in response to movement of the device body. The spatial state signal can be used to control a spatial motion of a surgical robotic system actuator. Several grip linkages can be pivotally coupled to the device body. A grip linkage displacement sensor may monitor movement of the grip linkages relative to the device body, and generate a grip signal in response to the movement. The grip signal can be used to control a grip motion of a robotic surgical tool mounted on the surgical robotic system actuator. Other embodiments are also described and claimed.

Abstract: An electronic device includes a housing defining an aperture. An input device extends through the aperture and has a user input surface external to the housing. An inertial actuator is mechanically and fixedly coupled to the input device and positioned within the housing. A mechanical wave dampener provides mechanical wave dampening between the input device and the housing. The electronic device enables haptic feedback to be provided locally to the input device. In some cases, the mechanical wave dampener may dampen shaking of the input device with respect to the housing by at least an order of magnitude.

Abstract: There is provided a control device including a control unit configured to control an operation offset that indicates a difference between a control reference point for a slave unit and a control reference point for a master unit on the basis of operation magnification indicating a ratio of a movement amount of the master unit to a movement amount of the slave unit, in which the control unit controls the operation offset for two pairs of master unit and slave unit according to a change in the operation magnification in a case where a designated position of a first pair of master unit and a slave unit of the two pairs of master units and the slave units is kept constant.

Abstract: Devices, systems, and methods for providing a surveillance marker configured to detecting movement of a dynamic reference base attached to a patient a robot-assisted surgical procedure are provided. The surveillance marker and the dynamic reference base are connected to a bony structure independent of each other.

Abstract: Surgical systems and methods are disclosed for creating a 3D model of a patient's affected area using an imaging device, using the model to determine an implant orientation and position, creating patient-matched instrumentation, placing the patient-matched instrumentation on the patient's anatomy, registering a computer-assisted surgical tool, and acquiring registration information. The methods and systems also include associating the surgical tool with a computer to perform a computer assisted surgery. Also disclosed are embodiments of patient-matched instrumentation to acquire registration information.

Abstract: A method of compressing tissue during a surgical procedure is disclosed. The method comprises obtaining a surgical instrument comprising an end effector, wherein the end effector comprises a first jaw and a second jaw, establishing a communication pathway between the surgical instrument and a surgical hub, and inserting the surgical instrument into a surgical site. The method further comprises compressing tissue between the first jaw and the second jaw, determining a location of the compressed tissue with respect to at least one of the first jaw and the second jaw, communicating the determined location of the compressed tissue to the surgical hub, and displaying the determined location of the compressed tissue on a visual feedback device.

Abstract: A method for actuating an X-ray device during robot-assisted navigation of at least two objects introduced into a body, such as a hollow organ, of a patient by at least one robotic system, includes providing a first selection criterion for selecting one of the objects, and providing a second selection criterion for selecting one of the objects. One of the at least two objects is selected based on the first selection criterion and the second selection criterion, and recording parameters of the X-ray device are automatically set, such that the selected object in an X-ray image to be recorded is highlighted compared to the at least one other object. The selected object may be highlighted with respect to image quality, image flavor, positioning on the X-ray image, and/or a collimator setting of a collimator of the X-ray device. An X-ray image is recorded with the set recording parameters.

Abstract: A method and system for determining an extent of matter removed from a targeted anatomical structure are disclosed. The method includes acquiring an initial representation of a targeted anatomical structure and then removing matter from the targeted anatomical structure. An instrument is then navigated within the targeted anatomical structure. The instrument includes a tracking array, and a relative position of the instrument within the targeted anatomical structure is determined by the tracking array. The method includes recording the relative position of the instrument within the targeted anatomical structure to determine a final representation of the targeted anatomical structure. Finally, the method includes determining an extent of matter removed from the targeted anatomical structure by comparing the initial representation of the targeted anatomical structure with the final representation of the targeted anatomical structure.

Abstract: A medical handling device which includes an instrument holder that supports and instrument and a robotic handling unit that supports the instrument hold, and a control device. The control device has a handling control unit that controls the robotic handling unit and an instrument control unit that controls the instrument. The control device has an interface for at least one input device. An input device is coupled to the interface. The input device is operable in a first operating mode to control the instrument and in a second operating mode to control the robotic handling unit. An enabling switch activates the second operating mode, in which the robotic handling unit is movable in response to input commands at the input device.

Abstract: A system comprises a manipulator assembly, one or more sensing elements configured to sense an arrangement of the assembly, and a control system configured to: determine a motion limit of the manipulator assembly based on the sensed arrangement of the assembly by using a position of a joint of a plurality of joints or using a position of a link of a plurality of links; store a plurality of threshold limits, where each of the plurality of threshold limits is associated with a procedure type and defines a limit of a range to be potentially travelled by the manipulator assembly to perform a procedure of the associated procedure type; select a threshold limit of the plurality of threshold limits based on which procedure type is to be performed; and provide a notification indicative of whether the selected threshold limit is outside a range of motion bounded by the motion limit.