Abstract: Systems and methods for remotely controlling a system using video are provided. A method in accordance the present disclosure includes detecting a video signal of an auxiliary system at a video input, wherein the video signal including images encoded with control information. The method also includes determining that the images included in the video signal include the control information. The method further includes extracting the control information from the images. Additionally, the method includes modifying operations of the system based on the control information.

Abstract: Systems and methods for endoscopic operations are described. For example, the disclosure provides mechanisms for sensing and controlling a field of view of an endoscope by determining a pose of the field of view using a first location and a second location, and controlling the pose of the field of view by moving at least one of: the first portion and the second portion. The first location is of a first portion of the endoscope and the second location is of a second portion of the endoscope. The endoscope comprises a flexible portion disposed between the first portion and the second portion. The first and second locations are defined by a configuration, relative to the endoscope, of an endoscope support and a cannula. The endoscope support configured to support the endoscope. A shaft of the endoscope is configured to extend through the cannula.

Abstract: Systems and methods for endoscopic operations are described. For example, the disclosure provides mechanisms for sensing and controlling a field of view of an endoscope by determining a pose of the field of view using a first location and a second location, and controlling the pose of the field of view by moving at least one of: the first portion and the second portion. The first location is of a first portion of the endoscope and the second location is of a second portion of the endoscope. The endoscope comprises a flexible portion disposed between the first portion and the second portion. The first and second locations are defined by a configuration, relative to the endoscope, of an endoscope support and a cannula. The endoscope support configured to support the endoscope. A shaft of the endoscope is configured to extend through the cannula.

Abstract: A medical puncture device system includes a puncture device, a sensor, and an indicator system. The puncture device is configured to create a puncture through patient tissue and into an internal patient cavity to enable a medical tool to be inserted through the puncture into the cavity. The sensor is configured to generate a signal indicative of motion of the puncture device through the tissue into the cavity. The indicator system is operable by a controller to produce human-perceptible feedback in response to the signal generated by the sensor.

Abstract: A medical puncture device system includes a puncture device, a sensor, and an indicator system. The puncture device is configured to create a puncture through patient tissue and into an internal patient cavity to enable a medical tool to be inserted through the puncture into the cavity. The sensor is configured to generate a signal indicative of motion of the puncture device through the tissue into the cavity. The indicator system is operable by a controller to produce human-perceptible feedback in response to the signal generated by the sensor.

Abstract: A computer-assisted medical system includes a user device wearable by an operator. The user device includes a display device configured to present imagery overlaid in an environment of a manipulator assembly, and a sensor configured to detect one or more landmarks in the environment. The medical system includes a controller configured to execute instructions to perform operations The operations include receiving, from the sensor, position or orientation information for the one or more landmarks in the environment, and directing a manual movement of a portion of the manipulator assembly by causing the display device to present the imagery overlaid in the environment based on the received position or orientation information.

Abstract: Systems and methods for remotely controlling a system using video are provided. A method in accordance the present disclosure includes detecting a video signal of an auxiliary system at a video input, wherein the video signal including images encoded with control information. The method also includes determining that the images included in the video signal include the control information. The method further includes extracting the control information from the images. Additionally, the method includes modifying operations of the system based on the control information.

Abstract: A medical puncture device system includes a puncture device, a sensor, and an indicator system. The puncture device is configured to create a puncture through patient tissue and into an internal patient cavity to enable a medical tool to be inserted through the puncture into the cavity. The sensor is configured to generate a signal indicative of motion of the puncture device through the tissue into the cavity. The indicator system is operable by a controller to produce human-perceptible feedback in response to the signal generated by the sensor.

Abstract: Systems and methods for endoscopic operations are described. For example, the disclosure provides mechanisms for sensing and controlling a field of view of an endoscope by determining a pose of the field of view using a first location and a second location, and controlling the pose of the field of view by moving at least one of: the first portion and the second portion. The first location is of a first portion of the endoscope and the second location is of a second portion of the endoscope. The endoscope comprises a flexible portion disposed between the first portion and the second portion. The first and second locations are defined by a configuration, relative to the endoscope, of an endoscope support and a cannula. The endoscope support configured to support the endoscope. A shaft of the endoscope is configured to extend through the cannula.

Abstract: In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.

Abstract: A multi-function force reflecting haptic interface including various sub-assemblies is disclosed. The sub-assemblies include multiple function user interfaces, a user interface docking station for setting the interface to a home position, temperature monitoring and control systems, and various kinematic cable drive systems.

Abstract: In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.

Abstract: A computer-implemented method of analyzing a sample task trajectory including obtaining, with one or more computers, position information of an instrument in the sample task trajectory, obtaining, with the one or more computers, pose information of the instrument in the sample task trajectory, comparing, with the one or more computers, the position information and the pose information for the sample task trajectory with reference position information and reference pose information of the instrument for a reference task trajectory, determining, with the one or more computers, a skill assessment for the sample task trajectory based on the comparison, and outputting, with the one or more computers, the determined skill assessment for the sample task trajectory.

Abstract: A patient-side surgeon interface provides enhanced capabilities in using a minimally invasive, teleoperated surgical system. The patient-side surgeon interface has components within the sterile surgical field of the surgery. The components allow a surgeon to control teleoperated slave surgical instruments from within the sterile surgical field. The patient-side surgeon interface permits a surgeon to be in the sterile surgical field adjacent a patient undergoing surgery. Controlling minimally invasive slave surgical instruments from within the sterile surgical field permits minimally invasive surgery combined with direct visualization by the surgeon. The proximity to the patient allows the surgeon to control a teleoperated slave surgical instrument in tandem with controlling manually controlled instruments such as a laparoscopic instrument. Also, the surgeon, from within the sterile surgical field, can use the patient-side surgeon interface to control at least one proxy visual in proctoring another surgeon.

Abstract: A patient-side surgeon interface provides enhanced capabilities in using a minimally invasive, teleoperated surgical system. The patient-side surgeon interface has components within the sterile surgical field of the surgery. The components allow a surgeon to control teleoperated slave surgical instruments from within the sterile surgical field. The patient-side surgeon interface permits a surgeon to be in the sterile surgical field adjacent a patient undergoing surgery. Controlling minimally invasive slave surgical instruments from within the sterile surgical field permits minimally invasive surgery combined with direct visualization by the surgeon. The proximity to the patient allows the surgeon to control a teleoperated slave surgical instrument in tandem with controlling manually controlled instruments such as a laparoscopic instrument. Also, the surgeon, from within the sterile surgical field, can use the patient-side surgeon interface to control at least one proxy visual in proctoring another surgeon.

Abstract: A patient-side surgeon interface provides enhanced capabilities in using a minimally invasive, teleoperated surgical system. The patient-side surgeon interface has components within the sterile surgical field of the surgery. The components allow a surgeon to control teleoperated slave surgical instruments from within the sterile surgical field. The patient-side surgeon interface permits a surgeon to be in the sterile surgical field adjacent a patient undergoing surgery. Controlling minimally invasive slave surgical instruments from within the sterile surgical field permits minimally invasive surgery combined with direct visualization by the surgeon. The proximity to the patient allows the surgeon to control a teleoperated slave surgical instrument in tandem with controlling manually controlled instruments such as a laparoscopic instrument. Also, the surgeon, from within the sterile surgical field, can use the patient-side surgeon interface to control at least one proxy visual in proctoring another surgeon.

Abstract: The invention provides a digital dentistry system that utilizes a haptic interface and features a computer-based design application configured to allow the intuitive construction of irregular, amorphous three-dimensional structures typically seen in dental restorations, utilizing, where appropriate, the design skills of a user. In certain embodiments, the system provides a comprehensive digital solution for dental labs in the business of creating dental restorations such as partial frameworks, crowns, copings, bridge frameworks, implants and the like, with a sense of touch provided by a haptic interface device.

Abstract: In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.

Abstract: In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.

Abstract: The invention provides a system for modeling three-dimensional objects using hybrid geometric/volumetric representation, wherein sharp edges are created by a geometric representation that is connected to the volumetric representation. The system creates, maintains, and updates the hybrid representation according to user input. The system also provides for conversion of the hybrid representation into either a wholly geometric representation or a wholly volumetric representation, as may be needed for output to a given device, such as a display device, a printer, and/or a fabricating device.