Abstract: A system includes a memory and a processing unit coupled to the memory. The processing unit is configured to receive first image data from a first image sensor exterior to a body, the first image data including data of an object; receive second image data from a second image sensor interior to the body, the second image data including data of the object; track the object moving across a body wall of the body based on the first and second image data to generate a tracking result to indicate a status of movement of the object across the body wall.

Abstract: Multi-view medical activity recognition systems and methods are described herein. In certain illustrative examples, a system accesses a plurality of data streams representing imagery of a scene of a medical session captured by a plurality of sensors from a plurality of viewpoints. The system temporally aligns the plurality of data streams and determines, using a viewpoint agnostic machine learning model and based on the plurality of data streams, an activity within the scene.

Abstract: Visibility metrics in multi-view medical activity recognition systems and methods are described herein. In certain illustrative examples, a system access imagery of a scene of a medical session captured by a plurality of sensors from a plurality of viewpoints, the imagery including first imagery captured by a first sensor of the plurality of sensors from a first viewpoint of the plurality of viewpoints. The system determines, during the medical session and based on the first imagery, a value of an activity visibility metric for the first sensor. The system facilitates, based on the value of the activity visibility metric, adjusting the first viewpoint of the first sensor.

Abstract: Scene perception systems and methods are described herein. In certain illustrative examples, a system combines data sets associated with imaging devices included in a dynamic multi-device architecture and uses the combined data sets to perceive a scene (e.g., a surgical scene) imaged by the imaging devices. To illustrate, the system may access tracking data for imaging devices capturing images of a scene and fuse, based on the tracking data, data sets respectively associated with the imaging devices to generate fused sets of data for the scene. The tracking data may represent a change in a pose of at least one of the image devices that occurs while the imaging devices capture images of the scene. The fused sets of data may represent or be used to generate perceptions of the scene. In certain illustrative examples, scene perception is dynamically optimized using a feedback control loop.

Abstract: A bifurcated navigation control system defines a path whereby a manipulator cart is to navigate from an initial location to a target location. The system directs the manipulator cart to navigate, in a first bifurcated navigation control mode associated with a primary control interface that facilitates both operator control of steering and propulsion, along at least part of a first portion of the path from the initial to an intermediate location. The system further directs the manipulator cart to navigate, in a second bifurcated navigation control mode associated with a secondary control interface that facilitates operator control of propulsion but not steering, along at least part of a second portion of the path from the intermediate to the target location. In the first and second bifurcated navigation control modes, the system autonomously controls the steering of the manipulator cart while allowing operator control of the propulsion of the manipulator cart.

Abstract: A bifurcated navigation control system defines a path whereby a manipulator cart is to navigate from an initial location to a target location, and identifies a navigation condition associated with a navigation of the manipulator cart along the path. Based on the navigation condition, the bifurcated navigation control system defines a propulsion limitation for the manipulator cart during the navigation of the manipulator cart along the path. The bifurcated navigation control system directs the manipulator cart to navigate along at least part of the path in a bifurcated navigation control mode in which the bifurcated navigation control system is configured to autonomously control a steering of the manipulator cart while allowing operator control of a propulsion of the manipulator cart in accordance with the propulsion limitation. Corresponding methods and systems are also disclosed.

Abstract: A device for imaging in a body cavity (e.g. for laparoscopic surgery) has a body dimensioned for insertion by way of a trocar. The body carries plural side-facing cameras. A gripping interface on the body is configured to allow the device to be grasped by a surgical implement and positioned to view a location relevant to a surgical procedure. Some embodiments provide adjustable baselines for stereoscopic viewing. An irrigation system may be provided for cleaning lenses of the cameras while the imaging device remains in a body cavity.