Abstract: A user input system directs a computer-assisted medical system, which includes a set of controls comprising a first control and a second control configured to receive user input, to operate in a manipulation input mode in which user input to the first control manipulates a first manipulator of the computer-assisted medical system, and user input to the second control manipulates a second manipulator of the computer-assisted medical system. The user input system further directs the computer-assisted medical system to operate in a hybrid input mode in which user input to the first control manipulates the first manipulator, and user input to the second control adjusts a parameter setting associated with a medical procedure.

Abstract: A configuration optimization system determines a reachability of a target object in a surgical space by a robotic instrument of a computer-assisted surgical system for a first configuration of the computer-assisted surgical system. The configuration optimization system determines a second configuration of the computer-assisted surgical system that improves the reachability of the target object by the robotic instrument. The configuration optimization system provides, to the computer-assisted surgical system, data indicating the second configuration.

Abstract: An exemplary system includes a memory storing instructions and a processor communicatively coupled to the memory. The processor may be configured to execute the instructions to obtain one or more operating characteristics of an instrument located in a surgical space; obtain one or more anatomical characteristics associated with the surgical space; and direct a computer-assisted surgical system to automatically perform, based on the based on the one or more operating characteristics of the device and the one or more anatomical characteristics associated with the surgical space, an operation with the instrument located in the surgical space.

Abstract: An exemplary system includes a memory storing instructions and a processor communicatively coupled to the memory. The processor may be configured to execute the instructions to obtain one or more parameters of a non-robotic device in a surgical space, the non-robotic device engaged by a computer-assisted surgical system; generate, based on at least the one or more parameters of the non-robotic device, guidance content for use by the computer-assisted surgical system to facilitate guided teleoperation of the non-robotic device; and provide the guidance content to the computer-assisted surgical system.

Abstract: A plenoptic endoscope includes a fiber bundle with a distal end configured to receive light from a target imaging region, a sensor end disposed opposite the distal end, and a plurality of fiber optic strands each extending from the distal end to the sensor end. The plenoptic endoscope also includes an image sensor coupled to the sensor end of the fiber bundle, and a plurality of microlenses disposed between the image sensor and the sensor end of the fiber bundle, the plurality of microlens elements forming an array that receives light from one or more of the plurality of fiber optic strands of the fiber bundle and directs the light onto the image sensor. The plurality of microlens elements and the image sensor together form a plenoptic camera configured to capture information about a light field emanating from the target imaging region.

Abstract: An exemplary tissue volume detection system accesses, during a surgical procedure involving resecting a piece of tissue from a body, a plurality of depth datasets for the resected piece of tissue. Each of the plurality of depth datasets is captured as a different portion of a surface of the resected piece of tissue is presented to an imaging device by an instrument that holds the resected piece of tissue in a manner that sequentially presents the different portions of the surface to the imaging device. During the surgical procedure and based on the depth datasets, the system generates a three-dimensional (3D) occupancy map that includes a set of voxels identified to be occupied by the resected piece of tissue. Based on the 3D occupancy map and still during the surgical procedure, the system determines an estimated volume of the resected piece of tissue. Corresponding systems and methods are also disclosed.

Abstract: An exemplary system includes a memory storing instructions and a processor communicatively coupled to the memory. The processor may be configured to execute the instructions to: detect an intent of a user of a computer-assisted surgical system to use a robotic instrument attached to the computer-assisted surgical system to interact with a target object while the target object is located in a surgical space; determine a pose of the target object in the surgical space; and perform, based on the detected intent of the user to interact with the target object and the determined pose of the target object in the surgical space, an operation with respect to the target object.

Abstract: A plenoptic endoscope includes a fiber bundle with a distal end configured to receive light from a target imaging region, a sensor end disposed opposite the distal end, and a plurality of fiber optic strands each extending from the distal end to the sensor end. The plenoptic endoscope also includes an image sensor coupled to the sensor end of the fiber bundle, and a plurality of microlenses disposed between the image sensor and the sensor end of the fiber bundle, the plurality of microlens elements forming an array that receives light from one or more of the plurality of fiber optic strands of the fiber bundle and directs the light onto the image sensor. The plurality of microlens elements and the image sensor together form a plenoptic camera configured to capture information about a light field emanating from the target imaging region.

Abstract: An exemplary system is configured to obtain anatomical characteristic data representative of a characteristic associated with an anatomical surface to be covered by a physical medical element, the anatomical surface within an internal space of a patient and determine, based on the anatomical characteristic data, a placement guidance parameter set. The placement guidance parameter set may include one or more parameters configured to guide a placement of the physical medical element on the anatomical surface with one or more surgical instruments controlled by a computer-assisted surgical system.

Abstract: An exemplary system is configured to instruct a display device to render a virtual medical element representative of a physical medical element over a target region within an image of an internal space of a patient, the target region depicting an anatomical surface to be covered by the physical medical element; receive, while the virtual medical element is rendered over the target region, user input that sets at least one of a pose of the virtual medical element within the image or a size of the virtual medical element; and determine, based on the user input and on depth data representative of a depth map for the internal space, physical dimensions for the physical medical element.

Abstract: A contact detection system is configured to classify each pixel in a plurality of pixels included in an ultrasound image captured by an ultrasound probe located within a patient as either showing tissue or showing non-tissue; determine an average pixel classification representative of a number of pixels classified as showing tissue compared to a number of pixels classified as showing non-tissue; determine, if the average pixel classification is above a first contact state threshold, that the ultrasound probe is in a first contact state that indicates that the ultrasound probe is in operative physical contact with the tissue; and determine, if the average pixel classification is below a second contact state threshold lower than the first contact state threshold, that the ultrasound probe is in a second contact state that indicates that the ultrasound probe is not in operative physical contact with the tissue.

Abstract: Described herein are an apparatus and methods for automating subtasks in surgery and interventional medical procedures. The apparatus consists of a robotic positioning platform, an operating system with automation programs, and end-effector tools to carry out a task under supervised autonomy. The operating system executes an automation program, based on one or a fusion of two or more imaging modalities, guides real-time tracking of mobile and deformable targets in unstructured environment while the end-effector tools execute surgical interventional subtasks that require precision, accuracy, maneuverability and repetition. The apparatus and methods make these medical procedures more efficient and effective allowing a wider access and more standardized outcomes and improved safety.

Abstract: A plenoptic endoscope includes a fiber bundle with a distal end configured to receive light from a target imaging region, a sensor end disposed opposite the distal end, and a plurality of fiber optic strands each extending from the distal end to the sensor end. The plenoptic endoscope also includes an image sensor coupled to the sensor end of the fiber bundle, and a plurality of microlenses disposed between the image sensor and the sensor end of the fiber bundle, the plurality of microlens elements forming an array that receives light from one or more of the plurality of fiber optic strands of the fiber bundle and directs the light onto the image sensor. The plurality of microlens elements and the image sensor together form a plenoptic camera configured to capture information about a light field emanating from the target imaging region.

Abstract: System and method for tracking and control in medical procedures. The system including a device that deploys fluorescent material on at least one of an organ under surgery and a surgical tool, a visual light source, a fluorescent light source corresponding to an excitation wavelength of the fluorescent material, an image acquisition and control element that controls the visual light source and the fluorescent light source, and captures and digitizes at least one of resulting visual images and fluorescent images, and an image-based, tracking module that applies image processing to the visual and fluorescent images, the image processing detecting fluorescent markers on at least one of the organ and the surgical tool.

Abstract: The present disclosure is related to a method and apparatus for providing recommendation for a medical surgical procedure, including acquiring, using circuitry, a plurality of multispectral images representing a portion of an anatomy of a patient, performing image processing on each of the plurality of multispectral images to form a plurality of value maps, each value map identifying aspects of the portion of the anatomy by assigned values, combining the plurality of value maps into a single recommendation map, determining optimal points for performing the medical surgical procedure based on the single recommendation map, and displaying the optimal points for the medical surgical procedure by overlaying the optimal points on an original image of the portion of the anatomy or applying the optimal points to a robotic medical surgical procedure.

Abstract: A system and method for corrected imaging including an optical camera that captures at least one optical image of an area of interest, a depth sensor that captures at least one depth map of the area of interest, and circuitry that correlates depth information of the at least one depth map to the at least one optical image to generate a depth image, corrects the at least one optical image by applying a model to address alteration in the respective at least one optical image, the model using information from the depth image, and outputs the corrected at least one optical image for display in 2D and/or as a 3D surface.

Abstract: Described herein are an apparatus and methods for automating subtasks in surgery and interventional medical procedures. The apparatus consists of a robotic positioning platform, an operating system with automation programs, and end-effector tools to carry out a task under supervised autonomy. The operating system executes an automation program, based on one or a fusion of two or more imaging modalities, guides real-time tracking of mobile and deformable targets in unstructured environment while the end-effector tools execute surgical interventional subtasks that require precision, accuracy, maneuverability and repetition. The apparatus and methods make these medical procedures more efficient and effective allowing a wider access and more standardized outcomes and improved safety.

Abstract: Described herein are an apparatus and methods for automating subtasks in surgery and interventional medical procedures. The apparatus consists of a robotic positioning platform, an operating system with automation programs, and end-effector tools to carry out a task under supervised autonomy. The operating system executes an automation program, based on one or a fusion of two or more imaging modalities, guides real-time tracking of mobile and deformable targets in unstructured environment while the end-effector tools execute surgical interventional subtasks that require precision, accuracy, maneuverability and repetition. The apparatus and methods make these medical procedures more efficient and effective allowing a wider access and more standardized outcomes and improved safety.

Abstract: The present disclosure is related to a method and apparatus for providing recommendation for a medical surgical procedure, including acquiring, using circuitry, a plurality of multispectral images representing a portion of an anatomy of a patient, performing image processing on each of the plurality of multispectral images to form a plurality of value maps, each value map identifying aspects of the portion of the anatomy by assigned values, combining the plurality of value maps into a single recommendation map, determining optimal points for performing the medical surgical procedure based on the single recommendation map, and displaying the optimal points for the medical surgical procedure by overlaying the optimal points on an original image of the portion of the anatomy or applying the optimal points to a robotic medical surgical procedure.

Abstract: A system and method for corrected imaging including an optical camera that captures at least one optical image of an area of interest, a depth sensor that captures at least one depth map of the area of interest, and circuitry that correlates depth information of the at least one depth map to the at least one optical image to generate a depth image, corrects the at least one optical image by applying a model to address alteration in the respective at least one optical image, the model using information from the depth image, and outputs the corrected at least one optical image for display in 2D and/or as a 3D surface.