Abstract: Disclosed herein are devices, systems, methods, and computer program products for planning and performing medical procedures. In some embodiments, a system for planning a medical procedure includes a processor and a memory operably coupled to the processor. The memory can store instructions that, when executed by the processor, cause the system to perform operations including: receiving image data of an anatomic region including a plurality of lymph nodes and a target lesion; generating a three-dimensional model of the anatomic region by segmenting the image data; selecting a subset of the lymph nodes to be biopsied during the medical procedure based at least in part on a location of the target lesion in the three-dimensional model; and determining a sequence for navigating a biopsy device to locations of the subset of the lymph nodes during the medical procedure.

Abstract: A medical robotic system includes a viewer, a gaze tracker, and a processor programmed to: draw an area or volume defining shape overlaid on an image based on the tracked gaze point after the user has gazed on the tracked gaze point for a programmed period of time; in response to receiving a user-selected action command, assign a fixed virtual constraint to the area or volume defining shape and constrain movement of a robotic tool; map points of the robotic tool in a tool reference frame to a viewer reference frame; determine a closest object to the tracked gaze point is the robotic tool based at least in part on the mapped points; display an object including text identifying the robotic tool, overlaid on the image, proximate to the robotic tool based on determining the robotic tool is the closest object; and perform an action indicated by the object.

Abstract: A robotic system provides user selectable actions associated with gaze tracking according to user interface types. User initiated correction and/or recalibration of the gaze tracking may be performed during the processing of individual of the user selectable actions.

Abstract: A medical system includes an interventional instrument and a control system including one or more processors. The control system is configured to: receive a pose dataset for a point on the instrument retained in compliant movement with a cyclically moving patient anatomy for a plurality of time parameters during a cyclical anatomical motion; determine a set of pose differentials for the identified point with respect to a reference point at each time parameter; identify a periodic signal for the anatomical motion from the set of pose differentials; generate a command signal indicating an intended movement of the instrument relative to the patient anatomy; adjust the command signal to include an instruction for a cyclical instrument motion based on a phase of the anatomical motion; and cause the intended movement of the instrument relative to the patient anatomy based on the adjusted command signal to compensate for the anatomical motion.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera configured to capture an image of a camera field of view. The system further comprises an input device, a display, and a processor. The processor is configured to display a first synthetic image including a first synthetic image of the tool. The first synthetic image of the tool includes a portion of the tool outside of the camera field of view. The processor is also configured to receive a user input at the input device and responsive to the user input, change the display of the first synthetic image to a display of a second synthetic image including a second synthetic image of the tool that is different from the first synthetic image of the tool.

Abstract: A method for image segmentation comprises receiving volumetric image data for an anatomical region and generating a first volumetric patch from the volumetric image data. The method also comprises generating a second volumetric patch from the first volumetric patch by weighting a plurality of volumetric units in the first volumetric patch and receiving the second volumetric patch as an input to a convolutional neural network. The method also comprises conducting a down-sampling filter process and conducting an up-sampling filter process within the convolutional neural network.

Abstract: A method of discharging a battery assembly used to power at least part of an object includes detecting when power to the object is turned off, detecting, with aid of a timer, an amount of time elapsed since the power to the object is turned off, and initiating a controlled self-discharge of the battery assembly when the amount of time exceeds a threshold length of time. The controlled self-discharge of the battery assembly is performed by a self-discharging circuit electrically coupled to the battery assembly.

Abstract: Devices, systems, methods, and computer program products for planning medical procedures are disclosed herein. In some embodiments, a system for planning a medical procedure includes a processor and memory operably coupled to the processor. The memory stores instructions that, when executed by the processor, cause the system to perform operations including receiving a three-dimensional model of an anatomic region of a patient and evaluating whether the three-dimensional model is suitable for use in a registration procedure to be performed in the anatomic region. The evaluating includes: analyzing a span of the three-dimensional model along at least two different directions, determining whether the three-dimensional model includes at least one segmented component corresponding to at least one structure of the anatomic region, and performing a registration between the three-dimensional model and a virtual registration data set.

Abstract: A method and system for hand tracking in a robotic system includes a hand tracking system and a controller coupled to the hand tracking system. The controller is configured to receive, from the hand tracking system, a plurality of locations of a hand; determine if the hand is in a first hand pose based on the plurality of locations; in response to determining that the hand is in the first hand pose, and switch the robotic system to a hand trajectory detection mode. While in the hand trajectory detection mode, the control unit is configured to detect, based on hand tracking information from the hand tracking system, that the hand has performed a first hand trajectory of a plurality of known hand trajectories; and in response to detecting the first hand trajectory, change a mode of operation of the robotic system.

Abstract: A method performed by a computing system comprises receiving a first set of spatial information from an instrument positioned within an anatomic passageway. The first set of spatial information includes a plurality of spatial data records including position information for a distal end of the instrument at a plurality of time periods. The method further comprises ordering the plurality of spatial data records in a time-gathered order. The method further comprises evaluating a spatial relationship between first and second consecutive spatial data records of the plurality of spatial data records. The method further comprises filtering the first set of spatial information based upon the evaluated spatial relationship.

Abstract: A method performed by a computing system comprises receiving a fluoroscopic image of a patient anatomy while a portion of a medical instrument is positioned within the patient anatomy. The fluoroscopic image has a fluoroscopic frame of reference. The portion has a sensed position in an anatomic model frame of reference. The method further comprises identifying the portion in the fluoroscopic image and identifying an extracted position of the portion in the fluoroscopic frame of reference using the identified portion in the fluoroscopic image. The method further comprises registering the fluoroscopic frame of reference to the anatomic model frame of reference based on the sensed position of the portion and the extracted position of the portion.

Abstract: Systems and methods for supporting image-guided procedures include a device having an instrument usable to collect location data for one or more passageways and one or more processors coupled to the instrument. The one or more processors are configured to organize a plurality of points within the location data based on a corresponding insertion depth of the instrument when each of the plurality of points is collected, create a passageway tree based on the points, identify at least three non-collinear landmark locations within the passageway tree, create a seed transformation between one or more of the at least three non-collinear landmark locations and corresponding model locations in model data, and register, using the seed transformation, the plurality of points to the model data for the one or more passageways. In some embodiments, the at least three non-collinear landmark locations are based on a main branch point in the passageway tree.

Abstract: A method and medical system for estimating the deformation of an anatomic structure that comprises generating a first model of at least one anatomical passageway from anatomical data describing a patient anatomy and determining a shape of a device positioned within the branched anatomical passageways. The method and medical system also comprise generating a second model of the plurality of branched anatomical passageways by adjusting the first model relative to the determined shape of the device.

Abstract: A medical system comprises a memory for receiving intraoperative external image data for at least a portion of a patient anatomy. The memory further receives intraoperative pose data for a medical instrument of the medical system. The medical system further comprises a processor configured for generating a first model of the patient anatomy. The processor is further configured for, based on the intraoperative external image data, intraoperatively generating an updated model of the patient anatomy that is different from the first model. The updated model includes an anatomical structure that is not present in the first model.

Abstract: A computer-assisted medical device is configured and used to endoluminally navigate to a location in the gastrointestinal system and there treat certain body lumen wall areas while avoiding other body lumen wall areas. Embodiments ablate the inner mucosal layer and sub-mucosal nerve plexus of the stomach, duodenum and jejunum to effect treatment of insulin resistance and metabolic disorders, such as Type II diabetes (T2D), polycystic ovarian syndrome (PCOS), non-alcoholic steatohepatitis (NASH), non-alcoholic fatty liver disease (NAFLD), congestive heart failure (CHF) and obstructive sleep apnea (OSA). Various sensors are used to assist a clinical operator to navigate from the mouth through the pyloric sphincter and into and through the duodenum and/or jejunum. Various sensors are used to map and identify portions of the duodenum and/or jejunum. Various lumen wall ablation devices and methods are described. Various post-treatment assessments are described.

Abstract: A method for image segmentation comprises receiving volumetric image data for an anatomical region and generating a first volumetric patch from the volumetric image data. The method also comprises generating a second volumetric patch from the first volumetric patch by weighting a plurality of volumetric units in the first volumetric patch and receiving the second volumetric patch as an input to a convolutional neural network. The method also comprises conducting a down-sampling filter process and conducting an up-sampling filter process within the convolutional neural network.

Abstract: A power conversion device includes: a plurality of legs, each leg including a high-side switch connected between a voltage supply node and a phase node and a low-side switch connected between the phase node and a reference node; a phase current sensor for each leg and configured to sense current flowing through the high-side switch or the low-side switch of the corresponding leg; a single current sensor connected between the reference node and the low-side switches, or between the voltage supply node and the high-side switches; and a controller. During a subperiod of a switching period, the controller is configured to sample the current sensed by at least one of the phase current sensors and a current sensed by the single current sensor such that the current in one or more of the legs is sampled during the same subperiod as the current flowing through the single current sensor.

Abstract: A system and method of planning a procedure includes a planning workstation including: a display system; and a user input device. The planning workstation is configured to: display image data via the display system; receive a first user input via the user input device; display via the display system a target of a medical procedure within the displayed image data identified based at least on the first user input; display an interactive image via the display system, the interactive image including the image data, a plurality of connected anatomical passageways, and the identified target; receive a second user input via the user input device; display via the display system a trajectory between the target and an exit point along a nearest passageway of the plurality of connected anatomical passageways identified based at least on the second user input; receive a third user input via the user input device; and adjust the interactive image based at least on the defined trajectory and the third user input.

Abstract: The present invention relates to a method, system and computer program product for task failover in an unstable environment, wherein the unstable environment includes a plurality of reclaimable nodes. According to the method, it is monitored if any node of the plurality of reclaimable nodes is to be reclaimed. Whether a task on any node of the plurality of reclaimable nodes is recoverable is determined. Responsive to the task being recoverable, data of the recoverable task is stored. Responsive to a node being reclaimed and the task on the reclaimed node being recoverable, at least one associated task of at least one associated node of the reclaimed node is notified to wait.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.