Abstract: An object sizing system sizes an object positioned within a patient. The object sizing system identifies a presence of the object. The object sizing system navigates an elongate body of an instrument to a position proximal to the object within the patient. An imaging sensor coupled to the elongate body captures one or more sequential images of the object. The instrument may be further moved around within the patient to capture additional images at different positions/orientations relative to the object. The object sizing system also acquires robot data and/or EM data associated with the positions and orientations of the elongate body. The object sizing system analyzes the captured images based on the acquired robot data to estimate a size of the object.

Abstract: An object sizing system sizes an object positioned within a patient. The object sizing system identifies a presence of the object. The object sizing system navigates an elongate body of an instrument to a position proximal to the object within the patient. An imaging sensor coupled to the elongate body captures one or more sequential images of the object. The instrument may be further moved around within the patient to capture additional images at different positions/orientations relative to the object. The object sizing system also acquires robot data and/or EM data associated with the positions and orientations of the elongate body. The object sizing system analyzes the captured images based on the acquired robot data to estimate a size of the object.

Abstract: Provided are systems and methods for weight-based registration of location sensors. In one aspect, a system includes an instrument and a processor configured to provide a first set of commands to drive the instrument along a first branch of the luminal network, the first branch being outside a path to a target within a model. The processor is also configured to track a set of one or more registration parameters during the driving of the instrument along the first branch and determine that the set of registration parameters satisfy a registration criterion. The processor is further configured to determine a registration between a location sensor coordinate system and a model coordinate system based on location data received from a set of location sensors during the driving of the instrument along the first branch and a second branch.

Abstract: Certain aspects relate to systems and techniques for navigation-assisted medical devices. Some aspects relate to correlating features of depth information generated based on captured images of an anatomical luminal network with virtual features of depth information generated based on virtual images of a virtual representation of the anatomical luminal network in order to automatically determine aspects of a roll of a medical device within the luminal network.

Abstract: Provided are systems and methods for weight-based registration of location sensors. In one aspect, a system includes an instrument and a processor configured to provide a first set of commands to drive the instrument along a first branch of the luminal network, the first branch being outside a path to a target within a model. The processor is also configured to track a set of one or more registration parameters during the driving of the instrument along the first branch and determine that the set of registration parameters satisfy a registration criterion. The processor is further configured to determine a registration between a location sensor coordinate system and a model coordinate system based on location data received from a set of location sensors during the driving of the instrument along the first branch and a second branch.

Abstract: Certain aspects relate to systems and techniques for navigation-assisted medical devices. Some aspects relate to correlating features of depth information generated based on captured images of an anatomical luminal network with virtual features of depth information generated based on virtual images of a virtual representation of the anatomical luminal network in order to automatically determine aspects of a roll of a medical device within the luminal network.

Abstract: Navigation of an instrument within a luminal network can include image-based airway analysis and mapping. Image-based airway analysis can include detecting one or more airways in an image captured within a luminal network and determining branching information indicative of how the current airway in which the image is captured branches into the detected “child” airways. Image-based airway mapping can include mapping the one or more detected airways to corresponding expected airways of the luminal network in the preoperative model.

Abstract: Provided are systems and methods for path-based navigation of tubular networks. In one aspect, the method includes receiving location data from at least one of a set of location sensors and a set of robot command inputs, the location data being indicative of a location of an instrument configured to be driven through a luminal network. The method also includes determining a first estimate of the location of the instrument at a first time based on the location data, determining a second estimate of the location of the instrument at the first time based on the path, and determining the location of the instrument at the first time based on the first estimate and the second estimate.

Abstract: Certain aspects relate to systems, methods, and techniques for correcting for uncommanded instrument roll. A method for adjusting a controller-feedback system in a medical instrument may comprise receiving data from a sensor at or near a distal end of the instrument, determining a tip frame of reference based on the data from the sensor, the tip frame of reference representing a current orientation of the distal end of the instrument, obtaining a desired frame of reference, determining an adjustment to a visual frame of reference or a control frame of reference based on the tip frame of reference and the desired frame of reference, and transforming the visual frame of reference or the control frame of reference.

Abstract: A surgical robotic system automatically calibrates tubular and flexible surgical tools such as endoscopes. By compensating for unideal behavior of an endoscope, the surgical robotic system can accurately model motions of the endoscope and navigate the endoscope while performing a surgical procedure on a patient. During calibration, the surgical robotic system moves the endoscope to a target position and receives data describing an actual position and/or orientation of the endoscope. The surgical robotic system determines gain values based at least on the discrepancy between the target position and the actual position. The endoscope can include tubular components referred to as a sheath and leader. An instrument device manipulator of the surgical robotic system actuates pull wires coupled to the sheath and/or the leader, which causes the endoscope to articulate.

Abstract: Certain aspects relate to systems, methods, and techniques for correcting for uncommanded instrument roll. A method for adjusting a controller-feedback system in a medical instrument may comprise receiving data from a sensor at or near a distal end of the instrument, determining a tip frame of reference based on the data from the sensor, the tip frame of reference representing a current orientation of the distal end of the instrument, obtaining a desired frame of reference, determining an adjustment to a visual frame of reference or a control frame of reference based on the tip frame of reference and the desired frame of reference, and transforming the visual frame of reference or the control frame of reference.

Abstract: Certain aspects relate to systems and techniques for navigation-assisted medical devices. Some aspects relate to correlating features of depth information generated based on captured images of an anatomical luminal network with virtual features of depth information generated based on virtual images of a virtual representation of the anatomical luminal network in order to automatically determine aspects of a roll of a medical device within the luminal network.

Abstract: Provided are systems and methods for displaying an estimated location of an instrument. In one aspect, the method includes determining a first location of the instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period, and after the first time period, receiving a user command to move the instrument during a second time period. The method also includes estimating a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period, and confirming the estimated second location based on second location data generated by the set of location sensors. The method further includes causing the estimated second location to be displayed prior to the confirmation of the estimated second location.

Abstract: Provided are systems and methods for displaying an estimated location of an instrument. In one aspect, the method includes determining a first location of the instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period, and after the first time period, receiving a user command to move the instrument during a second time period. The method also includes estimating a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period, and confirming the estimated second location based on second location data generated by the set of location sensors. The method further includes causing the estimated second location to be displayed prior to the confirmation of the estimated second location.

Abstract: Provided are systems and methods for weight-based registration of location sensors. In one aspect, a system includes an instrument and a processor configured to provide a first set of commands to drive the instrument along a first branch of the luminal network, the first branch being outside a path to a target within a model. The processor is also configured to track a set of one or more registration parameters during the driving of the instrument along the first branch and determine that the set of registration parameters satisfy a registration criterion. The processor is further configured to determine a registration between a location sensor coordinate system and a model coordinate system based on location data received from a set of location sensors during the driving of the instrument along the first branch and a second branch.

Abstract: Provided are systems and methods for path-based navigation of tubular networks. In one aspect, the method includes receiving location data from at least one of a set of location sensors and a set of robot command inputs, the location data being indicative of a location of an instrument configured to be driven through a luminal network. The method also includes determining a first estimate of the location of the instrument at a first time based on the location data, determining a second estimate of the location of the instrument at the first time based on the path, and determining the location of the instrument at the first time based on the first estimate and the second estimate.

Abstract: Navigation of an instrument within a luminal network can include image-based airway analysis and mapping. Image-based airway analysis can include detecting one or more airways in an image captured within a luminal network and determining branching information indicative of how the current airway in which the image is captured branches into the detected “child” airways. Image-based airway mapping can include mapping the one or more detected airways to corresponding expected airways of the luminal network in the preoperative model.

Abstract: Provided are systems and methods for displaying an estimated location of an instrument. In one aspect, the method includes determining a first location of the instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period, and after the first time period, receiving a user command to move the instrument during a second time period. The method also includes estimating a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period, and confirming the estimated second location based on second location data generated by the set of location sensors. The method further includes causing the estimated second location to be displayed prior to the confirmation of the estimated second location.

Abstract: A surgical robotic system automatically calibrates tubular and flexible surgical tools such as endoscopes. By compensating for unideal behavior of a surgical instrument, the surgical robotic system can accurately model motions of the surgical instrument and navigate the surgical instrument while performing a surgical procedure on a patient. During calibration, the surgical robotic system moves the surgical instrument to a target position and receives data describing an actual position and/or orientation of the surgical instrument. The surgical robotic system determines gain values based at least on the discrepancy between the target position and the actual position. The surgical instrument can include tubular components referred to as a sheath and leader. An instrument device manipulator of the surgical robotic system actuates pull wires coupled to the sheath and/or the leader, which causes the surgical instrument to articulate.

Abstract: Navigation of an instrument within a luminal network can include image-based branch detection and mapping. Image-based branch detection can include identifying within an image one or more openings associated with one or more branches of a luminal network. Image-based branch mapping can include mapping the detected one or more openings to corresponding branches of the luminal network. Mapping may include comparing features of the openings to features of a set of expected openings. A position state estimate for the instrument can be determined from the mapped openings, which can facilitate navigation of the luminal network.