Abstract: A robotic catheter system includes a controller with a master input device. An instrument driver is in communication with the controller and has a guide instrument interface including a plurality of guide instrument drive elements responsive to control signals generated, at least in part, by the master input device. An elongate guide instrument has a base, distal end, and a working lumen, wherein the guide instrument base is operatively coupled to the guide instrument interface. The guide instrument includes a plurality of guide instrument control elements operatively coupled to respective guide drive elements and secured to the distal end of the guide instrument. The guide instrument control elements are axially moveable relative to the guide instrument such that movement of the guide instrument distal end may be controlled by the master input device.

Abstract: A teleoperated system includes a robotic arm configured to support an instrument, a grip configured to be manipulated by an operator to command motion of the instrument, and a control system communicatively coupled to the robotic arm and the grip. To align the grip with the instrument by the grip, the control system is configured to determine grip rotation values describing an orientation of the grip, determine instrument rotation values describing an orientation of the instrument, determine an orientation error between the orientation of the grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, produce a motion command by selectively imposing, based on the orientation error, an artificial joint limit on a commanded movement of the instrument, and command the robotic arm to move in accordance with the motion command.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining grip rotation values describing an orientation of the master grip, determining instrument rotation values describing an orientation of the instrument, determining an orientation error between an orientation of the master grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, and reducing the orientation error by low pass filtering the grip rotation values or the instrument rotation values.

Abstract: A robot system with a robot configured for locomotion about a space using ground reaction force (GRF) to provide a first level of balancing. The robot system includes force generators located on or in the robot's body or offboard in the space that act to generate balancing forces to provide a second level of balancing for the robot using non-conventional physics. Clamping of a robot's feet to a support surface is provided whenever the feet are in contact with the support surface using electromagnets in the feet and a layer of ferrous material on the support surface or using mechanical coupling techniques to temporarily anchor the foot to the support surface. A balance controller processes output of balance sensors and responds by generating control signals to operate force generators onboard the robot such as electric fans or inertial reaction wheels.

Abstract: Systems and corresponding control methods providing a ballistic robot that flies on a trajectory after being released (e.g., in non-powered flight as a ballistic body) from a launch mechanism. The ballistic robot is adapted to control its position and/or inflight movements by processing data from onboard and offboard sensors and by issuing well-timed control signals to one or more onboard actuators to achieve an inflight controlled motion. The actuators may move an appendage such as an arm or leg of the robot or may alter the configuration of one or more body links (e.g., to change from an untucked configuration to a tucked configuration), while other embodiments may trigger a drive mechanism of an inertia moving assembly to change/move the moment of inertia of the flying body. In-flight controlled movements are performed to achieve a desired or target pose and orientation of the robot during flight and upon landing.

Abstract: A system for sensing and controlling eye contact for a robot. The system includes a robotic figure with a movable eye. The system includes a light source positioned in the robotic figure to output light through a light outlet of the eye. A light sensor is included that senses light striking surfaces in a physical space in which the robotic figure is positioned including the output light from the light source. The system includes an image processor processing output of the light sensor to identify a location of a target formed by the output light striking surfaces in the physical space and to identify a location of a face of a human. Further, the system includes a robot controller generating eye movement control signals based on the location of the target and the location of the face to position the eye to provide eye contact with the human observer.

Abstract: Robotic, telerobotic, and/or telesurgical devices, systems, and methods take advantage of robotic structures and data to calculate changes in the focus of an image capture device in response to movement of the image capture device, a robotic end effector, or the like. As the size of an image of an object shown in the display device varies with changes in a separation distance between that object and the image capture device used to capture the image, a scale factor between a movement command input may be changed in response to moving an input device or a corresponding master/slave robotic movement command of the system. This may enhance the perceived correlation between the input commands and the robotic movements as they appear in the image presented to the system operator.

Abstract: A robotic catheter system includes a controller with a master input device. An instrument driver is in communication with the controller and has a guide instrument interface including a plurality of guide instrument drive elements responsive to control signals generated, at least in part, by the master input device. An elongate guide instrument has a base, distal end, and a working lumen, wherein the guide instrument base is operatively coupled to the guide instrument interface. The guide instrument includes a plurality of guide instrument control elements operatively coupled to respective guide drive elements and secured to the distal end of the guide instrument. The guide instrument control elements are axially moveable relative to the guide instrument such that movement of the guide instrument distal end may be controlled by the master input device.

Abstract: A system for sensing and controlling eye contact for a robot. The system includes a robotic figure with a movable eye. The system includes a light source positioned in the robotic figure to output light through a light outlet of the eye. A light sensor is included that senses light striking surfaces in a physical space in which the robotic figure is positioned including the output light from the light source. The system includes an image processor processing output of the light sensor to identify a location of a target formed by the output light striking surfaces in the physical space and to identify a location of a face of a human. Further, the system includes a robot controller generating eye movement control signals based on the location of the target and the location of the face to position the eye to provide eye contact with the human observer.

Abstract: A robot system with a robot configured for locomotion about a space using ground reaction force (GRF) to provide a first level of balancing. The robot system includes force generators located on or in the robot's body or offboard in the space that act to generate balancing forces to provide a second level of balancing for the robot using non-conventional physics. For example, clamping of a robot's feet to a support surface may be provided whenever the feet are in contact with the support surface using electromagnets in the feet and a layer of ferrous material on the support surface or using mechanical coupling techniques to temporarily anchor the foot to the support surface. In other examples, a balance controller may process output of balance sensors and respond by generating control signals to operate force generators onboard the robot such as electric fans or inertial reaction wheels.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining grip rotation values describing an orientation of the master grip, determining instrument rotation values describing an orientation of the instrument, determining an orientation error between an orientation of the master grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, and reducing the orientation error by low pass filtering the grip rotation values or the instrument rotation values.

Abstract: Systems and corresponding control methods providing a ballistic robot that flies on a trajectory after being released (e.g., in non-powered flight as a ballistic body) from a launch mechanism. The ballistic robot is adapted to control its position and/or inflight movements by processing data from onboard and offboard sensors and by issuing well-timed control signals to one or more onboard actuators to achieve an inflight controlled motion. The actuators may move an appendage such as an arm or leg of the robot or may alter the configuration of one or more body links (e.g., to change from an untucked configuration to a tucked configuration), while other embodiments may trigger a drive mechanism of an inertia moving assembly to change/move the moment of inertia of the flying body. Inflight controlled movements are performed to achieve a desired or target pose and orientation of the robot during flight and upon landing.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining a grip orientation by which the master grip is gripped by an operator, determining a commanded velocity for the slave instrument based on a manipulation of the master grip by the operator, determining an error, and altering the commanded velocity for the slave instrument based on at least the grip orientation and the error. The error includes a parameter selected from a group consisting of a position error between a position of the master grip and a position of the slave instrument and an orientation error between an orientation of the master grip and an orientation of the slave instrument.

Abstract: A robotic catheter system includes a controller with a master input device. An instrument driver is in communication with the controller and has a guide instrument interface including a plurality of guide instrument drive elements responsive to control signals generated, at least in part, by the master input device. An elongate guide instrument has a base, distal end, and a working lumen, wherein the guide instrument base is operatively coupled to the guide instrument interface. The guide instrument includes a plurality of guide instrument control elements operatively coupled to respective guide drive elements and secured to the distal end of the guide instrument. The guide instrument control elements are axially moveable relative to the guide instrument such that movement of the guide instrument distal end may be controlled by the master input device.

Abstract: Systems and corresponding control methods providing a ballistic robot that flies on a trajectory after being released (e.g., in non-powered flight as a ballistic body) from a launch mechanism. The ballistic robot is adapted to control its position and/or inflight movements by processing data from onboard and offboard sensors and by issuing well-timed control signals to one or more onboard actuators to achieve an inflight controlled motion. The actuators may move an appendage such as an arm or leg of the robot or may alter the configuration of one or more body links (e.g., to change from an untucked configuration to a tucked configuration), while other embodiments may trigger a drive mechanism of an inertia moving assembly to change/move the moment of inertia of the flying body. Inflight controlled movements are performed to achieve a desired or target pose and orientation of the robot during flight and upon landing.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining a grip orientation by which the master grip is gripped by an operator, determining a commanded velocity for the slave instrument based on a manipulation of the master grip by the operator, determining an error, and altering the commanded velocity for the slave instrument based on at least the grip orientation and the error. The error includes a parameter selected from a group consisting of a position error between a position of the master grip and a position of the slave instrument and an orientation error between an orientation of the master grip and an orientation of the slave instrument.

Abstract: A system configured for stabilizing or balancing objects in an upright state. The system includes a motion system with an upper support surface for receiving an object that is positionable in a vertical state. The system includes a sensor assembly with at least one sensor generating sensor data by tracking at least one of three dimensional (3D) position and angular movement for the object. The system includes a controller with a stabilizing module to process the sensor data to determine when the object is tipping from the vertical state, and, in response to the tipping away of the object from the vertical state, the stabilizing module generates control signals to modify operations of the motion system to move at least a portion of the upper support surface in contact with a lower contact surface of the object through stabilizing movements, whereby the object remains balanced in the vertical state.

Abstract: A system for providing a user of a virtual reality (VR) system with physical interactions with an object in the real world or in the surrounding physical space while they are concurrently interacting in the virtual world with a corresponding virtual object. The real world object is dynamic with the system including a physical interaction system that includes a robot with a manipulator for moving, positioning, and/or orienting the real world object to move it into contact with the user. For example, the physical object is moved into contact with a tracked body part of the user at a time that is synchronized with a time of an interaction event occurring in the virtual world being created by the VR system. Further, a system is described for providing a dynamic physical interaction to a human participant, e.g., a fast and compelling handover in an augmented reality (AR) system.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to be coupled to a slave instrument. The ratcheting system is further configured to align the master grip with the slave instrument by determining a commanded angular velocity for the slave instrument based on a command from the master grip, determining a current alignment error between an alignment of the master grip and an alignment of the slave instrument, and altering the commanded angular velocity for the slave instrument based on the current alignment error. In some embodiments, the ratcheting system is further configured to introduce a control system error to alter the commanded angular velocity. In some embodiments, the current alignment error is a rotation angle error between the alignment of the master grip and the alignment of the slave instrument.

Abstract: A robot configured to provide accurate control over the rate of spin or rotation of the robot. To control the rate of spin, the robot includes an inertia shifting (or moving) assembly positioned within the robot's body so that the robot can land on a surface with a target orientation and “stick the landing” of a gymnastic maneuver. The inertia shifting assembly includes sensors that allow the distance from the landing surface (or height) to be determined and that allow other parameters useful in controlling the robot to be calculated such as present orientation. In one embodiment, the sensors include an inertial measurement unit (IMU) and a laser range finder, and a controller processes their outputs to estimate orientation and angular velocity. The controller selects the right point of the flight to operate a drive mechanism in the inertia shifting assembly to achieve a targeted orientation.