Abstract: A neck mechanism for a robot includes a first linear actuator, a second linear actuator in parallel with the first actuator, a rotary stage, and a support shaft positioned behind and between the first linear actuator and the second linear actuator. The first linear actuator and the second linear actuator are both connected between a platform and the rotary stage via joints, and the support shaft is connected between the upper platform and the rotary stage via a joint. The rotary motor is configured to rotate the rotary stage to yaw the platform and the first linear actuator and the second linear actuator are configured to pitch/roll the platform.

Abstract: A control system for a neck mechanism includes a perception system configured to track movement of an object, and a perception control system that controls a rotary motor to yaw a platform and controls a first linear actuator and a second linear actuator that is in parallel with the first linear actuator to pitch and roll the platform according to a target position of the platform. The perception system tracks movement of the object by estimating its position and pose in 3D space and the platform is moved according to a vision-based position and pose estimation result.

Abstract: The present disclosure is related to methods and systems for controlling a snake-arm robot. The method includes receiving real-time image data associated with an operating environment or a location of a workpiece from optical sensor(s) mounted on a robot head of the robot; receiving input data describing a desired pose of the robot head; computing and translating a desired displacement of the robot head; computing a position of each of the links of the snake-arm robot to follow motion of the robot head, a current position of each the links, and data required to move joints connecting the links to move the robot to the desired pose; generating movement instructions; and transmitting the movement instructions to a drive motor associated with an introduction device or controllers associated with servo-motors operably connected to joints connecting the links of the snake-arm causing the robot head to move to the desired pose.

Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.

Abstract: The present approach relates to streaming data derived from inspection data acquired using one or more robots performing inspections of an asset or assets. Such inspections may be fully or partially automated, such as being controlled by one or more computer-based routines, and may be planned or dynamically altered in response to inputs or requirements associated with an end-user of the inspection data, such as a subscriber to the data in a publication/subscription distribution scheme. Thus, an inspection may be planned or altered based on the data needs or subscription levels of the user or customers.

Abstract: Methods and systems for controlling a snake-arm robot. In an embodiment, a server computer receives real-time image data associated with at least one of an operating environment and a location of a workpiece from an optical sensor mounted on a robot head of a snake-arm robot, and receives, input data describing a desired pose of the robot head from a user device. The server computer then computes a desired velocity of the robot head using an image Jacobian, translates the desired velocity of the robot head into incremental displacement data and rotation data within a control cycle, computes a position of each of a plurality of links comprising a snake-arm of the snake-arm robot to follow motion of the robot head, computes a current position of each of the plurality of links utilizing a forward dynamics model, and computes force and torque data required to move at least one of a plurality of joints connecting the links to move the snake-arm robot to the desired pose.

Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.

Abstract: A sensor calibration system includes a plurality of sensors and a user interface configured to receive user-provided locations of at least two sensors of the plurality of sensors. The sensor calibration system further includes a motorized apparatus including a drive system, at least one detector, and a localization system. The sensor calibration system further includes a controller communicatively coupled to the user interface and the motorized apparatus. The controller is configured to determine a whether each of at least two sensors is a key sensor based on the user-provided locations. The controller is configured to determine a path for the motorized apparatus based on the user-provided locations. The controller is further configured to determine a position of each sensor based on the location of the motorized apparatus when each sensor is detected by the at least one detector.

Abstract: A method and system, the method including receive image data representations of a set of images of a physical asset; receive a data model of at least one asset, the data model of each of the at least one assets including a semantic description of the respective modeled asset and at least one operation associated with the respective modeled asset; determine a match between the received image data and the data model of one of the at least one assets based on a correspondence therebetween; generate, for the data model determined to be a match with the received image data, an operation plan based on the at least one operation included in matched data model; execute, in response to the generation of the operation plan, the generated operation plan by the physical asset.

Abstract: A system including at least three robots. Each robot including a proximity sensor unit and an imaging device. At least one robot including a processor to perform a method of estimating a pose of a human, the method including obtaining a first pose estimate for the human, the first pose estimate based on proximity sensor information, obtaining a second pose estimate for the human, the second pose estimate based on imaging device information, and generating a refined pose estimate for the human by fusing the first pose estimate with the second pose estimate, where the first pose information provides predictive values and the second pose estimate provides correction values. The method including applying a deep neural network (DNN) human model, and applying a DNN human pose model. A method to generate a refined pose estimation for a human and a non-transitory computer readable medium are also disclosed.

Abstract: A method and system, the method including receiving semantic descriptions of features of an asset extracted from a first set of images; receiving a model of the asset, the model constructed based on a second set of a plurality images of the asset; receiving, based on an optical flow-based motion estimation, an indication of a motion for the features in the first set of images; determining a set of candidate regions of interest for the asset; determining a region of interest in the first set of images; iteratively determining a matching of features in the set of candidate regions of interest and the determined region of interest in the first set of images to generate a record of matches in features between two images in the first set of images; and displaying a visualization of the matches in features between two images in the first set of images.

Abstract: An approach relates to manipulation of tools or instruments in the performance of a task by a robot. In accordance with this approach, sensor data is acquired and processed to identify a subset of instruments initially susceptible to manipulation. The instruments are then manipulated in the performance of the task based on the processed sensor data.

Abstract: A system for performing industrial tasks includes a robot and a computing device. The robot includes one or more sensors that collect data corresponding to the robot and an environment surrounding the robot. The computing device includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the collected data from the robot, generate a virtual recreation of the robot and the environment surrounding the robot, receive inputs from a human operator controlling the robot to demonstrate an industrial task. The system is configured to learn how to perform the industrial task based on the human operator's demonstration of the task, and perform, via the robot, the industrial task autonomously or semi-autonomously.

Abstract: A robotic body scanning system includes a robotic manipulator, a force sensor, a probe, a surface sensing system, and a computing device. The probe is attached to the robotic manipulator and configured to scan the portion of the human body. The surface sensing system is configured to detect a surface of the portion of the human body and generate data representing the portion of the human body. The computing device is configured to receive data representing the portion of the human body from said surface sensing system and generate two or three-dimensional representations of the portion of the human body. The computing device includes a trajectory generation module configured to generate an adapted trajectory for the probe to follow based on the two or three-dimensional representations. The robotic manipulator is configured to move the probe along the adapted trajectory along the portion of the human body.