Abstract: A method for controlling a robotic system includes determining a location and/or a pose of a power system component based on data received from one or more sensors, and determining a mapping of a location of a robotic system within a model of an external environment of the robotic system based on the data. The model of the external environment provides locations of objects external to the robotic system. A sequence of movements of components of the robotic system is determined to perform maintenance on the power system component based on the locations of the objects external to the robotic system and/or the location or pose of the power system component. One or more control signals are communicated to remotely control movement of the components of the robotic system based on the sequence or movements of the components to perform maintenance on the power system component.

Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.

Abstract: A fastener system and method includes a controller having one or more processors that obtain image information associated with a tie plate. The tie plate includes one or more holes, and each hole is configured to receive a fastener. A fastener driving unit drives the fastener into at least one of the one or more holes. The controller controls movement of the fastener driving unit to move the fastener driving unit to a location corresponding to the at least one hole, and the controller controls movement of the fastener driving unit to drive the fastener into the at least one hole.

Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

Abstract: In accordance with certain implementations of the present approach, a reduced, element-by-element, data set is transmitted between a robot having a sensor suite and a control system remote from the robot that is configured to display a representation of the environment local to the robot. Such a scheme may be useful in allowing a human operator remote from the robot to perform an inspection using the robot while the robot is on-site with an asset and the operator is off-site. In accordance with the present approach, an accurate representation of the environment in which the robot is situated is provided for the operator to interact with.

Abstract: A control system includes a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks, with the sub-tasks having one or more capability requirements. The task manager selects and assigns a first sequence of sub-tasks to a first robotic machine that has a first set of capabilities and operates according to a first mode of operation. The task manager selects and assigns a second sequence of sub-tasks to a second robotic machine that has a second set of capabilities and operates according to a second mode of operation. The task manager selects the first robotic machine based on the first set of capabilities and the first mode of operation of the first robotic machine, and selects the second robotic machine based on the second set of capabilities and the second mode of operation.

Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.

Abstract: The present approach relates to streaming data derived from inspection data acquired using one or more robots performing inspections of an asset or assets. Such inspections may be fully or partially automated, such as being controlled by one or more computer-based routines, and may be planned or dynamically altered in response to inputs or requirements associated with an end-user of the inspection data, such as a subscriber to the data in a publication/subscription distribution scheme. Thus, an inspection may be planned or altered based on the data needs or subscription levels of the user or customers.

Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.

Abstract: A system for performing industrial tasks includes a robot and a computing device. The robot includes one or more sensors that collect data corresponding to the robot and an environment surrounding the robot. The computing device includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the collected data from the robot, generate a virtual recreation of the robot and the environment surrounding the robot, receive inputs from a human operator controlling the robot to demonstrate an industrial task. The system is configured to learn how to perform the industrial task based on the human operator's demonstration of the task, and perform, via the robot, the industrial task autonomously or semi-autonomously.

Abstract: The present approach employs a context-aware simulation platform to facilitate control of a robot remote from an operator. Such a platform may use the prior domain/task knowledge along with the sensory feedback from the remote robot to infer context and may use inferred context to dynamically change one or both of simulation parameters and a robot-environment-task state being simulated. In some implementations, the simulator instances make forward predictions of their state based on task and robot constraints. In accordance with this approach, an operator may therefore issue a general command or instruction to a robot and based on this generalized guidance, the actions taken by the robot may be simulated, and the corresponding results visually presented to the operator prior to evaluate prior to the action being taken.

Abstract: An asset inspection system includes a robot and a server. The robot collects inspection data corresponding to an asset. The server, includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the inspection data from the robot, display the inspection data via the user-interface, receive feedback on the inspection data via the user interface, generate a human-assisted inspection based on the received feedback, analyze the inspection data via a trained model, generate an automated inspection based on the analysis by the trained model, combine the automated inspection and the human-assisted inspection to generate an inspection report, and transmit the inspection report for review.

Abstract: An asset inspection system includes a robot and a server. The server receives a request for data from the robot, wherein the requested data comprises an algorithm, locates the requested data in a database stored on the server, encrypts the requested data, and transmits the requested data to the robot. The robot is configured to collect inspection data corresponding to an asset based at least in part on the requested data and transmit the collected inspection data to the server.

Abstract: Modifying a motion plan for an autonomously-operated inspection platform (AIP) includes obtaining sensor data for an industrial asset area of interest, analyzing the obtained sensor data during execution of an initial motion plan to determine if modification of the initial motion plan is required. If modification is required then performing a pose estimation on a first group of potential targets and a second group of potential targets, optimizing the results of the pose estimation to determine a modification to the initial motion plan, performing reactive planning to the initial motion plan to include the modification, the reactive planning providing a modified motion plan that includes a series of waypoints defining a modified path, and autonomously controlling motion of the AIP along the modified path. The analysis, pose estimation, optimization, and reactive planning occurring during movement of the AIP along a motion plan. A system and computer-readable medium are disclosed.

Abstract: Systems and methods are provided for an automation system. The systems and methods calculate a motion trajectory of a manipulator and an end-effector. The end-effector is configured to grasp a target object. The motion trajectory defines successive positions of the manipulator and the end-effector along a plurality of via-points toward the target object. The systems and methods further acquire force/torque (F/T) data from an F/T sensor associated with the end-effector, and adjusts the motion trajectory based on the F/T data.

Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

Abstract: A robotic system is provided that includes a base, an articulable arm, a visual acquisition unit, and a controller. The articulable arm may extend from a base and is movable toward a target. The visual acquisition unit can be mounted to the arm or the base and to acquire image data. The controller is operably coupled to the arm and the visual acquisition unit, and can derive from the image data environmental information corresponding to at least one of the arm or the target. The controller further can generate at least one planning scheme using the environmental information to translate the arm toward the target, select at least one planning scheme for implementation, and control movement of the arm toward the target using the at least one selected planning scheme.