Abstract: Systems and methods for identifying a robot end effector in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the robot including the end effector. A processor may determine the identity of the end effector from the recorded image(s) and a library or database stored digital models.

Abstract: Systems and methods for continuously monitoring a workcell during operation of industrial machinery are disclosed. The system may comprise a safety system that includes at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell; a monitoring system for detecting a parameter value associated with the safety system; and a controller configured to determine a status of the safety system based at least in part on the detected parameter value and cause an alert to be issued if the status of the safety system does not satisfy a target objective.

Abstract: An integrated system and method for monitoring a workspace, classifying regions therein, dynamically identifying safe states, and identifying and tracking workpieces utilizes semantic analysis of a robot in the workspace and identification of the workpieces with which it interacts, as well as a semantic understanding of entity properties both governing and arising from interaction with other entities for control purposes. These properties may be stored in a profile corresponding to the entity; depending on the implementation, the profile and methods associated with the entity may be stored in a data structure corresponding to the entity “class.” Volumetric regions (e.g., voxels) corresponding to each entity may be tracked and used to implement object methods and/or control methods. For example, machinery may be controlled in accordance with the attributes specified by the objects corresponding to identified entities in a monitored workspace.

Abstract: Systems and methods monitor a workspace for safety purposes using sensors distributed about the workspace. The sensors are registered with respect to each other, and this registration is monitored over time. Occluded space as well as occupied space is identified, and this mapping is frequently updated. Based on the mapping, a constrained motion plan of machinery can be generated to ensure safety.

Abstract: Systems and methods for determining safe and unsafe zones in a workspace—where safe actions are calculated in real time based on all relevant objects (e.g., some observed by sensors and others computationally generated based on analysis of the sensed workspace) and on the current state of the machinery (e.g., a robot) in the workspace—may utilize a variety of workspace-monitoring approaches as well as dynamic modeling of the robot geometry. The future trajectory of the robot(s) and/or the human(s) may be forecast using, e.g., a model of human movement and other forms of control. Modeling and forecasting of the robot may, in some embodiments, make use of data provided by the robot controller that may or may not include safety guarantees.

Abstract: Crosstalk mitigation among cameras in neighboring monitored workcells is achieved by computationally defining a noninterference scheme that respects the independent monitoring and operation of each workcell. The scheme may involve communication between adjacent cells to adjudicate non-interfering camera operation or system-wide mapping of interference risks and mitigation thereof. Mitigation strategies can involve time-division and/or frequency-division multiplexing.

Abstract: Spatial regions potentially occupied by a robot (or other machinery) or portion thereof and a human operator during performance of all or a defined portion of a task or an application are computationally estimated. These “potential occupancy envelopes” (POEs) may be based on the states (e.g., the current and expected positions, velocities, accelerations, geometry and/or kinematics) of the robot and the human operator. Once the POEs of human operators in the workspace are established, they can be used to guide or revise motion planning for task execution.

Abstract: Control systems for industrial machinery (e.g., robots) or other devices such as medical devices utilize a safety processor (SP) designed for integration into safety applications and computational components that are not necessarily safety-rated. The SP monitors performance of the non-safety computational components, including latency checks and verification of identical outputs. One or more sensors send data to the non-safety computational components for sophisticated processing and analysis that the SP cannot not perform, but the results of this processing are sent to the SP, which then generates safety-rated signals to the machinery or device being controlled by the SP. As a result, the system may qualify for a safety rating despite the ability to perform complex operations beyond the scope of safety-rated components.

Abstract: Systems and methods for identifying a workpiece in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the workpiece at a location where a specified position and orientation thereof is required. A processor may determine, from the recorded image(s) and a stored digital model, whether the workpiece conforms to the specified position and orientation.

Abstract: Systems and methods monitor a workspace for safety purposes using sensors distributed about the workspace. The sensors are registered with respect to each other, and this registration is monitored over time. Occluded space as well as occupied space is identified, and this mapping is frequently updated. Based on the mapping, a constrained motion plan of machinery can be generated to ensure safety.

Abstract: Embodiments of the present invention provide automated robotic system identification and stopping time and distance estimation, significantly improving on existing ad-hoc methods of robotic system identification. Systems and methods in accordance herewith can be used by end users, system integrators, and the robot manufacturers to estimate the dynamic parameters of a robot on an application-by-application basis.

Abstract: Crosstalk mitigation among cameras in neighboring monitored workcells is achieved by computationally defining a noninterference scheme that respects the independent monitoring and operation of each workcell. The scheme may involve communication between adjacent cells to adjudicate non-interfering camera operation or system-wide mapping of interference risks and mitigation thereof. Mitigation strategies can involve time-division and/or frequency-division multiplexing.

Abstract: Systems and methods for optimizing factory scheduling, layout or both which represent active factory elements (human and machine) as computational objects and simulate factory operation to optimize a solution. This enables the efficient assembly of customized products, accommodates variable demand, and mitigates unplanned events (floor blockages, machines/IMRs/workcell/workers downtime, variable quantity, location, and destination of supply parts).

Abstract: Systems and methods for identifying a workpiece in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the workpiece at a location where a specified position and orientation thereof is required. A processor may determine, from the recorded image(s) and a stored digital model, whether the workpiece conforms to the specified position and orientation.

Abstract: Systems and methods for determining safe and unsafe zones in a workspace—where safe actions are calculated in real time based on all relevant objects (e.g., some observed by sensors and others computationally generated based on analysis of the sensed workspace) and on the current state of the machinery (e.g., a robot) in the workspace—may utilize a variety of workspace-monitoring approaches as well as dynamic modeling of the robot geometry. The future trajectory of the robot(s) and/or the human(s) may be forecast using, e.g., a model of human movement and other forms of control. Modeling and forecasting of the robot may, in some embodiments, make use of data provided by the robot controller that may or may not include safety guarantees.

Abstract: Safety systems in distributed factory workcells intercommunicate or communicate with a central controller so that when a person, robot or vehicle passes from one workcell or space into another on the same factory floor, the new workcell or space need not repeat the tasks of analysis and classification and can instead immediately integrate the new entrant into the existing workcell or space-monitoring schema. The workcell or space can also communicate attributes such as occlusions, unsafe areas, movement speed, and object trajectories, enabling rapid reaction by the monitoring system of the new workcell or space.

Abstract: Various embodiments for enforcing safe operation of machinery performing an activity in a three-dimensional (3D) workspace includes computationally generating a 3D spatial representation of the workspace; computationally mapping 3D regions of the workspace corresponding to space occupied by the machinery and a human; and based thereon, restricting operation of the machinery in accordance with a safety protocol during physical performance of the activity. Limited-access zones are defined within which the presence of a human will not affect operation of the machinery.

Abstract: Control systems for industrial machinery (e.g., robots) or other devices such as medical devices utilize a safety processor (SP) designed for integration into safety applications and computational components that are not necessarily safety-rated. The SP monitors performance of the non-safety computational components, including latency checks and verification of identical outputs. One or more sensors send data to the non-safety computational components for sophisticated processing and analysis that the SP cannot not perform, but the results of this processing are sent to the SP, which then generates safety-rated signals to the machinery or device being controlled by the SP. As a result, the system may qualify for a safety rating despite the ability to perform complex operations beyond the scope of safety-rated components.

Abstract: Various approaches to ensuring safe operation of industrial machinery in a workcell include disposing multiple image sensors proximate to the workcell and acquiring, with at least some of the image sensors, the first set of images of the workcell; registering the sensors to each other based at least in part on the first set of images and, based at least in part on the registration, converting the first set of images to a common reference frame of the sensors; determining a transformation matrix for transforming the common reference frame of the sensors to a global frame of the workcell; registering the sensors to the industrial machinery; acquiring the second set of images during operation of the industrial machinery; and monitoring the industrial machinery during operation thereof based at least in part on the acquired second plurality of images, transformation, and registration of the sensors to the industrial machinery.

Abstract: Systems and methods for determining safe and unsafe zones in a workspace—where safe actions are calculated in real time based on all relevant objects (e.g., some observed by sensors and others computationally generated based on analysis of the sensed workspace) and on the current state of the machinery (e.g., a robot) in the workspace—may utilize a variety of workspace-monitoring approaches as well as dynamic modeling of the robot geometry. The future trajectory of the robot(s) and/or the human(s) may be forecast using, e.g., a model of human movement and other forms of control. Modeling and forecasting of the robot may, in some embodiments, make use of data provided by the robot controller that may or may not include safety guarantees.