Abstract: A system includes sensors, memory, and a processor. The sensors are configured to capture images of a workspace, and the memory is configured to store the images and a model of machinery located within the workspace. The processor is configured to generate a spatial representation of the workspace based on the captured images. The processor is also configured to identify non-machinery entities within the workspace and, for each of the identified entities, generate an object that specifies a spatial extent of the respective entity and a protective separation distance for the entity. Further, the processor is configured to recognize an interaction between the entities and merge the corresponding objects into a merged object specifying a protective separation distance therefor. Moreover, the processor is configured to control operation of the machinery in accordance with a safety protocol and the protective separation distance for the merged object.

Abstract: This Application regards a system for continuously monitoring a workcell during operation of industrial machinery. The system includes a safety system, a monitoring system, and a controller. The safety system includes a sensor and supporting software or hardware for acquiring image data associated with the workcell. The monitoring system is for detecting a parameter value associated with the safety system. And the controller is configured to determine whether the image data is valid based at least in part on the detected parameter value, and cause an alert to be issued responsive to determining that the image data is invalid.

Abstract: Systems and methods for identifying a robot end effector in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the robot including the end effector. A processor may determine the identity of the end effector from the recorded image(s) and a library or database stored digital models.

Abstract: Systems and methods for continuously monitoring a workcell during operation of industrial machinery are disclosed. The system may comprise a safety system that includes at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell; a monitoring system for detecting a parameter value associated with the safety system; and a controller configured to determine a status of the safety system based at least in part on the detected parameter value and cause an alert to be issued if the status of the safety system does not satisfy a target objective.

Abstract: An integrated system and method for monitoring a workspace, classifying regions therein, dynamically identifying safe states, and identifying and tracking workpieces utilizes semantic analysis of a robot in the workspace and identification of the workpieces with which it interacts, as well as a semantic understanding of entity properties both governing and arising from interaction with other entities for control purposes. These properties may be stored in a profile corresponding to the entity; depending on the implementation, the profile and methods associated with the entity may be stored in a data structure corresponding to the entity “class.” Volumetric regions (e.g., voxels) corresponding to each entity may be tracked and used to implement object methods and/or control methods. For example, machinery may be controlled in accordance with the attributes specified by the objects corresponding to identified entities in a monitored workspace.

Abstract: Systems and methods for identifying a workpiece in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the workpiece at a location where a specified position and orientation thereof is required. A processor may determine, from the recorded image(s) and a stored digital model, whether the workpiece conforms to the specified position and orientation.

Abstract: A three-dimensional (3D) sensing apparatus together with a projector subassembly is provided. The 3D sensing apparatus includes two cameras, which may be configured to capture ultraviolet and/or near-infrared light. The 3D sensing apparatus may also contain an optical filter and one or more computing processors that signal a simultaneous capture using the two cameras and processing the captured images into depth. The projector subassembly of the 3D sensing apparatus includes a laser diode, one or optical elements, and a photodiode that are useable to enable 3D capture.

Abstract: Systems and methods for identifying a workpiece in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the workpiece at a location where a specified position and orientation thereof is required. A processor may determine, from the recorded image(s) and a stored digital model, whether the workpiece conforms to the specified position and orientation.

Abstract: Various approaches to ensuring safe operation of industrial machinery in a workcell include disposing multiple image sensors proximate to the workcell and acquiring, with at least some of the image sensors, the first set of images of the workcell; registering the sensors to each other based at least in part on the first set of images and, based at least in part on the registration, converting the first set of images to a common reference frame of the sensors; determining a transformation matrix for transforming the common reference frame of the sensors to a global frame of the workcell; registering the sensors to the industrial machinery; acquiring the second set of images during operation of the industrial machinery; and monitoring the industrial machinery during operation thereof based at least in part on the acquired second plurality of images, transformation, and registration of the sensors to the industrial machinery.

Abstract: Various embodiments for enforcing safe operation of machinery performing an activity in a three-dimensional (3D) workspace includes computationally generating a 3D spatial representation of the workspace; computationally mapping 3D regions of the workspace corresponding to space occupied by the machinery and a human; and based thereon, restricting operation of the machinery in accordance with a safety protocol during physical performance of the activity.

Abstract: A three-dimensional (3D) sensing apparatus together with a projector subassembly is provided. The 3D sensing apparatus includes two cameras, which may be configured to capture ultraviolet and/or near-infrared light. The 3D sensing apparatus may also contain an optical filter and one or more computing processors that signal a simultaneous capture using the two cameras and processing the captured images into depth. The projector subassembly of the 3D sensing apparatus includes a laser diode, one or optical elements, and a photodiode that are useable to enable 3D capture.

Abstract: An integrated system and method for monitoring a workspace, classifying regions therein, dynamically identifying safe states, and identifying and tracking workpieces utilizes semantic analysis of a robot in the workspace and identification of the workpieces with which it interacts, as well as a semantic understanding of entity properties both governing and arising from interaction with other entities for control purposes. These properties may be stored in a profile corresponding to the entity; depending on the implementation, the profile and methods associated with the entity may be stored in a data structure corresponding to the entity “class.” Volumetric regions (e.g., voxels) corresponding to each entity may be tracked and used to implement object methods and/or control methods. For example, machinery may be controlled in accordance with the attributes specified by the objects corresponding to identified entities in a monitored workspace.

Abstract: Systems and methods for continuously monitoring a workcell during operation of industrial machinery are disclosed. The system may comprise a safety system that includes at least one sensor and supporting software and/or hardware for acquiring image data associated with the workcell; a monitoring system for detecting a parameter value associated with the safety system; and a controller configured to determine a status of the safety system based at least in part on the detected parameter value and cause an alert to be issued if the status of the safety system does not satisfy a target objective.

Abstract: A three-dimensional (3D) sensing apparatus together with a projector subassembly is provided. The 3D sensing apparatus includes two cameras, which may be configured to capture ultraviolet and/or near-infrared light. The 3D sensing apparatus may also contain an optical filter and one or more computing processors that signal a simultaneous capture using the two cameras and processing the captured images into depth. The projector subassembly of the 3D sensing apparatus includes a laser diode, one or optical elements, and a photodiode that are useable to enable 3D capture.

Abstract: Various approaches to ensuring safe operation of industrial machinery in a workcell include disposing multiple image sensors proximate to the workcell and acquiring, with at least some of the image sensors, the first set of images of the workcell; registering the sensors to each other based at least in part on the first set of images and, based at least in part on the registration, converting the first set of images to a common reference frame of the sensors; determining a transformation matrix for transforming the common reference frame of the sensors to a global frame of the workcell; registering the sensors to the industrial machinery; acquiring the second set of images during operation of the industrial machinery; and monitoring the industrial machinery during operation thereof based at least in part on the acquired second plurality of images, transformation, and registration of the sensors to the industrial machinery.

Abstract: Various approaches to ensuring safe operation of industrial machinery in a workcell include disposing multiple image sensors proximate to the workcell and acquiring, with at least some of the image sensors, the first set of images of the workcell; registering the sensors to each other based at least in part on the first set of images and, based at least in part on the registration, converting the first set of images to a common reference frame of the sensors; determining a transformation matrix for transforming the common reference frame of the sensors to a global frame of the workcell; registering the sensors to the industrial machinery; acquiring the second set of images during operation of the industrial machinery; and monitoring the industrial machinery during operation thereof based at least in part on the acquired second plurality of images, transformation, and registration of the sensors to the industrial machinery.

Abstract: Systems and methods for identifying a workpiece in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the workpiece at a location where a specified position and orientation thereof is required. A processor may determine, from the recorded image(s) and a stored digital model, whether the workpiece conforms to the specified, position and orientation.

Abstract: Systems and methods for identifying a robot end effector in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the robot including the end effector. A processor may determine the identity of the end effector from the recorded image(s) and a library or database stored digital models.

Abstract: Various embodiments for enforcing safe operation of machinery performing an activity in a three-dimensional (3D) workspace includes computationally generating a 3D spatial representation of the workspace; computationally mapping 3D regions of the workspace corresponding to space occupied by the machinery and a human; and based thereon, restricting operation of the machinery in accordance with a safety protocol during physical performance of the activity.

Abstract: Various embodiments for enforcing safe operation of machinery performing an activity in a three-dimensional (3D) workspace includes computationally generating a 3D spatial representation of the workspace; computationally mapping 3D regions of the workspace corresponding to space occupied by the machinery and a human; and based thereon, restricting operation of the machinery in accordance with a safety protocol during physical performance of the activity.