Abstract: Multimodal systems are provided for managing safety in an industrial environment. The system comprises: (a) a computer vision component for generating a first output data; (b) a real-time locating component for generating a second output data about an object within the industrial environment and a mobile tag device deployed to the object; (c) a LIDAR component for generating a third output data; and (d) an edge computing device connected to the computer vision component, the real-time locating component and the LIDAR component via a local network, and is configured to: (i) receive a data stream including the first output data, the second output data and the third output data, (ii) process the data stream using a machine learning algorithm trained model to generate a safety related result and feedback data, and (iii) deliver the feedback data to the object via the mobile tag device.

Abstract: Multimodal systems are provided for managing safety in an industrial environment. The system comprises: (a) a computer vision component for generating a first output data; (b) a real-time locating component for generating a second output data about an object within the industrial environment and a mobile tag device deployed to the object; (c) a LIDAR component for generating a third output data; and (d) an edge computing device connected to the computer vision component, the real-time locating component and the LIDAR component via a local network, and is configured to: (i) receive a data stream including the first output data, the second output data and the third output data, (ii) process the data stream using a machine learning algorithm trained model to generate a safety related result and feedback data, and (iii) deliver the feedback data to the object via the mobile tag device.

Abstract: An adaptive multimodal system is provided for managing safety in an industrial environment. The system comprises: a computer vision component for generating a computer vision output data; a real-time locating component for generating location data about an object within the industrial environment; a LIDAR component for generating 3D point cloud data of the industrial environment; and one or more processors coupled to the computer vision component, the real-time locating component and the LIDAR component and configured to: (i) obtain an identity of the object and the location data, and (ii) adjust, based at least in part on the identity and the location data, a pixel distribution for acquiring the 3D point cloud data, the process for generating the computer vision output data, or one or more parameters for acquiring an image data by the computer vision component.

Abstract: A multimodal system is provided for managing safety in an industrial environment. The system comprises: a computer vision component for generating a computer vision output data; a real-time locating component for generating location data about an object within the industrial environment; a LIDAR component for generating 3D point cloud data of the industrial environment; and one or more processors coupled to the computer vision component, the real-time locating component and the LIDAR component and configured to: (i) generate label data using the location data and identity about one or more objects generated by the real-time locating component, and (ii) update one or more predictive models utilized by the component vision component or the multimodal system using the label data.