Abstract: A robot including a resource sharing circuit, configured to operate according to a resource utilization limit, and comprising a processor, configured to receive resource data representing a resource utilization of the robot; if the resource utilization of the robot is within a predetermined range, operate according to a first operational mode, wherein an upper limit of the predetermined range is defined by a tolerance relative to the resource utilization limit; if the resource utilization of the robot is outside of the predetermined range, operate according to a second operational mode; wherein the first operational mode includes controlling a communication circuit to send a first wireless signal representing an availability to accept a task; and wherein the second operational mode includes controlling the communication circuit to send a second wireless signal representing an availability to allocate a task to an external device for remote processing.

Abstract: Various aspects of techniques, systems, and use cases include provide instructions for operating an autonomous mobile robot (AMR). A technique may include capturing audio or video data using a sensor of the AMR, performing a classification of the audio or video data using a trained classifier, and identifying a coordinate of an environmental map corresponding to a location of the audio or video data. The technique may include updating the environmental map to include the classification as metadata corresponding to the coordinate. The technique may include communicating the updated environmental map to an edge device.

Abstract: In one embodiment, a device comprises interface circuitry and processing circuitry. The processing circuitry receives, via the interface circuitry, a video stream captured by a camera during performance of an industrial process, wherein the video stream comprises a sequence of frames; detects, based on analyzing the sequence of frames, a degree of particle scatter that occurs during performance of the industrial process; and determines, based on the degree of particle scatter, that an anomaly occurs during performance of the industrial process.

Abstract: Example systems, apparatus, articles of manufacture, and methods to detect and locate objects in three-dimensional (3D) point clouds are disclosed. Examples apparatus disclosed herein apply at least one of a template or a mask at a sample point of an overhead view of a 3D point cloud to identify a candidate cluster of points in the 3D point cloud, the candidate cluster to satisfy an occupancy target. Disclosed example apparatus also input the candidate cluster to a neural network, the neural network trained to output a feature vector for the candidate cluster. Disclosed example apparatus further process the feature vector to output parameters associated with an object classification and a bounding box for an object corresponding to the candidate cluster.

Abstract: Technologies for performing sensor fusion include a compute device. The compute device includes circuitry configured to obtain detection data indicative of objects detected by each of multiple sensors of a host system. The detection data includes camera detection data indicative of a two or three dimensional image of detected objects and lidar detection data indicative of depths of detected objects. The circuitry is also configured to merge the detection data from the multiple sensors to define final bounding shapes for the objects.

Abstract: Spatial data may be divided along an axis of the second dimension into a first data segment and a second data segment, such that the first data segment is limited to data points of the spatial data with second dimension coordinates within a first range and the second data segment is limited to data points of the spatial data with second dimension coordinates within a second range. A first processing element may execute an object detection process on the first data segment to generate a first list of objects within the first data segment. A second processing element may execute the object detection process on the second data segment to generate a second list of objects within the second data segment. A first set of objects detected in the first data segment may be combined with a second set of objects detected in the second data segment.

Abstract: A device for a vehicle may include a first wireline interface configured to receive a first data stream from a first sensor having a first sensor type for perceiving a surrounding of the vehicle, the first data stream including raw sensor data detected by the first sensor; a second wireline interface configured to receive a second data stream from a second sensor having a second sensor type for perceiving the surrounding of the vehicle, the second data stream including raw sensor data detected by the second sensor; one or more processors configured to generate a coded packet including the received first data stream and the received second data stream by employing vector packet coding on the first data stream and the second data stream; and an output wireline interface configured to transmit the generated coded packet to one or more target units of the vehicle.

Abstract: Apparatus and method to facilitate automatic detection of a device state are disclosed herein. Selectively constraining a sensor based data set associated with one or more states of a device, wherein selectively constraining the sensor based data set includes analyzing a distribution of the sensor based data set to determine whether to constrain the sensor based data set, the sensor based data set including a first class and a second class of data values. Determining a threshold associated with the sensor based data set by selecting the threshold based on a variance between the first and second classes of the sensor based data set, wherein selecting the threshold includes using a constrained sensor based data set when the sensor based data set is determined to be constrained, and wherein the threshold indicates the data values associated with the first and second classes.

Abstract: An apparatus to facilitate learning reliable keypoints in situ with introspective self-supervision is disclosed. The apparatus includes one or more processors to provide a view-overlapped keyframe pair from a pose graph that is generated by a visual simultaneous localization and mapping (VSLAM) process executed by the one or more processors: determine a keypoint match from the view-overlapped key frame pair based on a keypoint detection and matching process, the keypoint match corresponding to a keypoint: calculate an inverse reliability score based on matched pixels corresponding to the keypoint match in the view-overlapped keyframe pair: identify a supervision signal associated with the keypoint match, the supervision signal comprising a keypoint reliability score of the keypoint based on a final pose output of the VSLAM process; and train a keypoint detection neural network using the keypoint match, the inverse reliability score, and the keypoint reliability score.

Abstract: A computer-implemented system, platform, device, and method of audio processing comprises receiving, by processor circuitry, a mixed audio signal having a plurality of audio sources, and separating the mixed audio signal into at least one separate target audio source signal; and determining whether or not the at least one separate target audio source signal is associated with at least one target audio source. This also comprises inputting at least one of the separate target audio source signals into a classifying neural network.

Abstract: Various systems and methods for implementing LiDAR-based object tracking described herein. An object tracking system for a vehicle includes an interface to communicate with object detection circuitry and an object similarity calculator circuitry, to obtain segmented data of an environment the object tracking system is operating within, the segmented data obtained using a light imaging detection and ranging (LiDAR) system, and the segmented data including a first plurality of segments detected in a first frame and a second plurality of segments detected in a second frame, the second frame captured after the first frame; determine, for a given segment of the first plurality of segments, a similar segment in the second plurality of segments; assign an VEHICLE object identification of the given segment to the similar segment; and track the similar segment from the first frame to the second frame based on the object identification.

Abstract: Technologies for performing sensor fusion include a compute device. The compute device includes circuitry configured to obtain detection data indicative of objects detected by each of multiple sensors of a host system. The detection data includes camera detection data indicative of a two or three dimensional image of detected objects and lidar detection data indicative of depths of detected objects. The circuitry is also configured to merge the detection data from the multiple sensors to define final bounding shapes for the objects.

Abstract: A method for motion tracking is provided including receive first data, receive second data, transform the second data to generate transformed second data corresponding to the first frame; determine a first weighting factor for the first data and a second weighting factor for the transformed second data; weight the first data using the first weighting factor to generate first weighted data; weight the transformed second data using the second weighting factor to generate second weighted data; and combine the weighted first data and the weighted second data to generate combined image data. The first data include a first frame of a first scene of an environment detected by a camera or image sensor. The second data include a second frame of a second scene of an environment detected by a light detection and ranging (LIDAR) sensor. At least a subset of the second scene corresponds to the first scene.

Abstract: Technologies for performing sensor fusion include a compute device. The compute device includes circuitry configured to obtain detection data indicative of objects detected by each of multiple sensors of a host system. The detection data includes camera detection data indicative of a two or three dimensional image of detected objects and lidar detection data indicative of depths of detected objects. The circuitry is also configured to merge the detection data from the multiple sensors to define final bounding shapes for the objects.

Abstract: Spatial data may be divided along an axis of the second dimension into a first data segment and a second data segment, such that the first data segment is limited to data points of the spatial data with second dimension coordinates within a first range and the second data segment is limited to data points of the spatial data with second dimension coordinates within a second range. A first processing element may execute an object detection process on the first data segment to generate a first list of objects within the first data segment. A second processing element may execute the object detection process on the second data segment to generate a second list of objects within the second data segment. A first set of objects detected in the first data segment may be combined with a second set of objects detected in the second data segment.

Abstract: Systems, apparatus, articles of manufacture, and methods are disclosed that direct transmission of data between network-connected devices including circuitry, instructions, and programmable circuitry to at least one of instantiate or execute the instructions to cause the interface circuitry to identify a neural network (NN) to a first device of a first combination of devices corresponding to a first network topology, cause the first device to process first data with a first portion of the NN, and cause a second device of a second combination of devices to process second data with a second portion of the NN, the second combination of devices corresponding to a second network topology.

Abstract: Various systems and methods for implementing LiDAR-based object detection and classification are described herein. An object detection system includes a feature extraction and object identification (FEOI) circuit to: receive segmented data of an environment around the object detection system, the segmented data obtained using a light imaging detection and ranging (LiDAR) system, oriented with respect to a direction of travel; compute spatial and structural parameters of a segment of the segmented data; and use the spatial and structural parameters with a machine learning model to obtain a classification of the segment.

Abstract: Embodiments of adaptive multi-modal event detection are disclosed herein. In one example, sensor data captured by multiple sensors is received, and an inconsistency among the sensors is detected based on performing event detection on the sensor data. An external environment of the sensors is detected based on the sensor data, and one or more configuration parameter(s) for event detection are adjusted based on the external environment of the sensors. Event detection is then performed on the sensor data based on the adjusted configuration parameter(s).

Abstract: Embodiments of localization and mapping using depth modeling are described herein. In one example, frames of image data captured by sensor(s) from various poses within an environment are received over an interface. Keypoints are detected in the current frame, and matching keypoints are found in preceding frames. The pose of the current frame is determined based at least partially on depth models associated with the matching keypoints.

Abstract: Methods, apparatus, systems and articles of manufacture to train a model using attestation data are disclosed. An example apparatus includes memory, instructions, and at least one processor to execute machine readable instructions to at least access training data originating from an edge device, the training data including telemetry information and attestation information, determine a weighting value to be used for the telemetry information based on the attestation information associated with the edge device, and train a machine learning model based on the telemetry information and the weighting value.