Abstract: A device may process the video data, with a first machine learning model, to identify a driver of a vehicle and may process the video data associated with the driver, with a second machine learning model, to detect behavior data identifying a behavior of the driver. The device may process the behavior data, with a third machine learning model, to determine distraction data identifying whether the behavior is classified as a distracted behavior. The device may process the behavior data, with a fourth machine learning model, to determine policy compliance data identifying whether the behavior satisfies one or more policies. The device may calculate a distraction score based on the distraction data and the video data, and may calculate a policy compliance score based on the policy compliance data and vehicle data. The device may perform one or more actions based on the distraction score and the policy compliance score.

Abstract: In some implementations, a device may determine a plurality of driving conditions associated with an image of a road scene based on providing a set of features associated with the image to a plurality of processing layers of a model. Each processing layer, of the plurality of processing layers, may determine, in parallel, a respective driving condition of the plurality of driving conditions and may comprise a plurality of sequential linear layers including a first sequential, linear layer comprising a first quantity of neurons corresponding to a quantity of features included in the set of features and computing resources of the device and a last sequential, linear layer comprising a second quantity of neurons that is based on a task associated with determining the respective driving condition. The device may perform one or more actions based on the plurality of driving conditions.

Abstract: A device may receive driver facing video data associated with a driver of a vehicle and forward facing video data associated with the vehicle, and may process the driver facing video data, with a face model, to identify driver head orientation and driver gaze. The device may generate a first transformation matrix mapping the driver facing video data, the driver head orientation, and the driver gaze, and may generate a second transformation matrix mapping the driver facing video data and the forward facing video data. The device may utilize the first transformation matrix and the second transformation matrix to estimate image coordinates, and may aggregate the image coordinates to generate aggregated coordinates. The device may generate heat maps based on the aggregated coordinates, may train machine learning model, with the heat maps, to generate a trained machine learning model, and may perform actions based on the trained machine learning model.

Abstract: In some implementations, a video system may capture, from a camera mounted to a vehicle, a video of a portion of a road on which the vehicle is traveling. The video system may detect, in the video, a driving lane associated with the road on which the vehicle is traveling. The video system may detect, in the video, multiple other vehicles within the driving lane. The video system may determine, for each of the multiple other vehicles within the driving lane, a bounding box that substantially surrounds an image of the other vehicle, resulting in a plurality of bounding boxes. The video system may determine a region in the video corresponding to an area to be driven by the vehicle based on the plurality of bounding boxes.

Abstract: A device may receive accelerometer data and video data for a vehicle and may identify bounding boxes and object classes for objects near the vehicle. The device may identify tracks for the objects and may filter out tracks that are not associated with vehicles or vulnerable road users to generate one or more tracks or an indication of no tracks. The device may generate a collision cone identifying a drivable area of the vehicle to identify objects more likely to be involved in a collision and may filter out tracks from the one or more tracks, based on the bounding boxes, and to generate a subset of tracks or another indication of no tracks. The device may determine scores for the subset of tracks and may identify a track of the subset of tracks with a highest score. The device may perform actions based on the identified track.

Abstract: A system may determine, for each frame of a plurality of frames of image data associated with a vehicle, a probability that each frame of the plurality of frames that includes an image of a stop sign is relevant to the vehicle. The system may determine a longest sequence of consecutive frames of the plurality of frames for which the probability satisfies a probability threshold. The system may determine a maximum probability associated with a frame included in the longest sequence of consecutive frames. The system may determine a time window based on a time associated with the frame associated with the maximum probability. The system may determine location data and sensor data for the vehicle based on the time window. The system may determine an occurrence of a stop sign violation based on the location data and the sensor data.

Abstract: In some implementations, an adverse environment detection system may receive an image of a road scene associated with a vehicle. The adverse environment detection system may determine a set of features associated with the image based on providing the image to an initial portion of a model. The adverse environment detection system may determine a first condition associated with the image based on providing the set of features to a first processing layer of the model, a second condition associated with the image based on providing the set of features to a second processing layer of the model, and a third condition associated with the image based on providing the set of features to a third processing layer of the model. The first processing layer, the second processing layer, and the third processing layer may process the set of features in parallel.

Abstract: A video summary device may determine, based on video data, a plurality of events that occurred during a period of time. The video summary device may determine first measures of relevance of a plurality of portions of the period of time. A first measure of relevance of a portion of time may be determined based on one or more events of the plurality of events. The video summary device may determine second measures of relevance of a plurality of ranges of time between different portions of time of the plurality of portions of the period of time. The second measures of relevance is determined based on the first measures of relevance determined for the different portions of time. The video summary device may determine particular frames of the video data, as a video summary of the video data, based on the second measures of relevance.

Abstract: In some implementations, a device may receive video data associated with video frames that depict an environment of a vehicle. The device may identify an object depicted in the video frames, wherein an object detection model indicates bounding boxes associated with the object. The device may determine, based on the bounding boxes, a configuration of the bounding boxes within the video frames. The device may determine, based on the configuration of the bounding boxes, that the object is a vulnerable road user (VRU) that is in the environment. The device may determine a trajectory of the VRU based on a change in the configuration between video frames of a set of the video frames. The device may determine, based on the trajectory, a probability of a collision between the VRU and the vehicle. The device may perform, based on the probability, an action associated with the vehicle.

Abstract: A device may receive a first image. The device may process the first image to identify an object in the first image and a location of the object within the first image. The device may extract a second image from the first image based on the location of the object within the first image. The device may process the second image to determine at least one of a coarse-grained viewpoint estimate or a fine-grained viewpoint estimate associated with the object. The device may determine an object viewpoint associated with the second vehicle based on the at least one of the coarse-grained viewpoint estimate or the fine-grained viewpoint estimate. The device may perform one or more actions based on the object viewpoint.

Abstract: A violation detection platform may obtain image data, location data, and sensor data associated with a vehicle. The violation detection platform may determine a probability that a frame of the image data includes an image of a stop sign. The violation detection platform may determine that the probability satisfies a probability threshold. The violation detection platform may identify location data and sensor data associated with the frame of the image data based on the probability satisfying the probability threshold. The violation detection platform may determine an occurrence of a type of a stop sign violation based on the probability, the location data, and the sensor data. The violation detection platform may perform one or more actions based on determining the occurrence of the type of the stop sign violation.

Abstract: A load planning platform may generate, according to one or more loading rules, a preliminary packing solution that simulates placing unpacked items, in a set of items, into a container. The load planning platform may generate a set of packing solutions by applying one or more available moves to the preliminary packing solution. The load planning platform may select a final packing solution from the set of packing solutions based on one or more optimization criteria associated with the container and the set of items. The load planning platform may provide access to a three-dimensional rendering of the final packing solution that differentiates each item in the set of items based on a sequence in which the set of items are to be unloaded from the container.

Abstract: A device may receive, from a first vehicle, video data for video captured of a location associated with an accident for a second vehicle, and may process the video data, with a first model, to generate a sparse point cloud of the location associated with the accident. The device may process the video data, with a second model, to generate depth maps for frames of the video data, and may utilize the depth maps with the sparse point cloud to generate a dense point cloud. The device may process the video data, with a third model, to generate a dense semantic point cloud, and may process the dense semantic point cloud, with a fourth model, to determine a dense semantic overhead view of the location associated with the accident. The device may perform actions based on the dense semantic overhead view.

Abstract: A device may receive sensor data and video data associated with a vehicle, and may process the sensor data, with a rule-based detector model, to determine whether a probability of a vehicle accident satisfies a first threshold. The device may preprocess acceleration data of the sensor data to generate calibrated acceleration data, and may process the calibrated acceleration data, with an anomaly detector model, to determine whether the calibrated acceleration data includes anomalies. The device may filter the sensor data to generate filtered sensor data, and may process the filtered sensor data and anomaly data, with a decision model, to determine whether the probability of the vehicle accident satisfies a second threshold. The device may process the filtered sensor data, the anomaly data, and the video data, with a machine learning model, to determine whether the vehicle accident has occurred, and may perform one or more actions.

Abstract: A device may receive a video and corresponding sensor information associated with a vehicle, and may extract feature vectors associated with the corresponding sensor information and an appearance and a geometry of another vehicle captured in the video. The device may generate a tensor based on the feature vectors, and may process the tensor, with a convolutional neural network model, to generate a modified tensor. The device may select a decoder model from a plurality of decoder models, and may process the modified tensor, with the decoder model, to generate a caption for the video based on attributes associated with the video. The device may perform one or more actions based on the caption for the video.

Abstract: A device may process the video data, with a first machine learning model, to identify a driver of a vehicle and may process the video data associated with the driver, with a second machine learning model, to detect behavior data identifying a behavior of the driver. The device may process the behavior data, with a third machine learning model, to determine distraction data identifying whether the behavior is classified as a distracted behavior. The device may process the behavior data, with a fourth machine learning model, to determine policy compliance data identifying whether the behavior satisfies one or more policies. The device may calculate a distraction score based on the distraction data and the video data, and may calculate a policy compliance score based on the policy compliance data and vehicle data. The device may perform one or more actions based on the distraction score and the policy compliance score.

Abstract: A device may receive accelerometer data and video data for a vehicle and may identify bounding boxes and object classes for objects near the vehicle. The device may identify tracks for the objects and may filter out tracks that are not associated with vehicles or vulnerable road users to generate one or more tracks or an indication of no tracks. The device may generate a collision cone identifying a drivable area of the vehicle to identify objects more likely to be involved in a collision and may filter out tracks from the one or more tracks, based on the bounding boxes, and to generate a subset of tracks or another indication of no tracks. The device may determine scores for the subset of tracks and may identify a track of the subset of tracks with a highest score. The device may perform actions based on the identified track.

Abstract: A maneuver classification platform may obtain video data and telematic data that are associated with a driving event involving a vehicle. The maneuver classification platform may analyze the video data to identify a path of the vehicle along a roadway during the driving event, and based on markings of a plurality of roadways. The maneuver classification platform may analyze the video data to determine a type of a vehicle maneuver performed by the vehicle during the driving event. The maneuver classification platform may determine a maneuver score of the driving event based on the type of the vehicle maneuver, the path of the vehicle, and the telematic data. The maneuver classification platform may send a message associated with the maneuver score and a vehicle identifier of the vehicle to a client device to permit the client device to use the maneuver score.

Abstract: A device may receive an image. The device may utilize an episodic memory to determine a first classification associated with the image. The device may utilize a semantic memory to determine a second classification associated with the image. The device may determine an accuracy associated with utilizing the semantic memory to determine the second classification. The device may determine that the image is associated with the first classification when the accuracy fails to satisfy a threshold accuracy. The device may determine that the image is associated with the second classification when the accuracy satisfies the threshold accuracy.

Abstract: A device may process the video data, with a first machine learning model, to identify a driver of a vehicle and may process the video data associated with the driver, with a second machine learning model, to detect behavior data identifying a behavior of the driver. The device may process the behavior data, with a third machine learning model, to determine distraction data identifying whether the behavior is classified as a distracted behavior. The device may process the behavior data, with a fourth machine learning model, to determine policy compliance data identifying whether the behavior satisfies one or more policies. The device may calculate a distraction score based on the distraction data and the video data, and may calculate a policy compliance score based on the policy compliance data and vehicle data. The device may perform one or more actions based on the distraction score and the policy compliance score.