Abstract: This invention classifies an action that appears in a video clip by receiving a video clip for analysis, applying a convolutional neural network mechanism (CNN) to the frames in the clip to generate a 4D embedding tensor for each frame in the clip, applying a multi-resolution convolutional neural network mechanism (CNN) to each of the frames in the clip to generate a sequence of reduced resolution blocks, computing a kinematic attention weight that estimates the amount of motion in the block, applying the attention weights to the embedding tensors for each frame in a clip, to generate a weighted embedding tensor, or context, that represents all the frames in the clip, at the resolution, combining the contexts across all resolutions to generate a multi-resolution context, performing a 3D pooling to obtain a 1D feature vector and classifying a primary action of the video clip based on the feature vector.
Type:
Grant
Filed:
October 26, 2023
Date of Patent:
October 22, 2024
Assignee:
BEN GROUP, INC.
Inventors:
Schubert R. Carvalho, Tyler Folkman, Richard Ray Butler
Abstract: This invention predicts results for a media clip posted to a social media influencer channel by maintaining a database of results data for media clips where an influencer channel includes media clips that include unstructured data, and structured data, and then provide to a first machine learning model a first set of channel data, extracting a first set of features, predicting a value for the first target variable, providing to a second machine learning model a second set of channel data including a second selection of structured data, and the predicted value of the first target variable, extracting a second set of features, and predicting a value for the second target variable.
Type:
Grant
Filed:
November 1, 2023
Date of Patent:
September 10, 2024
Assignee:
BEN GROUP, INC.
Inventors:
Richard Ray Butler, Estelle Evonne Cramer, Tyler Folkman, Jacob Bradshaw Maughan, Alexander Charles McFadyen, Theodore Sheffield
Abstract: This invention classifies an action that appears in a video clip by receiving a video clip for analysis, applying a convolutional neural network mechanism (CNN) to the frames in the clip to generate a 4D embedding tensor for each frame in the clip, applying a multi-resolution convolutional neural network mechanism (CNN) to each of the frames in the clip to generate a sequence of reduced resolution blocks, computing a kinematic attention weight that estimates the amount of motion in the block, applying the attention weights to the embedding tensors for each frame in a clip, to generate a weighted embedding tensor, or context, that represents all the frames in the clip, at the resolution, combining the contexts across all resolutions to generate a multi-resolution context, performing a 3D pooling to obtain a 1D feature vector and classifying a primary action of the video clip based on the feature vector.
Type:
Grant
Filed:
November 16, 2021
Date of Patent:
December 12, 2023
Assignee:
BEN GROUP, INC.
Inventors:
Schubert R. Carvalho, Tyler Folkman, Richard Ray Butler
Abstract: This invention predicts results for a media clip posted to a social media influencer channel by maintaining a database of results data for media clips where an influencer channel includes media clips that include unstructured data, and structured data, and then provide to a first machine learning model a first set of channel data, extracting a first set of features, predicting a value for the first target variable, providing to a second machine learning model a second set of channel data including a second selection of structured data, and the predicted value of the first target variable, extracting a second set of features, and predicting a value for the second target variable.
Type:
Grant
Filed:
October 19, 2022
Date of Patent:
December 12, 2023
Assignee:
BEN GROUP, INC.
Inventors:
Richard Ray Butler, Estelle Evonne Cramer, Tyler Folkman, Jacob Bradshaw Maughan, Alexander Charles McFadyen, Theodore Sheffield