Abstract: Systems, methods, and other techniques for genealogical entity resolution. The systems obtain first tree data and second tree data, the first tree data corresponding to a first tree person and the second tree data corresponding to a second tree person. The systems extract a set of features from the first tree data and the second tree data. The systems further generate an individual-level similarity score for each possible pairing of tree persons based on the set of features to identify a set of most-similar tree persons based on the individual-level similarity score for each possible pairing. The systems also provide a plurality of individual-level similarity scores for the set of most-similar tree persons as input to a family-level ML model to determine that the first tree person and the second tree person correspond to a same individual.

Abstract: This invention classifies an action that appears in a video clip by receiving a video clip for analysis, applying a convolutional neural network mechanism (CNN) to the frames in the clip to generate a 4D embedding tensor for each frame in the clip, applying a multi-resolution convolutional neural network mechanism (CNN) to each of the frames in the clip to generate a sequence of reduced resolution blocks, computing a kinematic attention weight that estimates the amount of motion in the block, applying the attention weights to the embedding tensors for each frame in a clip, to generate a weighted embedding tensor, or context, that represents all the frames in the clip, at the resolution, combining the contexts across all resolutions to generate a multi-resolution context, performing a 3D pooling to obtain a 1D feature vector and classifying a primary action of the video clip based on the feature vector.

Abstract: This invention predicts results for a media clip posted to a social media influencer channel by maintaining a database of results data for media clips where an influencer channel includes media clips that include unstructured data, and structured data, and then provide to a first machine learning model a first set of channel data, extracting a first set of features, predicting a value for the first target variable, providing to a second machine learning model a second set of channel data including a second selection of structured data, and the predicted value of the first target variable, extracting a second set of features, and predicting a value for the second target variable.

Abstract: Systems, methods, and other techniques for extracting data from obituaries are provided. In some embodiments, an obituary containing a plurality of words is received. Using a machine learning model, an entity tag from a set of entity tags may be assigned to each of one or more words of the plurality of words. Each particular tag from the set of entity tags may include a relationship component and a category component. The relationship component may indicate a relationship between a particular word and the deceased individual. The category component may indicate a categorization of the particular word to a particular category from a set of categories. The extracted data may be stored in a genealogical database.

Abstract: Systems and methods for training a machine learning (ML) ranking model to rank genealogy hints are described herein. One method includes retrieving a plurality of genealogy hints for a target person, where each of the plurality of genealogy hints corresponds to a genealogy item and has a hint type of a plurality of hint types. The method includes generating, for each of the plurality of genealogy hints, a feature vector having a plurality of feature values, the feature vector being included in a plurality of feature vectors. The method includes extending each of the plurality of feature vectors by at least one additional feature value based on the number of features of one or more other hint types of the plurality of hint types. The method includes training the ML ranking model using the extended plurality of feature vectors and user-provided labels.

Abstract: Systems, methods, and other techniques for extracting data from obituaries are provided. In some embodiments, an obituary containing a plurality of words is received. Using a machine learning model, an entity tag from a set of entity tags may be assigned to each of one or more words of the plurality of words. Each particular tag from the set of entity tags may include a relationship component and a category component. The relationship component may indicate a relationship between a particular word and the deceased individual. The category component may indicate a categorization of the particular word to a particular category from a set of categories. The extracted data may be stored in a genealogical database.

Abstract: Systems and methods for training a machine learning (ML) ranking model to rank genealogy hints are described herein. One method includes retrieving a plurality of genealogy hints for a target person, where each of the plurality of genealogy hints corresponds to a genealogy item and has a hint type of a plurality of hint types. The method includes generating, for each of the plurality of genealogy hints, a feature vector having a plurality of feature values, the feature vector being included in a plurality of feature vectors. The method includes extending each of the plurality of feature vectors by at least one additional feature value based on the number of features of one or more other hint types of the plurality of hint types. The method includes training the ML ranking model using the extended plurality of feature vectors and user-provided labels.

Abstract: Systems, methods, and other techniques for extracting data from obituaries are provided. In some embodiments, an obituary containing a plurality of words is received. Using a machine learning model, an entity tag from a set of entity tags may be assigned to each of one or more words of the plurality of words. Each particular tag from the set of entity tags may include a relationship component and a category component. The relationship component may indicate a relationship between a particular word and the deceased individual. The category component may indicate a categorization of the particular word to a particular category from a set of categories. The extracted data may be stored in a genealogical database.

Abstract: This invention predicts results for a media clip posted to a social media influencer channel by maintaining a database of results data for media clips where an influencer channel includes media clips that include unstructured data, and structured data, and then provide to a first machine learning model a first set of channel data, extracting a first set of features, predicting a value for the first target variable, providing to a second machine learning model a second set of channel data including a second selection of structured data, and the predicted value of the first target variable, extracting a second set of features, and predicting a value for the second target variable.

Abstract: Systems and methods for determining whether two tree persons in a genealogical database correspond to the same real-life individual. Embodiments include obtaining, from a tree database, a first tree person from a first genealogical tree and a second tree person from a second genealogical tree. Embodiments also include identifying a plurality of familial categories. Embodiments further include, for each familial category of the plurality of familial categories, extracting a first quantity of features for each of the tree persons in the familial category, generating a first similarity score for each possible pairing of tree persons, identifying a representative pairing based on a maximum first similarity score, and extracting a second quantity of features for each of the tree persons in the representative pairing. Embodiments may also include generating a second similarity score based on the second quantity of features.

Abstract: Systems and methods for determining whether two tree persons in a genealogical database correspond to the same real-life individual. Embodiments include obtaining, from a tree database, a first tree person from a first genealogical tree and a second tree person from a second genealogical tree. Embodiments also include identifying a plurality of familial categories. Embodiments further include, for each familial category of the plurality of familial categories, extracting a first quantity of features for each of the tree persons in the familial category, generating a first similarity score for each possible pairing of tree persons, identifying a representative pairing based on a maximum first similarity score, and extracting a second quantity of features for each of the tree persons in the representative pairing. Embodiments may also include generating a second similarity score based on the second quantity of features.

Abstract: This invention classifies actions performed within a video clip, by receiving a video clip for analysis, where the video clip comprises a time sequence of video frames, applies a bottleneck attention mechanism to the frames in the clip to generate a reduced sequence of key-frames, applies a 2 dimensional (2D) convolutional neural network to the sequence of keyframes to obtain a 3D embedding tensor for each keyframe, applies a multi-headed attention mechanism to the 3D embedding tensors to generate a final action context, and apples a classification mechanism to the final action context to obtain a probability for each action class that indicates the likelihood that an action specified by the action class occurred in the video clip.

Abstract: Systems, methods, and other techniques for genealogical entity resolution. In some embodiments, first tree data and second tree data are obtained, the first tree data corresponding to a first tree person and the second tree data corresponding to a second tree person. A set of features is extracted from the first tree data and the second tree data. An individual-level similarity score for each possible pairing of tree persons is generated based on the set of features. A set of most-similar tree persons is identified based on the individual-level similarity score for each possible pairing. A plurality of individual-level similarity scores for the set of most-similar tree persons are provided as input to a family-level ML model to determine that the first tree person and the second tree person correspond to a same individual.

Abstract: Systems, methods, and other techniques for extracting data from obituaries are provided. In some embodiments, an obituary containing a plurality of words is received. Using a machine learning model, an entity tag from a set of entity tags may be assigned to each of one or more words of the plurality of words. Each particular tag from the set of entity tags may include a relationship component and a category component. The relationship component may indicate a relationship between a particular word and the deceased individual. The category component may indicate a categorization of the particular word to a particular category from a set of categories. The extracted data may be stored in a genealogical database.

Abstract: Systems and methods for determining whether two tree persons in a genealogical database correspond to the same real-life individual. Embodiments include obtaining, from a tree database, a first tree person from a first genealogical tree and a second tree person from a second genealogical tree. Embodiments also include identifying a plurality of familial categories. Embodiments My further include, for each familial category of the plurality of familial categories, extracting a first quantity of features for each of the tree persons in the familial category, generating a first similarity score for each possible pairing of tree persons, identifying a representative pairing based on a maximum first similarity score, and extracting a second quantity of features for each of the tree persons in the representative pairing. Embodiments may also include generating a second similarity score based on the second quantity of features.

Abstract: Systems and methods for training a machine learning (ML) ranking model to rank genealogy hints are described herein. One method includes retrieving a plurality of genealogy hints for a target person, where each of the plurality of genealogy hints corresponds to a genealogy item and has a hint type of a plurality of hint types. The method includes generating, for each of the plurality of genealogy hints, a feature vector having a plurality of feature values, the feature vector being included in a plurality of feature vectors. The method includes extending each of the plurality of feature vectors by at least one additional feature value based on the number of features of one or more other hint types of the plurality of hint types. The method includes training the ML ranking model using the extended plurality of feature vectors and user-provided labels.