Abstract: A system includes a computing platform having processing hardware, and a systems memory storing a software code. The processing hardware is configured to execute the software code to receive content including an image having multiple image regions, determine boundaries of each of the image regions to identify multiple bounded image regions, identify, within each of the bounded image regions, one or more local features and one or more global features, and identify, within each of the hounded image regions, another one or more local features based on a comparison with corresponding local features identified in each of one or more other bounded image regions. The processing hardware is further configured to execute the software code to annotate each of the bounded image regions using its respective one or more local features, its other one or more local features, and its one or more global features, to provide annotated content.

Abstract: A system includes a computing platform having processing hardware, and a memory storing software code. The processing hardware is configured to execute the software code to receive an image having a plurality of image regions, determine a boundary of each of the image regions to identify a plurality of bounded image regions, and identify, within each of the bounded image regions, one or more image sub-regions to identify a plurality of image sub-regions. The processing hardware is further configured to execute the software code to identify, within each of the bounded image regions, one or more first features, respectively, identify, within each of the image sub-regions, one or more second features, respectively, and provided an annotated image by annotating each of the bounded image regions using the respective first features and annotating each of the image sub-regions using the respective second features.

Abstract: According to one implementation, a system includes a computing platform having processing hardware, and a system memory storing a software code. The processing hardware is configured to execute the software code to receive a vocabulary, identify words from the vocabulary for use in extending the vocabulary, pair each of those words with every other of those words to provide word pairs, and output the word pairs to a vocabulary administrator. The software code also receives word pair characterizations identifying each of the word pairs as one of similar, dissimilar, or neither similar nor dissimilar, configures, based on the word pair characterizations, a multi-dimensional vector space including multiple embedding vectors each corresponding respectively to one of the identified words, and cross-references each of those words with its corresponding embedding vector to produce an extended vocabulary corresponding to the received vocabulary.

Abstract: A system includes a computing platform having processing hardware, and a memory storing software code and a machine learning (ML) model-based feature classifier. When executed, the software code receives media content including a first media component corresponding to a first media mode and a second media component corresponding to a second media mode, encodes the first media component using a first encoder to generate multiple first embedding vectors, and encodes the second media component using a second encoder to generate multiple second embedding vectors. The software code further combines the first embedding vectors and the second embedding vectors to provide an input data structure for a neural network mixer, process, using the neural network mixer, the input data structure to provide feature data corresponding to a feature of the media content, and predict, using the ML model-based feature classifier and the feature data, a classification of the feature.

Abstract: According to one implementation, a system for automating inferential content annotation includes a computing platform having a hardware processor and a system memory storing a software code including a set of rules trained to annotate content inferentially. The hardware processor executes the software code to utilize one or more feature analyzer(s) to apply labels to features detected in the content, access one or more knowledge base(s) to validate at least one of the applied labels, and to obtain, from the knowledge base(s), descriptive data linked to the validated label(s). The software code then infers, using the set of rules, one or more label(s) for the content based on the validated label(s) and the descriptive data, and outputs tags for annotating the content, where the tags include the validated label(s) and the inferred label(s).

Abstract: A metadata aggregation system includes a computing platform having a hardware processor and a memory storing a software code including a trained entity matching predictive model trained using training data obtained from a reference database. The hardware processor executes the software code to obtain metadata inputs from multiple sources, conform the metadata inputs to a common format, match, using the trained entity matching predictive model, at least some of the conformed metadata inputs to the same entity, and determine, using the trained entity matching predictive model, a confidence score for each match. The software code further sends a request to one or more human editor(s) for confirmation of each match having a confidence score greater than a first threshold and less than a second threshold, and updates the reference database, in response to receiving a confirmation that at least one match is a confirmed match, to include the confirmed match.

Abstract: A metadata aggregation system includes a computing platform having a hardware processor and a memory storing a software code including a trained entity matching predictive model trained using training data obtained from a reference database. The hardware processor executes the software code to obtain metadata inputs from multiple sources, conform the metadata inputs to a common format, match, using the trained entity matching predictive model, at least some of the conformed metadata inputs to the same entity, and determine, using the trained entity matching predictive model, a confidence score for each match. The software code further sends a request to one or more human editor(s) for confirmation of each match having a confidence score greater than a first threshold and less than a second threshold, and updates the reference database, in response to receiving a confirmation that at least one match is a confirmed match, to include the confirmed match.