Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of records from a set of inputs, with each record containing an entity key, a partition key, and one or more attribute-value pairs. Next, the system sorts and indexes the records by the entity key for each partitioned input. The system then processes a query of the records by matching entity key values to the sorted and indexed records for each input partition in the query. Next, the system merges the subset of records with the same entity key values into records, with each merged record containing an entity key field and a single field that includes a list of attribute-value pairs from the subset. Finally, the system outputs the merged records in response to the query.

Abstract: A machine may be configured to generate an enhanced user interface for displaying social analytics based on viral mentions and threading. For example, the machine accesses a plurality of items of digital content. The machine extracts, for each of the plurality of items of digital content, a title that describes a particular item of digital content. The machine generates a group of items of digital content based on the extracted titles associated with the plurality of items of digital content. The machine identifies, from the group of items of digital content, an original item of digital content and one or more subsequent items of digital content. The machine determines a strength value associated with the original item of digital content. The machine generates and causes a display of an enhanced user interface that displays the title and the strength value associated with the original item of digital content.

Abstract: A machine may be configured to generate an enhanced user interface for displaying social analytics based on viral mentions and threading. For example, the machine accesses a plurality of items of digital content. The machine extracts, for each of the plurality of items of digital content, a title that describes a particular item of digital content. The machine generates a group of items of digital content based on the extracted titles associated with the plurality of items of digital content. The machine identifies, from the group of items of digital content, an original item of digital content and one or more subsequent items of digital content. The machine determines a strength value associated with the original item of digital content. The machine generates and causes a display of an enhanced user interface that displays the title and the strength value associated with the original item of digital content.

Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of features for use with one or more statistical models. Next, the system generates feature profiling data containing a set of statistics for the set of features. The system then outputs the feature profiling data for use in characterizing a distribution of the features. Furthermore, the system updates the outputted feature profiling data based on a granularity associated with the statistics. Finally, the system uses the statistics in the feature profiling data to perform anomaly detection and alerts users if unexpected feature distribution change is detected.

Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of features for use by a set of statistical models. Next, the system generates a schema that includes a logical description of data represented by the features and a physical description related to generating and storing the features. The system then outputs the schema for use in managing and sharing the features across the statistical models. Finally, the system updates the outputted schema to reflect one or more parameters from a user.

Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a first configuration for processing a first set of content items from a first data source and a second configuration for processing a second set of content items from a second data source. For each content item in the first set of content items, the system uses mappings from the first configuration to transform original fields from the content item into required fields in a record representing the content item. Next, the system generates, from the required fields, a document key for the content item. The system also performs deduplication of multiple records with the document key and stores a single record with the document key. Finally, the system uses the second configuration to generate, from the second set of content items, a set of records independently of processing the first set of content items.

Abstract: Methods, systems, and computer programs are presented for selecting a title for a post of a social network. A method includes operations for identifying a word weight for each word in a corpus based on the relevance of each word, receiving a document that includes several sentences, and assigning to each word in the sentences a tag indicative of a part of speech. Further, the method includes operations for calculating a topic weight for each sentence based on the tags of the words in the sentence, and for calculating a sentence weight for each sentence based on a sum of the word weights of the words in the sentence, the topic weight for the sentence, and a position weight of the sentence within a paragraph. The sentence with the highest sentence weight is selected as the title for the document, and the title is presented with the document to a user.

Abstract: Methods, systems, and computer programs are presented for selecting a title for a post of a social network. A method includes operations for identifying a word weight for each word in a corpus based on the relevance of each word, receiving a document that includes several sentences, and assigning to each word in the sentences a tag indicative of a part of speech. Further, the method includes operations for calculating a topic weight for each sentence based on the tags of the words in the sentence, and for calculating a sentence weight for each sentence based on a sum of the word weights of the words in the sentence, the topic weight for the sentence, and a position weight of the sentence within a paragraph. The sentence with the highest sentence weight is selected as the title for the document, and the title is presented with the document to a user.

Abstract: The disclosed embodiments provide a system for processing textual content. During operation, the system obtains a content item containing a set of text units. For each text unit in the set of text units, the system obtains a similarity score representing a similarity of the text unit to other text units in the content item and calculates a ranking score for the text unit from a combination comprising a text unit frequency for the text unit, the similarity score, and a position weight associated with a position of the text unit in the content item. The system then ranks the set of text units by the ranking score and uses the ranking to display a summary containing a subset of the text units in the content item.

Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of records from a set of inputs, with each record containing an entity key, a partition key, and one or more attribute-value pairs. Next, the system sorts and indexes the records by the entity key for each partitioned input. The system then processes a query of the records by matching entity key values to the sorted and indexed records for each input partition in the query. Next, the system merges the subset of records with the same entity key values into records, with each merged record containing an entity key field and a single field that includes a list of attribute-value pairs from the subset. Finally, the system outputs the merged records in response to the query.

Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a first configuration for processing a first set of content items from a first data source and a second configuration for processing a second set of content items from a second data source. For each content item in the first set of content items, the system uses mappings from the first configuration to transform original fields from the content item into required fields in a record representing the content item. Next, the system generates, from the required fields, a document key for the content item. The system also performs deduplication of multiple records with the document key and stores a single record with the document key. Finally, the system uses the second configuration to generate, from the second set of content items, a set of records independently of processing the first set of content items.

Abstract: The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of records from a set of inputs, with each record containing an entity key, a partition key, and one or more attribute-value pairs. For each attribute-value pair in the records, the system maps an attribute name in the attribute-value pair to a unique identifier for the attribute name and replaces the attribute name with the unique identifier. The system then identifies a subset of the records with a matching entity key and a matching partition key and merges the subset of the records into a single record that includes the matching entity key, the matching partition key, and a single field containing a list of attribute-value pairs from the subset of the records. Finally, the system provides the single record and the mapping for use in querying from a centralized source.