Abstract: Systems and methods directed to utilizing a first camera system to capture first images of one or more people in proximity to a tabletop; utilizing a second camera system to capture second images of one or more documents in proximity to the tabletop; generating a query for a database derived from people recognition conducted on the first images and text extraction on the second images; determining a first ranked list of people and a second ranked list of documents based on results of the query, the results based on a calculated ranked list of two-mode networks; and providing an interface on a display to access information about one or more people from the first ranked list of people and one or more documents from the second ranked list of documents.

Abstract: A method and system for visualizing data associated with a search inquiry. The method includes receiving, a data set each data item having associated rank information, and similarity information indicative of similarities between the data item and one or more other data items, sorting the data set into a ranked list based on the rank information, masking a contiguous portion of the ranked list based on a boundary parameter, iteratively clustering a portion of the ranked list other than the masked contiguous portion based op the similarity information to produce a clustered, ranked data list; and generating and displaying a visualization representative of the clustered, ranked data list, the visualization comprising a shaped object representative of each cluster in the clustered, ranked data list.

Abstract: A method and system of associating textual summaries with data representative of media content is provided. The method may include receiving a plurality of textual summaries, each textual summary representative of an event, pairing, by a neural network, each received textual summary with each of a plurality of pieces of data, each piece of data representative of media content, to generate a plurality of text-data pairings; and associating a first selected textual summary with a first piece of data based on a similarity of content features extracted from each received textual summary to content features extracted from each piece of data in each of the plurality of text-data pairings.

Abstract: A method and system for determining a treatment order for a plurality of patient imaging records. The method includes extracting, by a trained neural network, image features from each of the plurality of imaging records, generating, by the trained neural network, a written report associated with each of the plurality of imaging records based on the extracted image features, wherein the trained neural network generates the written report based on a sentence annotation model that provides abnormality annotations on an individual sentence basis, determining, by the trained neural network, an abnormality score associated with each written report, and providing the written reports to a treating physician in a sorted order based on the abnormality score associated with each written report.

Abstract: A method and system for generating summaries of posts of interleaved text are provided. The method includes embedding, by a first neural network, each post through word-to-word encoding; embedding, by a second neural network, overall content of the plurality of posts through post-to-post encoding based on the word-to-word encoding of each post; generating, by at least a third neural network, a summary of the at least one thread through word-to-word decoding based on the overall content embedding of the plurality of posts; and displaying the summary of the at least one thread to a user.

Abstract: Systems and methods to analyze a person's social media photos or videos, such as those posted on Twitter, Facebook, Instagram, etc. and determine properties of their social life. Using information on the number of people appearing in the photos or videos, their ages, and genders, this method can predict whether the person is in a romantic relationship, has a close family, is a group person, or is single. This information is valuable for generating audiovisual content recommendations as well as for advertisers, because it allows targeting personalized advertisements to the person posting the photos. The described methods may be performed (and the advertisements or other content may be selected for recommendation) substantially in real-time as the user accesses a specific online resource.

Abstract: A method and system for training a user comprising detecting, by a neural network, a relationship pair comprising a question previously answered by the user and the score for the previously answered question, detecting context information associated with the question previously answered, the context information representing conditions occurring at the time the user previously answered the question, determining a probability that the user will successfully answer a subsequent question selected from potential questions based on the detected relationship pair and the detected context information associated with the question previously answered by the user; and selecting questions to be answered by the user based on the determined probability.

Abstract: Example implementations described herein involve an interface for calculating and displaying missing links for data represented as a bipartite network, along with novel methods for improving link prediction algorithms in the related art. Through example implementations described herein, the accuracy of link prediction algorithms can be improved upon, thereby providing the user with a more accurate understanding of the data in the bipartite network.

Abstract: A method and system for creating a visual representation of data is provided. The method may include receiving a user input to be represented by a glyph, generating, by a neural network, the glyph based on a vector extracted based on the received user input, linking an aspect of the generated glyph with an attribute of the data to be visually represented; and displaying the visual representation of the data created using the generated glyph to represent that linked aspect of the data.

Abstract: A method of generating a summary of a media file that comprises a plurality of media segments is provided. The method includes calculating, by a neural network, respective importance scores for each of the media segments, based on content features associated with each of the media segments and a targeting approach, selecting a media segment from the media segments, based on the calculated importance scores, generating a caption for the selected media segment based on the content features associated with the selected media segment, and generating a summary of the media file based on the caption.

Abstract: For tourists, interactions with digital public displays often depend on specific technologies that users may not be familiar with (Quick Response codes, near field communication, and so on) may not have access to because of networking issues, may lack a required application or device technology, may not want to use because of time constraints, or may not want to use because they are worried about sharing their data with a third-party service. Example implementations described herein are directed to a system that allows users to seamlessly share content with a public travel kiosk system.

Abstract: A method and system of generating titles for documents in a storage platform are provided. The method includes receiving a plurality of documents, each document having associated content features, applying a title generation computer model to each of the plurality of documents to generate a title based on the associated content features, appending the generated title to each of the plurality of documents, wherein the title generation computer model is created by training a neural network using a combination of a first set of unlabeled data from a first domain related to content features of the plurality of documents; and a second set of pre-labeled data from a second domain different from the first domain.

Abstract: A method of visualizing relationship data is illustrated. The method includes receiving relationship data comprising a first type of entities, a second type of entities, and data representative of relationships between an entity of the first type and an entity of the second type, generating, based on the data representative of relationships, a bicluster connecting the entity of the first type to the entity of the second type, and generating a visualization based on the bicluster generated, wherein the visualization includes a first column representative of the first type of entities, and a second column representative of the second type of entities, wherein each row of the visualization corresponds to the generated bicluster.

Abstract: A method of generating a caption for a social media post is provided. The method may include receiving a social media post to be posted to a social media network; collecting reference data relevant to determining common activities occurring at a category of location associated with the social media post; inferring potential topics for captions from a topic inference model, based on the collected reference data associated with the social media post; setting parameters associated with a language model based on the inferred topic; and generating at least one caption for the social media post based on the identified language model, and the inferred topic.

Abstract: A method and system for creating a visual representation of data is provided. The method may include receiving a user input to be represented by a glyph, generating, by a neural network, the glyph based on a vector extracted based on the received user input, linking an aspect of the generated glyph with an attribute of the data to be visually represented; and displaying the visual representation of the data created using the generated glyph to represent that linked aspect of the data.

Abstract: Systems and methods directed to utilizing a first camera system to capture first images of one or more people in proximity to a tabletop; utilizing a second camera system to capture second images of one or more documents in proximity to the tabletop; generating a query for a database derived from people recognition conducted on the first images and text extraction on the second images; determining a first ranked list of people and a second ranked list of documents based on results of the query, the results based on a calculated ranked list of two-mode networks; and providing an interface on a display to access information about one or more people from the first ranked list of people and one or more documents from the second ranked list of documents.

Abstract: Example implementations include a system and method of recognizing behavior of a user. In example implementations, a first post and at least one subsequent post indicative of a product and associated with a first social media account is obtained. A relevance probability is calculated for each of the obtained first post and the at least one subsequent post. The obtained first post and the at least one subsequent post are sequentially analyzed by a second neural network to determine output values relevant to probability of purchasing the product. A probability of purchasing the product is calculated based on the determined output values associated with each post and the calculated relevance probabilities. Product-related information is transmitted to the user associated with the obtained first post based on the determined probability of purchasing the product.

Abstract: A computer implemented method of grouping media objects is provided, as well as systems, interfaces and devices therefor. The method includes generating a group from the media objects based on a combination of a script of sequential events and an actor associated with one or more of the media objects in the script, segmenting the group into segments each including one or more of the media objects, based on clustering or classification, providing titling and captioning for the segments, and generating filter and annotation recommendations based on knowledge associations in the media objects, data, and the combination of the script and the actor, across the media objects of the group.

Abstract: A method and system of associating textual summaries with data representative of media content is provided. The method may include receiving a plurality of textual summaries, each textual summary representative of an event, pairing, by a neural network, each received textual summary with each of a plurality of pieces of data, each piece of data representative of media content, to generate a plurality of text-data pairings; and associating a first selected textual summary with a first piece of data based on a similarity of content features extracted from each received textual summary to content features extracted from each piece of data in each of the plurality of text-data pairings.

Abstract: A method for inferring venues from social messages includes: accessing a collection of venues and training a classifier that predicts whether a social message is linked to a venue in the collection of venues; receiving a new social message; for each venue in the collection of venues: identifying for the new social message corresponding meta-paths to the particular venue; encoding the corresponding meta-paths as a feature vector for the trained classifier; computing by the trained classifier a score for each venue in the collection of venues indicating whether the new social message is linked to the venue; and based on the scores, identifying at least one candidate venue as a predicted venue for the new social message and associating the predicted venue with the new social message. In some implementations, the new social message is not geotagged.