Abstract: A frequency of occurrence for each term in a training data set is determined in relation to the entire training data set. A relational data structure is generated that associates each term in the training data with its respective frequency. Any term that has a frequency below a threshold frequency is then added to a list of relevant words. When a natural language search query is received, a plurality of terms in the natural language search query are identified and compared with the list of relevant words. If any term of the natural language search query is included in the relevant words list, that term is identified as a keyword. The natural language search query is then interpreted based on any identified keywords.

Abstract: Insertion of supplemental content into a virtual environment is automated using a machine learning model. The machine learning model is trained to calculate a confidence value that a candidate virtual object fits into a virtual environment based on an input that includes a candidate virtual object, a list of persistent virtual objects, and a list of temporary virtual objects. The machine learning model is trained using the persistent and temporary objects displayed in the current virtual environment until it predicts that a selected virtual object fits into the current virtual environment. The trained machine learning model is then used to select a virtual object comprising supplemental content to be inserted as a new virtual object in the virtual environment.

Abstract: Systems and methods are disclosed for providing voice interactions based on user context. Data is received that causes a voice interaction to be generated for output at a user device. In response, current user contextual data of the user device is retrieved. A user availability level for consuming the voice interaction is determined based on the current user contextual data. The voice interaction is altered based on the user availability level. Content of the voice interaction may be altered to be suitable for consumption. The altered voice interaction is outputted at the user device.

Abstract: Systems and methods for determining hint words that improve the accuracy of automated speech recognition (ASR) systems. Hint words are determined in the context of a user issuing voice commands in connection with a voice interface system. Terms are initially taken from most frequently occurring terms in operation of a voice interface system. For example, most frequently occurring terms that arise in electronic search queries or received commands are selected. Certain of these terms are selected as hint words, and the selected hint words are then transmitted to an ASR system to assist in translation of speech to text.

Abstract: The system provides a synthesized speech response to a voice input, based on the prosodic character of the voice input. The system receives the voice input and calculates at least one prosodic metric of the voice input. The at least one prosodic metric can be associated with a word, phrase, grouping thereof, or the entire voice input. The system also determines a response to the voice input, which may include the sequence of words that form the response. The system generates the synthesized speech response, by determining prosodic characteristics based on the response, and on the prosodic character of the voice input. The system outputs the synthesized speech response, which includes a more natural, relevant, or both answer to the call of the voice input. The prosodic character of the voice input and/or response may include pitch, note, duration, prominence, timbre, rate, and rhythm, for example.

Abstract: Systems and methods for generating individualized content trailers. Content such as a video is divided into segments each representing a set of common features. With reference to a set of stored user preferences, certain segments are selected as aligning with the user's interests. Each selected segment may then be assigned a label corresponding to the plot portion or element to which it belongs. A coherent trailer may then be assembled from the selected segments, ordered according to their plot elements. This allows a user to see not only segments containing subject matter that aligns with their interests, but also a set of such segments arranged to give the user an idea of the plot, and a sense of drama, increasing the likelihood of engagement with the content.

Abstract: Systems and methods for a computer-based process that determines when a viewer is likely to skip over supplemental content and adjusts supplemental content presentation to compensate. Systems of embodiments of the disclosure may utilize various inputs to determine the likelihood of skipping supplemental content, including cursor position at or near specified icons or other UI elements, as well as user actions such as gaze direction, various motions or actions, controller manipulations, and the like. Once a likelihood of skipping supplemental content is determined, various actions may be taken in response, including without limitation selection of supplemental content that conveys its intended message prior to skipping, supplemental content that can be played at increased speed, and designation of supplemental content slots as skippable or non-skippable.

Abstract: A transcription of a query for content discovery is generated, and a context of the query is identified, as well as a first plurality of candidate entities to which the query refers. A search is performed based on the context of the query and the first plurality of candidate entities, and results are generated for output. A transcription of a second voice query is then generated, and it is determined whether the second transcription includes a trigger term indicating a corrective query. If so, the context of the first query is retrieved. A second term of the second query similar to a term of the first query is identified, and a second plurality of candidate entities to which the second term refers is determined. A second search is performed based on the second plurality of candidates and the context, and new search results are generated for output.

Abstract: Systems and methods are disclosed and described for correcting errors in ASR transcriptions. For an incorrect transcription, different words or phrases from the transcription, and/or related words or phrases, are submitted as hint words to the ASR system, and the voice query is submitted again, to determine new transcriptions. This process is repeated with different transcription terms, until a different and more proper transcription is generated. This increases the accuracy of ASR systems.

Abstract: Systems and methods for handling a query comprising a media quote are provided. One example method includes receiving, at a computing device, an input comprising a query. A media quote is identified based on the query. A media asset is identified based on the identified media quote. An action is performed at the computing device, the action based on the identified media asset.

Abstract: Systems and methods for paraphrasing communications are disclosed. A first communication input is received and a context of the first communication input is determined. Based on the context of the first communication input, a plurality of linguistic elements are selected and a plurality of paraphrasing pairs are identified, each pair having one of the plurality of linguistic elements and a paraphrasing candidate of the linguistic element. The paraphrasing candidate is based on an emotional state of a sender of the first communication input and at least one of the plurality of paraphrasing pairs are displayed to the sender for selection.

Abstract: Systems and methods for a computer-based process that determines when a viewer is likely to skip over supplemental content and adjusts supplemental content presentation to compensate. Systems of embodiments of the disclosure may utilize various inputs to determine the likelihood of skipping supplemental content, including cursor position at or near specified icons or other UI elements, as well as user actions such as gaze direction, various motions or actions, controller manipulations, and the like. Once a likelihood of skipping supplemental content is determined, various actions may be taken in response, including without limitation selection of supplemental content that conveys its intended message prior to skipping, supplemental content that can be played at increased speed, and designation of supplemental content slots as skippable or non-skippable.

Abstract: Systems and methods for handling multilingual queries are provided. One example method includes receiving, at a computing device, an input, wherein the input comprises a multi-lingual query comprising at least a first source language and a second source language. The multi-lingual query is translated, word for word, into a destination language to produce a monolingual query, with the word order of the multilingual query and the word order of the monolingual query being the same. The monolingual query is processed using natural language processing to map the mono-lingual query to a natural language query in the destination language.

Abstract: Systems and methods for a computer-based process that determines when a viewer is likely to skip over supplemental content and adjusts supplemental content presentation to compensate. Systems of embodiments of the disclosure may utilize various inputs to determine the likelihood of skipping supplemental content, including cursor position at or near specified icons or other UI elements, as well as user actions such as gaze direction, various motions or actions, controller manipulations, and the like. Once a likelihood of skipping supplemental content is determined, various actions may be taken in response, including without limitation selection of supplemental content that conveys its intended message prior to skipping, supplemental content that can be played at increased speed, and designation of supplemental content slots as skippable or non-skippable.

Abstract: Systems and methods are described for modifying a phonetic search index based on a use frequency associated with phonetic representations of text terms included in metadata of a media item. A first phonetic representation of a text term of the metadata, pronounced as a word, may be generated. A second phonetic representation of the text term may be generated by concatenating a phonetic representation of each letter in the text term. A database may be queried to determine use frequencies of the first and second phonetic representations, one of which may be selected based on a comparison of the use frequencies. A phonetic search index may be modified by including an entry for the selected phonetic representation. A voice query related to the media item may be received, and a reply to the voice query may be generated for output by performing a lookup in the modified phonetic search index.

Abstract: A computer-implemented method and an apparatus are provided for presenting an option to purchase an NFT based on a scene of a media asset to an advertiser. One example computer-implemented method includes obtaining, from a first source, a scene of a media asset, determining that the scene comprises a product, obtaining, from a second source, a non-fungible token (NFT) based on the scene, matching the NFT to an advertiser based on the product, and presenting an option to purchase the matched NFT to the advertiser.

Abstract: A frequency of occurrence for each term in a training data set is determined in relation to the entire training data set. A relational data structure is generated that associates each term in the training data with its respective frequency. Any term that has a frequency below a threshold frequency is then added to a list of relevant words. When a natural language search query is received, a plurality of terms in the natural language search query are identified and compared with the list of relevant words. If any term of the natural language search query is included in the relevant words list, that term is identified as a keyword. The natural language search query is then interpreted based on any identified keywords.

Abstract: Systems and methods are described to receive a query from a user and provide a reply that is appropriate for an age group of the user. A query for a media asset is received, where such query comprises an inputted term, and the query is determined to be received from a user belonging to a first age group. A context of the inputted term within the query is identified, and in response to the determining, based on the identified context, that the inputted term of the query is inappropriate for the first age group, a replacement term for the inputted term that is related to the inputted term and is appropriate for the first age group in the context of the query is identified. The query is modified to replace the inputted term with the identified replacement term, and a reply to the modified query is generated for output.

Abstract: Systems and methods for determining the answers to user queries regarding content, and presenting options for the user to view the answers. Searches are conducted to determine the answer to a query and, once the answer is found, various options are presented to the user, allowing the user the choice to view the answer in multiple different ways.

Abstract: A plurality of video clips comprising audio of a song are identified from a pool of videos. A portion of the song corresponding to the audio in each video clip is then determined. Using the determined portion, each video clip is mapped to a timeline of the song. A subset of video clips comprising different sections of the song are then selected. Video clips comprising audio from different sections of the song are selected to be included in the personalized video, which is then generated from the selected subset of video clips. The personalized video is then generated for display to the user.