Abstract: Methods and system for determining a similarity relationship between a plurality of digital assets and a target digital asset comprises creating a normalized semantic feature vector associated with a search query, discovering the target asset based on the normalized semantic feature vector, generating a normalized latent feature vector associated with the target asset, comparing the normalized semantic feature vector with semantic feature vectors for each of the digital assets to generate a semantic comparison value, comparing the normalized target latent feature vector with latent feature vectors for each of the digital assets to generate a latent comparison value, blending the semantic comparison vector value with the latent feature comparison vector value to create a target comparison value for each of the digital assets, and reporting the digital assets having the highest target comparison values to the user or group of users.

Abstract: Methods and system for presenting a user with multimedia digital content available to and having a high correlation of potential viewing interest to the user, comprises determining which multimedia assets are available to the user; ranking the available multimedia assets as a correlation between the user's interests and demographic information and metadata associated with each multimedia asset. Higher ranking and relevance of each respective multimedia asset is indicative of a higher likelihood of viewing interest to the user. The ranked and available multimedia assets are presented to the user on an interactive display screen, where the higher ranked multimedia assets are featured more prominently to the user on the interactive display screen. The user is then able to take further action with respect to each presented multimedia asset.

Abstract: The addition of relative term positions, temporal positions, and segment identifiers to an inverted index allows for temporal and phrase queries of multimedia assets. Segment identifiers enable any search results to be examined in context. The system makes advantageous use of Lucene's binary payload functionality to store temporal data and segment identifiers as additional binary data for each term instance in the inverted index. The payloads are made up of three variable-length integers, which account for twelve extra bytes of metadata, which are stored for each term instance. A content database on a Master/Administrator server node provides the indexes for search into content in response to user events, returning results in JSON format. The search results may then be used to locate and present content segments to a user containing both requested search term results and the time location within the multimedia asset in which the search term(s) is found.

Abstract: The present disclosure relates to systems and methods for classifying videos based on video content. For a given video file including a plurality of frames, a subset of frames is extracted for processing. Frames that are too dark, blurry, or otherwise poor classification candidates are discarded from the subset. Generally, material classification scores that describe type of material content likely included in each frame are calculated for the remaining frames in the subset. The material classification scores are used to generate material arrangement vectors that represent the spatial arrangement of material content in each frame. The material arrangement vectors are subsequently classified to generate a scene classification score vector for each frame. The scene classification results are averaged (or otherwise processed) across all frames in the subset to associate the video file with one or more predefined scene categories related to overall types of scene content of the video file.

Abstract: The present disclosure relates to systems and methods for identifying advertisement breaks in digital video files. Generally, an advertisement break identification module receives a digital video file and generates an edge response for each of one or more frames extracted from the video file. If one of the generated edge responses for a particular frame is less than a predefined threshold, then the module identifies the particular frame as the start of an advertisement break. The module then generates further edge responses for frames subsequent to the identified particular frame. Once an edge response is generated for a particular subsequent frame that is greater than the threshold, it is identified as the end of the advertisement break. The video file may then be manipulated or transformed, such as by associating metadata with the advertisement break for a variety of uses, removing the advertisement break from the video file, etc.

Abstract: Method, systems, and computer program products for synchronizing text with audio in a multimedia file, wherein the multimedia file is defined by a timeline having a start point and end point and respective points in time therebetween, wherein an N-gram analysis is used to compare each word of a closed-captioned text associated with the multimedia file with words generated by an automated speech recognition (ASR) analysis of the audio of the multimedia file to create an accurate, time-based metadata file in which each closed-captioned word is associated with a respective point on the timeline corresponding to the same point in time on the timeline in which the word is actually spoken in the audio and occurs within the video.

Abstract: A system for utilizing metadata created either at a central location for shared use by connected users, or at each individual user's location, to enhance user's enjoyment of available broadcast programming content. A variety of mechanisms are employed for automatically and manually identifying and designating programming segments, associating descriptive metadata which the identified segments, distributing the metadata for use at client locations, and using the supplied metadata to selectively record and playback desired programming.

Abstract: A system for replaying a broadcast sports event using a video on demand or personal video recording system. Metadata is created that subdivides the original broadcast into segments, and associates descriptive information with each segment. Playlists that specify an ordered subsequence of the sequence may be selected and used to present a variety of expanded or condensed versions of the sporting event to a viewer. Navigation controls including segment lists, specially formatted screen displays, and special functions under the control of a user-operated remote control, facilitate the interactive selection and control of the presentation.

Abstract: A system for creating user defined advertisements. The system comprises a computer readable storage medium. The medium comprises a digitized film/video; an attribute database comprising predetermined attributes. Each attribute correlates to at least one scene of the film/video. An advertisement database is provided comprising predetermined advertisements of the film/video. A publication database is provided comprising critiques of the film/video. The medium also comprises selection instructions for the user to select, for viewing, one of the digitized film/video, the selected scene, the predetermined advertisements or the critiques. A machine capable of reading the computer readable storage medium implements the instructions for viewing.

Abstract: The invention relates to systems and methods for providing video segments over a network. In one embodiment, metadata identifying a video segment is received from a first client device and transmitted to a second client device on a platform different than the first client device, via a network. In another embodiment, metadata identifies a key frame of a video file, which may be used to retrieve and/or playback a portion of the video file via the network. In another embodiment, metadata, generated at a plurality of client devices that are linked via the network, are indexed.

Abstract: Method, systems, and computer program products for synchronizing text with audio in a multimedia file, wherein the multimedia file is defined by a timeline having a start point and end point and respective points in time therebetween, wherein an N-gram analysis is used to compare each word of a closed-captioned text associated with the multimedia file with words generated by an automated speech recognition (ASR) analysis of the audio of the multimedia file to create an accurate, time-based metadata file in which each closed-captioned word is associated with a respective point on the timeline corresponding to the same point in time on the timeline in which the word is actually spoken in the audio and occurs within the video.

Abstract: Systems and methods are described for analyzing video content in conjunction with historical video consumption data, and identifying and generating relationships, rules, and correlations between the video content and viewer behavior. According to one aspect, a system receives video consumption data associated with one or more output states for one or more videos. The output states generally comprise tracked and recorded viewer behaviors during videos such as pausing, rewinding, fast-forwarding, clicking on an advertisement (for Internet videos), and other similar actions. Next, the system receives metadata associated with the content of one or more videos. The metadata is associated with video content such as actors, places, objects, dialogue, etc. The system then analyzes the received video consumption data and metadata via a multivariate analysis engine to generate an output analysis of the data.

Abstract: Methods and systems for indexing video files, the method comprising selecting and loading a video into a video editing program, segmenting the video into short clips and creating an edit decision list (EDL) containing information corresponding to the short clips, importing the video and EDL, parsing the EDL, and automatically populating a database with names of the short clips and corresponding EDL information, and cataloging the video by establishing specific identifiers associated with the video, transcribing audio from each of the short clips and associating the transcribed audio with the respective short clip, associating visual identifiers with each short clip, extracting metadata from each short clip and associating the metadata with the respective short clip, storing the transcribed audio, visual identifiers, and metadata in the database, and indexing the database according to the specific identifiers.

Abstract: The present disclosure relates to systems and methods for identifying advertisement breaks in digital video files. Generally, an advertisement break identification module receives a digital video file and generates an edge response for each of one or more frames extracted from the video file. If one of the generated edge responses for a particular frame is less than a predefined threshold, then the module identifies the particular frame as the start of an advertisement break. The module then generates further edge responses for frames subsequent to the identified particular frame. Once an edge response is generated for a particular subsequent frame that is greater than the threshold, it is identified as the end of the advertisement break. The video file may then be manipulated or transformed, such as by associating metadata with the advertisement break for a variety of uses, removing the advertisement break from the video file, etc.

Abstract: The present disclosure relates to systems and methods for dynamically creating hyperlinks associated with relevant multimedia content in a computer network. A hyperlink generation module receives an electronic text file from a server. The module searches the text file to identify keywords present in the file. Once the keywords have been identified, a database is queried to identify multimedia content that is related to the keywords. Generally, multimedia content is associated with metadata to enable efficient searching of the multimedia content. Typically, the multimedia content is contextually relevant to both the identified keywords and text file. One or more hyperlinks corresponding to the keywords are then generated and inserted into the text file. The hyperlinks provide pointers to the identified multimedia content. After insertion into the text file, the hyperlinks may be clicked by a user or viewer of the file to retrieve and display the identified multimedia content.

Abstract: The present disclosure relates to systems and methods for classifying videos based on video content. For a given video file including a plurality of frames, a subset of frames is extracted for processing. Frames that are too dark, blurry, or otherwise poor classification candidates are discarded from the subset. Generally, material classification scores that describe type of material content likely included in each frame are calculated for the remaining frames in the subset. The material classification scores are used to generate material arrangement vectors that represent the spatial arrangement of material content in each frame. The material arrangement vectors are subsequently classified to generate a scene classification score vector for each frame. The scene classification results are averaged (or otherwise processed) across all frames in the subset to associate the video file with one or more predefined scene categories related to overall types of scene content of the video file.

Abstract: The present disclosure relates to systems and methods for modeling, recognizing, and tracking object images in video files. In one embodiment, a video file, which includes a plurality of frames, is received. An image of an object is extracted from a particular frame in the video file, and a subsequent image is also extracted from a subsequent frame. A similarity value is then calculated between the extracted images from the particular frame and subsequent frame. If the calculated similarity value exceeds a predetermined similarity threshold, the extracted object images are assigned to an object group. The object group is used to generate an object model associated with images in the group, wherein the model is comprised of image features extracted from optimal object images in the object group. Optimal images from the group are also used for comparison to other object models for purposes of identifying images.

Abstract: A system for using metadata from a video signal to associate advertisements therewith, comprising (i) a segmentation system to divide the video signal into video clips, (ii) a digitizing system for digitizing the video clips, (iii) a feature extraction system for extracting audio and video features from each video clip, associating each audio feature with respective video clips, associating each video feature with respective video clips, and saving the audio and video features into an associated metadata file, (iv) a web interface to the feature extraction system for receiving the video clips, and (v) a database, wherein video signals and associated metadata files are stored and indexed, wherein the associated metadata file is provided when a video player requests the corresponding video signal, enabling selection of a relevant advertisement for presentment in conjunction with respective video clips based on the associated audio and video features of the respective video clip.

Abstract: Systems and methods are provided for generating unique signatures for digital video files to locate video sequences within a video file comprising calculating a frame signature for each frame of a first video; and for a second video: calculating a frame signature for each frame of the second video for corresponding first video frame signatures, calculating a frame distance between each of the corresponding video frame signatures, determining video signature similarity between the videos, and searching within a video signature similarity curve to determine a maximum corresponding to the first video within the second video. The method further applies area augmentation to the video signature similarity curve to determine a maximum from among a plurality of maxima corresponding to the first video file within the second video file.

Abstract: Methods and systems for indexing video files, the method comprising selecting and loading a video into a video editing program, segmenting the video into short clips and creating an edit decision list (EDL) containing information corresponding to the short clips, importing the video and EDL, parsing the EDL, and automatically populating a database with names of the short clips and corresponding EDL information, and cataloging the video by establishing specific identifiers associated with the video, transcribing audio from each of the short clips and associating the transcribed audio with the respective short clip, associating visual identifiers with each short clip, extracting metadata from each short clip and associating the metadata with the respective short clip, storing the transcribed audio, visual identifiers, and metadata in the database, and indexing the database according to the specific identifiers.