Abstract: A method for ranking events in media collections includes designating a media collection, using a processor to cluster the media collection items into a hierarchical event structure, using the processor to identify and count visually similar sub-events within each event in the hierarchical event structure, using the processor to determine a ranking of events based on the count of sub-events within each event, and associating the determined ranking with each event in the media collection.

Abstract: A method for identifying a set of key video frames from a video sequence comprising extracting feature vectors for each video frame and applying a group sparsity algorithm to represent the feature vector for a particular video frame as a group sparse combination of the feature vectors for the other video frames. Weighting coefficients associated with the group sparse combination are analyzed to determine video frame clusters of temporally-contiguous, similar video frames. A set of key video frames are selected based on the determined video frame clusters.

Abstract: A method for determining an estimated clutter level of an input digital image based on an inequality index. The inequality index is determined by analyzing the input digital image to determine a set of image features. The image features are associated with a set of designated reference features, and the inequality index is determined based on the statistical variation of the reference features. A set of scene content features relating to spatial structures or semantic content of the input digital image is determined by analyzing the input digital image. The estimated clutter is determined responsive to the inequality index and the scene content features.

Abstract: A method for controlling a device responsive to an audio signal captured using an audio sensor. A data processor is used to automatically analyze the audio signal using a plurality of semantic concept detectors to determine corresponding preliminary semantic concept detection values, each semantic concept detector being adapted to detect a particular semantic concept. The preliminary semantic concept detection values are analyzed using a joint likelihood model based on predetermined pair-wise likelihoods that particular pairs of semantic concepts co-occur to determine updated semantic concept detection values. One or more semantic concepts are determined based on the updated semantic concept detection values, and the device is controlled responsive to identified semantic concepts. The semantic concept detectors and the joint likelihood model are trained together with a joint training process using training audio signals, at least some of which are known to be associated with a plurality of semantic concepts.

Abstract: A method for determining a semantic concept classification for a digital video clip, comprising: receiving an audio-visual dictionary including a plurality of audio-visual grouplets, the audio-visual grouplets including visual background and foreground codewords, audio background and foreground codewords, wherein the codewords in a particular audio-visual grouplet were determined to be correlated with each other; analyzing the digital video clip to determine a set of visual features and a set of audio features; determining similarity scores between the digital video clip and each of the audio-visual grouplets by comparing the set of visual features to any visual background and foreground codewords associated with a particular audio-visual grouplet, and comparing the set of audio features to any audio background and foreground codewords associated with the particular audio-visual grouplet; and determining one or more semantic concept classifications using trained semantic classifiers.

Abstract: A method of detecting recurring events in a digital image collection taken over a pre-determined period of time is disclosed. The method uses a processor for analyzing the digital image collection to produce a two-dimensional representation of the distribution of image capture activity over time and detecting recurring events by identifying spatial clusters in the two-dimensional representation.

Abstract: Computing a scale factor to insert a first set of shapes into a second set of shapes to form a combined image includes receiving the two sets of shapes, using a processor to convert the first set of shapes into a set of rectangles and the second set of shapes into a set of intervals and computing the scale factor for either the set of intervals or the set of rectangles to generate the combined image by iteratively inserting the set of rectangles into the set of intervals and updating the scale factor in response to a residual area or an overflow area until all the rectangles in the set of rectangles have been inserted into the set of intervals and the residual area in the set of intervals is below a threshold, and storing the combined image in memory.

Abstract: Generating a tag layout from a set of tags and an ordering of the set of tags, wherein each tag includes a text label and a size for the text label, is disclosed. The method further includes receiving at least one closed shape corresponding to a space for the tag layout. A processor computes a scale factor for at least one of the closed shape or the size of the text labels in the set of tags to generate the tag layout of the set of tags within the closed shape such that all the tags in the set of tags fit within the closed shape and the tags are placed in the space based at least upon the ordering of the tags in the set of tags.

Abstract: A method for associating event times or time periods with digital images in a collection for determining if a digital image is of interest, includes storing a collection of digital images each having an associated capture time; comparing the associated capture time in the collection with a special event time to determine if a digital image in the collection is of interest, wherein the comparing step includes calculation of a special event time associated with a special event based on the calendar time associated with the special event and using such information to perform the comparison step; and associating digital images of interest with the special event.

Abstract: A method for determining an estimated clutter level of an input digital image based on an inequality index. The inequality index is determined by partitioning the input digital image into small sub-images and analyzing the sub-images to determine a set of image features. The image features are associated with a set of designated reference features, and the inequality index is determined based on the statistical variation of the reference features. The inequality index is compared to a predefined threshold to classify the input digital image as a rich-content image or a low-content image. For rich-content images, the estimated clutter level is determined responsive to a set of scene content features relating to spatial structures or semantic content of the input digital image is determined by analyzing the input digital image. For low-content images, the estimated clutter level is determined responsive to an overall luminance level.

Abstract: A method for organizing an event timeline for a digital image collection, includes using a processor for detecting events in the digital image collection and each event's associated timespan; determining the detected events that are significant in the digital image collection; and organizing the event timeline so that the event timeline shows the significant events and a clustered representation of the other events, made available to the user at different time granularities. The organized event timeline is also used for selecting images for generating output.

Abstract: A method for organizing an event timeline for a digital image collection, includes using a processor for detecting events in the digital image collection and each event's associated timespan; determining the detected events that are significant in the digital image collection; and organizing the event timeline so that the event timeline shows the significant events and a clustered representation of the other events, made available to the user at different time granularities. The organized event timeline is also used for selecting images for generating output.

Abstract: A method for associating event times or time periods with digital images in a collection for determining if a digital image is of interest, includes storing a collection of digital images each having an associated capture time; comparing the associated capture time in the collection with a special event time to determine if a digital image in the collection is of interest, wherein the comparing step includes calculation of a special event time associated with a special event based on the calendar time associated with the special event and using such information to perform the comparison step; and associating digital images of interest with the special event.

Abstract: A method of identifying groups of related digital images in a digital image collection, comprising: analyzing each of the digital images to generate associated feature descriptors related to image content or image capture conditions; storing the feature descriptors associated with the digital images in a metadata database; automatically analyzing the metadata database to identify a plurality of frequent itemsets, wherein each of the frequent itemsets is a co-occurring feature descriptor group that occurs in at least a predefined fraction of the digital images; determining a probability of occurrence for each the identified frequent itemsets; determining a quality score for each of the identified frequent itemsets responsive to the determined probability of occurrence; ranking the frequent itemsets based at least on the determined quality scores; and identifying one or more groups of related digital images corresponding to one or more of the top ranked frequent itemsets.

Abstract: A method of detecting recurring events in a digital image collection taken over a pre-determined period of time is disclosed. The method uses a processor for analyzing the digital image collection to produce a two-dimensional representation of the distribution of image capture activity over time and detecting recurring events by identifying spatial clusters in the two-dimensional representation.

Abstract: A method for determining a semantic concept classification for a digital video clip, comprising: receiving an audio-visual dictionary including a plurality of audio-visual grouplets, the audio-visual grouplets including visual background and foreground codewords, audio background and foreground codewords, wherein the codewords in a particular audio-visual grouplet were determined to be correlated with each other; determining reference video codeword similarity scores for a set of reference video clips; determining codeword similarity scores for the digital video clip; determining a reference video similarity score for each reference video clip representing a similarity between the digital video clip and the reference video clip responsive to the audio-visual grouplets, the codeword similarity scores and the reference video codeword similarity scores; and determining one or more semantic concept classifications using trained semantic classifiers responsive to the determined reference video similarity scores.

Abstract: A method for determining an estimated clutter level of an input digital image based on an inequality index. The inequality index is determined by partitioning the input digital image into small sub-images and analyzing the sub-images to determine a set of image features. The image features are associated with a set of designated reference features, and the inequality index is determined based on the statistical variation of the reference features. The inequality index is compared to a predefined threshold to classify the input digital image as a rich-content image or a low-content image. For rich-content images, the estimated clutter level is determined responsive to a set of scene content features relating to spatial structures or semantic content of the input digital image is determined by analyzing the input digital image. For low-content images, the estimated clutter level is determined responsive to an overall luminance level.

Abstract: A method for determining an estimated clutter level of an input digital image based on an inequality index. The inequality index is determined by analyzing the input digital image to determine a set of image features. The image features are associated with a set of designated reference features, and the inequality index is determined based on the statistical variation of the reference features. A set of scene content features relating to spatial structures or semantic content of the input digital image is determined by analyzing the input digital image. The estimated clutter is determined responsive to the inequality index and the scene content features.

Abstract: A method of identifying one or more particular images from an image collection, includes indexing the image collection to provide image descriptors for each image in the image collection such that each image is described by one or more of the image descriptors; receiving a query from a user specifying at least one keyword for an image search; and using the keyword(s) to search a second collection of tagged images to identify co-occurrence keywords. The method further includes using the identified co-occurrence keywords to provide an expanded list of keywords; using the expanded list of keywords to search the image descriptors to identify a set of candidate images satisfying the keywords; grouping the set of candidate images according to at least one of the image descriptors, and selecting one or more representative images from each grouping; and displaying the representative images to the user.

Abstract: Generating a tag layout from a set of tags and an ordering of the set of tags, wherein each tag includes a text label and a size for the text label, is disclosed. The system includes a processor accessible memory for receiving an ordered set of tags, each tag including a text label and a size for the text label, and at least one closed shape corresponding to a space for the tag layout. The system further includes a processor for generating the tag layout by computing a scale factor for either the closed shape or the size of the text labels in the set of tags such that all the tags in the set of tags fit within the closed shape, and the processor stores the generated tag layout in the memory.