Abstract: A method of producing a stereo image from a digital video includes receiving a digital video including a plurality of digital images captured by an image capture device; and using a processor to produce stereo suitability scores for at least two digital images from the plurality of digital images. The method further includes selecting a stereo candidate image based on the stereo suitability scores; producing a stereo image from the selected stereo candidate image wherein the stereo image includes the stereo candidate image and an associated stereo companion image based on the plurality of digital images from the digital video; and storing the stereo image whereby the stereo image can be presented for viewing by a user.

Abstract: A method for modifying an input digital image having input dimensions defined by a number of input rows and input columns to form an output digital image where the number of rows or columns is reduced by one, comprising an image energy map determined from the input image; determining a seam path responsive to the image energy map; imposing constraints on the seam path; and removing pixels along the seam path to modify the input digital image.

Abstract: A method for producing a blended video sequence that combines a still image and a video image sequence comprising: designating a first face in the still image, designating a second face in the video image sequence; detecting a series of video frames in the video image sequence containing the second face; identifying a video frame in the detected series of video frames suitable for transitioning from the first face into the second face; using a data processor to automatically produce a transition image sequence where the first face transitions into the second face, and a first background transitions into a second background; and producing the blended video sequence by concatenating the transition image sequence, and a plurality of video frames from the video image sequence starting from the identified video frame.

Abstract: A method for identifying a set of key frames from a video sequence including a time sequence of video frames, the method executed at least in part by a data processor, comprising: selecting a set of video frames from the video sequence; identifying a plurality of visually homogeneous regions from each of the selected video frames; defining a set of basis functions, wherein each basis function is associated with a different visually homogeneous region; determining a feature vector for each of the selected video frames; representing each of the determined feature vectors as a sparse combination of the basis functions; for each of the determined feature vectors, determining a sparse set of video frames that contain the visually homogeneous regions corresponding to the basis functions included in the corresponding sparse combination of the basis functions; and analyzing the sparse sets of video frames to identify the set of key frames.

Abstract: A method for resizing an input digital image to form an output digital image with an output aspect ratio, comprising: determining a number of rows or columns that need to be reduced from the input digital image; determining an image energy map for the input digital image; repeatedly determining a seam path responsive to the image energy map and removing pixels along the determined seam path to determine the output digital image, wherein the determined seam path satisfies a constraint that a directional image gradient is less than a gradient threshold for each pixel in the seam path, until either the determined number of rows or columns has been reduced or no valid seam path can be found; and cropping or scaling the output digital image to the output aspect ratio if the determined number of rows or columns was not reduced.

Abstract: A method for organizing individual collections of images or videos captured for the same event by different cameras into a master collection, wherein each individual collection forms a media stream in chronological order. A processor for extracting image features for each image or video of the media stream of each collection; constructing a graph based on the extracted features to link the images or videos from the two media streams; finding on the graph at least a pair of images or videos, each from one of the two media streams, that corresponds to correlated captured content; aligning the remaining images or videos in response to the aligned pair so that the all images or videos from the two media streams are aligned over a common timeline; and producing a master stream in chronological order of the event over a common timeline by merging the aligned individual.

Abstract: A method for organizing individual collections of images or videos captured for the same event by different cameras into a master collection, wherein each individual collection forms a media stream in chronological order, includes using a processor to provide the following steps: extracting image features for each image or video of the media stream of each individual collection; analyzing the extracted features to align the media streams to form a master stream in chronological order of the event over a common timeline; producing a master collection of images or videos of the event from the master stream by removing redundant images or videos; and storing, displaying or transmitting the master collection.

Abstract: A method for organizing and annotating individual collections of images or videos captured for the same event by different cameras into a master collection, wherein each individual collection forms a media stream in chronological order, includes using a processor to provide the following steps: extracting image features for each image or video of the media stream of each individual collection; analyzing the extracted features to align the media streams in chronological order of the event over a common timeline; transferring annotation from one individual collection to another individual collection based on alignment of the media streams; and storing, displaying or transmitting the transferred annotation.

Abstract: A method for determining a video summary from a video sequence including a time sequence of video frames, comprising: defining a global feature vector representing the entire video sequence; selecting a plurality of subsets of the video frames; extracting a frame feature vector for each video frame in the selected subsets of video frames; defining a set of basis functions, wherein each basis function is associated with the frame feature vectors for the video frames in a particular subset of video frames; using a data processor to automatically determine a sparse combination of the basis functions representing the global feature vector; determining a summary set of video frames responsive to the sparse combination of the basis functions; and forming the video summary responsive to the summary set of video frames.

Abstract: Video communication systems and methods for communicating between an individual in a local environment, and a remote viewer in a remote environment are provided. The system has an image display device; at least one image capture device which acquires video images for fields of view of a local environment, and any individuals therein; an audio system having an audio emission device and an audio capture device; a computer, which includes a contextual interface having a gaze adapting process, and image processor; and a communication controller which transmits and receives video images of the local environment and the remote environment, and data regarding video scene characteristics thereof across a network between the local environment and the remote environment; wherein the gaze adapting process identifies video scene characteristics of the local environment indicative of eye gaze image capture and altering the video images when the characteristics are indicative.

Abstract: A method for automatically producing a new digital image from a first digital image that includes regions of interest, includes obtaining a main subject belief map including an array of belief values indicating the location and relative importance of subject matter in the first digital image; producing a mask for each privileged object in the first digital image, each such mask including margins around its corresponding privileged object; overlaying the mask(s) onto the belief map; and producing a first convex hull that includes the mask(s) with margin(s) and regions of the highest belief values from the belief map.

Abstract: A method of recognizing the environment of an image from an image and position information associated with the image includes acquiring the image and its associated position information; using the position information to acquire an aerial image correlated to the position information; identifying the environment of the image from the acquired aerial image; and storing the environment of the image in association with the image for subsequent use.

Abstract: Classification of a group of temporally related images is disclosed, wherein a capture-location sequence is identified from the group of temporally related images. The capture-location-sequence information, which is associated collectively with the capture-location sequence, is compared with each of a plurality of sets of predetermined capture-location-sequence characteristics. Each set is associated with a predetermined classification. An identified classification associated with the group of temporally related images is identified based at least upon results from the comparing step; and the identified classification is stored in a processor-accessible memory system.

Abstract: In order to analyze a digital video clip to determine candidate frames for subsequent key frame selection, a camera motion sensor is provided in the camera so that information is provided during image capture regarding camera motion including translation of the scene or camera, or scaling of the scene. The sensor includes an accelerometer or a lens motor sensor. A plurality of video segments is formed based on the global motion estimate and each segment is labeled in accordance with a predetermined series of camera motion classes. Thereafter, key frame candidates are extracted from the labeled segments and a confidence score is computed for each candidate by using rules corresponding to each camera motion class and a rule corresponding to object motion.

Abstract: In a method and digital camera, an initial set of evaluation images are captured. A plurality of characteristics of the initial set of evaluation images are assessed to provide a first assessment. The characteristics include subject motion between the initial set of evaluation images. When the subject motion is in excess of a predetermined threshold, a final capture state of the camera is set responsive to the first assessment. When the subject motion is less than the predetermined threshold, the evaluation images are analyzed to provide analysis results and the final capture state of the camera is set responsive to the first assessment and the analysis results.

Abstract: A method of recommending social group(s) for sharing one or more user images, includes using a processor for acquiring the one or more user images and their associated metadata; acquiring one or more group images from the social group(s) and their associated metadata; computing visual features for the user images and the group images; and recommending social group(s) for the one of more user images using both the visual features and the metadata.

Abstract: A method of providing at least one recommended view to a user at a current geographic location that the user can use in composing images, comprising using a processor to provide the following steps using the geographic location of the user to obtain, from a database, images that were previously taken around the current geographic location; grouping the obtained images into clusters that correspond to distinct scenes; selecting a recommended view for each distinct scene using an image; and presenting the recommended view(s) to the user for consideration in composing images.

Abstract: A method for recommending places to visit, included using a processor to provide the following steps: assembling a collection of images, wherein each image has first and second tags with the first tag corresponding to the location where the image was taken, and the second tag corresponding to subject matter of the image; clustering the images in response to the first tags into a plurality of locations; using the images in each location to produce at least one representative image of the location; using the second tags of images of each location to produce a list of representative keywords for each location; providing a query in the form of an image or subject matter, or both; and using the query in the form of an image to search among the representative images to recommend a location to visit, or using the query in the form of subject matter to search among the keywords to recommend a location to visit.

Abstract: A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events includes: searching the photo collection to identify individuals in the photo collection, determining the gender and age range of the identified individuals; and using the identified individuals, their occurrences and co-occurrences, their gender, and their ages to infer social relationships between the individuals based on a set of rules.

Abstract: A method for resizing an input digital image to form an output digital image with an output aspect ratio, comprising: determining a number of rows or columns that need to be reduced from the input digital image; determining an image energy map for the input digital image; repeatedly determining a seam path responsive to the image energy map and removing pixels along the determined seam path to determine the output digital image, wherein the determined seam path satisfies a constraint that a directional image gradient is less than a gradient threshold for each pixel in the seam path, until either the determined number of rows or columns has been reduced or no valid seam path can be found; and cropping or scaling the output digital image to the output aspect ratio if the determined number of rows or columns was not reduced.