Abstract: A method for obtaining and automatically classifying images into events comprising the steps of: (a) obtaining a group of images from a digital source, wherein the images are in chronological order; (b) transferring the group of images to a computer system; said computer system (c) clustering the images into smaller groups based on chronological image similarity of nearby images by computing histograms of the images and comparing histogram intersection values obtained therefrom with one or more thresholds, whereby the clustering based on chronological image similarity is done in at least one stage by comparing each image with its direct neighboring images; and (d) evaluating the clustered images against a final condition related to at least one of a predetermined group maximum for the number of smaller groups and a predetermined maximum number of isolated pictures, whereby the smaller groups are classified as events if the final condition is met.

Abstract: A method for structuring video by probabilistic merging of video segments includes the steps of obtaining a plurality of frames of unstructured video; generating video segments from the unstructured video by detecting shot boundaries based on color dissimilarity between consecutive frames; extracting a feature set by processing pairs of segments for visual dissimilarity and their temporal relationship, thereby generating an inter-segment visual dissimilarity feature and an inter-segment temporal relationship feature; and merging video segments with a merging criterion that applies a probabilistic analysis to the feature set, thereby generating a merging sequence representing the video structure. The probabilistic analysis follows a Bayesian formulation and the merging sequence is represented in a hierarchical tree structure.

Abstract: A method for customizing a presentation of a set of digital images provided by a user is disclosed, comprising the steps of selecting an initial presentation format criteria for the set of digital images by the user; analyzing the digital images for additional information; providing to the user a first portable electronic storage medium having the set of digital images stored thereon, the images capable of being presented to the user on a display device in accordance with a first presentation format based upon the initial selected presentation format criteria and the analysis of the additional information; and providing a software program to the user enabling the user to select additional presentation format criteria.

Abstract: A transition in an MPEG sequence including anchor pictures and bidirectionally predicted (B) pictures is encoded by a) coding first and second anchor pictures and b) coding a transition in the sequence by inserting B pictures into the bitstream to create the transition from the first anchor picture to the second anchor picture.

Abstract: A method for automatically organizing digitized photographic images into events based on spoken annotations comprises the steps of: providing natural-language text based on spoken annotations corresponding to at least some of the photographic images; extracting predetermined information from the natural-language text that characterizes the annotations of the images; segmenting the images into events by examining each annotation for the presence of certain categories of information which are indicative of a boundary between events; and identifying each event by assembling the categories of information into event descriptions. The invention further comprises the step of summarizing each event by selecting and arranging the event descriptions in a suitable manner, such as in a photographic album.

Abstract: A method for simultaneously recording motion and still images, includes the steps of: capturing a motion image sequence and accompanying audio of a scene with a digital video camera adapted to record both motion and higher resolution still images; simultaneously capturing a still image sequence having a higher resolution and lower frame rate than the motion capture sequence; compressing the motion image sequence using interframe compression and the accompanying audio and storing the compressed motion image and audio data; and compressing the still images using intraframe coding and storing the compressed still image data.

Abstract: A method for classification of image regions by probabilistic merging of a class probability map and a cluster probability map includes the steps of a) extracting one or more features from an input image composed of image pixels; b) performing unsupervised learning based on the extracted features to obtain a cluster probability map of the image pixels; c) performing supervised learning based on the extracted features to obtain a class probability map of the image pixels; and d) combining the cluster probability map from unsupervised learning and the class probability map from supervised learning to generate a modified class probability map to determine the semantic class of the image regions. In one embodiment the extracted features include color and textual features.

Abstract: A method for organizing visual digital objects and for selecting one or more of such visual digital objects for viewing includes developing a histogram timeline which identifies a number of visual digital objects organized according to predetermined time periods and providing thumbnail representations thereof; selecting a portion of the histogram timeline for viewing such thumbnail representations of visual digital objects corresponding to such selected portion; and determining if one or more of the viewed such thumbnail representations is of interest and then viewing the corresponding digital visual object(s).

Abstract: A method of automated content-based grouping of digital images without using auxiliary metadata and training data set, comprises the steps of computing a color correlogram from image pixel values for each of the digital images, grouping the color correlograms into groups within a hierarchical structure based on relative similarities of the color correlograms, and assigning the images to the groups based on the hierarchical structure of the color correlograms.

Abstract: A method of storing a digital image file, includes the steps of: storing a header defined by a standard; storing image data encoded according to the standard after the header; and storing an image tail containing non-standard meta-data at the end of the image data.

Abstract: Duplicate images are detected by providing at least two images captured at determinable times; computing an indication of the image content for each image; determining the time of capture of each of the images; and evaluating the indication of image content and the time of capture to determine whether the images are duplicate images. The images are divided into blocks and the indication of image content is computed from a histogram for each block. Thereafter, the step of evaluating the indication of image content and the time of capture comprises comparing one or more blocks of one image, using a histogram intersection metric, to corresponding blocks of another image and using the time difference between capture of the two images to determine whether the images are duplicate images.

Abstract: A system for recording and displaying a multimedia presentation, includes a digital camera having a solid state image sensor for selectively generating a sampled analog video image signal or a higher resolution sampled analog still image signal, and a microphone for generating an analog audio signal. An analog to digital converter converts the sampled analog video image signals and audio signal to a digital image signal and digital audio signal and an audio visual encoder in the camera compresses the digital video signal and associated digital audio signal to form a compressed video bit stream. The camera is operated to periodically capture a higher resolution still image to form a still image file while capturing a video sequence. A pointer linking a captured high resolution still image with a corresponding frame in the compressed video bit stream is appended to the still image file.

Abstract: An event clustering method uses foreground and background segmentation for clustering images from a group into similar events. Initially, each image is divided into a plurality of blocks, thereby providing block-based images. Utilizing a block-by-block comparison, each block-based image is segmented into a plurality of regions comprising at least a foreground and a background. One or more luminosity, color, position or size features are extracted from the regions and the extracted features are utilized to estimate and compare the similarity of the regions comprising the foreground and background in successive images in the group. Then, a measure of the total similarity between successive images is computed, thereby providing image distance between successive images, and event clusters are delimited from the image distances.

Abstract: A method for automatically classifying images into events for composing and authoring of a multimedia image program on a recordable optical disc comprises the steps of: (a) receiving a plurality of images having either or both date and/or time of image capture; (b) determining one or more largest time differences of the plurality of images based on clustering of the images; (c) separating the plurality of images into events based on having one or more boundaries between events which one or more boundaries correspond to the one or more largest time differences; (d) specifying at least one multimedia feature that is related to each event; (e) encoding the images between event boundaries and the at least one multimedia feature associated therewith into an event bitstream; and (f) writing each event bitstream to the recordable optical disc, whereby each event is authored into a separate section of the recordable optical disc.

Abstract: A method for automatically organizing digitized photographic images into events based on spoken annotations comprises the steps of: providing natural-language text based on spoken annotations corresponding to at least some of the photographic images; extracting predetermined information from the natural-language text that characterizes the annotations of the images; segmenting the images into events by examining each annotation for the presence of certain categories of information which are indicative of a boundary between events; and identifying each event by assembling the categories of information into event descriptions. The invention further comprises the step of summarizing each event by selecting and arranging the event descriptions in a suitable manner, such as in a photographic album.

Abstract: Reference material in a digital graphics album is specified. Annotation data is extracted from the reference material and may be processed by a natural language processor to produce search keywords. In addition to the keywords, user directives may be provided, both of which are used to conduct a search for related graphical materials. The search is conducted by querying a graphical material database through a network connection. The search results are received and the user can select from the resultant materials for inclusion in the digital graphics album. If no satisfactory material is found, the user can specify a reference graphical image that is processed to produce search criteria that are image content descriptors. The database is again queried in accordance with these descriptors to provide search results for possible inclusion.

Abstract: A method for automatically organizing digitized photographic images into events based on spoken annotations comprises the steps of: providing natural-language text based on spoken annotations corresponding to at least some of the photographic images; extracting predetermined information from the natural-language text that characterizes the annotations of the images; segmenting the images into events by examining each annotation for the presence of certain categories of information which are indicative of a boundary between events; and identifying each event by assembling the categories of information into event descriptions. The invention further comprises the step of summarizing each event by selecting and arranging the event descriptions in a suitable manner, such as in a photographic album.

Abstract: A method for obtaining and automatically classifying images into events comprising the steps of: (a) obtaining a group of images from a digital source, wherein the images are in chronological order; (b) transferring the group of images to a computer system; said computer system (c) clustering the images into smaller groups based on chronological image similarity of nearby images by computing histograms of the images and comparing histogram intersection values obtained therefrom with one or more thresholds, whereby the clustering based on chronological image similarity is done in at least one stage by comparing each image with its direct neighboring images; and (d) evaluating the clustered images against a final condition related to at least one of a predetermined group maximum for the number of smaller groups and a predetermined maximum number of isolated pictures, whereby the smaller groups are classified as events if the final condition is met.

Abstract: A method for automatically classifying images into events for composing and authoring of a multimedia image program on a recordable optical disc comprises the steps of: (a) receiving a plurality of images having either or both date and/or time of image capture; (b) determining one or more largest time differences of the plurality of images based on clustering of the images; (c) separating the plurality of images into events based on having one or more boundaries between events which one or more boundaries correspond to the one or more largest time differences; (d) specifying at least one multimedia feature that is related to each event; (e) encoding the images between event boundaries and the at least one multimedia feature associated therewith into an event bitstream; and (f) writing each event bitstream to the recordable optical disc, whereby each event is authored into a separate section of the recordable optical disc.

Abstract: A method of generating a multimedia disc. The method includes the steps of: accessing a plurality of digital still images; generating a single MPEG bitstream comprising at least one of the plurality of digital still images; accessing the at least one of the plurality of digital still images; creating a description file defining a file structure comprising the MPEG bitstream and the at least one of the plurality of digital still images; interpreting the description file to generate a disc image of the multimedia disc; and generating the multimedia disc using the disc image.