Abstract: A system and process for creating an interactive digital image, which allows a viewer to interact with a displayed image so as to change it with regard to a desired effect, such as exposure, focus or color, among others. An interactive image includes representative images which depict a scene with some image parameter varying between them. The interactive image also includes an index image, whose pixels each identify the representative image that exhibits the desired effect related to the varied image parameter at a corresponding pixel location. For example, a pixel of the index image might identify the representative image having a correspondingly-located pixel that depicts a portion of the scene at the sharpest focus. One primary form of interaction involves selecting a pixel of a displayed image whereupon the representative image identified in the index image at a corresponding pixel location is displayed in lieu of the currently displayed image.

Abstract: Techniques and tools for displaying/viewing HDR images are described. In one aspect, a background image constructed from HDR image information is displayed along with portions of the HDR image corresponding to one or more regions of interest. The portions have at least one display parameter (e.g., a tone mapping parameter) that differs from a corresponding display parameter for the background image. Regions of interest and display parameters can be determined by a user (e.g., via a GUI). In another aspect, an intermediate image is determined based on image data corresponding to one or more regions of interest of the HDR image. The intermediate image has a narrower dynamic range than the HDR image. The intermediate image or a derived image is then displayed. The techniques and tools can be used to compare, for example, different tone mappings, compression methods, or color spaces in the background and regions of interest.

Abstract: A system and process for creating an interactive digital image, which allows a viewer to interact with a displayed image so as to change it with regard to a desired effect, such as exposure, focus or color, among others. An interactive image includes representative images which depict a scene with some image parameter varying between them. The interactive image also includes an index image, whose pixels each identify the representative image that exhibits the desired effect related to the varied image parameter at a corresponding pixel location. For example, a pixel of the index image might identify the representative image having a correspondingly-located pixel that depicts a portion of the scene at the sharpest focus. One primary form of interaction involves selecting a pixel of a displayed image whereupon the representative image identified in the index image at a corresponding pixel location is displayed in lieu of the currently displayed image.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (?) for each pixel on the set wherein ? is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (?) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: A system and process for automatically learning a reliable color-based tracking system is presented. The tracking system is learned by using information produced by an initial object model in combination with an initial tracking function to probabilistically determine the configuration of one or more target objects in a temporal sequence of images, and a data acquisition function for gathering observations relating to color in each image. The observations gathered by the data acquisition function include information that is relevant to parameters desired for a final color-based object model. A learning function then uses probabilistic methods to determine conditional probabilistic relationships between the observations and probabilistic target configuration information to learn a color-based object model automatically tailored to specific target objects.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (a) for each pixel on the set wherein a is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (a) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: A system and method for combining the precision estimate of a database entry's coordinate value such that the precision information is included as part of the one-dimensional index. This is done by constructing a hierarchical index in which the size of the grid is related to the precision of the coordinate value. A grid index is a gridding of an n-dimensional space into a regular partition of the grid space into grid units, for which for a point in space, x, there is a function index (x), which retrieves a unique integer value for the grid that contains Point x, and a function coordinate(y, s), which returns a point associated with the index y at scale s. A hierarchical grid index is effectively a number of grid indices overlaid on the same space, with grid units of different sizes. In this case, each of the functions employs an additional argument that specifies the size of the grid unit to use.

Abstract: The invention is a user interface for browsing a database of media that is tagged by geographic location information including photos, videos, and panoramas. Interchangeable panels are used for determining query constraints and viewing query results, grid-aligned media dots indicate how many media should be associated with a location on a map, and a reflective UI shows how query constraints and query results are related through cursor interaction.

Abstract: Computerized aesthetic judgment of images is disclosed. In one embodiment, a computer-implemented method inputs a training set of images, where each image has a corresponding set of aesthetic scores. The method trains a classifier based on the training set, and outputs the classifier. An image can then be input into the classifier, such that an aesthetic score for the image is generated by the classifier and output. Furthermore, recommendations can be generated to improve the aesthetic score for the image, which are also output.

Abstract: The present invention is embodied in a system and method for automatically adjusting gaze and head pose in a videoconferencing environment, where each participant has a camera and display. The images of participants are rendered in a virtual 3D space. Head-pose orientation and eye-gaze direction are corrected so that a participant's image in the 3D space appears to appear to be looking at the person they are looking at on the screen. If a participant is looking at the viewer, their gaze is set toward the “camera”, which gives the perception of eye-contact.

Abstract: A system and method for identifying and/or annotating location for a desired event. This location annotation system and method presumes the existence of two components. The first is a location history (a record of a person, object, or other entity's location history, with locations of the person, object or entity time-stamped so that the record contains location information for a particular time or times). The second component is a set of one or more documents which are time-stamped. The time-stamp is typically meaningfully related to a critical event in the lifetime of the document (e.g., creation time, modification time, and so forth). A document can be any electronic entity, regardless of its permanence or the means by which it is stored.

Abstract: The present invention is embodied in a system and method for detecting a face within an image using a relational template over a geometric distribution of a non-intensity image property. In general, the system of the present invention includes a hypothesis module for defining a sub-region in which to search for a face, a feature extraction module for extracting image feature values image based on a non-intensity image property, an averaging module for grouping the extracted image feature values into geometrically distributed facial regions, and a relational template module that uses a relational template and facial regions to determine whether a face has been detected. In a preferred embodiment the image property used is edge density, although other suitable properties (such as pixel color) may also be used.

Abstract: An example-based filling system identifies appropriate filling material to replace a destination region in an image and fills the destination region using this material, thereby alleviating or minimizing the amount of manual editing required to fill a destination region in image. Tiles of image data are borrowed from the proximity of the destination region or some other source to generate new image data to fill in the region. Destination regions may be designated by user input (e.g., selection of an image region by a user) or by other means (e.g., specification of a color or feature to be replaced). In addition, the order in which the destination region is filled by example tiles may be configured to emphasize the continuity of linear structures and composite textures using a type of isophote-driven image-sampling process.

Abstract: A photo illumination technology that facilitates user selectable illumination of an existing photo ranging from full artificial flash illumination to ambient light illumination and every gradation between. The technology in one embodiment employs a digital camera feature that captures two photos hundredths of a second apart where one photo is captured in concert with a flash and one is captured with no flash. Compensations are made to reconcile any movement of the subject matter that may have occurred between the two photos and the user is presented with the infinite gradations of illumination on the subject matter when selecting a photo for display or printing.

Abstract: The present invention is embodied in a system and process for automatically learning a reliable tracking system. The tracking system is learned by using information produced by an initial object model in combination with an initial tracking function, and a data acquisition function for gathering observations about each image. The initial tracking function probabilistically determines the configuration of one or more target objects in a temporal sequence of images. The observations gathered by the data acquisition function include information that is relevant to parameters desired for a final object model. These relevant observations may include information such as the color, shape, or size of a tracked object, and depend on the parameters necessary to support the final tracking function.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (&agr;) for each pixel on the set wherein a is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (&agr;) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to dilate the pixel set and a component to determine a foreground value (F) and to determine an opacity value (a) based on estimated foreground and background values for each pixel of the dilated set to facilitate a separation of the region from background portions of the image.

Abstract: The present invention is embodied in a system and method for automatically estimating the orientation or pose of an object, such as a human head, from any viewpoint and includes training and pose estimation modules. The training module uses known head poses for generating observations of the different types of head poses and the pose estimation module receives actual head poses of a subject and uses the training observations to estimate the actual head pose. Namely, the training module receives training data and extracts unique features of the data, projects the features onto corresponding points of a model and determines a probability density function estimation for each model point to produce a trained model.

Abstract: A system and method for providing a peer-to-peer photo-sharing environment. The system includes: manual and automatic photo annotation at the client; periodic client-server synchronization; an index of client photos on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the centralized index or photo database; and transmission of the relevant photos to the client via an on-line image cache. In one embodiment, one client's new photos are automatically displayed on another client's computer (e.g., via screen saver or another mechanism).

Abstract: The present invention includes a computer user interface system and a method for displaying short segments of video each representing a single theme or event (called video cliplets or “cliplets”). The computer user interface displays the cliplets and information and properties of each of the cliplets. Through the computer user interface of the invention, a user can quickly and easily determine the contents and interesting portions of the video. The cliplet user interface method includes displaying a plurality of cliplets in a two-dimensional arrangement along with cliplet information. The cliplet user interface system includes a plurality of keyframe windows for displaying cliplets and a keyframe within each keyframe window representing a cliplet therein. Moreover, the cliplet user interface system includes a cliplet property presentation area for displaying a cliplet interest rating.