Abstract: A system is provided for selecting a foreground region of an image, given a set of pixels defining the boundary of the foreground region of the image. The system includes a component to determine a foreground value (F) and opacity value (?) for each pixel on the set wherein ?is determined via a subpixel edge-offset to facilitate a separation the foreground region from background portions of the image. The foreground value (F) and opacity value (?) are then employed to smoothly mix the foreground region of the image with a subsequent image background region.

Abstract: An instant messaging translation plug-in interacts with an instant messaging program to intercept incoming messages and forward these messages to a language translation service. The plug-in then displays a translation received from the service along with the original message. This provides translation which can be used by instant messaging users to communicate across language barriers, and without local translation or knowledge of the internal workings of the translation services used. Additionally, the translation plug-in also provides for manual translation of messages, which allows communication with users who use a different language but do not use the translation plug-in. Messages are modified before translation in order to correct spelling, to prevent particular words or phrases from being translated, and to change instant messaging language into standard language form.

Abstract: Disclosed herein are scheduling techniques for transmitting time-critical data in a cost-aware manner over a network comprising a plurality of heterogeneous transmission interfaces. The scheduling problem is formulated as a linear programming problem with the deliver-by deadlines of the various data blocks as hard constraints and minimizing cost set as an objective (soft) constraint. The problem is simplified by assuming data blocks with the earliest deadlines should be scheduled first and the most aggressive interfaces should be used first. To formulate the linear programming problem, the time domain is divided into bins and various bin-level schedules are enumerated for switching the transmission of the data over various transmission interfaces. The linear programming techniques are applied to the various bin configurations and the least costly of the resulting transmission schedule is selected for submission to a switching layer.

Abstract: A facility for semantics-guided non-photorealistic rendering is described. In various embodiments, the facility receives a set of objects that are to be rendered in a non-photorealistic manner. For each received object, the facility determines whether the object has an associated indication of a feature type and, when the object has an associated indication of a feature type, employs a transformation function corresponding to the indicated feature type to render the object in a non-photorealistic style provided by the transformation function.

Abstract: Users can send short message service (SMS) communication with the purpose of the communication being implied therein. An SMS broker described herein can derive the implied purpose by parsing the communication at least in part according to defined set of rules of syntax and in light of a current context within which the communication was received. In one aspect, the communication is brokered via the SMS broker and it may be intended as a message to be sent to another user identified by a moniker, such as their e-mail alias, which has the advantage of avoiding the need to store phone numbers on memory-constrained devices. In another aspect, the communication is a request for user data of other users also identified in the request by a simple moniker such as their e-mail alias. Additionally, a user can also send a communication intended to update their own user information such as their current location, availability and so on.

Abstract: The present invention includes a system and a method for automatically authoring video compositions from longer units of digitized video (or a source video) by using short segments of video (or video “cliplets”). The video composition authoring process provides an aesthetically-pleasing layout of data elements to create a video composition. The data elements include multimedia elements, parameter information and description information. Any data elements that are missing but required are automatically selected by the system. The user may then review preliminary video composition results and refine the results if desired. The video composition authoring system includes an element selection and layout module for selecting the data elements in the video composition, and an iterative refinement module that allows the user to change and refine the preliminary results.

Abstract: The present invention involves a new system and method for probabilistic exemplar-based tracking of patterns or objects. Tracking is accomplished by first extracting a set of exemplars from training data. The exemplars are then clustered using conventional statistical techniques. Such clustering techniques include k-medoids clustering which is based on a distance function for determining the distance or similarity between the exemplars. A dimensionality for each exemplar cluster is then estimated and used for generating a probabilistic likelihood function for each exemplar cluster. Any of a number of conventional tracking algorithms is then used in combination with the exemplars and the probabilistic likelihood functions for tracking patterns or objects in a sequence of images, or in a space, or frequency domain.

Abstract: A facility for cross-application encoding of geographical location information is described. In various embodiments, the facility receives a first document containing information relating to a geographical area, displays an image representing the geographical area, receives input from a user identifying at least a geographical location that is located in the geographical area, encodes a portion of the input to create an encoded link to the geographical location, and causes the link to be added to a second document such that when the link is selected, the first application displays the geographical area and identifies the identified geographical location. In various embodiments, the facility includes a correlating server that correlates geographical locations identified in documents of a first document type with documents containing mapping information.

Abstract: A device for connecting a phone to a television so that content available via the phone can be rendered on the television is provided. The phone-to-television device includes a telephone interface for receiving content from and sending commands to the connected phone and includes a television interface for transmitting the received content for rendering on the connected television. The phone-to-television device includes a converter for converting content received from the phone into a television format and includes a transmission component for transmitting the formatted content for display on the television. As the user interacts with the phone, the user can view on the television the content that is provided by the phone.

Abstract: The present invention is embodied in a system and method for maintaining a background model of an image sequence by processing on multiple spatial scales. These multiple spatial scales include a pixel scale, a regional scale and a frame scale. The image sequence undergoes pixel processing that determines a current background model and provides an initial pixel assignment as either a background or a foreground pixel. Region processing further refines the initial pixel assignments by considering relationships between pixels and possibly reassigning pixels. Frame processing further refines the current background model by determining whether a substantial change has occurred in the actual background and, if so, providing a more accurate background model.

Abstract: System and method for estimating and tracking an orientation of a user's face by combining head tracking and face detection techniques. The orientation of the face, or facial pose, can be expressed in terms of pitch, roll and yaw of the user's head. Facial pose information can be used, for example, to ascertain in which direction the user is looking. In general, the facial pose estimation method obtains a position of the head and a position of the face and compares the two to obtain the facial pose. In particular, a camera is used to obtain an image containing a user's head. Any movement of the user's head is tracked and the head position is determined. A face then is detected on the head and the face position is determined. The head and face positions then are compared.

Abstract: A system and process for creating an interactive digital image, which allows a viewer to interact with a displayed image so as to change it with regard to a desired effect, such as exposure, focus or color, among others. An interactive image includes representative images which depict a scene with some image parameter varying between them. The interactive image also includes an index image, whose pixels each identify the representative image that exhibits the desired effect related to the varied image parameter at a corresponding pixel location. For example, a pixel of the index image might identify the representative image having a correspondingly-located pixel that depicts a portion of the scene at the sharpest focus. One primary form of interaction involves selecting a pixel of a displayed image whereupon the representative image identified in the index image at a corresponding pixel location is displayed in lieu of the currently displayed image.

Abstract: The coordinates for laying out visual items in two-, three-, or n-dimensional space along an embedded one-manifold or path are calculated and coordinates are generated for placement of the items in a container. A one-manifold may be continuous, discontinuous, be contained entirely within a container or extent beyond a container. The one-manifold may be defined by a set of parameters defining a function, formula or set of points. The container may be a two-dimensional, three-dimensional, or n-dimensional container. Such a mechanism may be employed by a graphics application and may determine the location or positioning of an object or item. The object or item may be one of a set of objects or items. In response to receiving a set of parameters defining a one-manifold, the one-manifold may be embedded within a container.

Abstract: A system and method for maintaining a background model of an image sequence by processing on multiple spatial scales. These multiple spatial scales include a pixel scale, a regional scale and a frame scale. The image sequence undergoes pixel processing that determines a current background model and provides an initial pixel assignment as either a background or a foreground pixel. Region processing further refines the initial pixel assignments by considering relationships between pixels and possibly reassigning pixels. Frame processing further refines the current background model by determining whether a substantial change has occurred in the actual background and, if so, providing a more accurate background model.

Abstract: System and method for estimating and tracking an orientation of a user's face by combining head tracking and face detection techniques. The orientation of the face, or facial pose, can be expressed in terms of pitch, roll and yaw of the user's head. Facial pose information can be used, for example, to ascertain in which direction the user is looking. In general, the facial pose estimation method obtains a position of the head and a position of the face and compares the two to obtain the facial pose. In particular, a camera is used to obtain an image containing a user's head. Any movement of the user's head is tracked and the head position is determined. A face then is detected on the head and the face position is determined. The head and face positions then are compared.

Abstract: Techniques and tools for displaying/viewing HDR images are described. In one aspect, a background image constructed from HDR image information is displayed along with portions of the HDR image corresponding to one or more regions of interest. The portions have at least one display parameter (e.g., a tone mapping parameter) that differs from a corresponding display parameter for the background image. Regions of interest and display parameters can be determined by a user (e.g., via a GUI). In another aspect, an intermediate image is determined based on image data corresponding to one or more regions of interest of the HDR image. The intermediate image has a narrower dynamic range than the HDR image. The intermediate image or a derived image is then displayed. The techniques and tools can be used to compare, for example, different tone mappings, compression methods, or color spaces in the background and regions of interest.

Abstract: A system and method for providing a peer-to-peer photo-sharing environment. The system includes: manual and automatic photo annotation at the client; periodic client-server synchronization; an index of client photos on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the centralized index or photo database; and transmission of the relevant photos to the client via an on-line image cache. In one embodiment, one client's new photos are automatically displayed on another client's computer (e.g., via screen saver or another mechanism).

Abstract: A system and process for creating an interactive digital image, which allows a viewer to interact with a displayed image so as to change it with regard to a desired effect, such as exposure, focus or color, among others. An interactive image includes representative images which depict a scene with some image parameter varying between them. The interactive image also includes an index image, whose pixels each identify the representative image that exhibits the desired effect related to the varied image parameter at a corresponding pixel location. For example, a pixel of the index image might identify the representative image having a correspondingly-located pixel that depicts a portion of the scene at the sharpest focus. One primary form of interaction involves selecting a pixel of a displayed image whereupon the representative image identified in the index image at a corresponding pixel location is displayed in lieu of the currently displayed image.

Abstract: A system and method for providing a peer-to-peer photo-sharing environment. The system includes: manual and automatic photo annotation at the client; periodic client-server synchronization; an index of client photos on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the centralized index or photo database; and transmission of the relevant photos to the client via an on-line image cache. In one embodiment, one client's new photos are automatically displayed on another client's computer (e.g., via screen saver or another mechanism).

Abstract: The present invention includes in a system and method for estimating and tracking an orientation of a user's face by combining head tracking and face detection techniques. The orientation of the face, or facial pose, can be expressed in terms of pitch, roll and yaw of the user's head. Facial pose information can be used, for example, to ascertain in which direction the user is looking. In general, the facial pose estimation method obtains a position of the head and a position of the face and compares the two to obtain the facial pose. In particular, a camera is used to obtain an image containing a user's head. Any movement of the user's head is tracked and the head position is determined. A face then is detected on the head and the face position is determined. The head and face positions then are compared.