Abstract: A real-time low frame-rate video compression system and method that allows the user to perform face-to-face communication through an extremely low bandwidth network. At the encoder side, the system is able to automatically select only a few good faces from the original sequence with high visual quality and compress and transmit them. At the decoder side, the system use image-morphing based rendering method to generate a normal frame-rate video. Experimental results show that the system is superior to more traditional video codecs for low bit-rate face-to-face communication.

Abstract: The present invention provides for a performing a type of gamut operation for a color device given a color input value, the color device being characterized by a gamut boundary comprising a collection of gamut boundary triangles. Boundary line elements are determined that correspond to a subset of the collection of gamut boundary triangles. The subset of the collection of gamut boundary triangles does not include gamut boundary triangles which are unlikely to yield useful results based on the type of gamut operation and the color input value. Each boundary line element represents a line segment defined by an intersection of one of the gamut boundary triangles within the subset of the collection of gamut boundary triangles with a hue plane, and the hue plane is within the gamut boundary and based on the color input value. In addition, a result is determined for the gamut operation using one or more of the determined boundary line elements.

Abstract: A system and method for improving document layout on arbitrary devices of different resolutions and size using manifold representations of content. Manifold representations of content are: multiple versions of anything that might appear in a document, from text, to images, to even such things as stylistic conventions. The specific content is selected and formatted dynamically, on the fly, by a layout engine in order to best adapt to a given viewing situation. A user interface for authoring and editing such manifold content is disclosed.

Abstract: A system and method for graphically showing the animation order of animated elements in a presentation program or other software. The invention consists of a User Interface (UI) widget which shows the order of the animation in the presentation. This UI employs an animation On Object User Interface (OOUI), or animation tag, that is preferably a rectangular control that encloses a number, and labels the order in which objects are animated. Each animation OOUI or animation tag is associated with an object on a display during creation and editing. The animation OOUI or tag is preferably placed in close proximity to the object it is associated with, rather than in a separate window or dialog box, and is hence termed ‘On Object’. The animation tag is active and responds to computer input device selection actions. Each animation OOUI is typically associated with an animation list.

Abstract: A system and method that provides an efficient scheme to code images and video by exploiting spatial correlations within an image by employing hybrid directional prediction and lifting wavelet techniques.

Abstract: A system and method for graphically showing the order and timing of elements in a presentation program or other software. The sequence of events is shown in an event list, a list of events in sequence order, each event being associated with an event timeline bar and correlated with a universal timeline, in the editing window of an electronic presentation or other software that deals with the scheduling of events. In one embodiment, each item in the list represents an individual animation effect. Elements of the event list are logically related to each other and these logical relationships may be used in assisting a user to build a sequence of events (e.g., an animation sequence).

Abstract: A random access read/write media format that enables segments of media to be read, written, accessed, and streamed in a non-sequential order. A media file is divided into a series of timeblocks TB0 to TBn-1 wherein each timeblock consists of media packets of a short non-overlapping time span. Each media packet in the media file is also divided into data units identifiable by data unit ID. A timeblock index table, with an entry for each timeblock in the series, and a media packet index field with a data unit ID entry for each data unit in the media packet (located in each timeblock header), are used to quickly locate portions of desired data. This two-level index hierarchy, the timeblock index table and the media packet index table, eases the locating, reading and writing of non-sequential media packets. The timeblock index allows data to be quickly found in terms of time, while the media packet index allows data to be quickly found by data unit ID.

Abstract: A wireless programmable user interaction system allows a user to interact with networked services relating to physical objects that have associated machine-readable tags. The system includes a portable interaction device in wireless communication with a local computer network. The portable interaction device includes a portable computing device, such as a hand-held computer, and an associated machine-readable tag reader (e.g., a bar code reader). An interaction system catalog in the portable computing device stores tag format information that correlates the tag identity information with an identity information category and related information. The interaction system catalog can indicate the types of information, interactions, or other computer network services that are available and relevant to the physical object. Upon selection of a desired network service by a user, a functional payload is delivered to the portable computing device over the wireless network connection to be executed.

Abstract: A system and method for editing images. A simple but powerful image stack is employed in creating an enhanced image from a stack of registered images. This paradigm combines pixels using multi-image operations on the image stack. Image Stacks can help create group photographs, create high dynamic range images, combine images captured under different lighting conditions, remove unwanted objects from images, and combine images captured at different times and with different focal lengths.

Abstract: Interactive multi-view video presents new types of video capture systems, video formats, video compression algorithms, and services. Many video cameras are allocated to capture an event from various related locations and directions. The captured videos are compressed in control PCs and are sent to a server in real-time. Users can subscribe to a new type of service that allows users to connect to the servers and receive multi-view videos interactively. In one embodiment of the invention, an automatic pattern-free calibration tool is employed to calibrate the multiple cameras. In contrast with a pattern-based method which uses the correspondences between image points and pattern points, the pattern-free calibration method is based on the correspondences between image points from different views.

Abstract: A system and method for providing a peer-to-peer photo-sharing environment. The system includes: manual and automatic photo annotation at the client; periodic client-server synchronization; an index of client photos on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the centralized index or photo database; and transmission of the relevant photos to the client via an on-line image cache. In one embodiment, one client's new photos are automatically displayed on another client's computer (e.g., via screen saver or another mechanism).

Abstract: A system and method for transmitting a clear image of a whiteboard work surface for remote collaboration. The image is separated into two portions; the projected image of the work surface, and the writing physically added to the whiteboard by participants. This separation allows several benefits. The bandwidth requirements are much lower than video teleconferencing, and the benefits of whiteboard sharing are improved. The visual echo created on a physical whiteboard can be canceled.

Abstract: Improved camera calibration techniques, including an improved up look angle and an improved method for calibrating a virtual center of projection. By using a view camera technique for the up look angle, the image sensors can be mounted flat to a Printed Circuit Board (PCB). By using a sub-region of the image sensor for the active area of the camera it is possible to calibrate the virtual center of projection (C?).

Abstract: A new color space that maps image pixel values in a mosaiced sampling pattern (such as that generated by a Bayer color filter array) into four color channels that correspond to rectangular sampling patterns. Because these new channels correspond to a rectangular sampling grid, they are much more amenable to processing steps such as compression. In one embodiment, the transformation from the original mosaic-patterned pixels into the new four-channel color space can be made reversible in integer arithmetic. That allows for the implementation of efficient lossless image compression systems for mosaiced (e.g., raw, or raw Charged Couple Device (CCD)) images.

Abstract: Generation, coding and transmission of an effective video form, scalable portrait video. As an expansion to bi-level video, portrait video is composed of more gray levels, and therefore possesses higher visual quality while it maintains a low bit rate and low computational costs. Portrait video is a scalable video in that each video with a higher level always contains all the information of the video with a lower level. The bandwidths of 2-4 level portrait videos fit into the bandwidth range of 20-40 Kbps that GPRS and CDMA 1X can stably provide. Therefore, portrait video is very promising for video broadcast and communication on 2.5 G wireless networks. With portrait video technology, this system and method is the first to enable two-way video conferencing on Pocket PCs and Handheld PCs.

Abstract: Interactive multi-view video presents new types of video capture systems, video formats, video compression algorithms, and services. Many video cameras are allocated to capture an event from various related locations and directions. The captured videos and any associated audio streams are captured in a video beam format which allows for the efficient and expedient search of the vast amount of data in real-time and allows the data to be stored for off-line access.

Abstract: A user interface for a system and method for improving document layout on arbitrary devices of different resolutions and size using manifold representations of content. Manifold representations of content are: multiple versions of anything that might appear in a document, from text, to images, to even such things as stylistic conventions. The specific content is selected and formatted dynamically, on the fly, by a layout engine in order to best adapt to a given viewing situation.

Abstract: A novel method for synchronizing the lips of a sketched face to an input voice. The lip synchronization system and method approach is to use training video as much as possible when the input voice is similar to the training voice sequences. Initially, face sequences are clustered from video segments, then by making use of sub-sequence Hidden Markov Models, a correlation between speech signals and face shape sequences is built. From this re-use of video, the discontinuity between two consecutive output faces is decreased and accurate and realistic synthesized animations are obtained. The lip synchronization system and method can synthesize faces from input audio in real-time without noticeable delay. Since acoustic feature data calculated from audio is directly used to drive the system without considering its phonemic representation, the method can adapt to any kind of voice, language or sound.

Abstract: A system and method for teleconferencing and recording of meetings. The system uses a variety of capture devices (a novel 360° camera, a whiteboard camera, a presenter view camera, a remote view camera, and a microphone array) to provide a rich experience for people who want to participate in a meeting from a distance. The system is also combined with speaker clustering, spatial indexing, and time compression to provide a rich experience for people who miss a meeting and want to watch it afterward.