Abstract: A method for clustering data streams. Specifically, one embodiment of the present invention discloses a method for clustering data streams for use in a virtual environment. The embodiment of the method begins by determining a cluster of receiving nodes in the virtual environment. Each of the cluster of receiving nodes have associated values for at least one clustering parameter that as a set satisfies a test. Then, the embodiment continues by generating a common data stream based on the clustering parameter. Thereafter, the embodiment sends the common data stream from a sending node to the cluster of receiving nodes.

Abstract: Geometry and view data relating to a image sequences is transmitted from a server to a client computer. Such enables reconstruction of images by a client with reduced bandwidth for the image stream transmission. A previous-image mesh of coordinates and depth values for selected pixels from the array of pixels in a previous-image is generated at the server. The depth values are transmitted to the client. A change-in-view matrix is generated at the server and transmitted to the client. Such represents the change in viewing parameters between the previous-image and a current-image. The change-in-view matrix is applied to the previous-image mesh to create a current-image mesh, independently at both the server and at the client. Such is applied to the previous-image to generate a predicted current-image. The current-image is generated at the server and a difference between the current-image and the predicted current-image is computed.

Abstract: A method for real-time video communication. Specifically, one embodiment of the present invention discloses a method of video conferencing that captures a plurality of real-time video streams of a local participant from a plurality of sample viewpoints. From the plurality of video streams, a new view synthesis technique can be applied to generate a video image stream in real-time of the local participant rendered from a second location of a second participant with respect to a first location of the local participant in a coordinate space of a virtual environment. A change in either of the locations leads to the modifying of the video image stream, thereby enabling real-time video communication from the local participant to the second participant.

Abstract: A method for real-time video communication. Specifically, one embodiment of the present invention discloses a method of video conferencing that captures a plurality of real-time video streams of a local participant from a plurality of sample viewpoints. From the plurality of video streams, a new view synthesis technique can be applied to generate a video image stream in real-time of the local participant rendered from a second location of a second participant with respect to a first location of the local participant in a coordinate space of a virtual environment. A change in either of the locations leads to the modifying of the video image stream, thereby enabling real-time video communication from the local participant to the second participant.

Abstract: A server stores a first multi-resolution texture pyramid and a 3-D geometry object. A client downloads the geometry object and a low resolution texture tile of the first multi-resolution texture pyramid, synthesizes a second multi-resolution texture pyramid from the low resolution tile, and begins rendering images while using the second pyramid as texture. The client downloads additional, higher resolution tiles and replaces synthesized tiles in the second pyramid with the downloaded tiles. The higher resolution tiles are downloaded according to visibility in the images being rendered. Higher visibility tiles are downloaded before lower visibility tiles. The downloading of the tiles from the server is performed in parallel with the rendering of the images. Thus, real texture in the image sequence is progressively increased as synthesized tiles in the local pyramid are selectively replaced with corresponding tiles that have been fetched from the server.

Abstract: A system for and method of graphic consistency verification for a replicated network having a plurality of existing applications. The system includes a graphic consistency autochecker and a plurality of application encapsulators. One encapsulator is distributed to and operates with each application. Each encapsulator includes an event tracker, an image catcher, and a signature calculator. The method includes the steps of receiving and multicasting input events from the user of one of the applications, capturing a graphic image from each of the applications, calculating an image signature for each graphic image, comparing all image signatures for consistency, and correcting any discrepancy when at least one of the applications has an inconsistent image signature before executing the next input event.

Abstract: In order to solve the need for an accurate two-dimensional representation of a three-dimensional image, the invention provides an improved method and apparatus for processing voxel data which avoid the problem of color artifacts coming from zero opacity regions. The three-dimensional image is stored in a computer memory as a three-dimensional data array having object data values associated with sample points in a three-dimensional space. A central processing unit (CPU) processes the object data values to determine voxel colors C and voxel opacities &agr; for the plurality of sample points and then opacity weights the voxel colors to produce a set of opacity weighted colors {tilde over (C)}. Next, the voxel opacities &agr; and the opacity weighted colors {tilde over (C)} from each sample point are composited in a compositor to form the two-dimensional representation. Finally, a display unit visually displays the two-dimensional representation.

Abstract: An image rendering apparatus that comprises an input path through which the rendering apparatus can receive three-dimensional graphics data, a pixel/depth buffer, a reference buffer and a rendering engine. The three-dimensional graphics data include polygon data and additionally include texture data defining a texture. The texture data include texture size data and sets of pattern data. The pattern data in each of the sets represent the texture with a different resolution. The pattern data constitute a majority of the texture data. The pixel/depth buffer and the reference buffer respectively include first memory cells and second memory cells that correspond to the pixels of a rendering screen. The rendering engine performs an initial rasterizing operation using only the polygon and texture size data to generate and to store in the reference buffer, for each of the pixels of the rendering screen, a texture identifier, a layer depth value indicating a texture resolution, and texture coordinates.