Abstract: A method is described herein for providing a middleware framework in a multiprocessing environment having multiple processing units for developing a desired application. The method includes: receiving a selection of a plurality of task modules for developing the desired application; receiving connections between the selected task modules to form the desired application; receiving an input of a plurality of execution threads for processing through the formed application; and providing automatic global scheduling over the entire middleware framework of the plurality of execution threads by at least a) providing a job list of at least one job for execution by at least one of the plurality of execution threads, each of the at least one job is a processing of one or more data objects by an associated one of the selected task modules, and b) automatically scheduling an execution of each job in the job list by one of the plurality of execution threads based on at least one predetermined policy.

Abstract: A method of displaying images includes performing geometric processing and photometric processing on a plurality of image frames, thereby generating a plurality of processed image frames, projecting the plurality of processed image frames on a non-planar display surface with at least one projector, wherein the geometric processing includes applying a first plurality of meshes to the plurality of image frames, wherein the first plurality of meshes defines 2D mappings between the display surface and the at least one projector.

Abstract: A method includes generating a first plurality of meshes configured to map a first domain associated with a display surface having a plurality of fiducial marks to a second domain associated with a image capture device configured to capture a first image of the display surface, generating a second plurality of meshes configured to map the second domain to a third domain associated with a first projector configured to display a second image onto the display surface, and generating a first mesh configured to map the first domain to the third domain in conjunction with a second mesh using the first plurality of meshes and the second plurality of meshes.

Abstract: One form of the present invention provides a method of displaying multiple image streams that includes providing a first plurality of image streams, processing the plurality of image streams, thereby generating at least one processed image stream, and projecting the at least one processed image stream onto a non-planar surface with at least one projector, thereby generating a plurality of different projected image streams at a corresponding plurality of different positions on the non-planar surface.

Abstract: A method includes determining a first blend map for a first projector, the first blend map including a first plurality of attenuation factors corresponding to a region of overlap between first and second images projected by the first projector and a second projector, respectively, on a display surface, applying the first blend map to a white level measurement map that includes a plurality of white level measurement values measured from a first plurality of captured images, applying a smoothing function to the white level measurement map to generate a white level target map, and determining a scale map for the first projector from the white level measurement map and the white level target map.

Abstract: A method and system for real-time rendering within a gaming environment. Specifically, one embodiment of the present invention discloses a method of rendering a local participant within an interactive gaming environment. The method begins by capturing a plurality of real-time video streams of a local participant from a plurality of camera viewpoints. From the plurality of video streams, a new view synthesis technique is applied to generate a rendering of the local participant. The rendering is generated from a perspective of a remote participant located remotely in the gaming environment. The rendering is then sent to the remote participant for viewing.

Abstract: According to one embodiment of the present invention, a method for rendering a digital image having surface reflectance properties is disclosed. The method comprises creating a parametric texture map that comprises parameters for an equation that defines a surface structure in a manner in which the appearance of the surface structure includes surface reflectance properties. The method further comprises rendering a digital image using the parametric texture map.

Abstract: Disclosed is a method for producing a model of an object, comprising receiving at least one image of the object in a computing device, processing one or more of the at least one image to produce a model of the object, generating feedback information corresponding to the model of the object, and imparting the feedback information to a user of the computing device concurrently with the processing such that a determination is enabled to be made whether the model of the object is of a desired quality while the computing device is disposed to receive a further image of the object. The feedback information can be an image of the model which enables a user to determine whether an additional image is necessary or the feedback information can be direction to acquire an additional image of the object.

Abstract: An apparatus, executing on a server or similar machine and a client machine, and a corresponding method, includes mechanisms for rendering a two-dimensional image of a three-dimensional object, and streaming the thus-rendered image to the client machine. The mechanisms include a rendering module that generates a first image, from a first point of view, having a plurality of pixels, as first image data for display on a client machine, and generates first depth information for one or more of the plurality of pixels, and a compression module that compresses the first image data and the first depth information, wherein the first image data and the first depth information are provided to the client machine.

Abstract: A graphics system that employs parametric texture maps. The graphics system renders surface features of a 3D object in a manner that is direction dependent but without the time consuming and expensive calculations involved in the evaluation of lighting equations on a per pixel basis. A parametric texture map holds a set of parameters that define a surface structure in a manner in which the appearance of the surface structure varies in response to a direction vector. The direction vector may be any user-defined vector including a light source vector or a half-angle vector. The parameters are those of a predetermined equation, the evaluation of which does not involve vector calculations. The equation may take any form including a polynomial equation or a non-polynomial equation. The graphic system renders a polygon with the surface structure using the equation.

Abstract: A method for real-time video communication. Specifically, one embodiment of the present invention discloses a method of video conferencing that captures a plurality of real-time video streams of a local participant from a plurality of sample viewpoints. From the plurality of video streams, a new view synthesis technique can be applied to generate a video image stream in real-time of the local participant rendered from a second location of a second participant with respect to a first location of the local participant in a coordinate space of a virtual environment. A change in either of the locations leads to the modifying of the video image stream, thereby enabling real-time video communication from the local participant to the second participant.

Abstract: Disclosed is a method for producing a model of an object, comprising receiving at least one image of the object in a computing device, processing one or more of the at least one image to produce a model of the object, generating feedback information corresponding to the model of the object, and imparting the feedback information to a user of the computing device concurrently with the processing such that a determination is enabled to be made whether the model of the object is of a desired quality while the computing device is disposed to receive a further image of the object. The feedback information can be an image of the model which enables a user to determine whether an additional image is necessary or the feedback information can be direction to acquire an additional image of the object.

Abstract: A method for real-time video communication. Specifically, one embodiment of the present invention discloses a method of video conferencing that captures a plurality of real-time video streams of a local participant from a plurality of sample viewpoints. From the plurality of video streams, a new view synthesis technique can be applied to generate a video image stream in real-time of the local participant rendered from a second location of a second participant with respect to a first location of the local participant in a coordinate space of a virtual environment. A change in either of the locations leads to the modifying of the video image stream, thereby enabling real-time video communication from the local participant to the second participant.

Abstract: An apparatus, executing on a server or similar machine and a client machine, and a corresponding method, includes mechanisms for rendering a two-dimensional image of a three-dimensional object, and streaming the thus-rendered image to the client machine. The mechanisms include a rendering module that generates a first image, from a first point of view, having a plurality of pixels, as first image data for display on a client machine, and generates first depth information for one or more of the plurality of pixels, and a compression module that compresses the first image data and the first depth information, wherein the first image data and the first depth information are provided to the client machine.

Abstract: A graphics system that employs parametric texture maps. The graphics system renders surface features of a 3D object in a manner that is direction dependent but without the time consuming and expensive calculations involved in the evaluation of lighting equations on a per pixel basis. A parametric texture map holds a set of parameters that define a surface structure in a manner in which the appearance of the surface structure varies in response to a direction vector. The direction vector may be any user-defined vector including a light source vector or a half-angle vector. The parameters are those of a predetermined equation, the evaluation of which does not involve vector calculations. The equation may take any form including a polynomial equation or a non-polynomial equation. The graphic system renders a polygon with the surface structure using the equation.