Abstract: This disclosure provides a pose- or gesture-based recognition system that processes images of the human hand, downconverts degrees of freedom of the human hand to lower-dimensional space, and then maps the downconverted space to a character set. In one embodiment, the system is implemented in a smart phone or as a computer-input device that uses a virtual keyboard. As the user moves his or her hand, the smart phone or computer provides simulated vocal feedback, permitting the user to adjust hand position or motion to arrive at any desired character; this is particularly useful for embodiments which use a phonetic character set. Software that performs character selection can be implemented in a manner that is language/region agnostic, with a contextual dictionary being used to interpret a phonetic character set according to a specific language or region.

Abstract: This disclosure provides a pose- or gesture-based recognition system that processes images of the human hand, downconverts degrees of freedom of the human hand to lower-dimensional space, and then maps the downconverted space to a character set. In one embodiment, the system is implemented in a smart phone or as a computer-input device that uses a virtual keyboard. As the user moves his or her hand, the smart phone or computer provides simulated vocal feedback, permitting the user to adjust hand position or motion to arrive at any desired character; this is particularly useful for embodiments which use a phonetic character set. Software that performs character selection can be implemented in a manner that is language/region agnostic, with a contextual dictionary being used to interpret a phonetic character set according to a specific language or region.

Abstract: Embodiments of the present invention pertain to methods and apparatuses for quantifying properties of skin. In one embodiment, data that describes a set of images of skin is received. A plurality of the images comprising the set of images were taken under a different lighting condition. Surface normals are computed based on the data and the computed surface normals are utilized to enable quantifying a property of the skin for the purpose of evaluating the skin.

Abstract: One embodiment relates to a method of acquiring three-dimensional structure of an object using a flatbed scanner. The object is placed with a surface to be scanned facing down on a scanner platen. At least three images are obtained under differing lighting directions. The images are processed to generate the three-dimensional structure. Other features and embodiments are also disclosed.

Abstract: A method for clustering data streams. Specifically, one embodiment of the present invention discloses a method for clustering data streams for use in a virtual environment. The embodiment of the method begins by determining a cluster of receiving nodes in the virtual environment. Each of the cluster of receiving nodes have associated values for at least one clustering parameter that as a set satisfies a test. Then, the embodiment continues by generating a common data stream based on the clustering parameter. Thereafter, the embodiment sends the common data stream from a sending node to the cluster of receiving nodes.

Abstract: A method of communicating gaze. Specifically, one embodiment of the present invention discloses a method of communicating gaze in an immersive virtual environment. The method begins by representing an immersive virtual environment on a monitor that is viewable by a viewing participant. The monitor displays a plurality of objects in the virtual environment. The physical gaze of the viewing participant is tracked to determine a physical direction of the physical gaze within a physical environment including the viewing participant. Thereafter, a viewed object is determined at which the viewing participant is gazing. Then, a virtual direction is determined between the viewing participant and the viewed object in the immersive virtual environment. A model of the viewing participant is rotated based on the physical and virtual directions to render a view of the viewing participant such that the viewing participant is facing the viewed object in the immersive virtual environment.

Abstract: Methods and systems for utilizing a parallel conversational thread during a remote collaboration are described. In one embodiment, a managing entity is utilized to establish a first communications path for a remote collaboration of at least two parties. Then, a request for a parallel conversation is received from at least one of the at least two parties during the remote collaboration. The managing entity then establishes a second communications path for the parallel conversation between the at least two parties. Wherein, the enabling of the parallel conversation on the second communications path is performed without inhibiting the first communications path, such that a portion of a first party can have a parallel conversation with a portion of a second party on the second communications path while the first communications path for the remote collaboration remains active.

Abstract: One embodiment relates to a method of acquiring three-dimensional structure of an object using a flatbed scanner. The object is placed with a surface to be scanned facing down on a scanner platen. At least three images are obtained under differing lighting directions. The images are processed to generate the three-dimensional structure. Other features and embodiments are also disclosed.

Abstract: A method and system for real-time rendering within a gaming environment. Specifically, one embodiment of the present invention discloses a method of rendering a local participant within an interactive gaming environment. The method begins by capturing a plurality of real-time video streams of a local participant from a plurality of camera viewpoints. From the plurality of video streams, a new view synthesis technique is applied to generate a rendering of the local participant. The rendering is generated from a perspective of a remote participant located remotely in the gaming environment. The rendering is then sent to the remote participant for viewing.

Abstract: According to one embodiment of the present invention, a method for rendering a digital image having surface reflectance properties is disclosed. The method comprises creating a parametric texture map that comprises parameters for an equation that defines a surface structure in a manner in which the appearance of the surface structure includes surface reflectance properties. The method further comprises rendering a digital image using the parametric texture map.

Abstract: A retractable camera apparatus is disclosed. Through the use of the apparatus, a video teleconference environment can communicate, in real time, such personal features as gesture, expression and body language. The apparatus includes a housing portion, at least one arm portion coupled to the housing portion wherein the at least one arm portion is capable of being moved between a retracted position and a deployed position and a plurality of cameras coupled to the at least one arm portion.

Abstract: A method for culling visual data streams. Specifically, one embodiment of the present invention discloses a method for culling view dependent visual data streams for a virtual environment. The method begins by determining a view volume of a viewing participant within the virtual environment. The view volume determines a field-of-view of the viewing participant within the virtual environment. The embodiment of the method then determines a proximity of a representation of an observed object in the virtual environment to the view volume. Thereafter, the embodiment of the method processes a view dependent visual data stream of the observed object only when the representation is within a specified proximity to the view volume.

Abstract: A support apparatus for a camera and strobe lights includes a mounting plate for holding the camera substantially normal to and at a fixed distance from the photograph area, a set of legs attached to one or more portions of the apparatus providing support and positions for mounting and a set of strobe lights affixed to the legs at known positions relative to the focal plane of the camera and directed towards the photograph area to facilitate acquisition of multiple photographic images for use in one or image processing operations. The support apparatus can be automated through the use of one or more mobile strobe lights slidably coupled to each leg, capable of self-propelled linear motion along the axis of the leg and providing indication of its position along the leg to facilitate acquisition of multiple photographic images and position data for the image processing operations.

Abstract: A method of communicating gaze. Specifically, one embodiment of the present invention discloses a method of communicating gaze in an immersive virtual environment. The method begins by representing an immersive virtual environment on a monitor that is viewable by a viewing participant. The monitor displays a plurality of objects in the virtual environment. The physical gaze of the viewing participant is tracked to determine a physical direction of the physical gaze within a physical environment including the viewing participant. Thereafter, a viewed object is determined at which the viewing participant is gazing. Then, a virtual direction is determined between the viewing participant and the viewed object in the immersive virtual environment. A model of the viewing participant is rotated based on the physical and virtual directions to render a view of the viewing participant such that the viewing participant is facing the viewed object in the immersive virtual environment.

Abstract: A method of generating a three-dimensional model of a scene from a plurality of photographs of the scene. The method includes voxels in an interior region and an exterior region of the scene in question and then examines the voxels to determine if they are empty or part of the objects in the scene. The interior region is divided into a plurality of interior voxels, that are preferably of the same size. The exterior region surrounds the interior space and is divided into exterior voxels having different sizes. The size of the exterior voxels increases as a function of the distance between the voxel and the interior region. The voxels that are furthest from the interior region are preferably infinite in size.

Abstract: A graphics system that employs parametric texture maps. The graphics system renders surface features of a 3D object in a manner that is direction dependent but without the time consuming and expensive calculations involved in the evaluation of lighting equations on a per pixel basis. A parametric texture map holds a set of parameters that define a surface structure in a manner in which the appearance of the surface structure varies in response to a direction vector. The direction vector may be any user-defined vector including a light source vector or a half-angle vector. The parameters are those of a predetermined equation, the evaluation of which does not involve vector calculations. The equation may take any form including a polynomial equation or a non-polynomial equation. The graphic system renders a polygon with the surface structure using the equation.

Abstract: A support apparatus for a camera and strobe lights includes a mounting plate for holding the camera substantially normal to and at a fixed distance from the photograph area, a set of legs attached to one or more portions of the apparatus providing support and positions for mounting and a set of strobe lights affixed to the legs at known positions relative to the focal plane of the camera and directed towards the photograph area to facilitate acquisition of multiple photographic images for use in one or image processing operations. The support apparatus can be automated through the use of one or more mobile strobe lights slidably coupled to each leg, capable of self-propelled linear motion along the axis of the leg and providing indication of its position along the leg to facilitate acquisition of multiple photographic images and position data for the image processing operations.

Abstract: A method and system for real-time rendering within a gaming environment. Specifically, one embodiment of the present invention discloses a method of rendering a local participant within an interactive gaming environment. The method begins by capturing a plurality of real-time video streams of a local participant from a plurality of camera viewpoints. From the plurality of video streams, a new view synthesis technique is applied to generate a rendering of the local participant. The rendering is generated from a perspective of a remote participant located remotely in the gaming environment. The rendering is then sent to the remote participant for viewing.

Abstract: A method for clustering data streams. Specifically, one embodiment of the present invention discloses a method for clustering data streams for use in a virtual environment. The embodiment of the method begins by determining a cluster of receiving nodes in the virtual environment. Each of the cluster of receiving nodes have associated values for at least one clustering parameter that as a set satisfies a test. Then, the embodiment continues by generating a common data stream based on the clustering parameter. Thereafter, the embodiment sends the common data stream from a sending node to the cluster of receiving nodes.

Abstract: Methods and systems for utilizing a parallel conversational thread during a remote collaboration are described. In one embodiment, a managing entity is utilized to establish a first communications path for a remote collaboration of at least two parties. Then, a request for a parallel conversation is received from at least one of the at least two parties during the remote collaboration. The managing entity then establishes a second communications path for the parallel conversation between the at least two parties. Wherein, the enabling of the parallel conversation on the second communications path is performed without inhibiting the first communications path, such that a portion of a first party can have a parallel conversation with a portion of a second party on the second communications path while the first communications path for the remote collaboration remains active.