Abstract: Implementations described herein relate to methods, systems, and computer-readable media to render virtual objects on a client device. In some implementations, the method includes obtaining a plurality of virtual objects associated with a virtual experience, for each virtual object of the plurality of virtual objects: determining physical connections of the virtual object to one or more other virtual objects in the virtual experience, and determining logical associations of the virtual object to one or more other virtual objects in the virtual experience, forming streaming sets of virtual objects, wherein for streaming sets that include two or more virtual objects, each virtual object within the streaming set has one or more of a physical connection and a logical association with at least one other virtual object in the streaming set, and rendering virtual objects included in one or more streaming sets in the virtual experience on the client device.

Abstract: A method and system for hybrid streaming of media content such as video for a computer-based game. In some implementations, a background media content stream includes a background video rendered on a server. The background media content stream is received at a client device. The client device renders one or more three-dimensional objects and forms a composite media stream by combining the background media content stream and the one or more three-dimensional objects. The composite media stream can be output to a display or other external system.

Abstract: A method and system are provided for hybrid streaming of media content such as video for a computer-based game. In some implementations, a background media content stream includes a background video rendered on a server. The background media content stream is received at a client device. The client device renders one or more three-dimensional objects and forms a composite media stream by combining the background media content stream and the one or more three-dimensional objects. The composite media stream can be output to a display or other external system.

Abstract: A method and system are provided for hybrid streaming of media content such as video for a computer-based game. In some implementations, a background media content stream includes a background video rendered on a server. The background media content stream is received at a client device. The client device renders one or more three-dimensional objects and forms a composite media stream by combining the background media content stream and the one or more three-dimensional objects. The composite media stream can be output to a display or other external system.

Abstract: A method and system are provided for hybrid streaming of media content such as video for a computer-based game. In some implementations, a background media content stream includes a background video rendered on a server. The background media content stream is received at a client device. The client device renders one or more three-dimensional objects and forms a composite media stream by combining the background media content stream and the one or more three-dimensional objects. The composite media stream can be output to a display or other external system.

Abstract: In one example, a computing system includes a first computing device including a first display having a moveable interaction window that is a subset of an entire display area of the first display, the first computing device to wirelessly transmit a video stream representing at least the interaction window. The computing system includes a tablet computing device including a second display, the tablet computing device to wirelessly receive the video stream and display content of the interaction window on the second display and cause movement of the interaction window on the first display based on movement of the tablet computing device.

Abstract: In one example, a computing system includes a first computing device including a first display having a moveable interaction window that is a subset of an entire display area of the first display, the first computing device to wirelessly transmit a video stream representing at least the interaction window. The computing system includes a tablet computing device including a second display, the tablet computing device to wirelessly receive the video stream and display content of the interaction window on the second display and cause movement of the interaction window on the first display based on movement of the tablet computing device.

Abstract: A non-transitory computer readable medium includes computer executable instructions configured to generate an object model from image data captured from a physical object. The object model includes data representing location and geometry of the physical object. The instructions generate an augmentation model that includes data representing a graphical image and location information thereof with respect to the physical object in response to a user interaction associated with the physical object. The instructions map the augmentation model to the object model such that the graphical image of the augmentation model is spatially linked to the physical object.

Abstract: The present invention describes a display system that includes a display, including a display screen; a viewpoint assessment component to determine a viewpoint of a user positioned in front the display screen; and an object tracking component to track the user manipulation of an object positioned behind the display screen.

Abstract: An image capture system is described that includes: a first image capture device for capturing a first image, the first image capture device having a first field of view; a viewpoint assessment sensor having a second field of view. The image capture system also includes a viewpoint assessment component for determining the location of the user viewpoint in the second field of view and an image modification component for modifying the first image responsive to the user viewpoint in the second field of view.

Abstract: One form of the present invention provides a method of displaying multiple image streams that includes providing a first plurality of image streams, processing the plurality of image streams, thereby generating at least one processed image stream, and projecting the at least one processed image stream onto a non-planar surface with at least one projector, thereby generating a plurality of different projected image streams at a corresponding plurality of different positions on the non-planar surface.

Abstract: A video system comprises a shared media accessor configured to access shared media. The shared media is configured to be displayed on a first display screen and a second display screen. A video accessor configured to access images from a first camera. A field of view of the first camera is oriented such that the first camera can capture the images comprising non-verbal communication of a user associated with the shared media. A video compositor configured to composite the images captured by the first camera and said shared media. The composited images are configured to be displayed on the second display screen.

Abstract: Systems and methods of visually indicating one or more gestures of a user of a node (22) in the content of a media stream (24) are disclosed. A node (22) configured to transmit a media stream (24) having content to one or more other nodes (22) includes a screen configured to display the content of the media stream, a media device (36) configured to capture an image of one or more gestures of the user of the node (22), wherein the one or more gestures are adjacent to the screen and the media device (36) is positioned to capture the image without capturing more than a peripheral view of the screen in that image; a media analyzer (38) configured to generate a visual representation of the captured one or more gestures; and a compositer (40) configured to composite the visual representation of the captured one or more gestures with the content of the media stream (24).

Abstract: An image capture system is described that includes: a first image capture device for capturing a first image, the first image capture device having a first field of view; a viewpoint assessment sensor having a second field of view. The image capture system also includes a viewpoint assessment component for determining the location of the user viewpoint in the second field of view and an image modification component for modifying the first image responsive to the user viewpoint in the second field of view.

Abstract: Embodiments of the present invention pertain to methods and apparatuses for quantifying properties of skin. In one embodiment, data that describes a set of images of skin is received. A plurality of the images comprising the set of images were taken under a different lighting condition. Surface normals are computed based on the data and the computed surface normals are utilized to enable quantifying a property of the skin for the purpose of evaluating the skin.

Abstract: The present invention describes a display system that includes a display, including a display screen; a viewpoint assessment component to determine a viewpoint of a user positioned in front the display screen; and an object tracking component to track the user manipulation of an object positioned behind the display screen.

Abstract: A video system comprises a shared media accessor configured to access shared media. The shared media is configured to be displayed on a first display screen and a second display screen. A video accessor configured to access images from a first camera. A field of view of the first camera is oriented such that the first camera can capture the images comprising non-verbal communication of a user associated with the shared media. A video compositor configured to composite the images captured by the first camera and said shared media. The composited images are configured to be displayed on the second display screen.

Abstract: Systems and methods of visually indicating one or more gestures of a user of a node (22) in the content of a media stream (24) are disclosed. A node (22) configured to transmit a media stream (24) having content to one or more other nodes (22) includes a screen configured to display the content of the media stream, a media device (36) configured to capture an image of one or more gestures of the user of the node (22), wherein the one or more gestures are adjacent to the screen and the media device (36) is positioned to capture the image without capturing more than a peripheral view of the screen in that image; a media analyzer (38) configured to generate a visual representation of the captured one or more gestures; and a compositer (40) configured to composite the visual representation of the captured one or more gestures with the content of the media stream (24).

Abstract: Systems and methods for modifying content of a media stream (24) based on a user's one or more gestures are disclosed.

Abstract: A method includes generating a first plurality of meshes configured to map a first domain associated with a display surface having a plurality of fiducial marks to a second domain associated with a image capture device configured to capture a first image of the display surface, generating a second plurality of meshes configured to map the second domain to a third domain associated with a first projector configured to display a second image onto the display surface, and generating a first mesh configured to map the first domain to the third domain in conjunction with a second mesh using the first plurality of meshes and the second plurality of meshes.