Abstract: In one embodiment, a method includes distributing rendering tasks to connected client nodes having capable graphics processing units by transmitting viewport state data objects and a unique spatial location to each of the clients, performing path tracing at each of the clients from the starting point of their unique spatial locations, and transmitting their rendered output back to the server. The server generates a composite rendered output from the individual rendered outputs received by the participating clients, and then transmits the composite to all connected clients for display. Thus, as the number of client nodes increases, the scene is rendered more rapidly and at higher quality. In particular embodiments, the rendered output is a lightmap representing the diffuse lighting for the scene, and each client may render the scene's specular highlights from its own viewport.

Abstract: Methods, apparatuses and systems directed to efficiently circumventing the limitations of client side rendering of virtual worlds. In a particular implementation, a proposed system renders each client viewport remotely, removing the burden of rendering a 3D scene from the local client device. 3D viewports, rather than being rasterized on the local client, are instead generated on a remote render device which then transmits a visual representation of the viewport to the client device in a format (including, but not limited to a video stream) which the client can use to display the scene without requiring complex 3D rasterization. This process eliminates the need for the client to have any specialized 3D rendering software or hardware, or to install or download any persistent render assets on the local system. The hardware requirements for the client are therefore roughly equivalent to those needed to play a continuous video stream.

Abstract: Methods, apparatuses and systems directed to hosting, on a computer system, a plurality of application instances, each application instance corresponding to a remote client application; maintaining a network connection to each of the remote client applications for which an application instance is hosted; allocating resources of a graphics processing unit of the computer system between at least two of the remote client applications; concurrently rendering, utilizing the resources of the graphics processing unit of the computer system, the graphical output of the application instances corresponding to the at least two of the remote client applications; and transmitting the rendered graphical output to the at least two of the remote client applications over the respective network connections.

Abstract: A subject is imaged using imaging equipment arranged on portable, wireless vehicles. The vehicles are positioned in a pattern in proximity to the subject and illuminate the subject in order to collect image data. The image data can be collected by cameras carried by the vehicles in addition to or instead of external high speed cameras.

Abstract: User interaction with virtual objects generated in virtual space on a first display device is enabled. Using sensor and camera data of the first display device, a real-world object with a marker on its surface is identified. Virtual objects are generated and displayed in the virtual 3D space relative to the marker on the real-world object. Manipulation of the real-world object in real 3D space results in changes to attributes of the virtual objects in the virtual 3D space. The marker comprises information regarding particular the renders to be generated. Different virtual objects can be generated and displayed based on information comprised in the markers. When the real world object has sensors, sensor data from the real-world object is transmitted to the first display device to enhance the display of the virtual object, or the virtual scene, based on sensor input. Local or remote storage can further define, enhance, or modify characteristics of the real world object.

Abstract: In one embodiment, a method includes distributing rendering tasks to connected client nodes having capable graphics processing units by transmitting viewport state data objects and a unique spatial location to each of the clients, performing path tracing at each of the clients from the starting point of their unique spatial locations, and transmitting their rendered output back to the server. The server generates a composite rendered output from the individual rendered outputs received by the participating clients, and then transmits the composite to all connected clients for display. Thus, as the number of client nodes increases, the scene is rendered more rapidly and at higher quality. In particular embodiments, the rendered output is a lightmap representing the diffuse lighting for the scene, and each client may render the scene's specular highlights from its own viewport.

Abstract: In one embodiment, a method includes distributing rendering tasks to connected client nodes having capable graphics processing units by transmitting viewport state data objects and a unique spatial location to each of the clients, performing path tracing at each of the clients from the starting point of their unique spatial locations, and transmitting their rendered output back to the server. The server generates a composite rendered output from the individual rendered outputs received by the participating clients, and then transmits the composite to all connected clients for display. Thus, as the number of client nodes increases, the scene is rendered more rapidly and at higher quality. In particular embodiments, the rendered output is a lightmap representing the diffuse lighting for the scene, and each client may render the scene's specular highlights from its own viewport.

Abstract: A token-based billing model for delivering server-side rendered applications to remote users. A token represents a right to access a server-side rendered application. Each remote user is associated with one or more tokens. When a given token expires, the set of tokens associated with a user is decremented. The rate at which tokens expire are modulated based on aggregate load across the resources of the server-side rendered application provider, as well as the individual loads attributable to each of the users.

Abstract: Methods, apparatuses and systems directed to using viewport state data objects (VSDO) to render a series of video frames according to render instructions to achieve video compression. In a particular implementation, the video compression format exposes the VSDO and render instructions to a video render client, allowing the video render client to finish rendering a sequence of video frames from different spatial locations and view transform parameters.

Abstract: Systems and methods for generating and animating virtual representations to a wearer of a HMD device are disclosed. A virtual representation associated with a real-world object is retrieved based on received input data. The retrieved virtual representation is rendered for display to the wearer. Sensor data tracking one or more of the real-world object and the wearer is also received. The rendered virtual representation can be further animated based on the sensor data.

Abstract: Lighting information comprising at least the reflectance data of a plurality of regions of an object surface is generated and printed out as a series of relightable holograms. Each of the printed holograms comprises the reflectance data of a corresponding region of the object. A model of the object is generated such that the model also comprises a plurality of portions corresponding to the regions of the object surface. The series of holograms are each affixed to a portion of the model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is affixed to the corresponding portion of the model. In an embodiment, the model of the object is generated from a metal. The series of holograms is engraved directly onto the metallic model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is engraved onto the corresponding portion of the metallic model.

Abstract: Lighting information comprising at least the reflectance data of a plurality of regions of an object surface is generated and printed out as a series of relightable holograms. Each of the printed holograms comprises the reflectance data of a corresponding region of the object. A model of the object is generated such that the model also comprises a plurality of portions corresponding to the regions of the object surface. The series of holograms are each affixed to a portion of the model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is affixed to the corresponding portion of the model. In an embodiment, the model of the object is generated from a metal. The series of holograms is engraved directly onto the metallic model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is engraved onto the corresponding portion of the metallic model.

Abstract: Lighting information comprising at least the reflectance data of a plurality of regions of an object surface is generated and printed out as a series of relightable holograms. Each of the printed holograms comprises the reflectance data of a corresponding region of the object. A model of the object is generated such that the model also comprises a plurality of portions corresponding to the regions of the object surface. The series of holograms are each affixed to a portion of the model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is affixed to the corresponding portion of the model. In an embodiment, the model of the object is generated from a metal. The series of holograms is engraved directly onto the metallic model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is engraved onto the corresponding portion of the metallic model.

Abstract: Methods, apparatuses and systems directed to efficiently circumventing the limitations of client side rendering of virtual worlds. In a particular implementation, a proposed system renders each client viewport remotely, removing the burden of rendering a 3D scene from the local client device. 3D viewports, rather than being rasterized on the local client, are instead generated on a remote render device which then transmits a visual representation of the viewport to the client device in a format (including, but not limited to a video stream) which the client can use to display the scene without requiring complex 3D rasterization. This process eliminates the need for the client to have any specialized 3D rendering software or hardware, or to install or download any persistent render assets on the local system. The hardware requirements for the client are therefore roughly equivalent to those needed to play a continuous video stream.

Abstract: In one embodiment, a method includes distributing rendering tasks to connected client nodes having capable graphics processing units by transmitting viewport state data objects and a unique spatial location to each of the clients, performing path tracing at each of the clients from the starting point of their unique spatial locations, and transmitting their rendered output back to the server. The server generates a composite rendered output from the individual rendered outputs received by the participating clients, and then transmits the composite to all connected clients for display. Thus, as the number of client nodes increases, the scene is rendered more rapidly and at higher quality. In particular embodiments, the rendered output is a lightmap representing the diffuse lighting for the scene, and each client may render the scene's specular highlights from its own viewport.

Abstract: A wearable computing device comprises one or more one eye pieces each of which further comprises a flexible frame surrounding a display screen and tactile elements arranged on the perimeter of the display screen. The tactile elements provide tactile feedback to the user that is synchronous with the display on the display screen. A detection system is also included in the flexible frame to monitor the movements of a wearer's eyes and the eye sockets and to execute various tasks in response to the detected movements. A visual cortex thought detector also coupled to the wearable computing device obtains information regarding the wearer's thoughts and manipulates a display on the display screen based on the obtained information.

Abstract: Methods, apparatuses and systems directed to efficiently circumventing the limitations of client side rendering of virtual worlds. In a particular implementation, a proposed system renders each client viewport remotely, removing the burden of rendering a 3D scene from the local client device. 3D viewports, rather than being rasterized on the local client, are instead generated on a remote render device which then transmits a visual representation of the viewport to the client device in a format (including, but not limited to a video stream) which the client can use to display the scene without requiring complex 3D rasterization. This process eliminates the need for the client to have any specialized 3D rendering software or hardware, or to install or download any persistent render assets on the local system. The hardware requirements for the client are therefore roughly equivalent to those needed to play a continuous video stream.

Abstract: An immersive experience system provides interactive content to a user while isolating the user from external stimuli in an isolation chamber. The user floats in a high-density suspension liquid maintained at the user's body temperature while consuming the interactive content which can provide audio, video and tactile inputs to the user. The user can interact with the immersive experience system via different modalities such as eye movements or gestures or via providing thought input through a visual cortex thought recorder comprised in the immersive experience system.

Abstract: A token-based billing model for delivering server-side rendered applications to remote users. A token represents a right to access a server-side rendered application. Each remote user is associated with one or more tokens. When a given token expires, the set of tokens associated with a user is decremented. The rate at which tokens expire are modulated based on aggregate load across the resources of the server-side rendered application provider, as well as the individual loads attributable to each of the users.

Abstract: In one embodiment, a method includes: receiving, by a first computer system, a data stream transmitted from a second computer system over a network connection between the first computer system and the second computer system, wherein the data stream comprises executable code of a software program; extracting, by the first computer system, the executable code of the software program from the data stream; allocating, by the first computer system, an amount of dynamic memory for the executable code of the software program; loading, by the first computer system, the executable code of the software program directly into the allocated dynamic memory; and executing, by the first computer system, the software program by launching the executable code of the software program loaded in the allocated dynamic memory.