Abstract: Systems, methods, and articles of manufacture are disclosed that enable the compression of depth data and real-time reconstruction of high-quality light fields. In one aspect, spatial compression and decompression of depth images is divided into the following stages: generating a quadtree data structure for each depth image captured by a light field probe and difference mask associated with the depth image, with each node of the quadtree approximating a corresponding portion of the depth image data using an approximating function; generating, from the quadtree for each depth image, a runtime packed form that is more lightweight and has a desired maximum error; and assembling multiple such runtime packed forms into per-probe stream(s); and decoding at runtime the assembled per-probe stream(s). Further, a block compression format is disclosed for approximating depth data by augmenting the block compression format 3DC+(BC4) with a line and two pairs of endpoints.

Abstract: Techniques for simulating interactions using an augmented reality device. A visual scene is captured using a camera device. The visual scene depicts of a first physical object within a physical environment. A dynamic interaction is simulated between the first physical object and one or more virtual objects and velocity of a first virtual object resulting from the simulated dynamic interaction is calculated. A predefined behavior for a virtual character to perform is selected in response to the dynamic interaction. The virtual character is distinct from the first virtual object, and the selection is based on the calculated velocity. A sequence of frames is rendered. The sequence of frames depicts the dynamic interaction between the first physical object and the virtual objects, and further depicts a representation of the virtual character performing the determined behavior. The sequence of frames is output for display using one or more display devices.

Abstract: Individual images for individual frames of an animation may be rendered to include individual focal areas. A focal area may include one or more of a foveal region corresponding to a gaze direction of a user, an area surrounding the foveal region, and/or other components. The foveal region may comprise a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight. A focal area within an image may be rendered based on parameter values of rendering parameters that are different from parameter values for an area outside the focal area.

Abstract: A system for performing memory allocation for seamless media content presentation includes a computing platform having a CPU, a GPU having a GPU memory, and a main memory storing a memory allocation software code. The CPU executes the memory allocation software code to transfer a first dataset of media content to the GPU memory, seamlessly present the media content to a system user, register a location of the system user during the seamless presentation of the media content, and register a timecode status of the media content at the location. The CPU further executes the memory allocation software code to identify a second dataset of the media content based on the location and the timecode status, transfer a first differential dataset to the GPU memory, continue to seamlessly present the media content to the system user, and transfer a second differential dataset out of the GPU memory.

Abstract: A method of rendering content items on a display via an electronic device involves mapping linked content items to a three-dimensional object defined by layout data. The layout data is then transmitted to an electronic device for display.

Abstract: Systems, methods, and articles of manufacture for real-time rendering using compressed animated light fields are disclosed. One embodiment provides a pipeline, from offline rendering of an animated scene from sparse optimized viewpoints to real-time rendering of the scene with freedom of movement, that includes three stages: offline preparation and rendering, stream compression, and real-time decompression and reconstruction. During offline rendering, optimal placements for cameras in the scene are determined, and color and depth images are rendered using such cameras. Color and depth data is then compressed using an integrated spatial and temporal scheme permitting high performance on graphics processing units for virtual reality applications.

Abstract: Individual images for individual frames of an animation may be rendered to include individual focal areas. A focal area may include one or more of a foveal region corresponding to a gaze direction of a user, an area surrounding the foveal region, and/or other components. The foveal region may comprise a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight. A focal area within an image may be rendered based on parameter values of rendering parameters that are different from parameter values for an area outside the focal area.

Abstract: Views of a virtual space may be presented based on predicted colors of individual pixels of individual frame images that depict the views of the virtual space. Predictive models may be assigned to individual pixels that predict individual pixel colors of individual pixels at individual time points. Individual models may be updated and/or reprojected to other pixels based on comparisons of the predicted pixel colors and colors specified by in a raster input signal.

Abstract: An apparatus displaying content to a viewer by adjusting parameters of the content or display devices based on environmental or display device changes. The apparatus includes a display device with a screen providing digital content. A thematic overlay is provided over the display screen to provide diffuse reflection of light striking the front surface. The output light is a combination of the displayed content from the screen and reflection of light from the thematic overlay. The apparatus includes a digital signage benchmarking tool with an output sensing element a benchmarking module processing the sensed output light to generate output light-based data. The apparatus includes a feedback control module modifying a parameter of the display device based on the output light-based data to modify chromaticity or illumination levels of the display device. The feedback control module operates to modify the digital content to provide the displayed content having an adjusted chromaticity.

Abstract: Embodiments can provide adaptive image filtering. Under this approach, image quality can be enhanced by adjusting an approximation function to better adapt image signals in different parts of an image. Certain parts of the image may be enhanced using a certain approximation function while some other parts of the image may be enhanced using a different approximation function. In certain embodiments, the approximation function selected for a part of the image can be a polynomial function having a specific order. The specific polynomial order can be applied directly to obtain an estimated image value of the part of the image. In certain embodiments, the estimation of the reconstruction error can include iteratively estimating a bias term of the reconstruction error and a variance term of the reconstruction error.

Abstract: Views of a virtual space may be presented based on predicted colors of individual pixels of individual frame images that depict the views of the virtual space. Predictive models may be assigned to individual pixels that predict individual pixel colors of individual pixels at individual time points. Individual models may be updated and/or reprojected to other pixels based on comparisons of the predicted pixel colors and colors specified by in a raster input signal.

Abstract: Training data from multiple types of sensors and captured in previous capture sessions can be fused within a physics-based tracking framework to train motion priors using different deep learning techniques, such as convolutional neural networks (CNN) and Recurrent Temporal Restricted Boltzmann Machines (RTRBMs). In embodiments employing one or more CNNs, two streams of filters can be used. In those embodiments, one stream of the filters can be used to learn the temporal information and the other stream of the filters can be used to learn spatial information. In embodiments employing one or more RTRBMs, all visible nodes of the RTRBMs can be clamped with values obtained from the training data or data synthesized from the training data. In cases where sensor data is unavailable, the input nodes may be unclamped and the one or more RTRBMs can generate the missing sensor data.

Abstract: A method of rendering content items on a display via an electronic device involves mapping linked content items to a three-dimensional object defined by layout data. The layout data is then transmitted to an electronic device for display.

Abstract: Individual images for individual frames of an animation may be rendered to include individual focal areas. A focal area may include one or more of a foveal region corresponding to a gaze direction of a user, an area surrounding the foveal region, and/or other components. The foveal region may comprise a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight. A focal area within an image may be rendered based on parameter values of rendering parameters that are different from parameter values for an area outside the focal area.

Abstract: Individual images for individual frames of an animation may be rendered to include individual focal areas. A focal area may include one or more of a foveal region corresponding to a gaze direction of a user, an area surrounding the foveal region, and/or other components. The foveal region may comprise a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight. A focal area within an image may be rendered based on parameter values of rendering parameters that are different from parameter values for an area outside the focal area.

Abstract: Individual images for individual frames of an animation may be rendered to include individual focal areas. A focal area may include one or more of a foveal region corresponding to a gaze direction of a user, an area surrounding the foveal region, and/or other components. The foveal region may comprise a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight. A focal area within an image may be rendered based on parameter values of rendering parameters that are different from parameter values for an area outside the focal area.

Abstract: Embodiments can provide adaptive image filtering. Under this approach, image quality can be enhanced by adjusting an approximation function to better adapt image signals in different parts of an image. Certain parts of the image may be enhanced using a certain approximation function while some other parts of the image may be enhanced using a different approximation function. In certain embodiments, the approximation function selected for a part of the image can be a polynomial function having a specific order. The specific polynomial order can be applied directly to obtain an estimated image value of the part of the image. In certain embodiments, the estimation of the reconstruction error can include iteratively estimating a bias term of the reconstruction error and a variance term of the reconstruction error.

Abstract: Techniques for simulating interactions using an augmented reality device. A visual scene is captured using a camera device. The visual scene depicts of a first physical object within a physical environment. A dynamic interaction is simulated between the first physical object and one or more virtual objects and velocity of a first virtual object resulting from the simulated dynamic interaction is calculated. A predefined behavior for a virtual character to perform is selected in response to the dynamic interaction. The virtual character is distinct from the first virtual object, and the selection is based on the calculated velocity. A sequence of frames is rendered. The sequence of frames depicts the dynamic interaction between the first physical object and the virtual objects, and further depicts a representation of the virtual character performing the determined behavior. The sequence of frames is output for display using one or more display devices.

Abstract: An apparatus displaying content to a viewer by adjusting parameters of the content or display devices based on environmental or display device changes. The apparatus includes a display device with a screen providing digital content. A thematic overlay is provided over the display screen to provide diffuse reflection of light striking the front surface. The output light is a combination of the displayed content from the screen and reflection of light from the thematic overlay. The apparatus includes a digital signage benchmarking tool with an output sensing element a benchmarking module processing the sensed output light to generate output light-based data. The apparatus includes a feedback control module modifying a parameter of the display device based on the output light-based data to modify chromaticity or illumination levels of the display device. The feedback control module operates to modify the digital content to provide the displayed content having an adjusted chromaticity.

Abstract: Techniques for displaying content using an augmented reality device are described. Embodiments provide a visual scene for display, the visual scene captured using one or more camera devices of the augmented reality device. Embodiments adjust physical display geometry characteristics of the visual scene to correct for optimal projection. Additionally, illumination characteristics of the visual scene are modified based on environmental illumination data to improve realism of the visual scene when it is displayed. Embodiments further adjust display characteristics of the visual scene to improve tone mapping output. The adjusted visual scene is then output for display on the augmented reality device.