Abstract: Techniques for generating an arbitrary view or perspective of an ensemble scene are disclosed. In some embodiments, in response to a received request for a prescribed perspective of an ensemble scene comprising a plurality of assets, an output image of the ensemble scene for the requested prescribed perspective is generated based at least in part on combining at least a portion of an existing image of each of at least a subset of the plurality of assets.

Abstract: Various techniques associated with automatic mesh generation are disclosed. One or more center curves of an outline of an object or figure are first determined. Next, for each of a plurality of points of each of the one or more center curves, a pair of rays is cast from a center curve in opposite directions, wherein the rays collide with opposite sides of the outline, and a collision pair is generated that comprises a line connecting collision points of the pair of rays on opposite sides of the outline. A mesh model of the object or figure is generated by mapping each of a set of collision pairs to polygons used to define the mesh model.

Abstract: Techniques for generating a prescribed perspective of a scene are disclosed. In some embodiments, a specification of a scene comprising a plurality of objects is specified using object views that are substantially free of perspective distortions, and a prescribed perspective of the scene is at least in part generated by populating the prescribed perspective of the scene with pixels from existing images of the plurality of objects.

Abstract: A machine learning based image processing architecture and associated applications are disclosed herein. In some embodiments, a machine learning framework is trained to learn low level image attributes such as object/scene types, geometries, placements, materials and textures, camera characteristics, lighting characteristics, contrast, noise statistics, etc. Thereafter, the machine learning framework may be employed to detect such attributes in other images and process the images at the attribute level.

Abstract: A machine learning based image processing architecture and associated applications are disclosed herein. In some embodiments, a machine learning framework is trained to learn low level image attributes such as object/scene types, geometries, placements, materials and textures, camera characteristics, lighting characteristics, contrast, noise statistics, etc. Thereafter, the machine learning framework may be employed to detect such attributes in other images and process the images at the attribute level.

Abstract: Improved techniques for generating video content are disclosed. In some embodiments, it is determined whether a frame comprising a scene is an independent frame or a predictive frame. In the event that the frame is an independent frame, the frame is encoded independently. In the event that the frame is a predictive frame, block differences and motion vectors are encoded, wherein motion vectors are determined from a known three-dimensional model and time evolution of the scene.

Abstract: Adaptive sampling of pixels is disclosed. In some embodiments, convergence of pixels of a rendering is evaluated by removing texture from the rendering to eliminate non-convergence due to texture complexity and determining whether pixels values satisfy convergence criteria associated with pixel sampling. Those pixels of the rendering that have not converged are sampled with one or more additional samples. The completed rendering is output. Pixels of the completed rendering satisfy the convergence criteria and are not uniformly sampled.

Abstract: Techniques for virtualizing content are disclosed. Elements comprising source content are virtualized by mapping each to and representing each with a corresponding database object. A specification of the corresponding database objects is provided for rendering the source content instead of any original pixel information of the source content so that a virtualized version of the source content is rendered.

Abstract: Techniques for generating an ensemble image are disclosed. In some embodiments, images associated with a plurality of independent scenes are translated to a prescribed origin, translated images associated with each independent scene are transformed into a prescribed perspective; and pixels of an image array having the prescribed perspective that is associated with each independent scene is populated with corresponding pixels from the transformed translated images associated with that independent scene. An ensemble image comprising the prescribed perspective is at least in part generated by combining at least some pixels of image arrays associated with the plurality of independent scenes.

Abstract: Two-dimensional compositing that preserves the curvatures of non-flat surfaces is disclosed. In some embodiments, a mapping is associated with a two-dimensional rendering that maps a potentially variable portion of the two-dimensional rendering to a canvas. The mapping is generated from a three-dimensional model of the potentially variable portion of the two-dimensional rendering. The potentially variable portion of the two-dimensional rendering is dynamically modified according to the mapping to reflect content comprising the canvas or edits received with respect to the canvas.

Abstract: Techniques for generating aligned, augmented reality views are disclosed. In some embodiments, an estimate of a floorplan of a three-dimensional space is first generated based on one or more received views of the three-dimensional space from a camera located in the three-dimensional space. A camera pose of the camera in the three-dimensional space is next determined based on generating a corrected floorplan from the estimate of the floorplan based on foreknowledge associated with the floorplan. Display of a rendering having the determined camera pose is facilitated in an actual view of the camera, resulting in an aligned, augmented reality view.

Abstract: Techniques for generating an arbitrary view of a scene from existing images of the scene are disclosed. In some embodiments, an image of a scene having a desired perspective is at least in part generated by populating some pixels of the image having the desired perspective using pixels obtained from a transformed existing image of the scene that is selected from a stored set of existing images associated with the scene and that is transformed to the desired perspective.

Abstract: A machine learning based image processing architecture and associated applications are disclosed herein. In some embodiments, a machine learning framework is trained to learn low level image attributes such as object/scene types, geometries, placements, materials and textures, camera characteristics, lighting characteristics, contrast, noise statistics, etc. Thereafter, the machine learning framework may be employed to detect such attributes in other images and process the images at the attribute level.

Abstract: Techniques for rendering a scene are disclosed. In some embodiments, a local database is populated with received three-dimensional object definitions. A received specification of a scene comprising a specification of objects comprising the scene is rendered according to the received specification using one or more three-dimensional object definitions already available in the local database.

Abstract: A machine learning based image processing architecture and associated applications are disclosed herein. In some embodiments, a machine learning framework is trained to learn low level image attributes such as object/scene types, geometries, placements, materials and textures, camera characteristics, lighting characteristics, contrast, noise statistics, etc. Thereafter, the machine learning framework may be employed to detect such attributes in other images and process the images at the attribute level.

Abstract: Techniques associated with adaptive sampling are disclosed. In some embodiments, in response to receiving a specification of a scene to render, a sampling of each portion of the scene is determined based at least in part on the specification of the scene such that the scene is not uniformly sampled, and the scene is rendered according to the determined sampling of each portion of the scene.

Abstract: Techniques for providing blended physical and virtual reality experiences are disclosed. In some embodiments, a pose of a camera of a device located in a venue is determined based at least in part on three-dimensional asset recognition in a field of view of the camera, wherein the field of view of the camera comprises an actual physical view of the venue; a virtual view corresponding to the actual view is obtained from existing assets comprising a specification of a virtualized version of the venue; and display of the virtual view is facilitated at the venue. Thus, a virtual reality of a physical space is provided while at the physical space based on actual three-dimensional objects detected or recognized in the physical space.

Abstract: Improved techniques for generating video content are disclosed. In some embodiments, a frame is rendered using a first rendering option. It is then determined whether the frame is an independent frame (I-frame) or a predictive frame (P-frame). In the event that the frame is an I-frame, the frame is rendered using a second rendering option that has a higher computational complexity than the first rendering option and encoded independently. In the event that the frame is a P-frame, motion vectors and prediction error with respect to the frame and one or more other frames are determined and encoded.

Abstract: Techniques for generating an arbitrary view of a scene are disclosed. In some embodiments, arbitrary view generation includes storing sets of images associated with corresponding assets in a database and generating an image comprising a requested view of a scene using images associated with one or more assets comprising the scene that are stored in the database.

Abstract: Adaptive sampling of pixels is disclosed. In some embodiments, a rendering of a scene is generated by sampling each pixel of the rendering with a prescribed number of samples. Subsequently, those pixels of the rendering that do not satisfy a noise threshold are iteratively sampled with an additional sample during each iteration until all pixels of the rendering satisfy the noise threshold. The noise threshold is associated with noise arising due to under sampling. Pixels comprising the completed rendering are not uniformly sampled.