Abstract: A method of populating a digital environment with an anonymous humanoid digital character is disclosed. One or more values are randomly determined for one or more target human properties. An asset pool is searched for assets that are compatible with the one or more values. The assets include a human body mesh. A blend of height and weight vertex animation textures (VATs) is applied to the human body mesh. The blended human body mesh is placed into the digital environment.

Abstract: An AI-assisted texture generation system and method that generates a texture for an object such as a 3D mesh. At a given iteration, the system renders, from a viewpoint, one or more of an object depth and a cumulative texture associated with a cumulative pixel quality map; determines an estimated pixel quality map associated with the viewpoint; generates, at the viewpoint, a new texture associated with the object based on one or more of the object depth, the cumulative texture, and a refine mask; updates the cumulative texture based on the new texture; and updates the cumulative pixel quality map based on the estimated pixel quality map. In some examples, the refine mask is computed based on the cumulative pixel quality map and an estimated pixel quality map. In some examples, the new texture is generating using an augmented inpainting diffusion model for image generation.

Abstract: A method of implementing eye-field user interactions is disclosed. One or more light markers are displayed within an eye-field region of a head-mounted display device. The eye-field region is positioned within a configurable distance of a user's eyes and at a distance where both eyes of the user can focus on the one or more light markers. It is detected that the user is focusing on a first light marker of the one or more light markers. In response to detecting that the user is focusing on the first light marker, the first light marker is moved in a confirmation pattern while. A virtual input event is triggered when the user's gaze follows the first light marker through the confirmation pattern with at least a threshold level of accuracy for a configurable duration.

Abstract: A method of generating physically-based rendering (PBR) textures is disclosed. A 3D mesh input is received. One or more text prompts associated with the 3D mesh input are received. The 3D mesh input and the one or more text prompts are in put into a trained machine-learning model. Output data is received from the trained machine-learning model. The output data comprises material and texture information. The material and texture information enables rendered views of the 3D mesh with the output data to respond to changes in lighting in a real-time 3D rendering environment.

Abstract: A method of rendering 3D content in a mixed reality environment is disclosed. A volume camera is defined within first virtual environment. The volume camera is configured to capture a 3D volume of space. The defining includes setting parameters for a position or an orientation to be captured by the volume camera. A volume view transform is applied to the volume camera to establish a perspective of the volume camera within the 3D volume of space. The volume view transform is configured to define the position or the orientation relative to the 3D content in the 3D volume of space. Selected 3D content is processed within the 3D volume of space based on a configuration of the volume camera. The selected 3D content is rendered into a second virtual environment based on the configuration. The rendering includes adapting to a perspective of a user within the second virtual environment.

Abstract: The system efficiently distributes data in a cloud pipeline to geographically distributed users. To enable efficient distribution of resources to multiple users, the production pipeline can be represented as two flow graphs: a flow graph of tasks as well as a flow graph of data. The flow graph of tasks can indicate a sequence of tasks, departments, and users in a production pipeline. The flow graph of data can indicate location of data needed for each task in the flow graph of tasks, and location of the users assigned to the particular task. Based on the next task that needs to be executed in the flow graph of tasks, the system can proactively gather the data from the various locations and deliver the data to the users assigned to executing the next task.

Abstract: Disclosed is a content distribution system including a content server communicatively coupled to a data packet network and running one or more server-side components. A mobile computing device also communicatively coupled to the data packet network and running a client-side component may be configured to: (a) receive from said one or more server-side components a mobile device operational scenario definition; (b) activate or configure one or more monitoring routines in accordance with the device operational scenario definition; and (c) monitor said mobile computing device for an occurrence of the defined operating scenario using the activated or configured monitoring routines.

Abstract: Systems, methods, and non-transitory computer-readable media can obtain a stream of audio waveform data that represents speech involving a plurality of speakers. As the stream of audio waveform data is obtained, a plurality of audio chunks can be determined. An audio chunk can be associated with one or more identity embeddings. The stream of audio waveform data can be segmented into a plurality of segments based on the plurality of audio chunks and respective identity embeddings associated with the plurality of audio chunks. A segment can be associated with a speaker included in the plurality of speakers. Information describing the plurality of segments associated with the stream of audio waveform data can be provided.

Abstract: Disclosed is a method to determine influence of a deformation of a curve on a surface. A processor obtains deformations of the curve and desired deformations of the surface. The processor obtains a first point on the surface and determines the influence of the deformation of the curve on the surface by determining a second point on the curve and iterating over a desired deformation of the surface and a corresponding curve. To iterate, the processor determines a desired position of the first point of the desired deformation, determines a position of the first point based on a position of the second point on the corresponding curve and a parameter indicating the influence, and calculates a difference between the desired position of the first point and the determined position of the first point. Based on the difference, the processor adjusts the parameter, and determines the influence based on the parameter.

Abstract: A computer-implemented method and interface provides visualization for a volume and/or a change in a volume of a virtual object, the representation usable in a user interface, comprising a first representation of the virtual object represented by a surface positioned in a three-dimensional (3D) virtual space, a bounding object input that defines a bounding object relative to the 3D virtual space, a plurality of local volumes of the virtual object, wherein a local volume of the plurality of local volumes is computed for geometry based on a bounding object feature associated with the bounding object and based on at least some vertices of the corresponding face, wherein at least some of the plurality of local volumes are aggregated to determine a global volume for the set of polygonal faces, and providing for display of a first visual indicator representing a value of the global volume.

Abstract: A method of performing operations for executing a progressive interactive augmented reality (AR) advertisement display during execution of a running application is disclosed. based on a receiving of a first trigger event from the running application, a first aspect of the progressive AR advertisement is executed within a display window while the application is executing. The first aspect includes an interactive advertisement. Based on a receiving of a second trigger event from within the first aspect of the progressive AR advertisement, a second aspect of the progressive AR advertisement is executed in the display window while the application is executing. The second aspect includes an interactive AR advertisement.

Abstract: An image dataset comprising pixel depth arrays might be processed by an interpolator, wherein interpolation is based on pixel samples. Input pixels to be interpolated from and an interpolated pixel might comprise deep pixels, each represented with a list of samples. Accumulation curves might be generated from each input pixel, weights applied, and accumulation curves combined to form an interpolation accumulation curve. An interpolated deep pixel can be derived from the interpolation accumulation curve, taking into account zero-depth samples as needed. Samples might represent color values of pixels.

Abstract: An animation system wherein a machine learning model is adopted to learn a transformation relationship between facial muscle movements and skin surface movements. For example, for the skin surface representing “smile,” the transformation model derives movement vectors relating to what facial muscles are activated, what are the muscle strains, what is the joint movement, and/or the like. Such derived movement vectors may be used to simulate the skin surface “smile.”.

Abstract: An image dataset is processed with a shadow map generated from objects in a virtual scene that can cast shadows and the scene is rendered independent of the shadows. The shadow might be edited separately, and then applied to a post-render image of the scene to form a shadowed image. Light factor values for pixels of the shadow map might be stored as summed-area table values.

Abstract: An image generator generates images of a set of virtual fibers and effects thereon by processing representations of the set of fibers and computing representation of a virtual surface for a fiber clump in the set of virtual fibers from an artist parameter representing a desired artist effect, computing correlations of the vertices from a set of vertices based on associations of the vertices corresponding to the artist parameter, computing a set of relevant vertices using the correlations of the vertices, computing orthogonal gradients to produce a plurality of gradients using a selected vertex and the set of relevant vertices for the fiber clump, and computing the virtual surface of the fiber clump from the plurality of gradients.

Abstract: A computer-implemented method for generating a mask for a light source in a virtual scene includes determining a bounding box for the scene based on a frustum of a virtual camera and generating a path-traced image of the scene within the bounding box. Light paths emitted by the camera and exiting at the light source are stored, and objects poorly sampled by the light source are removed from the scene. An initial mask for the light source is generated from the density of light paths exiting at that position on the light source. The initial mask is refined by averaging in the light path density at each point on the light source for subsequent images.

Abstract: A realistic feather generation may be represented via a user interface in a modeling system. To perform the feather generation, a curve defining a spine of a feather is received from input to the user interface of the modeling system. The feather is created in the user interface based at least on the curve, where the feather includes barbs extended away from the spine of the feather in one or more directions. The feather is deformed based on one or more deformation parameters. A feather contour of the barbs along at least one of the one or more directions is generated based on a contour parameter defining the feather contour. A barb density for a number of the barbs along the spine of the feather is established based on a barb density parameter. Thereafter, a data structure representing the feather is generated.

Abstract: A combustion simulation system is provided. The combustion simulation system can be performed using a computing device operated by a computer user or artist. The computer-implemented method of generating one or more visual representations of a combustion even is provided. The method includes simulating the combustion event, which transforms combustion reactants into combustion products, the combustion event occurring at a reference pressure, automatically determining values of combustion properties, the values of the combustion properties being calculated as a function of a nonzero pressure field, and generating the one or more visual representations of the combustion event based on the values of combustion properties.

Abstract: A computer-implemented method for managing associations between production elements and production approaches includes displaying, within a breakdown panel, a representation of at least one scene obtained from a script, the representation including a plurality of production elements; displaying, within an approaches panel, a representation of at least some of the plurality of production elements displayed within the breakdown panel, and associated respective user selection indicators; and displaying, within the approaches panel, a representation of at least one production approach. The method further includes receiving a user selection of at least one production element displayed within the approaches panel; receiving a user selection of the at least one production approach. The selected at least one production element is associated with the selected at least one production approach.

Abstract: An animation system is provided for generating an animation control rig for character development, configured to manipulate a skeleton of an animated character. Hierarchical representation of puppets includes groups of functions related in a hierarchy according to character specialization for creating the animated rig are derived using base functions of a core component node. The hierarchical nodes may include an archetype node, at least one appendage node, and at least one feature node. In some implementations, portions of a hierarchical node, including the functions from the core component node, may be shared to generate different animation rigs for a variety of characters. In some implementations, portions of a hierarchical node, including the component node functions, may be reused to build similar appendages of a same animation rig.