Abstract: Embodiments of the systems and methods described herein provide a terrain generation and population system that can determine terrain population rules for terrain population objects and features when placing objects and features in a three dimensional virtual space. As such, the terrain generation and population system can generate realistic terrain for use in game. The terrain generation and population system can receive an image, such as a satellite image, and utilize artificial intelligence to perform image segmentation at the pixel level to segment features and/or objects in the image. The game terrain system can automatically detect and apply feature and object masks based on the identified features and/or objects from the image segmentation. The game terrain system can place the features and/or objects in corresponding masks in the three dimensional space according to the application of terrain population rules.

Abstract: Systems and methods are provided for enhanced animation generation based on generative modeling. An example method includes training models based on faces and information associated with persons, each face being defined based on location information associated with facial features, and identity information for each person. The modeling system being trained to reconstruct expressions, textures, and models of persons.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for rendering audio via a game engine for a game. Various aspects may include determining sound source reverb metrics and listener reverb metrics. Aspects may include determining reverbs within a reverb possibility space for all rooms or spaces of the game rendered by the game engine. Aspects may also include determining sound tuning parameters describing reverb attenuation over distance. Aspects may include calculating acoustic parameters based on the reverb metrics, relative positions, and sound tuning parameters. Aspects may include rendering audio according to a fit of determined reverbs to the acoustic parameters.

Abstract: Systems and methods of curiosity driven reinforcement learning agents promote novel exploration of a virtual interactive environment. The data of the exploration can be stored in a buffer to determine, generate, and display visualizations in the virtual interactive environment. The visualizations can correspond to identify issues in the virtual interactive environment and/or identify relationships between regions of the virtual interactive environment.

Abstract: A gaming system may allow for a user to capture and/or edit simulation state data of gameplay in a video game such that a replay of the gameplay may be rendered and/or shared. The gaming system may receive simulation state data and a request. The simulation state data may include simulation state(s) which include a model and pose state of an avatar corresponding to a player in a game simulation of a video game previously rendered as rendered view(s). The request may request a replay of the simulation state data with modification(s). The gaming system may modify the simulation state data to generate modified simulation state data and render, based on the modified simulation state data, replay view(s) that differ from the previously rendered view(s). The gaming system may then output the replay view(s) to a display of a computing device.

Abstract: Systems and methods for determining whether to enable color blind accessibility settings within the course of a user interactive narrative are described herein. Virtual color blindness indication objects containing colors that are visibly distinguishable within a single dichromatic visual spectrum can be utilized in objectives to determine a user's dichromatic visual deficiency type.

Abstract: Systems and methods for performing a processing operation for a tiled image region are disclosed. The tiled image region may include a plurality of tiles or images. Further, the tiled image region may correspond to a plurality of image resolutions. A system may execute a game development application to perform the processing operation for the tiled image region. The system may identify the tiled image region corresponding to the processing operation. The system can utilize a texture array, a lookup texture, and a scaling factor to determine position data for the tiled image region. The system can then render a continuous image region that represents the tiled image region. The system can seamlessly process the continuous image region according to the processing operation and use the continuous image region to update the tiled image region.

Abstract: The disclosure relates to systems and methods for altering perception of virtual or game content in a virtual space based on one or more attribute levels. The perception of some virtual or game content may not be altered. Thus, the depiction of some content is altered while other content is not. A system may alter the depiction of game content based on attributes of an entity and/or based on which entity is to perceive the game content. The different depictions of game content may be provided to the same entity at different times and/or different perceptions of game content may be provided to different entities. Thus, a rich interface may be provided that differentially depicts game content based on attribute levels and/or the entity that is to perceive the game content.

Abstract: An identity authenticator receives a first authentication credential from a first application at a first computing device. The identity authenticator then determines that the first authentication credential is associated with a second authentication credential for the first application at a second computing device based on a stored authentication identity. The identity authenticator then provides a stored execution state for the first application to the first computing device, wherein the stored execution state is associated, based on the stored authentication identity, with at least one of the first authentication credential or the second authentication credential.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine- readable media for adjusting controller settings. The method includes receiving, through a controller associated with a user, controller input for software. The method also includes determining, based on the controller input, a user profile for the user comprising at least a skill level and an input tendency of the user. The method also includes providing suggested adjustments to the controller settings intended to improve performance of the user in relation to the software, the controller settings comprising at least one of controller sensitivity or controller assignments. The method also includes receiving approval of the user to implement the suggested adjustments to the controller settings. The method also includes adjusting the controller settings based on the approval of the user.

Abstract: A UI state crawler system may allow for the crawling of a video game UI that may identify and map UI states of the video game. The UI state crawler system may determine a user interface (UI) state identifier (ID) for a UI state of a UI of a video game based at least in part on a plurality of node IDs corresponding to a plurality of nodes of a hierarchical structure of the UI and determine a UI state map does not include a UI state map node corresponding to the UI state ID. In response to the determining the UI state map does not include the UI state map node corresponding to the UI state ID, the UI state crawler system may generate an updated UI state map including the UI state map node corresponding to the UI state ID.

Abstract: A system and method optimizes game quality by matching players for an online game to one of several virtual games. This matching process may involve filtering the players who wish to play according to various constraint minimizing criteria, packing the players into one or more virtual games to optimize game quality factors of the virtual games, and then instantiating the virtual games to actual online games played by the players. The game packing process may be iterative and may involve adding a new player into a virtual game. Game quality factor (GQF) values prior to and after the placement of the new player in the virtual game may be compared. The comparison of the GQF values may be used, at least in part to determine whether the new player is to remain in the virtual game. Various criteria may be considered in instantiating a virtual game.

Abstract: A computer-implemented method for generating a machine-learned model to generate facial position data based on audio data comprising training a conditional variational autoencoder having an encoder and decoder. The training comprises receiving a set of training data items, each training data item comprising a facial position descriptor and an audio descriptor; processing one or more of the training data items using the encoder to obtain distribution parameters; sampling a latent vector from a latent space distribution based on the distribution parameters; processing the latent vector and the audio descriptor using the decoder to obtain a facial position output; calculating a loss value based at least in part on a comparison of the facial position output and the facial position descriptor of at least one of the one or more training data items; and updating parameters of the conditional variational autoencoder based at least in part on the calculated loss value.

Abstract: Systems and methods are disclosed for calculating dynamic ambient occlusion (AO) values for character models to yield high-quality approximations of global illumination effects. The approach utilizes a dual component machine-learning model that factorizes dynamic AO computation into a non-linear component, in which visibility is determined by approximating spheres and their casted shadows, and a linear component that leverages a skinning-like algorithm for efficiency. The parameters of both components are trained in a regression against ground-truth AO values. The resulting model accommodates lighting interactions with external objects and can be generalized without requiring carefully constructed training data.

Abstract: Systems and methods are provided for enhanced pose generation based on conditional modeling of inverse kinematics. An example method includes accessing an autoencoder trained based on poses, with each pose being defined based on location information of joints, and the autoencoder being trained based on conditional information indicating positions of a subset of the joints. The autoencoder is trained to reconstruct, via a latent variable space, each pose based on the conditional information. Information specifying positions of the subset of the joints is obtained via an interactive user interface and the latent variable space is sampled. An output is generated for inclusion in the interactive user interface based on the sampling and the positions.

Abstract: In some embodiments, the dynamic animation generation system can provide a deep learning framework to produce a large variety of martial arts movements in a controllable manner from unstructured motion capture data. The system can imitate animation layering using neural networks with the aim to overcome challenges when mixing, blending and editing movements from unaligned motion sources. The system can synthesize movements from given reference motions and simple user controls, and generate unseen sequences of locomotion, but also reconstruct signature motions of different fighters. For achieving this task, the dynamic animation generation system can adopt a modular framework that is composed of the motion generator, that maps the trajectories of a number of key joints and root trajectory to the full body motion, and a set of different control modules that map the user inputs to such trajectories.

Abstract: System and methods for using a deep learning framework to customize animation of an in-game character of a video game. The system can be preconfigured with animation rule sets corresponding to various animations. Each animation can be comprised of a series of distinct poses that collectively form the particular animation. The system can provide an animation-editing interface that enables a user of the video game to make modifications to at least one pose or frame of the animation. The system can realistically extrapolate these modifications across some or all portions of the animation. In addition or alternatively, the system can realistically extrapolate the modifications across other types of animations.

Abstract: Disclosed are issue tracking systems, troubleshooting techniques, and user interfaces for troubleshooting, which are associated with a user of a software application triggering the recording of a session. During the session, the user may narrate suggestions or problems for the application while they interact with the application in real-time, and a recording engine of the application may record various types of session data, such as the user's interaction, narration, telemetry data, call stack data, and so forth. The session data is automatically submitted to an issue tracking system to process a support ticket. The issue tracking system may provide a user interface enabling a developer to review a support ticket and any associated session data to quickly determine the relevant portion of the application data (e.g., underlying program code) that needs to be modified. The issue tracking system may also process session data to identify related tickets or recurring issues.

Abstract: A method, device, and computer-readable storage medium for generating shadows in an image of a scene. The method includes: generating a shadow map to determine pixels in shadow; for each pixel in shadow, performing a sampling of neighboring pixels; for each pixel in shadow, computing an average brightness of the sampling to generate a shadow mapped shadow value; determining a set of close shadow edge pixels, which are shadow edge pixels that correspond to locations on an object that are below a threshold distance to an occluding object; for each pixel in the set of close shadow edge pixels, performing ray tracing to determine a ray traced shadow value; and outputting shadow values for pixels in shadow, wherein the output is based on the ray traced shadow value for the close shadow edge pixels, and the output is based on the shadow mapped shadow value for other shadow pixels.

Abstract: A change tracking and analytics system and method receives software code blocks from one or more repositories of software related to a software project, such as a new video game. Changes associated with software code blocks, such as relative to previous versions of the software code blocks, may be determined and logged. Additionally, various analytics, such as metrics associated with complexity, divergence from a master version of software code blocks, and/or any cascading effects of the software code blocks may be generated and stored in association with the software code blocks. The change information and analytics may then be used to generate any variety of reports indicating complexity, divergence, or the like over time, information related to software code blocks, and/or information related to behavior of software teams. The change information may also be used to make changes to allocated resources, such as quality assurance resources and/or software engineering resources.