Abstract: A system includes one or more hardware processors, a head mounted display (HMD) configured to display a virtual environment to a user wearing the HMD, an input device configured to allow the user to interact with virtual objects presented in the virtual environment, and a virtual mini-board module executable by the one or more hardware processors. The virtual mini-board module is configured to perform operations including providing a virtual mini-board to the user within the virtual environment, the virtual mini-board including a representation of a region of the virtual environment, detecting a scroll operation performed by the user, modifying the region of the virtual environment based on the scroll operation, and updating one or more of (1) the virtual environment and (2) the representation of the region of the virtual environment on the virtual mini-board, based on the modifying.

Abstract: A system includes a display device, a memory storing 2-dimensional (2D) content and 3-dimensional (3D) game content associated with a content item, and a playback engine. The playback engine is configured to receive the 2D content, the 2D content including one or more reference identifiers (IDs), display the 2D content on the display device for a user and, during display of the 2D content, receive an indication of a transition event. The playback engine is also configured to determine a transition reference identifier (ID) from the one or more reference IDs, identify the 3D game content based on the transition reference ID, render a 3D game environment based on the 3D content, and transition the display device from the displaying the 2D content to providing the 3D game environment.

Abstract: A method is disclosed for allowing a custom version of video session to be created for presentation on at least one viewer device. Game metadata generated from a live or recorded video feed is received. The game metadata includes three-dimensional modeling data associated with the live or recorded video feed. Viewer metadata collected from a plurality of viewer devices is received. The viewer metadata includes information pertaining to a plurality of responses of a plurality of viewers to a presentation of the video session on a plurality of viewer devices. Additional game metadata is created based on the game metadata and the viewer metadata. The additional game metadata includes camera data based on the three-dimensional modeling data. The additional game metadata is integrated into the game metadata for at least near-real-time presentation of the custom version of the video session.

Abstract: A method of registering multiple devices to a single coordinate system is disclosed. A digital video is received from a digital camera device. The digital video presents a 2D view of a three-dimensional environment surrounding the mobile device. A set of simulated images is generated based on each video frame in the digital video. The simulated images and video frame are analyzed to determine features and create scale and orientation invariant descriptors that include depth information for the features. The descriptors and other data are sent to the server over a network. The descriptors are matched to feature descriptors from a second mobile device. A registration matrix is determined that represents a transformation from a coordinate system in the mobile device to a coordinate system in the second mobile device. The registration matrix is stored on the server to perform the registering of the multiple devices.

Abstract: Methods and apparatuses to improve the performance of a video game engine using an Entity Component System (ECS) are described herein. In accordance with an embodiment, the ECS creates and uses entities, to represent game objects, which are constructed entirely using value data types. The ECS constructs the entities within a memory in a densely packed linear way, and whereby the ECS constantly monitors (e.g., during game play) objects within a game and adjusts the entity distribution within the memory so that a maximum density of memory usage is maintained in real time as the game is being played.

Abstract: A system includes hardware processors and a token exchange module configured to create a uniquely identified first digital token including an owner ID field identifying the current possessor of the digital token, associate the first digital token with digital content presented to the first user in a mixed reality environment, present the digital within the MR environment, make the first digital token available for acquisition, receive a request to acquire the first digital token, assign possession of the first digital token, via the owner ID field, to the first unique user ID of the first user based on the request to acquire the first digital token, receive a request to transfer the first digital token from the first user to the second user, the second user having a second unique user ID, and changing the owner ID field to the second unique user ID based on the request to transfer.

Abstract: A system includes a display device, one or more hardware processors, and a story development engine executable by the one or more hardware processors. The story development engine is configured to perform operations comprising generating a story grid, the story grid including one or more columns, each column of the one or more columns representing one part in a digital story, displaying the story grid to a user via the display device, receiving a first content element, creating a first cell within a first column, associating the first cell with the first content element, and marking the first cell as a selected cell from a plurality of cells within the first column, the selected cell being identified for inclusion as the one part of the digital story and excluding the other cells of the plurality of cells from the digital story.

Abstract: A job scheduler system includes one or more hardware processors, a memory including a job group queue stored in the memory, and a job scheduler engine configured to create a first job group in the job group queue, the first job group includes a generation counter having an initial value, receive a first request to steal the first job group, determine a state of the first job group based at least in part on the generation counter, the state indicating that the first job group is available to steal, based on the determining the state of the first job group, atomically increment the generation counter, thereby making the first job group unavailable for stealing, and alter an execution order of the first job group ahead of at least one other job group in the job group queue.

Abstract: A method for improving a display of a user interface element in a mixed reality environment is disclosed. A request to display the user interface element is received. The request includes display instructions, angle threshold data, distance threshold data, and velocity threshold data. Display operations are continuously performed while sensor data is continuously received from a mixed reality user interface device. The display operations include displaying the user interface element according to the display instructions, and, based on the sensor data indicating a distance between the user interface element and the mixed reality user interface device in the mixed reality environment has exceeded a distance threshold or based on the sensor data indicating an angle of view of the mixed reality user interface device has exceeded an angle threshold with respect to the user interface element in the mixed reality environment, hiding the user interface element.

Abstract: A system includes a memory, processors, and an asset player module configured to identify a playable asset configuration for a first playable asset, including a first graph configuration identifying processing nodes and edges, each node in the graph configuration represents a media processing component configured to modify media inputs to generate a media output, construct a graph in the memory based on the first graph configuration, receive a first set of media inputs, execute the media processing components in an order based on the graph configuration and using the first set of media inputs as the one or more input media components, based on said executing, generate a media output configured to be played by a conventional media player, alter the graph at runtime, thereby changing the media processing components identified within the graph, and execute the media processing components of the graph after the altering.

Abstract: A method of implementing a plurality of contextual applications within a mixed reality (MR) environment on an MR-capable device of a user is disclosed. At least one real-world object is identified in the MR environment by applying an object recognition algorithm to one or more attributes of the at least one real-world object that are captured by sensors of the MR-capable device. A first contextual application of the plurality of contextual applications is used to determine an association between a first set of contextual triggers and a second contextual application of the plurality of contextual applications. A second contextual application is initiated based on a satisfying of the at least one contextual trigger. A function is invoked within the second contextual application based on an interaction of the user with at least one virtual object satisfying a second set of contextual triggers associated with the second contextual application.

Abstract: A method, system, and computer-readable medium including operations for optimizing computer code is disclosed. A block of mixed intermediate representation (MIR) code is received. A partially-decompiled block of computer code is generated from the MIR code. For each instruction in the block of MIR code, in reverse order, a native expression vector for the instruction is computed. A set of pattern-matching operations is repeated until no transformations occur. A fully-decompiled block of computer code is generated from the partially-decompiled block of computer code, the fully-decompiled block of computer code having a semantic level that is raised. The fully-decompiled block of computer code is provided for deployment on an architecture, the deployment including lowering the semantic of the computer code to a level that corresponds to a CPU or GPU supported by the architecture.

Abstract: A system includes one or more hardware processors, a display device, a memory storing 2-dimensional (2D) content and 3-dimensional (3D) content associated with a content item, and a playback engine. The playback engine is configured to receive the 2D content, the 2D content including one or more reference identifiers (IDs), display the 2D content on the display device for a user and, during display of the 2D content, receive an indication of a transition event. The playback engine is also configured to determine a transition reference identifier (ID) from the one or more reference IDs, identify the 3D content based on the transition reference ID, render a 3D environment based on the 3D content, and transition the display device from the displaying the 2D content to the 3D environment.

Abstract: A system includes one or more hardware processors, a head mounted display (HMD), a digital camera device, and a path extraction engine. The path extraction engine is configured to receive two-dimensional (2D) video from the digital camera device, the 2D video presenting a 2D view of a three-dimensional (3D) object, the digital camera device moving along a camera path as the digital camera device captures the 2D video, identify a plurality of 2D features associated with the 3D object within the 2D video, track the plurality of 2D features across multiple frames of the 2D video, estimate motion in pixels associated with each 2D feature of the plurality of 2D features, using the estimated motion in the pixels, identify 2D motion caused by the digital camera device moving along the camera path, and compute a first camera position of the digital camera device based on the identified 2D motion.

Abstract: A system includes one or more hardware processors, a memory storing vosset data for a virtual object, the vosset data including a first displacement threshold and a first component, and a vosset module executable by the one or more hardware processors. The vosset module is configured to display the first component of the virtual object to a user in a virtual environment, display a manipulator object adjacent to the virtual object in the virtual environment, the manipulator identifies a pre-determined direction of displacement, detect a displacement event associated with the manipulator object, the displacement event being initiated by the user performing a grab event on the manipulator object and extending the manipulator object a displacement distance in the direction of displacement, determine that the displacement distance exceeds a displacement threshold, and alter the virtual object based on detecting the determining that the displacement distance exceeds the displacement threshold.

Abstract: A system includes hardware processors and a token exchange module configured to create a uniquely identified first digital token including an owner ID field identifying the current possessor of the digital token, associate the first digital token with digital content presented to the first user in a mixed reality environment, present the digital within the MR environment, make the first digital token available for acquisition, receive a request to acquire the first digital token, assign possession of the first digital token, via the owner ID field, to the first unique user ID of the first user based on the request to acquire the first digital token, receive a request to transfer the first digital token from the first user to the second user, the second user having a second unique user ID, and changing the owner ID field to the second unique user ID based on the request to transfer.

Abstract: A system includes processors, a head mounted display, a hand-tracking input device, and an editor engine. The editor engine performs operations including identifying a set of virtual assets, each virtual asset includes data associated with a 3D object, creating a card tray within a virtual environment, creating one or more virtual cards within the card tray, the one or more virtual cards including a first virtual card, the first virtual card is configured with a first interaction mechanic including a triggering gesture and an associated gesture response, the triggering gesture allows the user to interact with the first virtual card within the virtual environment by performing the triggering gesture, detecting performance of the triggering gesture by the user on the first virtual card using the first hand-tracking input device, and based on detecting performance of the triggering gesture, performing the gesture response associated with the first interaction mechanic.

Abstract: A system includes hardware processor(s), an HMD, an input device, and an onion skin animation module. The animation modules is configured to receive a character rig of a 3D character, receive a first 3D animation of the 3D character, the first 3D animation defines a motion sequence of the 3D character based on the character rig, create a virtual time bar within the virtual environment, the virtual time bar displaying a timeline associated with the first 3D animation, identify a first animation time within the first 3D animation, the first animation time is a point in time during the motion sequence, create a first pose object of the 3D character in the virtual environment, pose the first pose object based on the first 3D animation at the animation time, and positioning the first pose object within the virtual environment proximate the first animation time on the virtual time bar.

Abstract: A system includes hardware processors and a texturing module configured to display a texturing tray within a virtual reality environment or a mixed reality environment, the texturing tray including a first plurality of texturing mode objects, detect that a user has grabbed a first texturing mode object of the first plurality of texturing mode objects from the texturing tray with a virtual hand of the user, based on motion of the virtual hand after the grabbing, moving the first texturing mode object into a position adjacent to a surface of a target object, detect that the user has applied a texturing agent toward the first texturing mode object, and apply a texture effect to the surface of the target object based on a virtual interaction between the texturing agent and the first texturing mode object, the texture effect altering the appearance of the surface of the target object.

Abstract: A head-mounted display device including first and second display surfaces associated with first and second eyes of the user, a graphics processing unit, one or more hardware processors, and an adaptive rendering module. The adaptive rendering module is configured to identify a threshold frame time, the threshold frame time representing an upper threshold of time to render frame data by the GPU, receiving a first frame time associated with rendering a first frame to the first eye and second eye of the user, the first frame being rendered at a target resolution, determining that the first frame time exceeds the threshold frame time, and lowering the resolution below the target resolution for parts of a second frame associated with the first eye of the user while maintaining the resolution for parts of the second frame at the target resolution for images associated with the second eye of the user.