Abstract: Two dimensional images are converted to a 3D neural radiance field (NeRF), which is modified based on text personalized to a player and input to resemble the accoutrement for a character demanded by the text. A model scores how well an image matches a line of text to produce a final 3D NeRF, which may be converted to a polygonal mesh and imported into a computer simulation such as a computer game.

Abstract: A graphics shader takes in two grayscale images (called “masks”) and four colors and generates a full-color image. The logic behind the shader is two-fold. First, separating the colors from the image enables a greater variety of images (for example, change one color to get different colored brick walls), and secondly, two grayscale masks take up less space in memory than a full-color image. A script that uses differentiable programming and gradient descent “finds” the masks and colors for a target image.

Abstract: Two dimensional images are converted to a 3D neural radiance field (NeRF), which is modified based on text input to resemble the type of character demanded by the text. An open-source “CLIP” model scores how well an image matches a line of text to produce a final 3D NeRF, which may be converted to a polygonal mesh and imported into a computer simulation such as a computer game.

Abstract: A method, computer-readable medium, and system are disclosed for an interactive storytelling environment. The method comprises identifying a plurality of storytelling devices available to participate in a storytelling experience, including a first storytelling device at a first physical location and a second storytelling device at a remote second physical location. The method further comprises receiving, based on user input during playback of a story, an instruction to perform a first action of a predetermined plurality of actions using the second storytelling device, the user input indicating a user interaction with a depiction of the second storytelling device at the first physical location. The method further comprises performing, based on timing information included in the received instruction, the first action using the second storytelling device such that performing the first action is at least partly synchronized with performance of an animation sequence of the depicted second storytelling device.

Abstract: Systems and methods of simulating first-person control of remoted-controlled vehicles are described herein. The system may include one or more of a remote-controlled (RC) vehicle, a display interface, an input interface, and/or other components. The RC vehicle may have an image capturing device configured to capture in-flight images. View information representing the captured images may presented on a display worn and/or otherwise accessible to user. The input interface may allow the user to provide control inputs for dictating a path of the RC vehicle. Augmented reality graphics may be overlaid on the view information presented to the user to facilitate gameplay and/or otherwise enhance a user's experience.

Abstract: A method, computer-readable medium, and system are disclosed for an interactive storytelling environment. The method comprises identifying a plurality of storytelling devices available to participate in a storytelling experience, at least one of the plurality of the storytelling devices comprising a first beacon device. The method further comprises beginning playback of a first story of the storytelling experience, the first story comprising a first plurality of predetermined actions associated with a predetermined first virtual setting, the first virtual setting mapped to the first beacon device. The method further comprises determining a location of a user using the first beacon device, and during playback of the first story and using at least one of the plurality of storytelling devices, producing one or more of the at least one audiovisual effect corresponding to the first virtual setting based on the determined location of the user.

Abstract: This disclosure relates to systems and methods for augmenting an appearance of a hilt to simulate a bladed weapon. A hilt may be augmented with a blade of a bladed weapon by detecting a landmark associated with the hilt, determining a position and/or an orientation of the hilt, determining an overlay image comprising the blade of the bladed weapon, wherein the blade is placed within the overlay image according to the determined position and/or the determined orientation of the hilt, and displaying the overlay image so that the blade of the bladed weapon appears to be attached to the hilt.

Abstract: Systems and methods of simulating first-person control of remoted-controlled vehicles are described herein. The system may include one or more of a remote-controlled (RC) vehicle, a display interface, an input interface, and/or other components. The RC vehicle may have an image capturing device configured to capture in-flight images. View information representing the captured images may presented on a display worn and/or otherwise accessible to user. The input interface may allow the user to provide control inputs for dictating a path of the RC vehicle. Augmented reality graphics may be overlaid on the view information presented to the user to facilitate gameplay and/or otherwise enhance a user's experience.

Abstract: This disclosure relates to systems and methods for augmenting an appearance of a hilt to simulate a bladed weapon. A hilt may be augmented with a blade of a bladed weapon by detecting a landmark associated with the hilt, determining a position and/or an orientation of the hilt, determining an overlay image comprising the blade of the bladed weapon, wherein the blade is placed within the overlay image according to the determined position and/or the determined orientation of the hilt, and displaying the overlay image so that the blade of the bladed weapon appears to be attached to the hilt.

Abstract: Systems and methods of simulating first-person control of remoted-controlled vehicles are described herein. The system may include one or more of a remote-controlled (RC) vehicle, a display interface, an input interface, and/or other components. The RC vehicle may have an image capturing device configured to capture in-flight images. View information representing the captured images may presented on a display worn and/or otherwise accessible to user. The input interface may allow the user to provide control inputs for dictating a path of the RC vehicle. Augmented reality graphics may be overlaid on the view information presented to the user to facilitate gameplay and/or otherwise enhance a user's experience.

Abstract: This disclosure relates to systems and methods for augmenting an appearance of a hilt to simulate a bladed weapon. A hilt may be augmented with a blade of a bladed weapon by detecting a landmark associated with the hilt, determining a position and/or an orientation of the hilt, determining an overlay image comprising the blade of the bladed weapon, wherein the blade is placed within the overlay image according to the determined position and/or the determined orientation of the hilt, and displaying the overlay image so that the blade of the bladed weapon appears to be attached to the hilt.

Abstract: This disclosure relates to systems and methods for augmenting an appearance of a hilt to simulate a bladed weapon. A hilt may be augmented with a blade of a bladed weapon by detecting a landmark associated with the hilt, determining a position and/or an orientation of the hilt, determining an overlay image comprising the blade of the bladed weapon, wherein the blade is placed within the overlay image according to the determined position and/or the determined orientation of the hilt, and displaying the overlay image so that the blade of the bladed weapon appears to be attached to the hilt.

Abstract: This disclosure relates to systems and methods for augmenting an appearance of a hilt to simulate a bladed weapon. A hilt may be augmented with a blade of a bladed weapon by detecting a landmark associated with the hilt, determining a position and/or an orientation of the hilt, determining an overlay image comprising the blade of the bladed weapon, wherein the blade is placed within the overlay image according to the determined position and/or the determined orientation of the hilt, and displaying the overlay image so that the blade of the bladed weapon appears to be attached to the hilt.

Abstract: There is provided system including a user device and a viewing device configured to receive the user device, the viewing device including a control element and a viewing portal, the user device including a display, a non-transitory memory storing an executable code, a hardware processor executing the executable code to display, on the display, a computer-mediated reality content visible by a user through the viewing portal of the viewing device, receive a first input from the viewing device, in response to a second input provided by the user using the control element of the viewing device, modify an operational element of the user device, in response to the first input.

Abstract: A method, computer-readable medium, and system are disclosed for an interactive storytelling environment. The method comprises identifying a plurality of storytelling devices available to participate in a storytelling experience, at least one of the plurality of the storytelling devices comprising a first beacon device. The method further comprises beginning playback of a first story of the storytelling experience, the first story comprising a first plurality of predetermined actions associated with a predetermined first virtual setting, the first virtual setting mapped to the first beacon device. The method further comprises determining a location of a user using the first beacon device, and during playback of the first story and using at least one of the plurality of storytelling devices, producing one or more of the at least one audiovisual effect corresponding to the first virtual setting based on the determined location of the user.

Abstract: A method, computer-readable medium, and system are disclosed for an interactive storytelling environment. The method comprises identifying a plurality of storytelling devices available to participate in a storytelling experience, including a first storytelling device at a first physical location and a second storytelling device at a remote second physical location. The method further comprises receiving, based on user input during playback of a story, an instruction to perform a first action of a predetermined plurality of actions using the second storytelling device, the user input indicating a user interaction with a depiction of the second storytelling device at the first physical location. The method further comprises performing, based on timing information included in the received instruction, the first action using the second storytelling device such that performing the first action is at least partly synchronized with performance of an animation sequence of the depicted second storytelling device.