Abstract: A storytelling system includes location-based content (LBC) servers and LBC effects databases for use in a real-world story venue, and a computing platform communicatively coupled to those LBC servers and databases. A processor of the computing platform executes software code to receive story selection data from a user device, obtain a story template including story arcs each associated with one or more LBC effect(s) that corresponds to the story selection data, and determine, using a location of the user device, one of the story arcs as an active story arc. The software code also identifies an LBC interaction zone for the LBC effect(s), designates one LBC server and one LBC effects database for supporting the active story arc, and distributes one or more of the LBC effect(s) to the designated database. The designated server enables instantiation of the one or more of the LBC effect(s) at the LBC interaction zone.

Abstract: An image processing system includes a computing platform having a hardware processor and a system memory storing an image augmentation software code, a three-dimensional (3D) shapes library, and/or a 3D poses library. The image processing system also includes a two-dimensional (2D) pose estimation module communicatively coupled to the image augmentation software code. The hardware processor executes the image augmentation software code to provide an image to the 2D pose estimation module and to receive a 2D pose data generated by the 2D pose estimation module based on the image. The image augmentation software code identifies a 3D shape and/or a 3D pose corresponding to the image using an optimization algorithm applied to the 2D pose data and one or both of the 3D poses library and the 3D shapes library, and may output the 3D shape and/or 3D pose to render an augmented image on a display.

Abstract: An image processing system includes a computing platform having a hardware processor and a system memory storing an image augmentation software code, a three-dimensional (3D) shapes library, and/or a 3D poses library. The image processing system also includes a two-dimensional (2D) pose estimation module communicatively coupled to the image augmentation software code. The hardware processor executes the image augmentation software code to provide an image to the 2D pose estimation module and to receive a 2D pose data generated by the 2D pose estimation module based on the image. The image augmentation software code identifies a 3D shape and/or a 3D pose corresponding to the image using an optimization algorithm applied to the 2D pose data and one or both of the 3D poses library and the 3D shapes library, and may output the 3D shape and/or 3D pose to render an augmented image on a display.

Abstract: A storytelling system includes location-based content (LBC) servers and LBC effects databases for use in a real-world story venue, and a computing platform communicatively coupled to those LBC servers and databases. A processor of the computing platform executes software code to receive story selection data from a user device, obtain a story template including story arcs each associated with one or more LBC effect(s) that corresponds to the story selection data, and determine, using a location of the user device, one of the story arcs as an active story arc. The software code also identifies an LBC interaction zone for the LBC effect(s), designates one LBC server and one LBC effects database for supporting the active story arc, and distributes one or more of the LBC effect(s) to the designated database. The designated server enables instantiation of the one or more of the LBC effect(s) at the LBC interaction zone.

Abstract: A storytelling system includes location-based content (LBC) servers and LBC effects databases for use in a real-world story venue, and a computing platform communicatively coupled to those LBC servers and databases. A processor of the computing platform executes software code to receive story selection data from a user device, obtain a story template including story arcs each associated with one or more LBC effect(s) that corresponds to the story selection data, and determine, using a location of the user device, one of the story arcs as an active story arc. The software code also identifies an LBC interaction zone for the LBC effect(s), designates one LBC server and one LBC effects database for supporting the active story arc, and distributes one or more of the LBC effect(s) to the designated database. The designated server enables instantiation of the one or more of the LBC effect(s) at the LBC interaction zone.

Abstract: Techniques for animation are provided. A first trajectory for a first element in a first animation is determined. A first approximation is generated based on the first trajectory, and the first approximation is modified based on an updated state of the first element. The first trajectory is then refined based on the modified first approximation.

Abstract: A storytelling system includes location-based content (LBC) servers and LBC effects databases for use in a real-world story venue, and a computing platform communicatively coupled to those LBC servers and databases. A processor of the computing platform executes software code to receive story selection data from a user device, obtain a story template including story arcs each associated with one or more LBC effect(s) that corresponds to the story selection data, and determine, using a location of the user device, one of the story arcs as an active story arc. The software code also identifies an LBC interaction zone for the LBC effect(s), designates one LBC server and one LBC effects database for supporting the active story arc, and distributes one or more of the LBC effect(s) to the designated database. The designated server enables instantiation of the one or more of the LBC effect(s) at the LBC interaction zone.

Abstract: Techniques for animation are provided. A first trajectory for a first element in a first animation is determined. A first approximation is generated based on the first trajectory, and the first approximation is modified based on an updated state of the first element.

Abstract: An automated costume augmentation system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to provide an image including a posed figure to an artificial neural network (ANN), receive from the ANN a 2D skeleton data including joint positions corresponding to the posed figure, and determine a 3D pose corresponding to the posed figure using an optimization algorithm applied to the skeleton data. The software code further identifies one or more proportion(s) of the posed figure based on the skeleton data, determines bone directions corresponding to the posed figure using another optimization algorithm applied to the 3D pose, parameterizes a costume for the posed figure based on the 3D pose, the proportion(s), and the bone directions, and outputs an enhanced image including the posed figure augmented with the fitted costume for rendering on a display.

Abstract: There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface.

Abstract: An automated costume augmentation system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to provide an image including a posed figure to an artificial neural network (ANN), receive from the ANN a 2D skeleton data including joint positions corresponding to the posed figure, and determine a 3D pose corresponding to the posed figure using an optimization algorithm applied to the skeleton data. The software code further identifies one or more proportion(s) of the posed figure based on the skeleton data, determines bone directions corresponding to the posed figure using another optimization algorithm applied to the 3D pose, parameterizes a costume for the posed figure based on the 3D pose, the proportion(s), and the bone directions, and outputs an enhanced image including the posed figure augmented with the fitted costume for rendering on a display.

Abstract: An image processing system includes a computing platform having a hardware processor and a system memory storing an image augmentation software code, a three-dimensional (3D) shapes library, and/or a 3D poses library. The image processing system also includes a two-dimensional (2D) pose estimation module communicatively coupled to the image augmentation software code. The hardware processor executes the image augmentation software code to provide an image to the 2D pose estimation module and to receive a 2D pose data generated by the 2D pose estimation module based on the image. The image augmentation software code identifies a 3D shape and/or a 3D pose corresponding to the image using an optimization algorithm applied to the 2D pose data and one or both of the 3D poses library and the 3D shapes library, and may output the 3D shape and/or 3D pose to render an augmented image on a display.

Abstract: There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface.

Abstract: Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Abstract: There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface.

Abstract: Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Abstract: Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Abstract: There is provided a system and method for augmented reality image transformation. In one implementation, such a system includes a system processor, a system memory, and an image transformation engine stored in the system memory. The system processor is configured to execute the image transformation engine to receive image data corresponding to an image, to detect a feature on a surface of the image, and to synthesize a texture corresponding to the feature. The system processor is further configured to execute the image transformation engine to produce an augmented reality representation of the image having the texture for display to a user, the texture covering a surface of the augmented reality representation of the image corresponding to a portion of the feature that is not visible on the surface of the image.

Abstract: There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface.

Abstract: There is provided a system and method for augmented reality image transformation. In one implementation, such a system includes a system processor, a system memory, and an image transformation engine stored in the system memory. The system processor is configured to execute the image transformation engine to receive image data corresponding to an image, to detect a feature on a surface of the image, and to synthesize a texture corresponding to the feature. The system processor is further configured to execute the image transformation engine to produce an augmented reality representation of the image having the texture for display to a user, the texture covering a surface of the augmented reality representation of the image corresponding to a portion of the feature that is not visible on the surface of the image.