Abstract: Systems, methods, and computer program products to perform an operation comprising computing a saliency value for a video based on saliency values a set of pixels in each frame of the video, computing, for the video, an expected value for a metric by a predictive algorithm based on the saliency value for the video, and outputting the expected value for the metric as an indication of an expected outcome for the metric achieved by the video.

Abstract: A method is disclosed for applying physics-based simulation to an animator provided rig. The disclosure presents equations of motions for simulations performed in the subspace of deformations defined by an animator's rig. The method receives an input rig with a plurality of deformation parameters, and the dynamics of the character are simulated in the subspace of deformations described by the character's rig. Stiffness values defined on rig parameters are transformed to a non-homogeneous distribution of material parameters for the underlying rig.

Abstract: In one aspect, the present disclosure relates to a method for removing noise from a digital video sequence containing a modulated light signal emitted from a beacon light source. In some embodiments, the method includes electronically receiving, by an image sensor of a device, a digital video sequence of a scene, calculating noise from the digital video sequence, wherein the noise comprises information within the digital video sequence corresponding to the un-modulated illumination of the scene, reducing the noise from the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene, and demodulating the emitted light signal from the isolated digital video sequence.

Abstract: A method of identifying locations in a virtual environment where a motion sequence can be performed by an animated character may include accessing the motion sequence for the animated character, identifying a plurality of contact locations in the motion sequence where the animated character contacts surfaces in virtual environments, accessing the virtual environment comprising a plurality of surfaces, and identifying the locations in the virtual environment where the motion sequence can be performed by the animated character by identifying surfaces in the plurality of surfaces that match the plurality of contact locations.

Abstract: Techniques for simulating interactions using an augmented reality device. A visual scene is captured using a camera device. The visual scene depicts of a first physical object within a physical environment. A dynamic interaction is simulated between the first physical object and one or more virtual objects and velocity of a first virtual object resulting from the simulated dynamic interaction is calculated. A predefined behavior for a virtual character to perform is selected in response to the dynamic interaction. The virtual character is distinct from the first virtual object, and the selection is based on the calculated velocity. A sequence of frames is rendered. The sequence of frames depicts the dynamic interaction between the first physical object and the virtual objects, and further depicts a representation of the virtual character performing the determined behavior. The sequence of frames is output for display using one or more display devices.

Abstract: The disclosure provides an approach for populating a virtual environment with objects. In one embodiment, an editing application may track a handheld device using sensor data from a camera, by following an image displayed on the handheld device's screen. The editing application then updates the position of an object in the virtual environment according to the tracked position of the handheld device. Initially, the handheld device may be placed at a fixed location for calibration purposes, during which the editing application initializes a mapping between the virtual and physical environments. To add an object to the virtual environment, a user may select the object on the handheld device. The user may then place the object at a desired location and orientation in the virtual environment by moving the handheld device in the physical environment.

Abstract: In one aspect, the present disclosure relates to a method for configuring one or more imaging sensors of an imaging device to capture digital images for digital pulse recognition demodulation. In some embodiments, the method includes initializing one or more imaging sensors of the imaging device, determining a subset of the one or more imaging sensors to configure, setting a configuration for each of the one or more imaging sensors of the subset by defining a region of interest as a metering area for each of the one or more imaging sensors of the subset and automatically adjusting a setting for each of the one or more imaging sensors of the subset, and adjusting input parameters of a demodulation function based on a device profile of the imaging device. In some embodiments, the adjusted setting is locked to prevent further adjustment of the adjusted setting.

Abstract: An operable cabinet storage unit includes an outer cabinet structure having a plurality of sides and an aperture for selectively accessing an interior volume. A plurality of operable cassettes are each linearly operable through the aperture to define a storage position within the interior volume and an access position outside of the interior volume. Each cassette of the plurality of cassettes includes a plurality of storage receptacles, wherein each cassette of the plurality of cassettes occupies a corresponding vertical plane within the interior volume. A retaining mechanism extends from each cassette to the outer cabinet structure, wherein the retaining mechanism selectively retains a corresponding cassette in the storage position.

Abstract: Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Abstract: Techniques for simulating interactions using an augmented reality device are described. Embodiments capture a visual scene for display, wherein the visual scene is captured using one or more camera devices. Embodiments simulate a dynamic interaction between the first physical object and one or more virtual objects. Additionally, a sequence of frames is rendered for display that depicts the simulated dynamic interaction the first physical object and the one or more virtual objects.

Abstract: The disclosure provides an approach for populating a virtual environment with objects. In one embodiment, an editing application may track a handheld device using sensor data from a camera, by following an image displayed on the handheld device's screen. The editing application then updates the position of an object in the virtual environment according to the tracked position of the handheld device. Initially, the handheld device may be placed at a fixed location for calibration purposes, during which the editing application initializes a mapping between the virtual and physical environments. To add an object to the virtual environment, a user may select the object on the handheld device. The user may then place the object at a desired location and orientation in the virtual environment by moving the handheld device in the physical environment.

Abstract: Techniques are disclosed for creating digital assets that can be used to personalize themed products. For example, a workflow and pipeline used to generate a 3D model from digital images of a person's face and to manufacture a personalized, physical figurine customized with the 3D model are disclosed. The 3D model of the person's face may be simplified to match a topology of a desired figurine. While the topology is deformed to match that of the figurine, the 3D model retains the geometry of the child's face. Simplifying the topology of the 3D model in this manner allows the mesh to be integrated with or attached to a mesh representing desired figurine.

Abstract: In one aspect, the present disclosure relates to a method for configuring one or more imaging sensors of an imaging device to capture digital images for digital pulse recognition demodulation. In some embodiments, the method includes initializing one or more imaging sensors of the imaging device, determining a subset of the one or more imaging sensors to configure, setting a configuration for each of the one or more imaging sensors of the subset by defining a region of interest as a metering area for each of the one or more imaging sensors of the subset and automatically adjusting a setting for each of the one or more imaging sensors of the subset, and adjusting input parameters of a demodulation function based on a device profile of the imaging device. In some embodiments, the adjusted setting is locked to prevent further adjustment of the adjusted setting.

Abstract: Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Abstract: A user interface may be presented to a user that may provide an intuitive interface configured for generating animations. The user interface may be users of varying levels of expertise, while retaining the freedom of authoring complex narratives in an animation. A given narrative may be constrained by user input related to one or more of events to occur in an animation, individual animation components that may be included in the events, and/or other input. The system may be configured to “fill in” missing gaps in a narrative to generate a consistent animation while still meeting one or more narrative constraints specified by user input. By way of non-limiting example, gaps may be “filled in” by effectuating non-user selections of one or more of events, animation components, and/or other information used to generate an animation.

Abstract: A method is disclosed for applying physics-based simulation to an animator provided rig. The disclosure presents equations of motions for simulations performed in the subspace of deformations defined by an animator's rig. The method receives an input rig with a plurality of deformation parameters, and the dynamics of the character are simulated in the subspace of deformations described by the character's rig. In certain embodiments, the present disclosure provides a method that transforms stiffness values defined on rig parameters to a non-homogeneous distribution of material parameters for the underlying rig.

Abstract: There is provided a system and method for augmented reality image transformation. In one implementation, such a system includes a system processor, a system memory, and an image transformation engine stored in the system memory. The system processor is configured to execute the image transformation engine to receive image data corresponding to an image, to detect a feature on a surface of the image, and to synthesize a texture corresponding to the feature. The system processor is further configured to execute the image transformation engine to produce an augmented reality representation of the image having the texture for display to a user, the texture covering a surface of the augmented reality representation of the image corresponding to a portion of the feature that is not visible on the surface of the image.

Abstract: Systems, methods, and computer program products to perform an operation comprising computing a saliency value for a video based on saliency values a set of pixels in each frame of the video, computing, for the video, an expected value for a metric by a predictive algorithm based on the saliency value for the video, and outputting the expected value for the metric as an indication of an expected outcome for the metric achieved by the video.

Abstract: There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface.

Abstract: A method of animation of surface deformation and wrinkling, such as on clothing, uses low-dimensional linear subspaces with temporally adapted bases to reduce computation. Full space simulation training data is used to construct a pool of low-dimensional bases across a pose space. For simulation, sets of basis vectors are selected based on the current pose of the character and the state of its clothing, using an adaptive scheme. Modifying the surface configuration comprises solving reduced system matrices with respect to the subspace of the adapted basis.