Abstract: A virtual puppeteering system includes a portable device including a camera, a display, a hardware processor, and a system memory storing an object animation software code. The hardware processor is configured to execute the object animation software code to, using the camera, generate an image in response to receiving an activation input, using the display, display the image, and receive a selection input selecting an object shown in the image. The hardware processor is further configured to execute the object animation software code to determine a distance separating the selected object from the portable device, receive an animation input, identify, based on the selected object and the received animation input, a movement for animating the selected object, generate an animation of the selected object using the determined distance and the identified movement, and render the animation of the selected object.

Abstract: Methods for improving operation of a user device executing an application. The methods include collecting a first set of data corresponding to a run time environment of the application, collecting a second set of data corresponding to a crash of the application, identifying a cause of the crash based on the first set of data and a second set of data and determining the cause of the crash is associated with an application feature corresponding to a feature flag.

Abstract: Techniques for buffering data over high bandwidth networks are provided. A first portion of data is downloaded into a buffer at a first download speed via a first network. The first portion of data is outputted from the buffer. Upon determining that data is being downloaded, via a second network, at a second download speed greater than the first download speed, a size of the buffer is expanded, and a second portion of data is downloaded into the expanded buffer.

Abstract: The embodiments herein use a corrector plate or a light field display in an AR/VR display device to compensate for sub-optimal collimation at the edge of the FOV. In one embodiment, the corrector plate is disposed between the collimator and the viewer so that the light at the edge of the FOV can be corrected so that the aberrations mentioned above do not occur. In another embodiment, rather than using a corrector plate, the AR/VR display device can include a light field display that can use color intensity to pre-distort emitted light to compensate for sub-optimal collimation at the edge of the FOV. In this manner, the AR/VR display device can mitigate aberrations or distortions as the user moves her eyes relative to the display device.

Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.

Abstract: A method of generating a training data set for training an image matting machine learning model includes receiving a plurality of foreground images, generating a plurality of composited foreground images by compositing randomly selected foreground images from the plurality of foreground images, and generating a plurality of training images by compositing each composited foreground image with a randomly selected background image. The training data set includes the plurality of training images.

Abstract: This disclosure presents systems and methods to improve user brushing behavior. Exemplary implementations may: effectuate presentation of audio content via an audio output device, the audio content being characterized by an audio profile; obtain output signals from one or more sensors coupled to a user device, the output signals conveying user input information, the user input information defining user input by a user via the user device; determine, based on the user input information, a user profile, the user profile including one or more user values of the one or more audio attribute; compare the user profile with the audio profile to determine, for individual audio attributes, one or more differences; determine one or more scores reflecting the one or more differences; and/or perform other operations.

Abstract: Systems and methods for providing machine-learning enabled user-specific evaluations are disclosed. Implementations include obtaining a first set of evaluation data from a user interface, obtaining a first set of target-descriptive data including target-specific characteristics objectively describing the evaluation targets, and training, with a machine-learning algorithm, a user-specific evaluation profile indicating evaluation patterns relative to the first set of evaluation data and the first set of target-specific characteristics. Implementations include applying the user-specific evaluation profile to a second set of target-descriptive data to predict a user-specific evaluation.

Abstract: A system and method for model-based camera tracking and image occlusion removal for a camera viewing a sports field (or other scene) includes receiving a synthesized data set comprising at least one empty field image of the field, the empty field image with at least one occlusion graphic, and camera parameters corresponding to the empty field image, training a neural network model to estimate the empty field image and the corresponding camera parameters by providing the model with an input training image comprising the empty field image with occlusion graphic, and providing the model with model output targets comprising the empty field image and the corresponding camera parameters as targets for the model, receiving by the neural network model, alive input image comprising a view of the field with live occlusions, and providing by the neural network model, using trained model parameters, estimated live camera parameters or an estimated empty field image associated with the live input image.

Abstract: A method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest.

Abstract: A method includes storing a plurality of scores and a plurality of session identifiers for a game. The plurality of scores are generated by monitoring player activity during game sessions identified by the plurality of session identifiers and by applying rules of the game to determine scoring events based on the player activity. The method also includes generating, during a game session, a code for a player, providing the code to the player before the player leaves the game, and receiving, from a device, a target session identifier generated by the device based on the code and in response to receiving the target session identifier. The method further includes retrieving a score of the plurality of scores generated during a game session identified by a session identifier of the plurality of session identifiers that matches the target session identifier and communicating, to the device, the retrieved score.

Abstract: A method to project content from a moving projector. The method includes analyzing an object to identify a projection surface; determining a first position of a projector relative to the projection surface; modifying a first frame of a content for projection onto the projection surface based on the projection surface and the first position of the projector; projecting the first frame of the content from the projector onto the projection surface; determining a second position of the projector relative to the projection surface; modifying a second frame of the content based on the projection surface and the second position; and projecting the second frame of the content from the projector onto the projection surface.

Abstract: Systems and methods are provided for reordering and/or bypassing certain informational content or menus that are conventionally presented prior to playback of media content stored on physical media discs. Upon initial use of a physical media disc, certain information content or menus may be presented to a user or viewer, for example, piracy warnings, language selection menus, etc. However, upon subsequent use of the physical media disc, such informational content or menus may be bypassed. The user or viewer is given an option to immediately begin consuming the media content stored on the physical media disc. Conventional content, such as trailers are not played prior to playback of the media content.

Abstract: An image processing system includes a computing platform having a hardware processor and a system memory storing an image augmentation software code, a three-dimensional (3D) shapes library, and/or a 3D poses library. The image processing system also includes a two-dimensional (2D) pose estimation module communicatively coupled to the image augmentation software code. The hardware processor executes the image augmentation software code to provide an image to the 2D pose estimation module and to receive a 2D pose data generated by the 2D pose estimation module based on the image. The image augmentation software code identifies a 3D shape and/or a 3D pose corresponding to the image using an optimization algorithm applied to the 2D pose data and one or both of the 3D poses library and the 3D shapes library, and may output the 3D shape and/or 3D pose to render an augmented image on a display.

Abstract: There is provided a media player device for use with a text medium having a plurality of pages each having a plurality of words, the media player device comprising an audio output, a memory storing a text medium application software; and a processor configured to execute the text medium application software to receive a first signal emitted from a wireless communication element embedded in the text medium, the first signal including a text medium ID uniquely identifying the text medium, and play an audio, via the audio output and in response to receiving the text medium ID, wherein the audio corresponds to the text medium ID and the audio pronounces the plurality of words in a same sequence appearing in each of the plurality of pages.

Abstract: A system includes a computing platform having a hardware processor, and a system memory storing a software code and a content labeling predictive model. The hardware processor is configured to execute the software code to scan a database to identify content assets stored in the database, parse metadata stored in the database to identify labels associated with the content assets, and generate a graph by creating multiple first links linking each of the content assets to its corresponding label or labels. The hardware processor is configured to further execute the software code to train, using the graph, the content labeling predictive model, to identify, using the trained content labeling predictive model, multiple second links among the content assets and the labels, and to annotate the content assets based on the second links.

Abstract: An interactive autonomous robot is configured for deployment within a social environment. The disclosed robot includes a show subsystem configured to select between different in-character behaviors depending on robot status, thereby allowing the robot to appear in-character despite technical failures. The disclosed robot further includes a safety subsystem configured to intervene with in-character behavior when necessary to enforce safety protocols. The disclosed robot is also configured with a social subsystem that interprets social behaviors of humans and then initiates specific behavior sequences in response.

Abstract: Techniques to facilitate compression of depth data and real-time reconstruction of high-quality light fields. A parameter space of values for a line, pairs of endpoints on different sides of the line, and a palette index for each pixel of a pixel tile of a depth image is sampled. Values for the line, the pairs of endpoints, and the palette index that minimize an error are determined and stored.

Abstract: Embodiments provide for improved stream generation. A target average bitrate (TAB) segment is generated by encoding a first segment, of a plurality of segments in a video, using a first maximum average bitrate (MAB) of a plurality of MABs specified in an encoding ladder. An intermediate average bitrate (IAB) segment is generated by encoding the first segment using a first intermediate bitrate, wherein the first intermediate bitrate is lower than the first MAB. Upon receiving a request for the first segment at the first MAB, the IAB segment is output based at least in part on determining that a first quality score of the IAB segment is within a predefined tolerance of a second quality score of the TAB segment.

Abstract: A head for a walk-around costume is provided that is adapted for enhanced visibility. The costume head includes an outer shell defining an interior space for receiving a head of a human performer. The outer shell includes an aperture allowing incoming light from an exterior space to enter the interior space, and an eye location for the human performer is spaced apart from the aperture when the head is received in the interior space. To provide an enlarged field of view, the costume head includes an optical viewfinder assembly disposed within the interior space of the outer shell between the aperture and the eye location. The optical viewfinder assembly is adapted for receiving the incoming light and transmitting the incoming light to the eye location to move a viewpoint of the human performer to the aperture to provide a larger field of view of the exterior space.

Abstract: One aspect of this disclosure relates to presentation of a first effect on one or more presentation devices during an oral recitation of a first story. The first effect is associated with a first trigger point, first content, and/or first story. The first trigger point being one or more specific syllables from a word and/or phrase in the first story. A first transmission point associated with the first effect can be determined based on a latency of a presentation device and user speaking profile. The first transmission point being one or more specific syllables from a word and/or phrase before the first trigger point in the first story. Control signals for instructions to present the first content at the first trigger point are transmitted to the presentation device when a user recites the first transmission point such that first content is presented at the first trigger point.

Abstract: A system comprises active magnetic emitters positioned within an area, passive magnetic emitters configured to be moved within the area, a magnetic field detector configured to measure a strength and direction of a magnetic field within the area, and a processor in communication with the magnetic field detector. The passive magnetic emitters are configured to be integrated in, coupled to, or secured to at least one tracked object or tracked subject within the area. The processor is configured to evaluate at least one change in the measured strength and direction of the magnetic field end send a signal to a visual effect actuator or visual effects display to initiate a visual effect based on the at least one change. A method and computer program product relating to the system is also provided.

Abstract: Systems and methods are provided for providing a platform to provide virtual storefronts to consumers. Environmental elements are associated with specific consumer services on computer server. A user in the environment takes audio or visual recordings of an environmental element and uploads the recordings to the server. The server determines the appropriate consumer service associated with the recorded environmental element and provides the user with a reference to the service. Accordingly, any space, such as a bus stop, subway or train terminal, movie theater, or airport, may be turned into a virtual store.

Abstract: A robot including a hybrid fan-based and fluid-based propulsion system to provide thrust, such as deceleration during fall to create a smooth landing or to provide a quick reduction in velocity, and to provide actuation/controlled motion, such as to hover after quick deceleration and to control orientation or pose. The hybrid propulsion system uses discharging of pressurized fluid and exhausted gas (or fluid in some cases) from ducted fans (or propellers, impellers, and the like) to provide controlled thrust and/or lift forces. The hybrid propulsion system uses of pressurized fluid for generating larger or primary thrust and quick changes in velocity. The hybrid propulsion system includes a fan-based propulsion assembly with ducted fans that use environmental air (or fluids) to provide lower or secondary thrust. Both types of propulsion can be integrated into a robot or robotic figure to move the robot during flight (e.g., during falling or hovering).

Abstract: A system for displaying three dimensional (3D) images. The system includes a 3D display operating in a first state to display a 3D image by outputting light into a viewing space and operating in a second state in which the 3D image is not displayed. The system further includes a screen element positioned between the 3D display and the viewing space. The screen element reflects light from the viewing space to appear opaque to a viewer in the viewing space when the 3D display operates in the second state. The screen element transmits the light output by the 3D display, whereby the 3D display image is perceivable by the viewer in the viewing space. The screen element includes a sheet of mesh or netting material that transmits light output by the 3D display through its pores or openings and may be a planar sheet of scrim or tulle.

Abstract: In various embodiments, a map inference application automatically maps a user space. A camera is positioned within the user space. In operation, the map inference application determines a path of a first moving object within the user space based on a tracking dataset generated from images captured by the camera. Subsequently, the map inference application infers a walking space within the user space based on the path. The map inference application then generates a model of at least a portion of the user space based on the walking space. One or more movements of a second object within the user space are based on the model. Advantageously, unlike prior art solutions, the map inference application enables a model of a user space to be automatically and efficiently generated based on images from a single stationary camera.

Abstract: Interactive multimedia package methods and systems are provided. An interactive multimedia package system may generate, manage, deliver, and/or play interactive multimedia packages with various digital media. An interactive multimedia package may be incorporated into any platform such as physical media (e.g., CDs, DVDs, etc.), web services (e.g., download, or streaming), and other applications. A user may shop directly off of the digital media that he or she is experiencing (e.g., watching a movie, viewing a digital news, reading an e-book, playing a video game, etc.) The user may be directed to an e-commerce website, a digital storefront, or a list of items associated with an object, by clicking on the object of interest in the digital media.

Abstract: Various embodiments of the invention disclosed herein provide techniques for generating a virtual object for a VR/AR environment in response to a trigger. A VR/AR application executing on a client device receives a media content item. The VR/AR application detects an event trigger associated with the media content item. The VR/AR application generates at least a portion of a virtual object based on the event trigger. The VR/AR application displays the media content item and the at least a portion of the virtual object on a display associated with a user device.

Abstract: A modeling engine generates a prediction model that quantifies and predicts secondary dynamics associated with the face of a performer enacting a performance. The modeling engine generates a set of geometric representations that represents the face of the performer enacting different facial expressions under a range of loading conditions. For a given facial expression and specific loading condition, the modeling engine trains a Machine Learning model to predict how soft tissue regions of the face of the performer change in response to external forces applied to the performer during the performance. The modeling engine combines different expression models associated with different facial expressions to generate a prediction model. The prediction model can be used to predict and remove secondary dynamics from a given geometric representation of a performance or to generate and add secondary dynamics to a given geometric representation of a performance.

Abstract: In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

Abstract: Methods and apparatuses are provided, which may be implemented to combine and distribute user enhanced video and/or audio content.

Abstract: The present disclosure describes a method for displaying supplemental content. The method includes determining environmental characteristics, e.g., wall space, empty areas, colors, etc., for a display environment, determining supplemental content based in part on a primary content displayed by a primary display, and displaying the supplemental content in the display environment.

Abstract: Techniques are disclosed for changing the identities of faces in images. In embodiments, a tunable model for changing facial identities in images includes an encoder, a decoder, and dense layers that generate either adaptive instance normalization (AdaIN) coefficients that control the operation of convolution layers in the decoder or the values of weights within such convolution layers, allowing the model to change the identity of a face in an image based on a user selection. A separate set of dense layers may be trained to generate AdaIN coefficients for each of a number of facial identities, and the AdaIN coefficients output by different sets of dense layers can be combined to interpolate between facial identities. Alternatively, a single set of dense layers may be trained to take as input an identity vector and output AdaIN coefficients or values of weighs within convolution layers of the decoder.

Abstract: In various embodiments, a relevance application quantifies how a trained neural network operates. In operation, the relevance application generates a set of input distributions based on a set of input points associated with the trained neural network. Each input distribution is characterized by a mean and a variance associated with a different neuron included in the trained neural network. The relevance application propagates the set of input distributions through a probabilistic neural network to generate at least a first output distribution. The probabilistic neural network is derived from at least a portion of the trained neural network. Based on the first output distribution, the relevance application computes a contribution of a first input point included in the set of input points to a difference between a first output point associated with a first output of the trained neural network and an estimated mean prediction associated with the first output.

Abstract: One embodiment of the present invention sets forth a technique for performing deinterlacing. The technique includes separating a first interlaced video frame into a first sequence of fields ordered by time, the first sequence of fields including a first field. The technique also includes generating, by applying a deinterlacing network to a first field in the first sequence, a second field that is missing from the first sequence of fields and is complementary to the first field. The technique further includes constructing a progressive video frame based on the first field and the second field.

Abstract: Systems and methods are described for leveraging machine learning to deliver time-sensitive media content offers to a consumer over an optimal device and channel. In an implementation, a server system transmits media content offers over an optimal device and channel to a user. The server system captures metadata of at least one of: the user's use of multiple devices, the user's media content preferences, the user's preferred transmission channels for receiving media content offers over the multiple devices, and the user's preferred times for receiving media content offers. The server system prepares a media content offer for transmission to the user. Based on the captured metadata, the server system selects a user device of the multiple user devices and a transmission channel of multiple transmission channels to transmit the media content offer; and transmits the media content offer to the selected user device over the selected transmission channel.

Abstract: Techniques relating to caching a content object are disclosed. A first server receives a revalidation request, relating to a content object, from a requestor. It is determined that metadata, relating to the content object, is stored in a cache associated with the first server. In response, the first server determines not to retrieve the content object from a second server. The content object is not stored in the cache. A response to the revalidation request, indicating that the content object is not modified, is transmitted from the first server to the requestor, based on analyzing the metadata.

Abstract: A method, comprises monitoring a encoding process of a source video file performed by an encoder; obtaining an encoding decision parameter used to encode a picture of the source video file during the encoding process; comparing the encoding decision parameter to a threshold; based on the step of comparing, identifying the picture as a candidate picture for a visual defect or coding error; and storing a timestamp of the candidate picture.

Abstract: Some implementations of the disclosure are directed to tapping input/output (I/O) data from an industrial control system (ICS) or applying the tapped I/O data to a learned model to perform predictive or prescriptive maintenance. In one implementation, a method comprises: tapping I/O data from a controller of an ICS while the controller executes first control code to control one or more devices of the ICS; transmitting the tapped I/O data over a network to a second system; and executing, via the second system, second control code comprising an original or modified version of all or a subset of the first control code of the ICS, wherein the second control code executes in response to receiving the tapped I/O data. The output of executing the second control code may be provided to a model to predict a future event involving the ICS or to prescribe maintenance of the ICS.

Abstract: According to one implementation, a system for performing graph-based media content evaluation includes a computing platform having a hardware processor, and a system memory storing a media content evaluation software code and a graph database. The hardware processor is configured to execute the media content evaluation software code to receive a query from a system user, and to identify one or more media content evaluation metrics corresponding to the query. In addition, the hardware processor is configured to execute the media content evaluation software code to search the graph database for a media content data relevant to the one or more media content evaluation metrics, and to retrieve the media content data from the graph database. The hardware processor is further configured to execute the media content evaluation software code to generate a report responsive to the query using the media content data.

Abstract: Systems, methods and articles of manufacture for are provided for analyzing user behavior in real time by ingesting telemetry data related to a streaming media application; feeding the telemetry data to a machine learning model (MLM) that produces a User Experience (UX) command based on the telemetry data and prior telemetry data received from the content streaming application; selecting content items to provide to the client device based on the telemetry data; determining, based on the telemetry data, whether the client device has sufficient free resources to receive the UX command and the content items in a current time window while providing a predefined level of service; when client device has sufficient free resources to receive the UX command and the content items, encapsulating the UX command with the content items in a content stream; and transmitting the content stream to the client device.

Abstract: An electronic device that includes one or more input sensor devices, one or more output devices, one or more computer processors and a memory containing computer program code that, when executed by operation of the one or more computer processors, performs an operation. The operation includes collecting information, using one or more input sensor devices, about the plurality of users within a physical environment. The operation includes analyzing the collected information to determine a present situational context for the plurality of users that are currently present within the physical environment. An action to perform is determined based on the determined present situational context. The determined action is executed using the one or more output devices.

Abstract: A method includes producing a filter mask based on a blur mask and a saliency mask and identifying locations of a plurality of bounding boxes of a plurality of objects of interest in a received image. The method also includes applying the filter mask to the received image and to the locations of the plurality of bounding boxes in the received image to remove at least one object of interest from consideration. The method further includes performing a comparison of a location of a bounding box of the plurality of bounding boxes of an object of interest remaining in consideration to a predetermined safe region of the received image and generating a validation result based on the comparison.

Abstract: Systems and methods for compressing target content are disclosed. In one embodiment, a system may include non-transient electronic storage and one or more physical computer processors. The one or more physical computer processors may be configured by machine-readable instructions to obtain the target content comprising one or more frames, wherein a given frame comprises one or more features. The one or more physical computer processors may be configured by machine-readable instructions to obtain a conditioned network. The one or more physical computer processors may be configured by machine-readable instructions to generate decoded target content by applying the conditioned network to the target content.

Abstract: A method for use by a system computer for granting access to a network resource includes receiving, in a first session, a first request for accessing the network resource, the first request including authorization information of a user of an access computer, initiating, while in the first session and using the first authorization information, a first authorization process with one or more authorization computers, and determining a failure relating to the first authorization process initiated with the one or more authorization computers. The method further includes, upon determining the failure, sending a second request indicating a temporary access token is to be delivered to the access computer in response to an access computer executing a session refresh for initiating a second session.

Abstract: A gameplay system for providing interactivity based on a piece of merchandise or other object held or worn by a player. The system includes an object identification assembly, which may be a modified computer vision system, that operates to sense, for a gameplay participant, the presence and identity of a particular augmenting object such as themed merchandise worn or held by a rider of a theme park ride. The sensing may be performed by detecting an on-and-off pattern of light emitted from the object. In response, the gameplay system selects or modifies the interactive features of gameplay associated with the participant based on the identified augmenting object. For example, the interactive features are selected from memory by the gameplay system controller to match a character associated with the augmenting object during any interactive gameplay. This allows the gameplay participant to choose their abilities or powers for gameplay.

Abstract: A system and method for providing customized instances of a game within a virtual space. The system may be configured to obtain values associated with one or more users of the virtual space. The game, which is playable within the virtual space, may initially comprise predefined features and initially undefined features. The customizations may define the initially undefined features to provide custom-defined features. As such, when played, the game may include the predefined features and the custom-defined features. Customizations defining the initially undefined features to provide custom-defined features for a given instance of the game may be determined based on the values associated with a given user. The system may be configured to provide the given instance of the game to the given user.