Abstract: A method includes obtaining a speech proficiency value indicator indicative of a speech proficiency value associated with a user of the electronic device. The method further includes in response to determining that the speech proficiency value satisfies a threshold proficiency value: displaying training text via the display device; obtaining, from the audio sensor, speech data associated with the training text, wherein the speech data is characterized by the speech proficiency value; determining, using a speech classifier, one or more speech characterization vectors for the speech data based on linguistic features within the speech data; and adjusting one or more operational values of the speech classifier based on the one or more speech characterization vectors and the speech proficiency value.

Abstract: A method includes, while displaying a first set of text content via a display device, determining an engagement value that characterizes a level of user engagement with respect to the first set of text content. The method includes, in accordance with a determination that the engagement value satisfies a threshold, replacing the first set of text content with a second set of text content via the display device. The first set of text content is different from the second set of text content. The method includes in accordance with a determination that the engagement value does not satisfy the threshold, maintaining display of the first set of text content via the display device.

Abstract: An example process includes: receiving a speech input representing a user utterance; determining, based on a textual representation of the speech input, a first score corresponding to a type of the user utterance; determining, based on the textual representation of the speech input, a second score representing a correspondence between the user utterance and a domain recognized by a digital assistant; determining, based on the first score and the second score, whether the speech input is intended for the digital assistant; in accordance with a determination that the speech input is intended for the digital assistant: initiating, by the digital assistant, a task based on the speech input; and providing an output indicative of the initiated task.

Abstract: An example process includes: receiving a speech input representing a user utterance; determining, based on a textual representation of the speech input, a first score corresponding to a type of the user utterance; determining, based on the textual representation of the speech input, a second score representing a correspondence between the user utterance and a domain recognized by a digital assistant; determining, based on the first score and the second score, whether the speech input is intended for the digital assistant; in accordance with a determination that the speech input is intended for the digital assistant: initiating, by the digital assistant, a task based on the speech input; and providing an output indicative of the initiated task.

Abstract: A method includes obtaining user input interaction data. The user input interaction data includes one or more user interaction input values respectively obtained from the corresponding one or more input devices. The user input interaction data includes a word combination. The method includes generating a user interaction-style indicator value corresponding to the word combination in the user input interaction data. The user interaction-style indicator value is a function of the word combination and a portion of the one or more user interaction input values. The method includes determining, using a semantic text analyzer, a semantic assessment of the word combination in the user input interaction data based on the user interaction-style indicator value and a natural language assessment of the word combination. The method includes generating a response to the user input interaction data according to the user interaction-style indicator value and the semantic assessment of the word combination.

Abstract: Controlling an automated agent in an environment includes obtaining high-quality data regarding a current state of the automated agent; identifying a behavior model; determining a trajectory estimate for the automated agent based on the current state of the automated agent and the behavior model; determining a final trajectory for the automated agent using the trajectory estimate; and controlling the automated agent according to the final trajectory.

Abstract: One aspect of the disclosure is a non-transitory computer-readable storage medium including program instructions. Operations performed by execution of the program instructions include obtaining an input image that depicts a face of a subject, having an initial facial expression and an initial pose, determining a reference shape description based on the input image, determining a target shape description based on the reference shape description, a facial expression difference, and a pose difference, generating a rendered target shape image using the target shape description, and generating an output image based on the input image and the rendered target shape using an image generator, wherein the output image is a simulated image of the subject of the input image that has a final expression that is based on the initial facial expression and the facial expression difference, and a final pose that is based on the initial pose and the pose difference.

Abstract: A method includes, while displaying a first set of text content via a display device, determining an engagement value that characterizes a level of user engagement with respect to the first set of text content. The method includes, in accordance with a determination that the engagement value satisfies a threshold, replacing the first set of text content with a second set of text content via the display device. The first set of text content is different from the second set of text content. The method includes in accordance with a determination that the engagement value does not satisfy the threshold, maintaining display of the first set of text content via the display device.

Abstract: A method includes displaying a first set of text content characterized by a first difficulty level. The method includes obtaining speech data associated with the first set of text content. The method includes determining linguistic feature(s) within the speech data. The method includes in response to completion of the speech data, determining a reading proficiency value associated with the first set of text content and based on the linguistic feature(s). The method includes in accordance with determining the reading proficiency value satisfies change criteria, changing a difficulty level for a second set of text content. After changing the difficulty level, the second set of text content corresponds to a second difficulty level different from the first difficulty level. The method includes in accordance with determining the reading proficiency value does not satisfy the change criteria, maintaining the second set of text content at the first difficulty level.

Abstract: One aspect of the disclosure is a non-transitory computer-readable storage medium including program instructions. Operations performed by execution of the program instructions include obtaining an input image that depicts a face of a subject, having an initial facial expression and an initial pose, determining a reference shape description based on the input image, determining a target shape description based on the reference shape description, a facial expression difference, and a pose difference, generating a rendered target shape image using the target shape description, and generating an output image based on the input image and the rendered target shape using an image generator, wherein the output image is a simulated image of the subject of the input image that has a final expression that is based on the initial facial expression and the facial expression difference, and a final pose that is based on the initial pose and the pose difference.

Abstract: Systems and methods for animating an avatar are provided. An example method of animating an avatar includes at an electronic device having one or more processors and memory, receiving an audio input, receiving a video input including at least a portion of a user's face, wherein the video input is separate from the audio input, determining one or more movements of the user's face based on the received audio input and received video input, and generating, using a neural network separately trained with a set of audio training data and a set of video training data, a set of characteristics for controlling an avatar representing the one or more movements of the user's face.

Abstract: A method includes displaying a first set of text content characterized by a first difficulty level. The method includes obtaining speech data associated with the first set of text content. The method includes determining linguistic feature(s) within the speech data. The method includes in response to completion of the speech data, determining a reading proficiency value associated with the first set of text content and based on the linguistic feature(s). The method includes in accordance with determining the reading proficiency value satisfies change criteria, changing a difficulty level for a second set of text content. After changing the difficulty level, the second set of text content corresponds to a second difficulty level different from the first difficulty level. The method includes in accordance with determining the reading proficiency value does not satisfy the change criteria, maintaining the second set of text content at the first difficulty level.

Abstract: A method includes obtaining user input interaction data. The user input interaction data includes one or more user interaction input values respectively obtained from the corresponding one or more input devices. The user input interaction data includes a word combination. The method includes generating a user interaction-style indicator value corresponding to the word combination in the user input interaction data. The user interaction-style indicator value is a function of the word combination and a portion of the one or more user interaction input values. The method includes determining, using a semantic text analyzer, a semantic assessment of the word combination in the user input interaction data based on the user interaction-style indicator value and a natural language assessment of the word combination. The method includes generating a response to the user input interaction data according to the user interaction-style indicator value and the semantic assessment of the word combination.

Abstract: There are provided systems and methods for generating a visually consistent alternative audio for redubbing visual speech using a processor configured to sample a dynamic viseme sequence corresponding to a given utterance by a speaker in a video, identify a plurality of phonemes corresponding to the dynamic viseme sequence, construct a graph of the plurality of phonemes that synchronize with a sequence of lip movements of a mouth of the speaker in the dynamic viseme sequence, use the graph to generate an alternative phrase that substantially matches the sequence of lip movements of the mouth of the speaker in the video.

Abstract: Speech animation may be performed using visemes with phonetic boundary context. A viseme unit may comprise an animation that simulates lip movement of an animated entity. Individual ones of the viseme units may correspond to one or more complete phonemes and phoneme context of the one or more complete phonemes. Phoneme context may include a phoneme that is adjacent to the one or more complete phonemes that correspond to a given viseme unit. Potential sets of viseme units that correspond with individual phoneme string portions may be determined. One of the potential sets of viseme units may be selected for individual ones of the phoneme string portions based on a fit metric that conveys a match between individual ones of the potential sets and the corresponding phoneme string portion.

Abstract: Speech animation may be performed using visemes with phonetic boundary context. A viseme unit may comprise an animation that simulates lip movement of an animated entity. Individual ones of the viseme units may correspond to one or more complete phonemes and phoneme context of the one or more complete phonemes. Phoneme context may include a phoneme that is adjacent to the one or more complete phonemes that correspond to a given viseme unit. Potential sets of viseme units that correspond with individual phoneme string portions may be determined. One of the potential sets of viseme units may be selected for individual ones of the phoneme string portions based on a fit metric that conveys a match between individual ones of the potential sets and the corresponding phoneme string portion.

Abstract: There are provided systems and methods for generating a visually consistent alternative audio for redubbing visual speech using a processor configured to sample a dynamic viseme sequence corresponding to a given utterance by a speaker in a video, identify a plurality of phonemes corresponding to the dynamic viseme sequence, construct a graph of the plurality of phonemes that synchronize with a sequence of lip movements of a mouth of the speaker in the dynamic viseme sequence, use the graph to generate an alternative phrase that substantially matches the sequence of lip movements of the mouth of the speaker in the video.

Abstract: In combination, the loose tube flying lead includes: a) a pair of improved cobra head assemblies, each being able to receive a variety of different stab-plates with minimal modification; b) a pair of bend limiters, one extending from each cobra head assembly and c) an elongate bundle of non-constrained interior conduits surrounded by an over-hose, the over-hose being connected to each bend limiter. The over-hose may rotate independently of the bend limiters and the cobra head assemblies.

Abstract: In combination, the loose tube flying lead includes: a) a pair of improved cobra head assemblies, each being able to receive a variety of different stab-plates with minimal modification; b) a pair of bend limiters, one extending from each cobra head assembly and c) an elongate bundle of non-constrained interior conduits surrounded by an over-hose, the over-hose being connected to each bend limiter. The over-hose may rotate independently of the bend limiters and the cobra head assemblies.

Abstract: The invention provides a system for delivering targeted video content across a broadcast network. The invention allows content providers to deliver content to groups of consumers with common interests or specified individual subscribers. The invention also allows for the receipt of feedback from viewers. Embodiments of the invention include mechanisms for the subscriber to provide feedback regarding the content and for the subscriber to receive a benefit for providing such feedback.