Abstract: Methods, electronic devices, and storage media for driving an interaction object are provided. The methods include: obtaining an audio signal at a periphery of a display device; obtaining, based on the audio signal, first driving data for driving the interaction object to respond; monitoring, in response to outputting the first driving data, the audio signal for detecting a sound of a target object; and driving, based on a presence state of the sound of the target object in the audio signal, the interaction object to respond.

Abstract: A method, computer system, and a computer program product for digital remote presentation are provided. Presentation content is received that includes visual content, one or more speech triggers, and one or more presentation enhancements corresponding to the one or more speech triggers. A virtual meeting is presented by transmitting the presentation content to at least one receiver computer. A first audio file is received that includes recorded audio spoken by a presenter during the virtual meeting. From the first audio file the one or more speech triggers spoken by the presenter are identified. The respective presentation enhancement corresponding to the identified speech trigger is performed. The presentation enhancement is presented to the at least one receiver computer during the virtual meeting.

Abstract: An electronic device is provided. The electronic device includes a memory for storing at least one dynamic shortcut command, a display, and a processor operatively connected with the memory and the display, the processor configured to store a first dynamic shortcut command including first type information for at least one first dynamic variable word in the memory, when acquiring a user utterance, detect the first dynamic shortcut command in the memory based on the first dynamic variable word included the user utterance, change the first type information included in the detected first dynamic shortcut command into the first dynamic variable word included in the user utterance, and execute a task corresponding to the changed first dynamic shortcut command including the first dynamic variable word included in the user utterance. Various other embodiments may be provided. The method performing shortcut command in the electronic device may be performed using an artificial intelligence model.

Abstract: Techniques for providing device functionalities using device components are described. A system receives a system-generated directive from a skill system and determines a workflow to execute. The system implements a response orchestrator that operates based on the workflow that includes interception points where cross-cutting functionalities can be invoked as pluggable components. The interception points occur pre-system-generated directive, pre-device-facing directive, post-device-facing directive generation, post-device-facing directive dispatch, and the like. The system supports asynchronous execution, conditional execution, and sequential execution of components. Data determined by the cross functionality components can be used by other components for processing.

Abstract: A messaging system, which hosts a backend service for an associated messaging client, includes a voice chat system that provides voice chat functionality that enables users to dictate their messages, while delivering the resulting message to the intended recipient as both the associated audio and text content. When a user at a sender client device begins dictating a voice message, the voice chat system starts converting the received audio stream into text and, also, starts communicating the audio content together with the generated text to the recipient client device. The recipient user can listen to the voice message and read the text generated from the audio in real time. It is also possible for the recipient user to consume the voice message in a textual form only, if the sound at the client device is undesirable.

Abstract: Systems and methods for natural language processing policies are disclosed. For example, content such as a response to a user command and/or user input such as a customer review, may be analyzed to determine if the content deviates from one or more content policies and to determine a severity of the content-policy deviation(s). A system may determine a number of content-policy deviations associated with the content and whether the content includes an indicator of a person, such as a pronoun and/or a proper noun. Content that includes multiple content-policy deviations and/or than includes an indicator of a person may be determined to be more severe than other deviated content. Applications associated with deviated content may be ranked and corrective action may be taken based on the ranking.

Abstract: Systems and methods for integration of speech processing functionality with organization systems are disclosed. For example, a voice interface application may be created to enable a voice interface functionality for devices associated with an organization. Space identifiers of spaces of the organization may be created and associated with the voice interface application. Devices associated with the space identifiers may be enabled for utilizing the voice interface application and may be set up utilizing wireless network identifiers associated with the spaces and/or the organization.

Abstract: A user terminal device includes a display; at least one sensor; a communication module; and a processor operatively connected to the display, the at least one sensor, and the communication module, wherein the processor is configured to, based on receiving a user utterance voice, determine whether or not a response screen corresponding to the user utterance voice is able to be provided through the display on the basis of at least one of a sensed value obtained from the at least one sensor or an inactive period of the display, based on determining that the response screen is unable to be provided through the display, receive current status information of at least one external device connected to the user terminal device through the communication module, determine one external device among the at least one external device to display the response screen on the basis of the current status information of the at least one external device, obtain the response screen to the user utterance voice, and transmit the respo

Abstract: Systems and methods are disclosed for performing actions on network-connected objects in response to reminders on devices. An input from a first user device is received wherein keywords of the input correspond to an action identifier corresponding to an action. The system determines a plurality of network-connected devices capable of performing the action. A comparison is executed for each of the plurality of network-connected devices which identifies a device identifier from the words of the input determining a target device for performing the action. The system determines a plurality of criteria identifiers for performing the action on the target device. A comparison is executed for each of the criteria identifiers which identifies an action criterion from the words of the input. A command is transmitted, from the user device, for the action to be executed on the target device according to the action criterion.

Abstract: Processor(s) of a client device can: receive sensor data that captures environmental attributes of an environment of the client device; process the sensor data using a machine learning model to generate a predicted output that dictates whether one or more currently dormant automated assistant functions are activated; making a decision as to whether to trigger the one or more currently dormant automated assistant functions; subsequent to making the decision, determining that the decision was incorrect; and in response to determining that the determination was incorrect, generating a gradient based on comparing the predicted output to ground truth output. In some implementations, the generated gradient is used, by processor(s) of the client device, to update weights of the on-device speech recognition model. In some implementations, the generated gradient is additionally or alternatively transmitted to a remote system for use in remote updating of global weights of a global speech recognition model.

Abstract: A personalized voice conversion system includes a cloud server and an intelligent device that communicates with the cloud server. The intelligent device upstreams an original voice signal to the cloud server. The cloud server converts the original voice signal into an intelligible voice signal based on an intelligible voice conversion model. The intelligent device downloads and plays the intelligible voice signal. Based on the original voice signal and the corresponding intelligible voice signal, the cloud server and the intelligent device train an off-line voice conversion model provided to the intelligent device. When the intelligent device stops communicating with the cloud server, the intelligent device converts a new original voice signal into a new intelligible voice signal based on the off-line voice conversion model and plays the new intelligible voice signal.

Abstract: A mobile terminal improved in operability concerning fax transmission. A CPU of the mobile terminal sets information indicative of a fax transmission destination, sets reading and transmission information concerning fax transmission and original reading, and sends a request for fax transmission, to an image forming apparatus. When a response notifying capability of fax transmission is received from the apparatus, the CPU causes a message for prompting a user to set an original, to be displayed on a display section. When the original has been set and an instruction for fax transmission from the user is received, the CPU sends an instruction for reading the original and executing fax transmission, together with the transmission destination information, and the reading and transmission information, to the apparatus. The CPU causes a result of fax transmission by the apparatus to be displayed on the display section.

Abstract: Provided are an electronic device and an operation method thereof. The electronic device includes: a first sound receiver configured to receive a sound input while power is supplied to the first sound receiver in a standby state; a trigger word/phrase recognizer configured to recognize whether the sound input received by the first sound receiver corresponds to a trigger word or phrase; a second sound receiver configured to receive a sound input by receiving supply of power based on the trigger word or phrase being recognized by the trigger word/phrase recognizer; and a data transceiver configured to output a first sound input signal supplied from the first sound receiver and a second sound input signal supplied from the second sound receiver.

Abstract: A voice control method that includes: a terminal device receiving voice information; the terminal device querying a control instruction corresponding to the voice information from a local voice library; when no control instruction corresponding to the voice information is found in the local voice library, the terminal device uploading the voice information onto a cloud server; the cloud server querying the control instruction corresponding to the voice information from a cloud voice library; when the control instruction corresponding to the voice information is found in the cloud voice library, the cloud server sending the control instruction to the terminal device; the terminal device receiving the control instruction, and executing a corresponding operation on the basis of the control instruction. The present disclosure improves the response speed of a terminal device, and improves user experience.

Abstract: This application relates to systems and methods for proactively predicting user intents on personal agents. In some examples, a user intent prediction system can include a computing device configured to obtain user intent data identifying a desired action by a user on a network-enabled tool. The computing device is further configured to obtain contextual data characterizing a user's interaction with the network-enabled tool. The computing device can then determine at least one predicted future intent of the user on the network-enabled tool based on the user intent data and the contextual data and present the at least one predicted future intent to the user.

Abstract: A virtual assistant for a communication session is disclosed herein. A device may receive, during a communication session, an invocation input that is associated with invoking a virtual assistant. The invocation input may be received from a user, of the device, involved in the communication session. The virtual assistant may be associated with a communication application that is hosting the communication session. The device may receive, from the user, a voice command associated with the virtual assistant. The voice command may include instructions associated with adjusting a setting of a feature of the communication session. The device may enable the virtual assistant to identify the setting of the feature from the voice command. The device may configure, in association with the virtual assistant, the feature of the communication session according to the setting.

Abstract: Acoustic signatures can be used in connection with a voice-enabled computer system. An acoustic signature can be a specific noise pattern (or other sound) that is played while the user is speaking and that is mixed in the acoustic channel with the user's speech. The microphone of the voice-enabled computer system can capture, as recorded audio, a mix of the acoustic signature and the user's voice. The voice-enabled computer system can analyze the recorded audio (locally or at a backend server) to verify that the expected acoustic signature is present and/or that no previous acoustic signature is present.

Abstract: The present disclosure provides a method, an apparatus and a device for implementing a voice application and a computer readable storage medium, which determine a feedback content and a template identifier corresponding to a voice command of a user on a server side, and the determination result is performed by the IoT device. As the Internet information is iteratively updated, the voice command is also updated, the processing function of the voice command can be updated on the server side, so that the voice application in the IoT device does not need to be updated. Therefore, the processing capability of the voice application can be updated without upgrading the voice application itself, thereby alleviating the problem of an excessively long upgrade process due to the OTA upgrade process in the prior art.

Abstract: A dialogue control system, comprising at least one processor configured to: acquire remark information about a remark of a user; control a plurality of dialogue generators each for generating, when the remark information is acquired, reply information about a reply to be made in response to the remark indicated by the remark information; and output the reply information generated by at least one of a plurality of dialogue generators, wherein the acquisition of the remark information and the output of the reply information are repeated so that a dialogue progresses, and wherein each of the plurality of dialogue generators is configured to generate new reply information based on the reply information that has been generated and output by another of the plurality of dialogue generators.

Abstract: Disclosed are various embodiments for staged user enrollment using audio devices. In one embodiment, among others, a system includes a computing device and program instructions. The program instructions can cause the computing device to receive a configuration profile for configuring a client device. The configuration profile includes a device policy associated with an organizational group. The program instructions can further cause the computing device to generate a sound payload based on encoding the configuration profile onto a sound signal. A request is received a request from a voice assistant service for configuring the client device. The request is associated with configuring the client device according to the device policy. The sound payload is transmitted to the voice service for broadcasting from a speaker device. The sound payload is broadcast within an audible distance of the client device.