Abstract: Systems and processes for operating an intelligent automated assistant are provided. Upon receiving a user input requesting that a digital assistant initiate a task, performance of the task is initiated, and a task response is provided. If the digital assistant determines that task is associated with a first user interface, such as a non-digital assistant-specific user interface, the task response is provided using the first user interface.

Abstract: Ingesting large quantities of data in a secure manner can be problematic, particularly processing types of data streams to determine the content of the data stream. As provided herein, a context associated with the data stream can be ascertained by mapping the content of data stream using contextual maps. The content and context can then be further processed in order to generate appropriate responses. In addition, obfuscation can be applied to the content such that the original content is lost while the contextual meaning associated with the content is maintained. In this way, an understanding can persist of the original content without retaining the underlying raw data.

Abstract: Provided is an information processing system including: a voice information acquisition unit that acquires voice information including an utterance made by a person; a status acquisition unit that acquires status information related to status of the person; and a support information generation unit that generates support information used for supporting operation of the person based on the voice information and the status information.

Abstract: In-feed encapsulation of display ads or other externally-hosted content is disclosed. In various embodiments, an indication is received that an ad to be displayed in the context of an instance of a publisher content page as rendered at a client system links out to advertising content associated with a third party site. The client system is configured to display a modified version of the advertising content in the event an indication is received that the ad has been selected.

Abstract: A computer-implemented method for improving a predictive response of a machine learning-based virtual dialogue agent includes identifying an unfilled dialogue slot associated with an active dialogue between a user and the machine learning-based virtual dialogue agent, obtaining subsequent dialogue input data based on prompting the user for the unfilled dialogue slot, and computing a value of the unfilled dialogue slot based on the obtaining of the subsequent dialog input, wherein computing the value of the unfilled dialogue slot includes computing, via a question-answering machine learning model, a slot answer inference comprising the value of the unfilled dialogue slot based on an input of a machine learning-derived query and machine learning-derived context computed for the unfilled dialogue slot.

Abstract: Provided is an information processing system including: a voice information acquisition unit that acquires voice information including an utterance made by a person; a status acquisition unit that acquires status information related to status of the person; and a support information generation unit that generates support information used for supporting operation of the person based on the voice information and the status information.

Abstract: A system and method for enhancing communication between multiple parties includes a first user accessing a communication device; initiating a communication connection to a receiving communication device of a second user; and wherein at least one of the communication devices includes a list of enabled universal communication attributes of the user, utilizing one or more of the enabled communication attributes to complete the communication connection between the initiating and receiving communication devices. A user can select a desired communication attribute or multiple attributes which can be stored in the user's profile. The enabled attributes can be utilized by a network accessing the user's profile to complete the communication connection.

Abstract: A system for automated account interaction receives historical information associated with an account corresponding to a user. The historical information identifies a transaction involving the account. The system uses one or more trained machine learning models to identify an intent for the transaction at least in part by inputting the historical information to the trained machine learning models. The system uses the trained machine learning models to generate a recommended transaction at least in part by inputting the intent for the transaction to the trained machine learning models. The system outputs the recommended transaction and receives a confirmation regarding the recommended transaction.

Abstract: The present disclosure relates generally to systems, methods, instructions, and other aspects describing automated transcription and associated script generation. In one aspect, a method includes facilitating a voice bot segment of a two-way communication session, where the voice bot segment is between a customer device and a non-human bot agent, and transfer of the session to a human agent device as part of a human voice segment of the two-way communication session, wherein the transfer occurs following a failure of the non-human bot agent to resolve a customer issue. Accessing survey data describing the two-way communication session, wherein the survey data is associated with successful resolution of the customer issue and automatically processing transcript data from the two-way communication with the survey data to identify language data from the transcript associated with resolution of the customer issue. The non-human bot agent is then dynamically updated using the language data.

Abstract: A faucet is provided that electronically controls the flow volume and temperature of water being dispensed. The faucet illustratively includes a faucet body and a faucet handle. In some embodiments, the faucet may include a faucet body and be voice controlled. The faucet illustratively includes an inertial motion unit sensor mounted in the faucet handle to sense spatial orientation of the faucet handle. The faucet illustratively includes an electronic flow control system to adjust flow volume and temperature of water being dispensed. The faucet illustratively includes a controller configured to receive signals from the inertial motion unit sensor and control the electronic flow control system to adjust flow volume and temperature of water being dispensed based upon the position of the faucet handle.

Abstract: Described herein is a system for enabling a user to perform complex goals using multiple skills/applications of an intelligent assistant device. Skills may register as consumers of an action or providers of an action, and the consumer skills may be configured to invoke provider skills to perform actions. The system receives a request to perform an action from a skill along with some action data. The system validates the action data, selects another skill to perform the action, and forwards the request to the selected skill to perform the action.

Abstract: Embodiments are related to processing of one or more input audio feeds for generation of a target audio stream that includes at least one object of interest to a listener. In some embodiments, the target audio stream may exclusively or primarily include the sound of the object of interest to the listener, without including other persons. This allows a listener to focus on an object of his or her interest and not necessarily have to listen to the performances of other objects in the input audio feed. Some embodiments contemplate multiple audio feeds and/or with multiple objects of interest.

Abstract: A system includes one or more memory devices storing instructions, and one or more processors configured to execute the instructions to perform steps of providing automated natural dialogue with a customer. The system may generate one or more events and commands temporarily stored in queues to be processed by one or more of a dialogue management device, an API server, and an NLP device. The dialogue management device may create adaptive responses to customer communications using a customer context, a rules-based platform, and a trained machine learning model.

Abstract: At an electronic device with a display, a microphone, and an input device: while the display is on, receiving user input via the input device, the user input meeting a predetermined condition; in accordance with receiving the user input meeting the predetermined condition, sampling audio input received via the microphone; determining whether the audio input comprises a spoken trigger; and in accordance with a determination that audio input comprises the spoken trigger, triggering a virtual assistant session.

Abstract: Embodiments of the present disclosure provide for improved interoperable data management between a user-accessed software application and an embedded software application. In some contexts, a user-accessed application provides both its own functionality as well as enabling access to functionality of an embedded application. The embedded application is accessed via a data-driven connection that provides several technical advantages and addresses various data interoperability and persistence problems. In some embodiments, a user-accessed application may be configured to provide functionality of multiple embedded applications consistent with the innovations herein described.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for detecting a continued conversation are disclosed. In one aspect, a method includes the actions of receiving first audio data of a first utterance. The actions further include obtaining a first transcription of the first utterance. The actions further include receiving second audio data of a second utterance. The actions further include obtaining a second transcription of the second utterance. The actions further include determining whether the second utterance includes a query directed to a query processing system based on analysis of the second transcription and the first transcription or a response to the first query. The actions further include configuring the data routing component to provide the second transcription of the second utterance to the query processing system as a second query or bypass routing the second transcription.

Abstract: The embodiment of the present disclosure provides a method for smart gas personalized feedback service and an Internet of things (IoT) system thereof. The method is implemented based on a smart gas management platform. The method includes: receiving a call message of a target customer through a call center, and a content of the call message being related to a gas business; determining a service category corresponding to the call message based on the call message, and determining a feedback mode; in response to the feedback mode being manual feedback, determining a target operator through the call center to feed back a call of the target customer; and in response to the feedback mode being automatic feedback, determining, using a knowledge map, a feedback content through the call center based on the service category corresponding to the call message, and sending the feedback content to the target customer.

Abstract: A method of twinning a primary wireless communication device with an in-vehicle wireless communication device.

Abstract: A voice command resolution apparatus, including a memory configured to store instructions; and a processor configured to execute the instructions to: recognize a voice command of a user in an input sound, analyze a non-speech sound included in the input sound, and determine at least one target Internet of things (IoT) device related to execution of the voice command, based on an analysis result of the non-speech sound.

Abstract: A server-side processing method for implementing an active initiation of a dialogue is disclosed, comprising: establishing a communication connection with a voice client, in response to a received request for establishing a connection from the voice client; receiving an information stream sent by the voice client through the communication connection; performing a dialogue decision-making process according to the information stream, obtaining and outputting an adapted dialogue content to the voice client upon determining that it is an active dialogue scenario. A server and a system for implementing an active initiation of a dialogue are also provided. The disclosed solutions realize intelligent decision-making for voice interaction, and can actively initiate a dialogue based on server-side decision-making, improving interaction experience and realizing intelligent interaction.

Abstract: Implementations disclosed herein are directed to techniques for selectively enabling and/or disabling non-transient storage of one or more instances of assistant interaction data for turn(s) of a dialog between a user and an automated assistant. Implementations are additionally or alternatively directed to techniques for retroactive wiping of non-transiently stored assistant interaction data from previous assistant interaction(s).

Abstract: Systems and methods are disclosed herein for training a model to accurately determine whether two phrases are conversationally connected. A media guidance application may detect a first phrase and a second phrase, translate each phrase to a string of word types, append each string to the back of a prior string to create a combined string, determine a degree to which any of the individual strings matches any singleton template, and determine a degree to which the combined string matches any conversational template. Based on the degrees to which the individual and combination strings match the singleton and conversational templates, respectively, strengths of association are correspondingly updated.

Abstract: Generating synthesized speech audio data on behalf of a given user in a conversation. The synthesized speech audio data includes synthesized speech that incorporates textual segment(s). The textual segment(s) can include recognized text that results from processing spoken input, of the given user, using a speech recognition model and/or can include a selection of a rendered suggestion that conveys the textual segment(s). Some implementations dynamically determine one or more prosodic properties for use in speech synthesis of the textual segment, and generate the synthesized speech with the one or more determined prosodic properties. The prosodic properties can be determined based on the textual segment(s) used in speech synthesis, textual segment(s) corresponding to recent spoken input of additional participant(s), attribute(s) of relationship(s) between the given user and additional participant(s) in the conversation, and/or feature(s) of a current location for the conversation.

Abstract: Systems and methods are described herein for alerting a user that the user will be unable to view a broadcast program based on an estimated time of arrival of the user to a media consumption device, and responsively providing the user with an option to record the broadcast program. These systems and methods are performed at least by identifying a plurality of broadcast programs that are indicated on a profile of a user, receiving an estimated time of arrival of the user to a location of a media consumption device, responsively determining whether the user will be unable to view a broadcast program of the plurality of broadcast programs, responsively providing the user with an option to record the broadcast program, and responsively causing the broadcast program to be recorded.

Abstract: Methods and systems that use a plurality of machine learning models to both monitor user-generated data entries corresponding to differences in network traffic that may be evidence of a disruption and determine severity levels based on: (i) current and historic differences in average network traffic over the plurality of communication networks; (ii) current and historic user-generated data entries; and (iii) labeled severity levels for historic differences in average network traffic over the plurality of communication networks.

Abstract: Implementations are directed to dynamically adapting which assistant on-device model(s) are locally stored at assistant devices of an assistant device group and/or dynamically adapting the assistant processing role(s) of the assistant device(s) of the assistant device group. In some of those implementations, the corresponding on-device model(s) and/or corresponding processing role(s), for each of the assistant devices of the group, is determined based on collectively considering individual processing capabilities of the assistant devices of the group. Implementations are additionally or alternatively directed to cooperatively utilizing assistant devices of a group, and their associated post-adaptation on-device model(s) and/or post-adaptation processing role(s), in cooperatively processing assistant requests that are directed to any one of the assistant devices of the group.

Abstract: A computer-implemented method is provided. The method including receiving speech audio of dictation associated with a user ID, deriving acoustic features from the speech audio, storing the derived acoustic features in a user profile associated with the user ID, receiving a request for acoustic features through an application programming interface (API), the request including the user ID, and sending the derived acoustic features through the API.

Abstract: Methods, systems, and devices for managing software agent health are described. A software platform may output multiple requests to one or more software agents. Each request may be associated with operation of a respective software agent. The software platform may obtain statistics for each software agent in response to the multiple requests. The statistics may corresponds to a respective performance of each software agent of the one or more software agents. The software platform may output a recommendation for each software agent, of the one or more software agents, based on the statistics and one or more rules configured at the software platform.

Abstract: A multi-factor authentication technique can use multiple smart devices to determine whether a person is authenticated by minimizing the extent to which the person is expected to interact with his or her smart devices. In an example multi-factor authentication method comprises performing a first determination, that a first mobile device is located within a wireless range of a device, obtaining a unique identifier from the first mobile device, sending, to a server, the unique identifier, receiving, from the server, information that indicates a first authentication technique and a second authentication technique, performing a second determination that the person is authenticated by successfully performing the first authentication technique with the first mobile device and by successfully performing the second authentication technique with the second mobile device, and performing a final authentication operation in response to performing the second determination.

Abstract: A method for electronically utilizing content in a communication between a customer and a customer representative is provided. An audible conversation between a customer and a service representative is captured. At least a portion of the audible conversation is converted into computer searchable data. The computer searchable data is analyzed during the audible conversation to identify relevant meta tags previously stored in a data repository or generated during the audible conversation. Each meta tag is associated with the customer. Each meta tag provides a contextual item determined from at least a portion of one of a current or previous conversation with the customer. A meta tag determined to be relevant to the current conversation between the service representative and the customer is displayed in real time to the service representative currently conversing with the customer.

Abstract: A method for maintaining contact information in a hearing impaired assisted user's communication device includes the steps of (a) providing a web site for altering assisted user contact information, (b) linking a proxy device to the web site, (c) receiving an identifier associated with the assisted user's device via the proxy device, (d) identifying an assisted user's device via the received identifier, (e) enabling the proxy device to be used to modify contact information for the assisted user associated with the received identifier, (f) starting a timer to time out a sync timeout period, (g) during the sync timeout period, receiving an indication via the assisted user's device confirming a desire to update the assisted user's contact information, (h) updating the assisted user's contact information, and (i) at the end of the timeout period, ceasing an indication that updated data is ready to be used from the assisted user's device.

Abstract: The processor of an information processing apparatus includes serves, by executing an information processing program, as: a function determiner; a morpheme analyzer configured to analyze a message input by a user in morphemes; a word detector configured to detect a predetermined time-representing word indicating temporal nearness or farness and a predetermined keyword which is modified by the time-representing word and which indicates settings associated with the function from the message analyzed in morphemes by the morpheme analyzer; a setting selector configured to select a newest set value when the word detector has detected the time-representing word indicating temporal nearness and to select a set value used when the user used the function in the past when the word detector has detected the time-representing word indicating temporal farness; and a function executor configured to execute the function determined by the function determiner using the set value selected by the setting selector.

Abstract: An embodiment vehicle includes a communication device, an output device, an input device including a microphone, and a control device connected to each. The control device is configured to transmit speech data received through the microphone to a server through the communication device, to receive analysis information of the speech data from the server through the communication device in response to the transmission of the speech data, to identify whether the speech data corresponds to a first speech command registered in the server based on the analysis information, to control the output device to output information about target devices of a control setting of the vehicle based on the speech data not corresponding to the first speech command, and to set the speech data as a second speech command for controlling at least one of the target devices based on a reception of a user input through the input device.

Abstract: Techniques for using multiple voice-enabled devices in a user environment to reduce the latency for obtaining responses to user utterances from a remote system. The voice-enabled devices may each establish connections with the remote system to have the remote system perform supplemental speech processing for utterances the devices are unable to process locally. One voice-enabled device may have a higher-latency connection to the remote system, and another voice-enabled device may have a lower-latency connection to the remote system. The lower-latency device may send an utterance to the remote system before the higher-latency device is able, and the remote system may begin processing the utterance faster than if the lower-latency device sent the utterance. The remote system may then provide a response for the utterance to the higher-latency device in less time than if the remote system had to wait for the utterance from the higher-latency device.

Abstract: An apparatus for generating a text report is disclosed. The apparatus includes at least a processor and a memory communicatively connected to the at least a processor. The memory instructs the processor to receive contextual data from a user. The memory instructs the processor to generate a query as a function of the contextual data. The memory instructs the processor to receive a query response from the user as a function of the query. The memory instructs the processor to generate a return as a function of the query response using a tonal adjustment engine. The memory instructs the processor to display the response using a display device.

Abstract: Various implementations disclosed herein include devices, systems, and methods for monitoring engagement associated with pharmaceutical articles. In various implementations, a device includes a non-transitory memory and a processor coupled with the non-transitory memory. In some implementations, a method includes obtaining engagement data indicating engagement associated with a pharmaceutical article. In some implementations, the method includes identifying a plurality of topics associated with the pharmaceutical article. In some implementations, the method includes determining respective comprehension scores for the plurality of topics based on the engagement data. In some implementations, the method includes recommending a set of one or more media content items related to a subset of the plurality of topics based on the respective comprehension scores for the plurality of topics.

Abstract: Technical solutions relate to the fields of artificial intelligence technologies and voice technologies. A technical solution includes: performing voice recognition and demand analysis on a voice instruction input by a user; in response to an unknown demand obtained by the demand analysis, acquiring information of a query entity and query content using a result of the demand analysis, and acquiring reply information corresponding to the query content by communication with the query entity; and returning a first voice response to the user using the reply information.

Abstract: A value-added content providing method for a computer system includes receiving an input message indicating to present a pop-up window in a display area of the computer system; obtaining a content area in the display area according to the input message; analyzing the content area to generate an analysis content; and providing and displaying a value-added content in the pop-up window according to the analysis content.

Abstract: Systems and methods for identifying irregularities during an automated user interaction are disclosed. The system may receive a communication and extract a perceived irregularity from the communication. The system may generate a first explanatory hypothesis associated with the perceived irregularity having an associated confidence measurement. The system may selectively retrieve user information based on the generated hypothesis and generate an investigational strategy associated with the hypothesis. In response to the investigational strategy, the system may receive a user communication, and the system may update the confidence measurement based on the user communication. When the confidence measurement exceeds the predetermined confidence threshold the system may validate the perceived irregularity as a true irregularity and provide a computer-generated dialogue response indicative of a proposed resolution of the irregularity.

Abstract: Disclosed are systems and methods that automate the process of analyzing interactive content data using artificial intelligence and natural language processing technology. The interactive content data is converted to machine encoded communication elements that can be further grouped into machined encoded n-grams. The co-occurrence of machine encoded communication elements or n-grams in the interactive content data is compared against communication elements or n-grams in a seed set of concentrated content files to determine an equivalence value. In this manner, the system can automate the process of determining the equivalence of interactive content data files.

Abstract: In some embodiments, the present disclosure provides an exemplary method that may include steps of receiving an input text data retrieved from a transcription associated with a previously recorded audio data file between a user of a plurality of users and an agent associated with a call center; identifying personal information associated with the user of the plurality of users from the input text data by inputting the input text data into a trained machine learning model; determining at least one key term within the personal information associated with the user of the plurality of users; automatically determining a confidence positivity score associated with the at least one key term; automatically extracting a plurality of tuples from the input text data; storing the plurality of tuples in an external database; and automatically generating a call script for conducting a subsequent call with the user.

Abstract: Synchronizing a sensor network and an ontology by analyzing outputs of a set of sensors, analyzing relationships of an ontology, mapping the outputs to the relationships, identifying a correlation among the outputs, and modifying the ontology according to the correlation.

Abstract: To provide techniques for generating, from a sound signal, a natural language representation corresponding to the sound signal while controlling a predetermined index for a natural language representation. A data generation apparatus 200 includes: a latent variable generation unit 210 that generates, from a sound signal, a latent variable corresponding to the sound signal using an encoder; and a data generation unit 220 that generates a natural language representation corresponding to the sound signal from the latent variable and a condition concerning an index for the natural language representation using a decoder.

Abstract: The present technology provides a system that enables a user to communicate with one of multiple devices in a network based on context information from another device in the network. The system includes a context manager configured to (1) receive context information from the multiple devices; (2) identify a subject-of-interest based on a user input; (3) determine a set of relevant context information based on the subject-of-interest and the received context information; and (4) transmitting the set of relevant context information to a target device to perform a task associated with the subject-of-interest. The context information managed by the present technology enables a user to conveniently interact with the multiple devices in the network without requiring the user to provide details of his/her instructions.

Abstract: A speech recognition method, apparatus, and device, and a computer-readable storage medium provided pertain to the field of artificial intelligence technologies. The method includes: obtaining or generating a dynamic target language model based on reply information of a first intent, where the dynamic target language model includes a front-end part and a core part; obtaining a speech signal, parsing the speech signal to generate a key word; and invoking the dynamic target language model to determine a second intent and a service content. The front-end part of the dynamic target language model parses out the second intent based on the key word, and the core part of the dynamic target language model parses out the service content based on the key word. The speech recognition method prevents a provided service content from deviating from a user requirement and achieves a good recognition effect.

Abstract: A method includes obtaining a query in a base language and translating the query to generate one or more translated queries each in a respective target language. The method also includes searching one or more sets of electronic files based on the one or more translated queries to generate target-language search results, where each translated query is used to search one or more electronic files that include content in the respective target language of the translated query. The method also includes, based on the target-language search results, scheduling one or more electronic files of the one or more sets of electronic files for at least partial translation to the base language.

Abstract: Migrating audio/video (A/V) recording and communication devices to new networks in accordance with various embodiments of the present disclosure are provided.

Abstract: A system includes an acoustic monitoring, analysis, and diagnostic system having a processor. The processor is configured to receive NF noise signals from a near field (NF) microphone array, the NF microphone array measures noises from a power generation system in a NF. The processor is configured to receive FF noise signals from a far field (FF) microphone array, the FF microphone array measures noises from a power generation system in a FF. The processor is configured to derive NF and FF noise measurements based on the signals and to synchronize the NF and FF noise measurements to create synchronized NF and FF noise data. The processor is configured to analyze the synchronized NF and FF noise data to create a NF and an FF noise signature. The processor is configured to diagnose root causes of noises generated from the power generation system and to report the root causes.

Abstract: The invention provides a content playback system comprising a playback device that is configured to detect a voice command from a user and to play content. When a voice command is received, the system is configured to analyse the voice command to determine a user intent. The system then extracts one or more entities from the voice command, wherein each of the extracted entities is of a type associated with the determined user intent. Then, based on the one or more extracted entities, the system controls the playback device. Analysis of the voice command in this manner may improve an accuracy with which a meaning of the voice command can be obtained, thereby facilitating control of the playback device.

Abstract: Systems and methods for dynamically customizing a virtual assistant are disclosed. The systems and methods can receive information associated with a conversation involving the virtual assistant; determine whether a channel switching condition for switching the conversation from a first channel to a second channel is satisfied, based on the information associated with the conversation; determine whether a language switching condition for switching the conversation from a first language to a second language is satisfied, based on the information associated with the conversation; determine whether a configuration switching condition for switching a first configuration of the virtual assistant to a second configuration of the virtual assistant is satisfied, based on the information associated with the conversation; and perform an action based on at least one of the determinations.