Abstract: Systems and methods for identifying content corresponding to a language are provided. Language spoken by a first user based on verbal input received from the first user is automatically determined with voice recognition circuitry. A database of content sources is cross-referenced to identify a content source associated with a language field value that corresponds to the determined language spoken by the first user. The language field in the database identifies the language that the associated content source transmits content to a plurality of users. A representation of the identified content source is generated for display to the first user.

Abstract: Methods, systems, and apparatus for selecting an input mode are described. In one aspect, a method includes receiving request data specifying a request to launch a virtual assistant application from a lock screen of a mobile device. In response to receiving the request data, input signals are obtained. A selection of an input mode for the virtual assistant application is made, from candidate input modes, based on the input signals. Each candidate input mode is of an input type different from each other input type of each other candidate input mode. The input types include an image type and an audio type. The input mode of the image type receives pixel data for input to the virtual assistant application. The input mode of the audio type receives audio input for the virtual assistant application. The virtual assistant application presents content selected based on input signals received using the selected input mode.

Abstract: A system may include first and second speech-processing systems with corresponding first and second wakewords. An utterance may contain two or more wakewords. The system determines which wakeword was spoken first and can send data to that wakeword's speech-processing system to perform further processing.

Abstract: A method and device for behavior control of a virtual image based on a text, and a medium are disclosed. The method includes inserting a symbol in a text, and generating a plurality of input vectors corresponding to the symbol and elements in the text; inputting the plurality of input vectors to a first encoder network, and determining a behavior trigger position in the text based on an attention vector of a network node corresponding to the symbol; determining behavior content based on a first encoded vector that is outputted from the first encoder network and corresponds to the symbol; and playing an audio corresponding to the text, and controlling the virtual image to present the behavior content when the audio is played to the behavior trigger position.

Abstract: Contact center agents commonly have dissimilar levels of skill for a particular topic or ability. Often an expert is available to help lesser-skilled agents, but such experts may not always be available. Automated systems and methods are provided that allow for an agent-customer interaction to be monitored and, when a question is present, identify a best-matching knowledge unit to address the question. With the knowledge unit identified, a prior communication portion associated with the knowledge unit is then presented to the agent, such as via pop-up message, whisper voice message, etc., to allow the agent to have the benefit of the knowledge of the expert to answer the question without engaging the expert.

Abstract: In an approach to controlling voice command execution via boundary creation, one or more computer processors determine one or more devices included in an Internet of Things platform. One or more computer processors receive, from a user, an indication of a boundary around two or more devices of the one or more devices. One or more computer processors create a boundary around the two or more devices of the one or more devices. One or more computer processors receive a voice command from the user associated with the two or more devices of the one or more devices. One or more computer processors transmit the voice command to the two or more devices of the one or more devices within the boundary.

Abstract: A system for authenticating digital contents includes a computing platform having a hardware processor and a memory storing a software code. According to one implementation, the hardware processor executes the software code to receive digital content, identify an image of a person depicted in the digital content, determine an ear shape parameter of the person depicted in the image, determine another biometric parameter of the person depicted in the image, and calculate a ratio of the ear shape parameter of the person depicted in the image to the biometric parameter of the person depicted in the image. The hardware processor is also configured to execute the software code to perform a comparison of the calculated ratio with a predetermined value, and determine whether the person depicted in the image is an authentic depiction of the person based on the comparison of the calculated ratio with the predetermined value.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Abstract: A system for parsing separate intents in natural language speech configured to (i) receive, from the user computer device, a verbal statement of the user including a plurality of words; (ii) translate the verbal statement into text; (iii) label each of the plurality of words in the verbal statement; (iv) detect one or more potential splits in the verbal statement; (v) divide the verbal statement into a plurality of intents based upon the one or more potential splits; and (vi) generate a response based upon the plurality of intents.

Abstract: In one embodiment, a method includes receiving, from a client system associated with a user, a user request comprising a reference to a target object, accessing visual data from the client system, wherein the visual data comprises images portraying the target object and one or more additional objects, and wherein attribute information of the target object is recorded in a multimodal dialog state, resolving the reference to the target object based on the attribute information recorded in the multimodal dialog state, determining relational information between the target object and one or more of the additional objects portrayed in the visual data, and sending, to the client system, instructions for presenting a response to the user request, wherein the response comprises the attribute information and the determined relational information.

Abstract: A system and method to interpret natural language requests and handle natural language responses in conversation is disclosed. The system includes an intent creation subsystem to receive one or more predefined intents to create one or more corresponding intent databases; a natural language message handling subsystem to receive a plurality of natural language messages from a user to identify one or more intents, to match one or more identified intents associated with the plurality of received natural language messages with the one or more predefined intents, handle the one or more identified intents by using a first message handling scheme when a similar match is found and a second message handling scheme in case of a dissimilar match; a natural language response handling subsystem to extract information from plurality of received natural language messages, to rectify the plurality of received natural language messages to handle a structured natural language response.

Abstract: A method of operating a voice assistant activation system, the voice assistant activation system comprising a microphone, a first voice assistant module, and a second voice assistant module. The method includes receiving, via the microphone, a voice input; transmitting the voice input via a first virtual microphone to the first voice assistant module; transmitting the voice input via a second virtual microphone to the second voice assistant module; activating the first voice assistant module when the voice input comprises a first keyword; and activating the second voice assistant module when the voice input comprises a second keyword.

Abstract: A speech recognition method and apparatus for performing speech recognition in response to an activation word determined based on a situation are provided. The speech recognition method and apparatus include an artificial intelligence (AI) system and its application, which simulates functions such as recognition and judgment of a human brain using a machine learning algorithm such as deep learning.

Abstract: Techniques are described for performing session termination(s) for active sessions in response to a planned operation on a database server of a DBMS. In an embodiment, the DBMS receives a request for a planned operation on a database server. The database server may have session(s) established with a client system to receive request(s) to execute database command(s) on the DBMS. In response, the DBMS transmits to the client system a notification to drain a session with the database server, and the DBMS marks the sessions at the database to drain. The DBMS is configured to terminate any drain-marked sessions by the database server when a rule is satisfied, and the failover is expected to succeed, and/or that the session is unlikely to drain or to failover at a later point in the session lifecycle. The DBMS may identify, in a rule set, a rule having rule instructions to detect a possible termination point for the session before the drain timeout period expires.

Abstract: The present disclosure relates to a method comprising receiving an electronic message. Message intents of the received electronic message and one or more related intents may be determined. An electronic message may be generated according to a selected subset of the message intents or according to the related intents. The generated electronic message may be provided.

Abstract: A microscope control method for operating a microscope, includes: capturing an item of acoustic, graphically represented and/or electronically coded voice information; comparing the voice information with stored reference commands and determining a voice command on the basis of a predetermined degree of correspondence between at least one section of the voice information and a reference command; selecting that reference command to which the voice command corresponds at least to a predetermined degree; generating at least one control command suitable for operating the microscope, wherein the control command is either an invariable control command assigned to the selected reference command or the control command is generated on the basis of a rule assigned to the reference command for forming a generated control command, and controlling the microscope by means of the assigned or generated control command. Also, a microscope is designed to carry out the microscope control method.

Abstract: An electronic device, a system, a method, and a program for externally adding voice control functionality to another device are disclosed. The electronic device includes memory, a processor, an audio input interface, a first communication interface, a second communication interface, and an audio encoder. First return audio data is received by the first communication interface from a sink device. An audio signal corresponding to a voice command is received by the audio input interface from a transducer. The audio signal is encoded by the audio encoder to obtain second return audio data. The second return audio data is output by the second communication interface to a source device. The second return audio data is encoded by an audio encoder of the source device to obtain control data. A function of the source device is controlled based on the control data.

Abstract: A method for managing commands utilizing command boundaries includes establishing a first command boundary for a first intelligent virtual assistant operating on a first electronic device. The method also includes, responsive to receiving audio from a plurality of sources within a vicinity of the first electronic device, identifying a portion of the audio from the plurality of sources within the first command boundary. The method also includes, responsive to determining a command is identifiable in the portion of the audio from the plurality of sources within the first command boundary, sending the command to the first intelligent virtual assistant on the first electronic device.

Abstract: Techniques described herein are directed to arbitrating between multiple potentially-responsive, automated-assistant capable electronic devices to determine which should respond to the user's utterance, and/or which should defer to other electronic device(s). In various implementations, a spoken utterance of a user may be detected at a microphone of a first electronic device, a spoken utterance provided by a user. Sound(s) emitted by additional electronic device(s) may also be detected at the microphone. Each of the sound(s) may encode a timestamp corresponding to detection of the spoken utterance at a respective electronic device. Timestamp(s) may be extracted from the sound(s) and compared to a local timestamp corresponding to detection of the spoken utterance at the first electronic device. Based on the comparison, the first electronic device may either invoke an automated assistant locally or defer to one of the additional electronic devices.

Abstract: Systems and methods are disclosed for customizing, distributing and processing audio signature data. Examples disclosed herein include waking a portable device from an inactive state in response to an activation signal. Disclosed examples also include generating a first signature based on audio from a microphone of the portable device during a period of time specified by the activation signal. Disclosed examples further include comparing the first signature with a second signature obtained from the activation signal to determine a match score, and communicating a match result based on the match score to a server via a network.

Abstract: Systems and methods for determining identifying semantic entities in audio signals are provided. A method can include obtaining, by a computing device comprising one or more processors and one or more memory devices, an audio signal concurrently heard by a user. The method can further include analyzing, by a machine-learned model stored on the computing device, at least a portion of the audio signal in a background of the computing device to determine one or more semantic entities. The method can further include displaying the one or more semantic entities on a display screen of the computing device.

Abstract: A dialogue system includes a Speech to Text (STT) engine configured to convert a user speech into a spoken text; a learning-based dialogue engine configured to determine a user intention corresponding to the spoken text; a storage configured to store learning data used for learning of the dialogue engine; and a controller configured to determine an actual user intention based on at least one of context information or an additional user speech, match a spoken text failing to determine the user intention with the actual user intention when the dialogue engine fails to determine the user intention corresponding to the spoken text, and the dialogue engine may perform learning using the spoken text stored in the storage and the actual user intention.

Abstract: A method for intent-based natural language processing may include a conversation engine receiving text of an utterance in a conversation from a conversation program, storing a session identifier for the conversation and a conversation state for the conversation, selecting one of a plurality a priority of intents based on the text of the utterance, communicating the text of the utterance to a natural language understanding computer program, receiving a plurality of potential intents and a confidence score for each potential intent from the natural language understanding computer program, selecting a selected intent based on the selected priority of intents, the potential intents, and the confidence scores, executing intent logic associated with the selected intent, updating the conversation state in the database based on the executed intent logic, and returning a response to the conversation program based on the executed intent logic.

Abstract: A speech processing system uses contextual data to determine the specific domains, subdomains, and applications appropriate for taking action in response to spoken commands and other utterances. The system can use signals and other contextual data associated with an utterance, such as location signals, content catalog data, data regarding historical usage patterns, data regarding content visually presented on a display screen of a computing device when an utterance was made, other data, or some combination thereof.

Abstract: A computerized method for enhancing agent's efficiency in a contact center by orchestrating a multi-agent to multi-contact attribute-based routing while maintaining seamless contact interaction is provided herein. The computerized method includes receiving a request for service and in response may operate an orchestration engine. The orchestration engine derives contact related information from the communication channel to yield at least one contact attribute and according to a preconfigured set of rules and the agent's availability state, performs attribute-based routing of the request for service to one or more agents and designates a primary agent out of the one or more agents to handle the request for service, and when the orchestration engine can't find a human agent having a proficiency as defined in the computerized system, the orchestration engine is designates as a primary agent, a bot agent.

Abstract: A robot includes a microphone configured to receive sound signals, and one or more controllers configured to determine a reference sound pressure level of background noise based on a sound signal received at a first time point via the microphone, detect occurrence of a sound event based on the reference sound pressure level and a sound pressure level of a sound signal received at a second time point via the microphone, recognize an event corresponding to the detected sound event, and control an operation of the robot based on the recognized event.

Abstract: An artificial intelligence device is provided. The artificial intelligence device according to an embodiment of the present disclosure includes: an input unit configured to receive a speech input; and a processor configured to operate in an interaction mode if a second wakeup word for setting an operation mode is recognized after a first wakeup word for calling the artificial intelligence device is recognized, and process one or more commands received after the second wakeup word according to the operation mode indicated by the second wakeup word.

Abstract: A computer evaluates free-form text messages among members of a team, using natural language processing techniques to process the text messages and to assess psychological state of the team members as reflected it the text messages. The computer assembles the psychological state as reflected in the messages to evaluate team collective psychological state. The computer reports a trend of team collective psychological state in natural language text form.

Abstract: The present disclosure provides a human-machine interactive method based on artificial intelligence and a human-machine interactive device based on artificial intelligence. The method includes: receiving a query from a user; processing the query based on a pre-generated model, and obtaining an answer with a human conversation style corresponding to the query, wherein the model is generated based on a human conversation corpus; and feeding back the answer to the user.

Abstract: A method, system, and computer program product for implementing automated software application generation is provided. The method includes scanning source code for identifying missing elements of hardware and software parameters associated with functional operation of software for development. The hardware and software parameters are analyzed and converted into configurable digital bins. An automation parameter is generated. The automation parameter is associated with portions of the software configured for automatic development and generation. Corrective actions associated with automating development of the software are generated based on the automation parameter and it is determined that the automation parameter is within a specified range of the portions. The corrective actions are executed with respect to development of the software and the software is generated.

Abstract: The invention relates to a method and system for booking reservations in a booking system and synchronizing bookings among several booking systems. The system comprises at least one booking system; at least one service provider; a mediator service; a client, and at least one client terminal device that can be a mobile device and that includes a dialogue. The client uses the dialogue to enter information into the system and the mediator receives inquiries and answers from the at least one booking system, the at least one service provider, and the at least one client. The mediator transfers and adapts information between them. The method and system are particularly suited for use with mobile phone users by Small Message Service messages.

Abstract: In one embodiment, a method includes, by one or more computing devices of an online social network, receiving, from a client system of a first user and from a second user, a biometric input used to identify the second user, sending, to the client system, a personal identifier for presentation to the second user, receiving, from the client system in response to the presentation of the personal identifier to the second user, an audio input from the second user, determining, based on a comparison of the audio input to a voiceprint of the second user, wherein the voiceprint comprises audio data for auditory identification of the second user, whether the audio input comprises the personal identifier spoken by the second user, and authenticating the second user to access an online account associated with the second user via the client system if the audio input is determined to be spoken by the second user and comprise the personal identifier spoken by the second user.

Abstract: A navigation system for providing driving instructions to a driver of a vehicle traveling on a route is provided. The driving instructions are generated by executing a multimodal fusion method that comprises extracting features from sensor measurements, annotating the features with directions for the vehicle to follow the route with respect to objects sensed by the sensors, and encoding the annotated features with a multimodal attention neural network to produce encodings. The encodings are transformed into a common latent space, and the transformed encodings are fused using an attention mechanism producing an encoded representation of the scene. The method further comprises decoding the encoded representation with a sentence generation neural network to generate a driving instruction and submitting the driving instruction to an output device.

Abstract: An electronic device is provided. The electronic device includes a microphone, a processor operatively connected to the microphone, and a memory operatively connected to the processor, wherein the memory, when executed, stores instructions for causing the processor to receive first speech data through the microphone, recognize a user input to call a voice assistant from the first speech data, convert the user input into a first wakeup score, determine the electronic device as a first reference device at least based on the first wakeup score that exceeds a designated threshold value, configure a first noise reduction space based on location information of the first reference device, determine at least one of one or more electronic devices, located in the first noise reduction space, as a first noise reduction device to perform a noise reduction operation, and control the noise reduction operation of the first noise reduction device.

Abstract: A method to present a summary of a transcription may include obtaining, at a first device, audio directed to the first device from a second device during a communication session between the first device and the second device. Additionally, the method may include sending, from the first device, the audio to a transcription system. The method may include obtaining, at the first device, a transcription during the communication session from the transcription system based on the audio. Additionally, the method may include obtaining, at the first device, a summary of the transcription during the communication session. Additionally, the method may include presenting, on a display, both the summary and the transcription simultaneously during the communication session.

Abstract: A performance internet marketing self-optimizing, anthropomorphic, artificial intelligence-based system and method to quote, compare and purchase benefits products from a benefits provider. The system and method collects information from an online advertising platform during the process and returns the collected information to the online advertising platform for optimization of the online advertising platform.

Abstract: Various embodiments are provided for providing intelligent library management in a computing environment by a processor. Application compatibility may be learned from a plurality of projects, repositories, application libraries, data sources, or a combination thereof. A list of recommended application libraries, ordered according to the application compatibility, may be automatically provided for implementation, integration, or replacements of one or more sections of an application library.

Abstract: A computer-based system and method for generating a current pain assessment of a neonate using facial expressions along with crying sounds, body movement, and vital signs changes and for using the current pain objective assessment to predict future pain objective assessment and assign a future pain probability score by incorporation spatiotemporal data into the multimodal assessment.

Abstract: Because digital assistants tend to have different areas of expertise and/or different abilities to fulfill a given request, it is sometimes difficult for a user to know which digital assistant is best able to fulfill a request. Representative embodiments disclose mechanisms to increase federate digital assistants so that a user's request can be funneled to the digital assistant best able to fulfill the user's request. A meta-assistant gathers information on skills provided by a set of digital assistants. The meta-assistant also gathers completion data for requests for different digital assistants and user satisfaction information. A user submits a request to the meta-assistant. The meta-assistant extracts user intent from the request and redirects the user's request to the digital assistant best able to fulfill the request. Embodiments can utilize trained machine learning models or scored algorithmic approaches to select the digital assistant.

Abstract: A selective sensor polling system for a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a template for an action data structure with a plurality of fields. The system can determine to poll a first sensor for data for the first field. The system can determine to obtain data in memory previously collected by the second sensor. The system can generate and transmit the action data structure with the data from the sensor and memory, and transmit the action data structure to a third party device.

Abstract: Within an environment in which users converse at least partly with human agents to accomplish a desired task, a server assists the agents by identifying workflows that are most applicable to the current conversation. Workflow selection functionality identifies one or more candidate workflows based on techniques such as user intent inference, conversation state tracking, or search, according to various embodiments. The identified candidate workflows are either automatically selected on behalf of the agent, or are presented to the agent for manual selection.

Abstract: A management system controls smart devices in a home by speech input without need of an internet connection or wireless or wired router. The system processes audio input and generates command signals for controlling the addressed smart device(s) using an industry standard protocol. The system allows the user to remove or add any kind of smart device within a residential environment.

Abstract: A method of operating a customer utterance analysis system includes obtaining a subset of utterances from among a first set of utterances. The method includes encoding, by a sentence encoder, the subset of utterances into multi-dimensional vectors. The method includes generating reduced-dimensionality vectors by reducing a dimensionality of the multi-dimensional vectors. Each vector of the reduced-dimensionality vectors corresponds to an utterance from among the subset of utterances. The method includes performing clustering on the reduced-dimensionality vectors. The method includes, based on the clustering performed on the reduced-dimensionality vectors, arranging the subset of utterances into clusters. The method includes obtaining labels for a least two clusters from among the clusters. The method includes generating training data based on the obtained labels. The method includes training a neural network model to predict an intent of an utterance based on the training data.

Abstract: A device implementing a system for responding to a voice request includes a processor configured to receive a voice request for content, the voice request corresponding to a first user account, the device being associated with the first user account, a second user account and a default account. The processor if further configured to determine that the content is unavailable via the first user account, and provide, in response to the determining, the content via at least one of the second user account or the default account.

Abstract: According to one embodiment of the present invention, a system for speech to media translation includes at least one processor. The at least one processor may be configured to receive an input in a first language and receive a command to translate the input. The input is one of text and audio. The at least one processor may be further configured to search an image database based on the input to retrieve contextually relevant images. The at least one processor may be configured to communicate the retrieved contextually relevant image to a target user.

Abstract: An electronic device includes a microphone, a display, and a processor configured to obtain a voice input through the microphone; identify whether the voice input corresponds to an instruction that is set to execute at least one function regarding at least one command; in response to it being identified that the voice input corresponds to the set instruction, perform an action for executing the at least one function; through the display, display at least one object for controlling the action for executing the at least one function; and, in response to a user input on the at least one object, control the action for executing the at least one function.

Abstract: Systems, methods, and storage media for performing actions in response to a determined spoken command of a user are disclosed.

Abstract: An appliance control apparatus according to an embodiment of the present invention includes a recognition device including a communication unit connected to a speech processing device or a control command input device to receive a control command for an appliance from the speech processing device or the control command input device, and a recognition module configured to recognize a setting environment for the appliance based on the received control command and generate control information for the appliance based on the recognized setting environment, and a control device configured to receive the control information from the recognition device, generate a control signal based on the received control information, and transmit the generated control signal to the appliance or a control command input device connected to the appliance.

Abstract: Disclosed herein are systems and methods for handling unwanted telephone calls through a branching node. In one aspect, an exemplary method comprises, intercepting a call request from a terminal device of a calling party to a terminal device of a called party, establishing a connection through the branching node via two different communication channels, a first communication channel being with the terminal device of the called party and a second communication channel being with a call recorder; duplicating media data between the terminal devices such that one data stream is directed towards a receiving device of the media data and a second data stream is directed towards the call recorder; recording and sending the recorded call to an automatic speech recognizer for converting the media file to digital information suitable for analysis; and when the call is unwanted, handling the call based on classification of the call.

Abstract: A display apparatus, an electronic device, an interactive system, and controlling methods thereof are provided. The display apparatus includes: a storage unit which stores peripheral device control information in which a remote control signal for controlling a peripheral device of the display apparatus matches with a control signal corresponding to a user voice; a voice collector which the user voice; a communicator which transmits the collected user voice to the display apparatus and receives the control signal corresponding to the user voice from the display apparatus; an infrared ray (IR) transmitter which transmits the remote control signal for controlling the peripheral device; and a controller which, if the control signal is received from the display apparatus, controls the IR transmitter to transmit a remote control signal corresponding to the received control signal among remote control signals stored in the storage unit, to the peripheral device.