Abstract: A computer inputs data including different verbal judgment sets. Each different verbal judgment set includes words which are votes that define different rank values and each represents an evaluation of an alternative. The processor determines a word similarity score of each word in the verbal judgment sets to predefined words in a predefined scale. The processor determines a set similarity score between the different verbal judgment set and the predefined scale based on the words included in the different verbal judgment set and the predefined words within the predefined scale. The processor maps the words of the different verbal judgment sets to a numerical scale that corresponds to the predefined scale, based on the set similarity score. The processor interprets the different verbal judgment sets in the universe of known data based on the numerical scale and provides cleansed data which is used by a data-dependent application.

Abstract: Techniques for identifying a location of a voice-controlled device within an environment. After identifying a location of the device, the device may receive a voice command from a user within the environment and may determine a response to the command based in part on the location, may determine how to output a response based in part on the location or may determine how to interact with the user based in part on the location.

Abstract: Systems, methods, and devices for recognizing a user are disclosed. A speech-controlled device captures a spoken utterance, and sends audio data corresponding thereto to a server. The server determines content sources storing or having access to content responsive to the spoken utterance. The server also determines multiple users associated with a profile of the speech-controlled device. Using the audio data, the server may determine user recognition data with respect to each user indicated in the speech-controlled device's profile. The server may also receive user recognition confidence threshold data from each of the content sources. The server may determine user recognition data associated that satisfies (i.e., meets or exceeds) a most stringent (i.e., highest) of the user recognition confidence threshold data. Thereafter, the server may send data indicating a user associated with the user recognition data to all of the content sources.

Abstract: Systems for performing methods for searching documents are disclosed. The system may receive a first document comprising textual content, summarize the textual content using a first neural network, and translate the summarized textual content into translated content (e.g., content translated into Lojban) using a second neural network. The system may also conduct a fuzzy search of a database using the translated content for similar translated content from a plurality of documents and output results of the fuzzy search.

Abstract: A speech control method and an electronic device. The method includes displaying a first interface of an application, where the first interface includes a control used to update the first interface, enabling a speech application in the background in response to a wake-up signal entered by a user, displaying M speech input prompts on the first interface, where each speech input prompt corresponds to at least one control on the first interface, collecting a speech control signal entered by the user, where the speech control signal corresponds to a first speech input prompt in the M speech input prompts, and displaying a second interface of the application in response to the speech control signal, where the second interface is an interface obtained through updating after a first control on the first interface is triggered, and the first control corresponds to the first speech input prompt.

Abstract: A display device including a housing; a rotatable roller accommodated in the housing; a rollable display adjusted in a drawn-out length from the housing according to rotation of the roller; and a controller configured to receive an input of a voice command, and vary a method of outputting a result of the voice command according to the drawn-out length of the rollable display.

Abstract: A speech processing system configured to convey linked content to a user in a voice user interface (VUI) environment is described. The system may create output audio data that includes an audible indicator (e.g., a beep) that indicates to a user linked content. An audible indicator may be located at the beginning and/or end of linked content in the output audio data. The system may also output non-linked content in a first voice while outputting linked content in a second voice. The system may further overlay audio atop the linked portion of the output audio data, with the overlaid audio indicating the linked content to the user. A user may invoke linked content in output audio by speaking the linked content, or a portion thereof, back to the system. The system may then output the linked, additional content to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for instantiating a dialog process at a particular child node state. In one aspect, a method includes receiving a request specifying a particular child node state of a dialog process, instantiating the dialog process at the root node state, providing input responses to the dialog process that cause the dialog process to traverse from the root node state to the particular child node state, where each input response is provided in response to an input request, and providing data that causes a user device to present the dialog process at the particular child node state.

Abstract: The present invention relates to a method and an apparatus for calling a voice recognition service by using Bluetooth low energy (LE). In particular, a method performed by a first device may comprise the steps of: receiving a first request message requesting start of a voice recognition service, from a second device connected to the first device through Bluetooth communication, wherein the first request message is generated by generation of a first wake word pre-configured in the second device; executing a voice gateway connected to multiple voice managers in response to the first request message; and executing a voice recognition service between the second device and a first voice manager determined by the voice gateway among the multiple voice managers.

Abstract: In present disclosure, a data processing method, a data processing device, and an apparatus for data processing are provided. The method specifically includes: receiving a source language speech input by a target user; determining, based on the source language speech, a target acoustic model from a preset acoustic model library, the acoustic model library including at least two acoustic models corresponding to different timbre characteristics; converting, based on the target acoustic model, the source language speech into a target language speech; and outputting the target language speech. According to the embodiments of the present disclosure, the recognition degree of the speaker corresponding to the target language speech output by the translation device can be increased, and the effect of user communication can be improved.

Abstract: An output technology for improving information delivery corresponding to a voice request is provided. In one embodiment, a method by which an electronic device comprising a voice-based interface provides information comprises the steps of: receiving a voice request from a user through the voice-based interface; acquiring response information corresponding to the voice request; outputting the response information in a reply voice, which is an auditory output form, through at least one medium among a plurality of media including a main medium corresponding to the voice-based interface and a sub medium included in other electronic devices linkable with the electronic device; and providing other outputs for at least a part of the response information through at least one medium, which is the same as or different from the medium through which the reply voice is being outputted, among the plurality of media.

Abstract: The present invention provides automated methods, apparatus, and systems for improving engagement with a voice assistant or smart speaker. Media content playback is detected at a media content detection application and the media content is identified. Upon receiving a voice command from a user at a smart speaker or voice assistant relating to the identified media content, the context of the voice command in relation to the identified media content is determined. The voice command is processed and executed based on the determined context.

Abstract: In order to provide filtering of content to be presented on a mobile device, a gesture-based preferencing system and method may be employed. When content is presented to a user, the user may indicate a positive or negative preference toward that content by making a gesture. The gesture may be detected by a motion sensor and the preference of the content indicated by the gesture may be stored in a preference datastore. The preference may be used to subsequently filter content that is to be presented to the user.

Abstract: A computer implemented method processes audio streams recorded during a meeting by a plurality of distributed devices.

Abstract: Disclosed are a speech recognition device and a speech recognition method, which perform speech recognition by executing an artificial intelligence (AI) algorithm and/or a machine learning algorithm provided therein, and which can communicate with other electronic devices and an external server in a 5G communication environment.

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically allowing web browsing in a user interface of an electronic messaging system. The disclosed systems and methods automatically display electronic messages containing item information displayed in an electronic message in place of any web page links associated with the item enabling browsing of the item information from within the electronic messaging system's user interface.

Abstract: Systems and methods for unifying question answering and text classification via span extraction include a preprocessor for preparing a source text and an auxiliary text based on a task type of a natural language processing task, an encoder for receiving the source text and the auxiliary text from the preprocessor and generating an encoded representation of a combination of the source text and the auxiliary text, and a span-extractive decoder for receiving the encoded representation and identifying a span of text within the source text that is a result of the NLP task. The task type is one of entailment, classification, or regression. In some embodiments, the source text includes one or more of text received as input when the task type is entailment, a list of classifications when the task type is entailment or classification, or a list of similarity options when the task type is regression.

Abstract: A method for a virtual assistant is provided. The method includes controlling, in a first operation mode, at least one sensor to sense a physical quantity. Further, the method includes receiving, in the first operation mode, sensor data indicative of the physical quantity from the at least one sensor. Additionally, the method includes processing, in the first operation mode, the sensor data to detect whether the sensor data exhibit a predetermined characteristic. If the predetermined characteristic is detected in the sensor data, the method includes setting the operation mode of the virtual assistant to a second operation mode assigned to the predetermined characteristic.

Abstract: A device to process speech includes a speech processing network that includes an input configured to receive audio data corresponding to audio captured by one or more microphones. The speech processing network also includes one or more network layers configured to process the audio data to generate an output representation of the audio data. The speech processing network includes an output configured to be coupled to multiple speech application modules to enable the output representation to be provided as a common input to each of the multiple speech application modules.

Abstract: A method and apparatus for facilitating persona-based agent interactions with online visitors is disclosed. A plurality of persona related attributes is extracted from a textual transcript of each interaction between an agent of an enterprise and an online visitor. A feature vector data representation is generated based on the plurality of persona related attributes extracted from each interaction to configure a plurality of feature vector data representations. The plurality of feature vector data representations is classified based on a plurality of persona-based clusters, which enables classification of the plurality of online visitors into the plurality of persona-based clusters. A learning model is trained for each persona-based cluster using utterances of online visitors classified into a respective persona-based cluster. The learning model is trained to mimic a visitor persona representative of the respective persona-based cluster.

Abstract: Disclosed are various embodiments for creating and providing narratives associated with a type of subject entity (e.g., person, movie, place, etc.). A narrative for the subject entity can be generated according to a narrative template. The narrative template can be selected based on a variety of factors. Following the selection of a narrative template, fields in the selected template are filled with stored data associated with the subject entity. The new or updated narrative may be stored in a memory. In response to a request for information related to the subject entity, the narrative can be transmitted to a client device.

Abstract: Methods and apparatus are disclosed to measure exposure to streaming media using media watermarks. An example apparatus includes a memory, and a logic circuit to cause transmission of media, received from a service provider, to a media device in response to a first request for the media, the media including instructions to cause the media device to (1) determine a source Uniform Resource Locator, (2) determine a current playback time of the media, and (3) transmit a second request for metadata of the media to the apparatus, and metadata associated with the source Uniform Resource Locator and the current playback time of the media, the second request including the source Uniform Resource Locator of the media and the current playback time of the media. Example systems, methods, and apparatus disclosed herein enable a single set of monitoring instructions to be operated on multiple different devices and/or browsers.

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant.

Abstract: Systems and methods are described for processing voice input to detect and remove voice recognition errors in the context of a product attribute query. Spoken-word input may be processed to tentatively identify a query regarding a product and an attribute. A hierarchical product catalog is then used to identify categories that include the identified product, and an affinity score is determined for each category to indicate the relative strength of the relationship between the category and the attribute. The affinity score for each category is determined based on historical questions submitted to a question and answer service with regard to other products in the category. An affinity score for the product-attribute pairing is then determined based on a weighted average of the affinity scores for the product categories, and the affinity score is used to determine whether the question is valid and the voice input has been correctly processed.

Abstract: The embodiments of the present disclosure provide a service control method, a service control apparatus and a device, the method including: determining an application service in operating state in an electronic device; and transmitting audio data captured by a microphone to the application service and a control service, where the application service is configured to perform multimedia information interaction according to the audio data, and the control service is configured to control the electronic device according to the audio data, thereby improving flexibility in controlling services in the electronic device.

Abstract: Embodiments are disclosed for correcting a natural language interface database (NLIDB) system. The techniques include receiving feedback indicating that an answer provided in response to a question for an NLIDB system is inaccurate. The techniques further include finding an ontology element for a datastore of the NLIDB system that matches to the feedback. The techniques also include selecting candidate annotations for the NLIDB system based on the ontology element and a data type of the ontology element. Additionally, the techniques include generating a question-answer (QA) pair for each of the candidate annotations. Further, the techniques include adding one of the candidate annotations to annotations for a natural language query (NLQ) engine of the NLIDB system based on a client verification of the QA pair.

Abstract: A system and method include detection of a user utterance of one of plurality of voice keywords, each of the plurality of voice keywords associated with a respective voice assistant application, determination, in response to the detection of the one of the plurality of respective voice keywords, of whether any of the plurality of voice assistant applications are designated as uninterruptable, and, if it is determined that none of the plurality of voice assistant applications are designated as uninterruptable, activation of the one of the plurality of voice assistant applications associated with the detected keyword.

Abstract: A faucet is provided that electronically controls the flow volume and temperature of water being dispensed. The faucet illustratively includes a faucet body and a faucet handle. In some embodiments, the faucet may include a faucet body and be voice controlled. The faucet illustratively includes an inertial motion unit sensor mounted in the faucet handle to sense spatial orientation of the faucet handle. The faucet illustratively includes an electronic flow control system to adjust flow volume and temperature of water being dispensed. The faucet illustratively includes a controller configured to receive signals from the inertial motion unit sensor and control the electronic flow control system to adjust flow volume and temperature of water being dispensed based upon the position of the faucet handle.

Abstract: Technologies are disclosed for relaying availability information using a virtual assistant. The virtual assistant can serve as a personal assistant to a user and receive and provide availability information associated with a user. The availability information may include information such as, but not limited to location information about the user, timing information, (e.g., a time the user left), message information (e.g., a message left by the user, a message left by a person looking for the user, . . . ), and the like. The availability information that is provided by the virtual assistant may be different depending on the identity of the requesting user. The virtual assistant may also record messages from requesting users that may be provided to the user upon return and/or while the user is away (e.g., via email, text message, instant message, phone call, and the like).

Abstract: A descriptive media content search solution is provided to allow a user to search for media content that better matches a user's descriptive search request. The descriptive media content search solution utilizes an extensive catalog of playlists each having a playlist description, such as a playlist title or other descriptive text, and identifies additional descriptive information for media content items to be searched. The descriptive media content search solution can set up a descriptive search database and utilize the descriptive search database to conduct a descriptive search responsive to the user's descriptive search request.

Abstract: A system for determining context and intent in a conversation using machine learning (ML) based artificial intelligence (AI) in omnichannel data communications is disclosed. The system may comprise a data store to store and manage data within a network, a server to facilitate operations using information from the one or more data stores, and a ML-based AI subsystem to communicate with the server and the data store in the network. The ML-based AI subsystem may comprise a data access interface to receive data associated with a conversation with a user via a communication channel. The ML-based AI subsystem may comprise a processor to provide a proactive, adaptive, and intelligent conversation by applying hierarchical multi-intent data labeling framework, training at least one model with training data, and generating and deploying a production-ready model based on the trained and retained at least one model.

Abstract: A search system obtains a search result comprising an entry. The search result is based on a set of search constraints. The search system generates a hit index based on the search result and each constraint in the set of search constraints. The hit index includes identification information of an element associated with the entry that caused the entry to be included in the search result. The search system updates the search result to comprise an indication of the element associated with the entry based on the hit index.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a digital conversation is described. One of the methods includes guiding a user through a directed conversation having a plurality of flows, each flow including at least one statement to be made by a digital advisor. The method includes receiving user input as part of the directed conversation. The method includes selecting one of the flows based on the received user input. The method also includes storing at least some of the information provided by the user in a data store.

Abstract: Embodiments for managing voice commands by one or more processors are described. The receiving of a voice command from an individual is detected. An action associated with the voice command is caused to be at least temporarily prevented from being executed based on at least one data source associated with the individual.

Abstract: A method for accessing information. A request to change a piece of the information is received from a source. A branch for the piece of the information is identified using an identifier in the request. The branch is part of branches in a hierarchical structure and the branches are versions of the piece of the information. The identifier identifies the branch. The branch is changed when the request is from a source that controls a portion of the information in which the branches for the piece of the information are located in a location and the source is part of sources that control portions of the information in the location.

Abstract: The present disclosure relates generally to a system and method for voice development frameworks. Certain cloud-based systems may be embodied in a multi-instance or multi-tenant framework, and may provide for certain computing systems and resources. For example, the cloud-based systems may provide for data repositories and the creation of executable objects, e.g., Flow Designer objects that include voice commands. In certain embodiments, visual development tools, including a Flow Designer system, may be used to create the executable objects, including voice command objects. For example, the Flow Designer system may enable the non-technical personnel to use natural language to more easily create and visualize objects and processes that automate certain tasks.

Abstract: An apparatus or method to give a user information about, and control of, internal and/or external microphone(s) so that the user can make adjustments to audio recording in real time. The method includes choosing microphones, displaying visual representations of microphones, capturing an acoustic source using a microphone, allowing a user to interact with a visual representation of a microphone to select or deselect the microphone, and processing of the audio signal from the acoustic source captured by a microphone.

Abstract: Disclosed are a system and a method of providing customized content by using a sound, the system including: multiple smart devices outputting content for each channel received from a content provider; multiple user terminals configured to: receive a user's voice for a preset text for voice recognition to register the user's voice as voice data for user identification, and receive waveform data of a sound output from the smart device and voice data of the user for transmission when a voice corresponding to the registered voice data for user identification is recognized while the smart device is in operation; and a recommendation server configured to: collect the waveform data for the content that is possibly output from the smart device, and analyze the voice data and the waveform data to generate interest information of the user when the waveform data and the voice data are transmitted from the user terminal.

Abstract: A computer-implemented method, cognitive intelligence server and computer program product adapt a relational database containing numeric data types. At least one numeric token in the relational database is converted to a textual form. Text is produced based on relations of tokens in the relational database. A set of word vectors is produced based on the text. A cognitive intelligence query, expressed as a structured query language (SQL) query, may be applied to the relational database using the set of word vectors. At least one numeric token in the relational database may be converted to a typed string comprising a heading for a column in the relational database for which the token appears and the numeric value. Converting at least one numeric token in the relational database may comprise clustering tokens in a column of the relational database using a clustering algorithm and replacing each token in the column by a cluster identifier.

Abstract: A computer system is provided that automatically generates a natural language processing model from a provided API specification. Intent names are based on operation type and name. Entity datasets are constructed based on the generated intent name. A plurality of training phrases are generated based on the entity dataset and an action dataset with a name and corresponding parameters is generated.

Abstract: Techniques are disclosed herein for resolving a natural language query. Input (e.g., text input, audio input) corresponding to a query requesting data is received. A type of the query is determined based on a natural language analysis on the query. A form of response to the query is identified based on the type of the query. A visualization associated with the form of response is identified. The visualization is presented via a user interface. The presented visualization includes the requested data.

Abstract: Described is a voice dialogue system that includes a voice input unit which acquires a user utterance, an intention understanding unit which interprets an intention of utterance of a voice acquired by the voice input unit, a dialogue text creator which creates a text of a system utterance, and a voice output unit which outputs the system utterance as voice data. When creating a text of a system utterance, the dialogue text creator creates the text by inserting a tag in a position in the system utterance, and the intention understanding unit interprets an utterance intention of a user in accordance with whether a timing at which the user utterance is made is before or after an output of a system utterance at a position corresponding to the tag from the voice output unit.

Abstract: At an electronic device with a display, a microphone, and an input device: while the display is on, receiving user input via the input device, the user input meeting a predetermined condition; in accordance with receiving the user input meeting the predetermined condition, sampling audio input received via the microphone; determining whether the audio input comprises a spoken trigger; and in accordance with a determination that audio input comprises the spoken trigger, triggering a virtual assistant session.

Abstract: Speech-based interaction with a display window is disclosed, including: receiving speech input with respect to a display window that is presented at a device; converting the speech input into an operation instruction; determining an interface element of the display window that corresponds to the operation instructions, including by querying interface element information corresponding to the display window; and activating the interface element of the display window based at least in part on simulating a manual selection event with respect to the interface element of the display window.

Abstract: A machine for improving content delivery generates a graph representing a personalized conversational flow for sequenced delivery of digital content. The graph includes nodes representing interactive dialogues between a machine and a user, and edges that connect the nodes. The machine causes display of a user interface including a prompt related to job-seeking guidance. The machine, based on a first action in response to the prompt, dynamically adjusts the graph, the dynamic adjusting including selecting a first node. The machine generates and causes display of a first incentive content item, and a first call-to-action content item. The machine, in response to a second action received in response to the first call-to action content item, dynamically selects an edge connecting the first node and a further node. The dynamic selecting of the edge results in display of a further incentive content item, and a further call-to-action content item.

Abstract: The present disclosure provides a method and a system for triggering of Internet of things (IoT) devices. The system comprising a processor causes the processor to receive a change in output of first IoT device from a plurality of IoT devices, wherein the plurality of IoT devices are connected to each other, determine one or more connectivity paths between the plurality of IoT devices including the first IoT device based on stored connectivity paths between the plurality of IoT devices in a database, select one of the determined one or more connectivity paths between the plurality of IoT devices, wherein the selecting is based on similarity of metadata of each of the plurality of IoT devices in each of the one or more connectivity paths and trigger one or more IoT devices of the plurality of IoT devices in the selected connectivity path.

Abstract: A method and apparatus for personalizing a speech recognition model is disclosed. The apparatus may obtain feedback data that is a result of recognizing a first speech input of a user using a trained speech recognition model, determine whether to update the speech recognition model based on the obtained feedback data, and selectively update, dependent on the determining, the speech recognition model based on the feedback data.

Abstract: A method, computer system, and a computer program product for implementing a plurality of actions associated with an impaired driver to prevent vehicle accidents is provided. The present invention may include collecting, from a plurality of existing vehicle sensors and a plurality of existing portable user device sensors, a plurality of data. The present invention may also include analyzing the collected plurality of data. The present invention may then include determining an impairment state associated with the driver. The present invention may further include implementing the plurality of actions to prohibit the driver from operating the vehicle. The present invention may then include storing the implemented plurality of actions, the analyzed plurality of data, and the determined impairment state associated with the driver in a historical database.

Abstract: Implementations are described which provide for recipient-based filtering of an event that relates to a topic to which consumers are subscribed. Responsive to determining that an attribute of the event includes a set of one or more identifiers for intended recipients for the event, the event is delivered to consumers that correspond to the intended recipients. Alternatively, responsive to determining that the attribute of the event does not include a set of one or more identifiers for intended recipients for the event, the event is delivered to all of the consumers subscribed to the topic to which the event relates.

Abstract: A system is disclosed for chatbot conversation construction, and includes user interface, coupled to a conversation construction and management platform, configured to provide entry of intents, associated responses and search terms, and to construct and store conversation controllers, each based at least in part on one or more of the intents, and build conversation flows, each based at least in part on one or more of the conversation controllers. An artificial intelligence (AI) connector platform couples to the conversation construction and management platform, and is configured to receive natural language (NL) search data from a chatbot channel, format the NL search data into an input protocol of a selectable NL processing engine and receive a response from the NLP engine and, based at least in part on one or more of the conversation flows, convert the NLP engine response to a personalized response, and send the personalized response to the chatbot channel.