Abstract: A computer implemented method that includes receiving a group-based audio feed for an on-going group-based communication session, the audio feed comprising a plurality of sub-feeds, each sub-feed received from a respective client user participating in the group-based communication session and comprising a plurality of sequential audio snippets; converting the audio snippets from the plurality of sub-feeds into text strings using a speech recognition engine; and causing display, to each of the respective client users while the group-based communication session is occurring, of a group-based communication session interface comprising the text strings so that the text strings are simultaneously displayed in real-time to each of the respective client users.

Abstract: According to one aspect, there is provided an apparatus comprising at least one processing unit and at least one memory. The at least one memory stores program instructions that, when executed by the at least one processing unit, cause the apparatus to cause display of executed task instances relating to at least one application on a graphical user interface on a display, detect a storing command associated with the executed task instances, and store task information relating to the executed task instances in a task file in the at least one memory for later resumption of execution of the task instances.

Abstract: A method of sorting and displaying data on a portable electronic device includes: determining geographical coordinates of the portable electronic device, providing search criteria to the portable electronic device, performing a search in a database based on the search criteria resulting in a list of database records, determining a search area of the portable electronic device and displaying selected records from the list of database records on a display screen of the portable electronic device. Each of the selected records is located within a search radius, which originates at the geographical coordinates of the portable electronic device, and within the search area, which is determined based on a pointing direction of the portable electronic device.

Abstract: An image processing system includes an information processing apparatus and an image processing apparatus, and the information processing apparatus includes a first operation input portion that receives a first operation input, a second operation input portion that receives a second operation input, a first notification portion that performs a first notification, and a second notification portion that performs a second notification. The image processing system further includes a notification selection portion that selects at least one of the first notification portion and the second notification portion of the information processing apparatus as a destination to which a notification of a processing result regarding the image processing executed by the image processing apparatus is sent.

Abstract: Aspects of the disclosure include an electronic device comprising: a sensor device including at least one biometric sensor; memory storing a table of a plurality of gestures, wherein for each gesture, a corresponding plurality of features are stored in the memory; and at least one processor operatively connected to the sensor device and the memory, wherein the at least one processor is configured to: obtain a bio-signal of a user from the at least one biometric sensor; select a section of the bio-signal that includes one feature of the corresponding plurality of features for the plurality of gestures; determine a specific one of the plurality of gestures based on the one feature included in the section of the bio-signal and the corresponding plurality features for the plurality of gestures.

Abstract: Features are disclosed for generating intent-specific results in an automatic speech recognition system. The results can be generated by utilizing a decoding graph containing tags that identify portions of the graph corresponding to a given intent. The tags can also identify high-information content slots and low-information carrier phrases for a given intent. The automatic speech recognition system may utilize these tags to provide a semantic representation based on a plurality of different tokens for the content slot portions and low information for the carrier portions. A user can be presented with a user interface containing top intent results with corresponding intent-specific top content slot values.

Abstract: An information processing apparatus includes circuitry configured to acquire audio information to be used for operating a target apparatus, recognize the audio information, obtain specific instruction information indicating specific information processing to be instructed to the target apparatus based on a recognition result of the acquired audio information, convert the specific instruction information into specific operation execution information described in an information format interpretable by the target apparatus, and output the specific operation execution information to the target apparatus.

Abstract: Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.

Abstract: Techniques for passive enrollment of a user in a speaker identification (ID) device are provided. One technique includes: parsing, by a processor of the speaker ID device, a speech sample, spoken by the user, into a keyword phrase sample and a command phrase sample; identifying, by a text-dependent speaker ID circuit of the speaker ID device, the user as the speaker of the keyword phrase sample; associating the command phrase sample with the identified user; determining if the command phrase sample in conjunction with one or more earlier command phrase samples associated with the user is sufficient command phrase sampling to enroll the user in a text-independent speaker ID circuit of the speaker ID device; and enrolling the user in the text-independent speaker ID circuit using the command phrase samples associated with the user after determining there is sufficient command phrase sampling to enroll the user.

Abstract: Features are disclosed for automatically identifying a speaker. Artifacts of automatic speech recognition (“ASR”) and/or other automatically determined information may be processed against individual user profiles or models. Scores may be determined reflecting the likelihood that individual users made an utterance. The scores can be based on, e.g., individual components of Gaussian mixture models (“GMMs”) that score best for frames of audio data of an utterance. A user associated with the highest likelihood score for a particular utterance can be identified as the speaker of the utterance. Information regarding the identified user can be provided to components of a spoken language processing system, separate applications, etc.

Abstract: Methods and systems are presented for defining criteria that indicate when authentication for an identified client device should be revoked based on rules associated with interested parties. Authentication information is stored that indicates that an identified client device is authenticated. Rules that are associated with a plurality of interested parties and include rules of different rule types may also be stored. Criteria may be defined based on the rules and the authentication information, the criteria indicating when authentication of the identified client device should be revoked. Authentication of the identified client device may be revoked based on the criteria.

Abstract: Disclosed herein are embodiments for controlling visual indicators of an audio responsive electronic device. In some embodiments, an audio responsive electronic device operates by receiving audio input, and then analyzing the audio input to identify an intended target of the audio input. The intended target may be one of a plurality of electronic devices or services which are native or non-native to the audio responsive electronic device. The audio responsive electronic device transmits the audio input to the identified intended target. A reply message is received from the intended target. Then, the audio responsive electronic device controls its visual indicators using information in the reply message, to thereby provide visual feedback to a user. Also disclosed herein are embodiments for capturing and providing audio to an application according to an application programming interface of a media device.

Abstract: A computer system for controlling a dialogue between a user and the computer system, the computer system being communicatively coupled with an industrial control system controlling an industrial system, the computer system including: an interface for receiving intent inputs representing a respective desired interaction with the computer system; an intent determination module for determining the desired interactions of received intent inputs; a data storage for storing one or more directed graphs, each graph specifying an industrial control domain specific dialogue, a particular graph defining a dialogue state machine with a plurality of nodes representing states of the dialogue, and with edges representing transitions between the states, each state transition from a first state to a second state depending on at least one precondition, the desired interaction of a received intent input corresponding to a target node to be reached from a current node of the particular graph.

Abstract: Receiving a first username of a first user account (FAU) and a biometric signature (BS) of a user; in response to determining that BS matches a stored signature of FAU, presenting indications of a group of available services (GAS); receiving a selection of a service of GAS; transmitting an identifier of the selected service (SS); receiving an encrypted username (EU) and an encrypted password (EP) of a second user account (SAU) of SS; decrypting EU and EP; opening a first page that corresponds to a login page (LP) of SS; launching a script that identifies a username entry field (UEF) and a password entry field (PEF) on LP; entering the decrypted username (DU) in UEF and the decrypted password (DP) in PEF; and selecting a submit button (SB) within LP, wherein selecting SB to be selected causes SAU to be authenticated using DU and DP.

Abstract: An exemplary method for identifying media may include receiving user input associated with a request for media, where that user input includes unstructured natural language speech including one or more words; identifying at least one context associated with the user input; causing a search for the media based on the at least one context and the user input; determining, based on the at least one context and the user input, at least one media item that satisfies the request; and in accordance with a determination that the at least one media item satisfies the request, obtaining the at least one media item.

Abstract: Embodiments of the present invention provide methods and systems for performing automatic diarisation of sound recordings including speech from one more speakers. The automatic diarisation has a development or training phase and a utilisation or evaluation phase. In the development or training phase background models and hyperparameters are generated from already annotated sound recordings. These models and hyperparameters are applied during the evaluation or utilisation phase to diarise new or not previously diarised or annotated recordings.

Abstract: A recording device records a video and an imaging time, and a voice. Based on the voice, a sound parameter calculator calculates a sound parameter for specifying magnitude of the voice in a monitoring area at the imaging time for each of pixels and for each of certain times. A sound parameter storage unit stores the sound parameter. A sound parameter display controller superimposes a voice heat map on a captured image of the monitoring area and displays the superimposed image on a monitor. At this time, the sound parameter display controller displays the voice heat map based on a cumulative time value of magnitude of the voice, according to designation of a time range.

Abstract: Embodiments of the present disclosure provide methods, systems, apparatuses, and computer program products for generating a searchable transcript of a group-based audio/video connection within a group-based communication system.

Abstract: A home assistant device captures voice signal expressed by users in the home and extracts vocal features from these captured voice recordings. The device collects data about the current context in the home and requests from an aggregator a background model that is best adapted to the current context. This background model is obtained and locally used by the home assistant device to perform the speaker recognition. Home assistant devices from a plurality of homes contribute to the establishment of a database of background models by aggregating vocal features, clustering them according to the context and computing background models for the different contexts. These background models are then collected, clustered according to their contexts and aggregated by an aggregator in the database. Any home assistant device can then request from the aggregator the background model that fits best its current context, thus improving the speaker recognition.

Abstract: A system and method for creating more realistic lip syncing to pre-recorded vocal tracks during live performance, music videos, film, television, and the like. During a lip synchronized performance, the system and method simulates signal level, proximity effect, and other parameters normally associated with a live performance. A proximity sensor attached in a fixed relationship with a microphone dynamically detects the distance between a microphone and the vocalist. A control data stream that includes dynamic distance information sensed by the proximity sensor is used to increase the signal level of the pre-recorded vocal track as the sensed distance between the microphone and vocalist decreases and decrease the signal level of the vocal track as the distance between the microphone and vocal track increases.

Abstract: Human voice activity in proximity to a printing device is detected. Printing of the print job is based on the detected human voice activity. For instance, starting of print job printing can be based on the detected human voice activity. Controlling of print job printing after printing has started can also be based on the detected human voice activity.

Abstract: Optimization of sequence dependent operations in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. A prediction component can determine a thread based on the trigger keyword and the request that includes a first action, a second action subsequent to the first action, and a third action subsequent to the second action. A content selector component can select, based on the third action and the trigger keyword, a content item. An audio signal generator component can generate an output signal comprising the content item. An interface can transmit the output signal to cause a client computing device to drive a speaker to generate an acoustic wave corresponding to the output signal prior to occurrence of at least one of the first action and the second action.

Abstract: Systems and methods for management of automated dynamic messages are providing. In some embodiments, a data store is populated with one or more knowledge sets and one or more lead datasets in response to a user's input. A campaign builder may be provided to the user for generating and initiating campaigns. A campaign is a series of messages designed to satisfy one or more objectives. The campaign builder allows the creation of a campaign by allowing the composition of a series of message templates with variable fields. The variable fields correspond to classes of data from the knowledge sets and/or the lead data. Once the campaign has been initiated, the system categorizes the responses using algorithms. These categorizations have corresponding confidence levels. If the confidence level is too low, manual user intervention may be required in order to determine which subsequent action the system should perform.

Abstract: Authentication methods, apparatuses, and devices, including computer programs encoded on computer storage media are provided. One of the methods includes: receiving information to be authenticated from user input; sending an authentication request to an authentication client; determining a first time when the authentication request is sent to the authentication client and a second time when a jump operation from the browser to the authentication client is completed; when a time difference between the first time and the second time is greater than a threshold, sending an authentication result request to the authentication client; receiving a page jump request from the authentication client for jumping from the authentication client to the browser according to the identification information, the page jump request comprising an authentication result of the information to be authenticated; and displaying the authentication result according to the identification information.

Abstract: Disclosed herein are an apparatus and method for determining the speech and motion properties of an interactive robot. The method for determining the speech and motion properties of an interactive robot includes receiving interlocutor conversation information including at least one of voice information and image information about an interlocutor that interacts with an interactive robot, extracting at least one of a verbal property and a nonverbal property of the interlocutor by analyzing the interlocutor conversation information, determining at least one of a speech property and a motion property of the interactive robot based on at least one of the verbal property, the nonverbal property, and context information inferred from a conversation between the interactive robot and the interlocutor, and controlling the operation of the interactive robot based on at least one of the determined speech property and motion property of the interactive robot.

Abstract: Techniques for use in identifying one or more concepts in a knowledge representation (KR). The techniques include obtaining user context information associated with a user, wherein the user context information comprises a plurality of words; Also included are semantic disambiguation techniques comprising obtaining user context information associated with a user, wherein the user context information comprises a first portion and a second portion different from the first portion; and disambiguating between a first and second concept in a knowledge representation (KR) associated with a first meaning of the first portion. Semantic disambiguation techniques further include obtaining user context information associated with a user, wherein the user context information comprises a first portion and a second portion different from the first portion; and disambiguating between a first concept and second concept in a knowledge representation (KR) using a measures of dominance and semantic coherence.

Abstract: A media player may receive an instruction to advance the media file content a higher than normal speed. At least a portion of the associated metadata may be accessed to retrieve a location of a group of words determined to be the most important in a portion of the media file content being advanced at the higher than normal speed. Audio content of the group of the most important words may be played at a normal speed while advancing the media file at a higher than normal speed.

Abstract: A system and method for incorporating motion into a speech processing system. A wearable device that is capable of both capturing spoken utterances and capturing motion data may be used to interact with a speech processing system. In certain circumstances, such as when voice communication are unreliable (due to noise) or when controlling the system by motion is desired, motion of a device may be used to provide input to a speech processing system. For example, sensor data or gesture data resulting from movement of a device may be processed and input into a natural language system as representative of a spoken command portion or other input. The motion information may be interpreted to provide prompts to the system (e.g., “yes,” “no,” etc.), to perform certain commands (skip, forward, back, cancel) or to otherwise control the system.

Abstract: Systems and methods are disclosed for customizing, distributing and processing audio fingerprint data. An example method includes receiving, at a first device, an activation signal and a first audio fingerprint via first wireless communications between the first device and a communications network, the receiving occurring while the first device is not recording audio via a microphone of the first device; based on the activation signal, recording audio using the microphone during a first time period; generating a second audio fingerprint representative of the recorded audio; determining whether the second audio fingerprint matches the first audio fingerprint; and sending an indication of whether the second audio fingerprint matches the first audio fingerprint to an audience measurement entity via second wireless communications between the first device and the communications network.

Abstract: Features are disclosed for automatically identifying a speaker. Artifacts of automatic speech recognition (“ASR”) and/or other automatically determined information may be processed against individual user profiles or models. Scores may be determined reflecting the likelihood that individual users made an utterance. The scores can be based on, e.g., individual components of Gaussian mixture models (“GMMs”) that score best for frames of audio data of an utterance. A user associated with the highest likelihood score for a particular utterance can be identified as the speaker of the utterance. Information regarding the identified user can be provided to components of a spoken language processing system, separate applications, etc.

Abstract: A diarization embodiment may include a system that clusters data up to a current point in time and consolidates it with the past decisions, and then returns the result that minimizes the difference with past decisions. The consolidation may be achieved by performing a permutation of the different possible labels and comparing the distance. For speaker diarization, a distance may be determined based on a minimum edit or hamming distance. The distance may alternatively be a measure other than the minimum edit or hamming distance. The clustering may have a finite time window over which the analysis is performed.

Abstract: Speech recognition is performed by receiving a speech signal that includes spoken phones. A dynamic time warping procedure is applied to the received speech signal to generate a time-warped signal. The time-warped signal is compared to a plurality of stored reference patterns to identify a set of stored reference patterns that are most similar to the time-warped signal. A candidate hot word is selected from a list using the identified set of stored reference patterns. The selection of the candidate hot word is then refined.

Abstract: An apparatus, a system, and a method for transferring data from a terminal to an Electromyography (EMG) device are provided. The method includes detecting a user motion, determining whether the user motion corresponds to a motion associated with requesting data to be transferred from the source terminal to the EMG device, and if the user motion corresponds to a motion associated with requesting data to be transferred to from the source terminal to the EMG device, transmitting to the source terminal a request for the data according to the user motion.

Abstract: A method for context-based natural language processing is disclosed herein. The method comprises maintaining a plurality of dialog system rules, receiving a user request from a Dialog System Interface, receiving one or more attributes associated with the user request from the Dialog System Interface or a user device, and identifying a type of context associated with the user request based on the user request and the one or more attributes. A context label is assigned to the user request associated with the type of context. Based on the context label and the user request, a particular dialog system rule is selected from the plurality of dialog system rules. A response to the user request is generated by applying the dialog system rule to at least a part of the user request.

Abstract: An interactive robot includes an image capturing device, an audio capturing device, an output device, and a processor. The processor is configured to obtain audio information captured by the audio capturing device and image information captured by the image capturing device, recognize a target from the audio information and the image information, confirm basic information and event information of the target and link the basic information with the event information, obtain key information from the event information of the target, implement a neural network analysis algorithm on the key information to confirm an emotion type of the target, search a preset public knowledge database according to the key information to obtain a relevant result, apply a deep learning algorithm on the relevant result and the emotion type of the target to determine a response, and execute the response through the output device.

Abstract: Systems and methods for building conversational understanding systems are provided. More specifically, the systems and methods utilize prebuilt conversational items that can form a CU system upon selection by a builder without requiring any further input from the builder. Accordingly, the systems and methods for building a conversational understanding system reduce the expertise, time, and resources necessary to build a conversational understanding system for an application when compared to systems and methods that utilize conversational items that require further input from the builder.

Abstract: A method of converting a feature vector includes extracting a feature sequence from an audio signal including utterance of a user; extracting a feature vector from the feature sequence; acquiring a conversion matrix for reducing a dimension of the feature vector, based on a probability value acquired based on different covariance values; and converting the feature vector by using the conversion matrix.

Abstract: Techniques for scam detection and prevention are described. In one embodiment, an apparatus may comprise an interaction processing component operative to generate a scam message example repository; submit the scam message example repository to a natural-language machine learning component; and receive a scam message model from the natural-language machine learning component in response to submitting the scam message example repository; an interaction monitoring component operative to monitor a plurality of messaging interactions with a messaging system based on the scam message model; and determine a suspected scam messaging interaction of the plurality of messaging interactions; and a scam action component operative to perform a suspected scam messaging action with the messaging system in response to determining the suspected scam messaging interaction. Other embodiments are described and claimed.

Abstract: A concierge robot system, a concierge service method, and a concierge robot are provided.

Abstract: A method of loading content items for accessibility by a vehicle automatic speech recognition (ASR) system. The method tracks content items requested by one or more users and prioritizes the loading of requested content items and/or selectively loads requested content items at least partially based on the interaction history of one or more users. The method may also adapt the ASR system based on the interaction history of one or more users to make preferred content items readily accessible instead of randomly accessible.

Abstract: A computing device may compare a voice command to a customized voiceprint of a user. The computing device may, if a result of the comparison exceeds a threshold, determine the voice command matches the voiceprint, determine a security level associated with the voice command, generate a signal comprising an audible announcement, access website related information, and utilize customized user settings.

Abstract: The present disclosure provides systems and methods for selecting and presenting content items based on user input. The method includes receiving first input intended to identify a desired content item among content items associated with metadata, determining that an input portion has an importance measure exceeding a threshold, and providing feedback identifying the input portion. The method further includes receiving second input, and inferring user intent to alter or supplement the first input with the second input. The method further includes, upon inferring intent to alter the first input, determining an alternative query by modifying the first input based on the second input, and, upon inferring intent to supplement the first input, determining an alternative query by combining the first input and the second input. The method further includes selecting and presenting a subset of content items based on comparing the alternative query and metadata associated with the subset.

Abstract: Aspects of connected phrase search queries and titles are described. In one embodiment, a phrase in a search string may be identified with reference to a compilation data store. The compilation data store may include various collaborative, taxonomy, and brand name data, for example. After a phrase is identified in the search string, a search query may be generated based on the phrase. For example, a catalog of items may be queried to generate a query result, and the query result may be parsed for display to a user. In various embodiments, a plurality of phrases may be identified in a search string, and a plurality of search queries may be generated based on combinations of the phrases. In this manner, more search results may be obtained, especially for constrained search strings. The identification of phrases may also be applied to generate variations on titles, in certain embodiments.

Abstract: Certain embodiments of the invention may include systems, methods, and apparatus for controlling gesture initiation and termination of a user and controlling devices based on a user's gestures. According to one embodiment, a vehicle can include at least one actuator; at least one gesture detection device; and one or more processors. The one or more processors receive an initiation indication from the at least one actuator; receive gesture information from the at least one gesture detection device; receive a termination indication from the at least one actuator; determine, from the received gesture information, a gesture from at least one occupant of the vehicle, wherein the gesture is determined based at least in part on the initiation indication; select a command from a plurality of commands, based at least in part on the determined gesture; and output a control signal or a command control signal associated with the command.

Abstract: A system, method and computer-readable storage devices are disclosed for using targeted clarification (TC) questions in dialog systems in a multimodal virtual agent system (MVA) providing access to information about movies, restaurants, and musical events. In contrast with open-domain spoken systems, the MVA application covers a domain with a fixed set of concepts and uses a natural language understanding (NLU) component to mark concepts in automatically recognized speech. Instead of identifying an error segment, localized error detection (LED) identifies which of the concepts are likely to be present and correct using domain knowledge, automatic speech recognition (ASR), and NLU tags and scores. If at least concept is identified to be present but not correct, the TC component uses this information to generate a targeted clarification question.

Abstract: Methods and systems are presented for defining criteria that indicate when authentication for an identified client device should be revoked based on rules associated with interested parties. Authentication information is stored that indicates that an identified client device is authenticated. Rules that are associated with a plurality of interested parties and include rules of different rule types may also be stored. Criteria may be defined based on the rules and the authentication information, the criteria indicating when authentication of the identified client device should be revoked. Authentication of the identified client device may be revoked based on the criteria.

Abstract: A method for controlling voice activation by a target keyword in a mobile device is disclosed. The method includes receiving an input sound stream. When the input sound stream indicates speech, the voice activation unit is activated to detect the target keyword and at least one sound feature is extracted from the input sound stream. Further, the method includes deactivating the voice activation unit when the at least one sound feature indicates a non-target keyword.

Abstract: Systems and methods for predicting trigger events, such as an advertisement during a video program, and activating a remote control device in response to the prediction are described. By activating the remote control device at a particular time, the remote control device may save energy when listening for data from one or more terminal devices. The time to activate the remote control may be based on one or more factors, including the current presentation position and/or presentation speed of the video program. A remote control device may take additional actions the next time it listens for data, including illuminating backlights, turning on a display, displaying content on the display, interacting with other devices, etc.

Abstract: A method and apparatus for the automatic transmission of user profile information to a web server are disclosed.

Abstract: Systems and techniques for connected device voice command support are described herein. A voice command may be received from a user. A set of connected devices proximate to the user may be identified. The voice command may be transformed into a command for the set of connected devices. The command may be communicated to the set of connected devices.