Abstract: Embodiments include method, systems and computer program products for enhancing a customer service process. Aspects include receiving customer data associated with a customer and creating a customer profile based on the customer data. Aspects also include obtaining customer service representative data comprising a customer service profile for each of a plurality of customer service representatives and determining a matching subset of the plurality of customer service representatives for the customer based upon the customer profile and the customer service representative data. Next, aspects include displaying, to the customer, the matching subset of the plurality of customer services representatives for the customer. Aspects also include selecting a first customer service representative from the matching subset of the plurality of customer service representatives for the customer based on a customer input.

Abstract: An example core for a data processing engine (DPE) includes a register file, a processor, coupled to the register file. The processor includes a multiply-accumulate (MAC) circuit, and permute circuitry coupled between the register file and the MAC circuit, the permute circuitry configured to concatenate at least one pair of outputs of the register file to provide at least one input to the MAC circuit. The core further includes an instruction decoder, coupled to the processor, configured to decode a very large instruction word (VLIW) to set a plurality of parameters of the processor, the plurality of parameters including first parameters of the permute circuitry and second parameters of the MAC circuit.

Abstract: An electronic device includes: a first processing circuit configured to detect voice from ambient sounds in first processing, and when detecting voice after a state of detecting no voice continues for a first period of time or longer, shift procedure to second processing; a second processing circuit configured to determine whether the voice detected from the ambient sound includes a specific word or not in the second processing, while being configured, when the specific word appears within a second period of time after the shifting to the second processing, to shift the procedure to third processing, and, when the specific word does not appear within the second period of time, not to shift the procedure to the third processing; and a third processing circuit configured to activate the specific function in the third processing.

Abstract: Disclosed is an apparatus and method for determining which controllable device an audible command is directed towards, the method comprising: receiving at each of two or more controlling devices the audible command signal, the audible command being directed to control at least one of two or more controllable devices controlled by a respective one of the two or more controlling devices; digitizing each of the received audible command signals; attaching a unique identifier to each digitized audible command so as to uniquely correlate it to a respective controlling device; determining a magnitude of each of the digitized audible command; determining a digitized audible command with the greatest magnitude, and further determining to which controlling device the audible command is directed to on the basis of the unique identifier associated with the digitized audible command with the greatest magnitude; performing speech recognition on the digitized audible command with the greatest magnitude; and forwarding a com

Abstract: Aspects automatically invoke automated dialog chat bots in response to determining that query text content meets a threshold relevance. A computer processor analyzes different words within text content of a user query input to identify via natural language processing query topics defined by combinations of the words. The processor drives a display device to present an automated dialog chat bot to the user that presents a chat bot series of dialog questions in response to determining that a query topic identified from analyzing the text content meets a threshold relevancy; or searches a database for results that satisfy keywords or query topics of the query content in response to failing to identify a query topic for the query text content, or to determining that an identified query topic does not meet the threshold relevancy.

Abstract: An apparatus for voice recognition transforms voice information into a phoneme sequence expressed by characters of individual phonemes corresponding to feature parameters of the voice information, determines, based on a first likelihood and a second likelihood, whether or not collation succeeds, executes a matching operation that includes associating, based on a collation result, individual phonemes of the phoneme sequence of the voice information at a time of a failure of collation and individual phonemes of a phoneme sequence of previous voice information with each other, and executes a determination operation that includes determining, based on a result of the association, whether or not the phoneme sequence of the voice information is based on repetitive vocalization.

Abstract: A digital messaging system is arranged to aggregate digital messages from a plurality of sources, the system comprising context extraction means arranged to extract context information from the messages and classification means arranged to classify the messages according to the extracted context information.

Abstract: A channel independent metadata representation of forms is stored by an online system that interacts with client devices via a plurality of messaging channels. The online system allows use of forms by various messaging channels. The online system receives a request identifying a form and a messaging channel. The online system retrieves a channel independent metadata representation of the selected form. The online system generates a channel specific representation of the selected form for the identified messaging channel from the metadata representation. The generated form representation is sent by the online system to the client device via the messaging channel. The client device may render a user interface comprising the form.

Abstract: A computer-implemented method of multisensory speech detection is disclosed. The method comprises determining an orientation of a mobile device and determining an operating mode of the mobile device based on the orientation of the mobile device. The method further includes identifying speech detection parameters that specify when speech detection begins or ends based on the determined operating mode and detecting speech from a user of the mobile device based on the speech detection parameters.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for a sequence to sequence to classification model for generating recommended messages. A messaging system generates, using a sequence to sequence encoder, an embedding vector from a message being transmitted as part of a communication session, the sequence to sequence encoder having been trained based on historical message data that includes messages transmitted between users of the messaging system. The messaging system determines, based on the embedding vector, a set of candidate responses for replying to the first message, the set of candidate responses being a subset of a set of available responses. The messaging system selects, from the set of candidate responses, a set of recommended responses to the first message, and causes the set of recommended responses to be presented by a client device of a recipient user of the first message.

Abstract: A computer-implemented method of multisensory speech detection is disclosed. The method comprises determining an orientation of a mobile device and determining an operating mode of the mobile device based on the orientation of the mobile device. The method further includes identifying speech detection parameters that specify when speech detection begins or ends based on the determined operating mode and detecting speech from a user of the mobile device based on the speech detection parameters.

Abstract: Aspects of the subject technology relate to a method for using a voice command for multiple computing devices. First voice input data is received from a first computing device associated with a user account, where the first voice input data comprises a first voice command captured at the first computing device. Second voice input data is received from a second computing device associated with the user account where the second voice input data comprises a second voice command captured at the second computing device. An intended voice command is determined based on the obtained first and second voice input data. Based on the intended voice command, a first target computing device is determined. First instructions associated with the intended voice command are provided to the first target computing device for execution.

Abstract: According to an example, with respect to artificial intelligence based service implementation, a voice call may be analyzed to generate voice data. The voice data may be converted to text data, which may be analyzed to identify keywords. Based on an analysis of the identified keywords, a user of a plurality of users may be identified. A user assistance flow of a plurality of user assistance flows that corresponds to a determined intent of the identified user may be ascertained. The voice call may be transferred to a digital assistant that may provide artificial intelligence based assistance to the identified user based on the user assistance flow that corresponds to the determined intent.

Abstract: A system and method for simulating facial expression of a virtual facial model are provided. The system stores a plurality of three-dimensional facial models corresponding to a plurality of preset sentiments one-to-one. The system identifies a present sentiment according to an acoustic signal and selects a selected model from the three-dimensional facial models according to the present sentiment, wherein the preset sentiment corresponding to the selected model is same as the present sentiment. The system predicts an upper half face image according to a lower half face image, combines the lower half face image and the upper half face image to form a whole face image, and generates a plurality of feature relationships by matching the facial features of the whole face image with the facial features of the selected model so that a virtual facial model can simulate an expression based on the feature relationships.

Abstract: A group-based communication platform may be utilized to execute one or more processing actions via respective external application systems based on messages exchanged among client devices via the group-based communication platform. A particular processing action may be executed for a particular message by generating a container including contextual data and payload data, wherein the payload data comprises the message for which the processing action is to be performed. The container is provided to the external application system via a proxy endpoint, thereby causing the external application system to execute the processing action based on the data included within the container.

Abstract: A method including identifying an emotion identifier from a message using an emotion identifier table is provided. The method includes separating emotion identifier from the message, splitting a portion into multiple tokens delimited by a space or a punctuation mark, and determining a score for the message based on an emotion score in the emotion identifier table, and on at least one of the multiple tokens. The method includes adding a token from the multiple tokens to the emotion identifier table based on a contribution from the token to the message score, associating a sentiment score for the token in the emotion identifier table based on the contribution of the token to the message score, and modifying an emotion score of the token when the token is already included in the emotion identifier table based on the contribution of the token to the message sentiment score.

Abstract: Functionality is disclosed herein for using a context sensitive framework to identify relevant applications to a current context and to provide data received from the relevant applications to a user. Instead of a user having to manually locate and launch an application, relevant applications determined by a contextual service may provide data in response to receiving the context data. The applications that are identified as relevant to the context determine the application data to provide to the contextual service. The contextual service selects at least a portion of the application data to provide for display within a user interface. In some configurations, the selected application data is displayed within a user interface that maintains a same look and feel regardless of the application data that is displayed.

Abstract: A voice input may be received, and from the voice input, a topic may be identified. A sentiment score for the topic may be generated using sentiment analysis on the voice input, and the sentiment score may reflect an individual's reaction to the topic. The sentiment score may be compared to a sentiment threshold. In response, one or more images may be selected, based on the topic, from an image database. The one or more images may be validated, and then displayed.

Abstract: A method and associated system for recognizing speech using multiple speech recognition algorithms. The method includes receiving speech at a microphone installed in a vehicle, and determining results for the speech using a first algorithm, e.g., embedded locally at the vehicle. Speech results may also be received at the vehicle for the speech determined using a second algorithm, e.g., as determined by a remote facility. The results for both may include a determined speech topic and a determined speech slotted value, along with corresponding confidence levels for each. The method may further include using at least one of the determined first speech topic and the received second speech topic to determine the topic associated with the received speech, even when the first speech topic confidence level of the first speech topic, and the second speech topic confidence level of the second speech topic are both a low confidence level.

Abstract: Disclosed is an electronic apparatus for providing a video conference, and a method of controlling the same. The electronic apparatus includes a plurality of cameras, and a processor configured to execute instructions to: control to obtain, through a first camera from among the plurality of cameras, first video of a plurality of users who perform the video conference, determine a first user who is currently speaking among the plurality of users on a basis of the first video that is obtained through the first camera, control to obtain, through a second camera from among the plurality of cameras, second video of the determined first user, determine a second user who is expected to speak after the first user on a basis of the first video that is obtained through the first camera, control to obtain, through a third camera from among the plurality of cameras, third video of the determined second user, and control to output a screen in which the second video is simultaneously displayed with the third video.

Abstract: An audio recognition method may comprising performing diffusion processing on a plurality of first feature points in a spectrogram of a to-be-recognized audio file to obtain a feature point map; searching in a spectrogram of a target audio file to determine whether the spectrogram of the target audio file comprises second feature points that respectively correspond to the diffused first feature points in the feature point map; and in response to determining that the spectrogram of the target audio file comprises the second feature points, determining that the to-be-recognized audio file is a part of the target audio file.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for hotword detection on multiple devices are disclosed. In one aspect, a method includes the actions of receiving, by a computing device, audio data that corresponds to an utterance. The actions further include determining a likelihood that the utterance includes a hotword. The actions further include determining a loudness score for the audio data. The actions further include based on the loudness score, determining an amount of delay time. The actions further include, after the amount of delay time has elapsed, transmitting a signal that indicates that the computing device will initiate speech recognition processing on the audio data.

Abstract: One embodiment of the invention sets forth a mechanism for selecting a voice recognition device included in a network of such devices for processing audio commands corresponding to a detected speech event. The voice recognition devices in the network individually determine which one of the devices is best suited to process the audio commands corresponding to the speech event. In operation, each of the voice recognition devices that detected the same speech event independently selects the same device for processing the audio command. Because each of the voice recognition devices, including the selected device, selects the same device for processing the audio command, the voice recognition devices not need to share information related to the selected device with one another.

Abstract: A method, a system, and a computer program product for detecting an audio trigger phrase at a particular audio input channel and initiating a voice recognition session. The method includes capturing audio content by a plurality of microphone pairs of an audio capturing device, wherein each microphone pair of the plurality of microphone pairs is associated with an audio input channel of a plurality of audio input channels of the audio capturing device. The method further includes simultaneously monitoring, by a processor of the audio capturing device, audio content on each of the audio input channels. The method further includes: independently detecting, by the processor, an audio trigger phrase on at least one audio input channel of the plurality of audio input channels; and in response to detecting the audio trigger phrase, commencing a voice recognition session using the at least one audio input channel as an audio source.

Abstract: A method provides binaural sound to a person through electronic earphones. The binaural sound localizes to a sound localization point (SLP) in empty space that is away from but proximate to the person. When an event occurs, the binaural sound switches or changes to stereo sound, to mono sound, or to altered binaural sound.

Abstract: A power tool accident prevention system receiving images from a static camera of a setup of a power tool, the system comprising: a processor; and a memory, the memory storing instructions to cause the processor to: analyze the images to identify inherent dangers in the setup of the power tool; identify at least one potential cause of an accident based on the identified inherent dangers; and activate an emergency safety measure of the power tool to avoid the at least one potential cause of the accident.

Abstract: Controlling a mixed reality (MR), virtual reality (VR), or augmented reality (AR) (collectively, MR) environment visualization may involve obtaining a plurality of sensor data from a plurality of data sources; processing the obtained plurality of sensor data using a plurality of data analyzers to identify at least one feature; generating a plurality of annotated data sets, wherein the annotated data sets contain an annotation of the at least one feature; aggregating the plurality of annotated data sets to correlate the at least one feature as a common feature across different annotated data sets of the plurality of annotated data sets; and based at least on the common feature, providing a visualization output representing the MR (VR, AR, or specifically mixed-reality) environment. Disclosed examples enable utilizing of disparate data types from different data sources, localizing the different data a common space, and aggregating results for visualization and/or further analysis.

Abstract: A server controlling an external device is provided. The server includes a communicator; a processor; a memory which stores at least one natural language understanding (NLU) engine for generating a command corresponding to a user's utterance. The server receives, from a pairing device paired to the external device, the user's utterance controlling the external device and information about at least one external device registered with the pairing device, via the communicator, determines an NLU engine corresponding to the external device, from among the at least one NLU engine, based on the user's utterance controlling the external device and the information about the at least one external device, and generates the command controlling the external device based on the user's utterance, by using the determined NLU engine.

Abstract: Computer program products for performing workflows using a mobile device, without requiring tactile input from the user. The workflow is thus “touchless” and may utilize input preferably including optical data and/or audio data. Tactile input may be optionally provided in some embodiments, but the workflow is configured to be performed without any tactile input. Accordingly, in one embodiment, a computer program product includes a computer readable medium having computer readable and/or executable program instructions embodied therewith, the program instructions being configured to cause a processor to: invoke a mobile application using a mobile device; receive auditory input via the mobile device; and perform a business workflow via the mobile application based on the auditory input. Corresponding systems and computer program product embodiments configured for touchless mobile workflows are also described.

Abstract: An active control system of a vehicular dual microphone and a control method thereof control a beamforming area of a microphone installed adjacent to each of a driver seat and a passenger seat to be directed toward a person (utterer) who utters a voice command. The control system and method use sitting height information and seat position information of the driver or the passenger and use passenger seat riding information. The control system determines output from a mouth shape change detection unit and the user and seat position detection unit, controls microphone beamforming of the driver seat according to the determined microphone beamforming control mode, and selectively adjusts a specific microphone gain according to the determined microphone beamforming control mode to separately control microphone beamforming of the driver seat and the passenger seat.

Abstract: A system and method of categorizing communications involves evaluating one or more portions of a communication. Systems include a language module structured to analyze the one or more portions of the communication for at least one of a language characteristic or a non-word symbol within a text of the communication, an acoustic analysis module structured to analyze the one or more portions of the communication for an acoustic characteristic, and a determination module structured to determine at least one category label to associate with the one or more portions of the communication using at least one of the language characteristic or the non-word symbol, and the acoustic characteristic.

Abstract: A customized video stream is provided. A second content is searched for that includes the plurality of entities, and a plurality of user data associated with the social media account. A hierarchy of additional content is generated based, at least in part, on the second content that is associated with the plurality of entities, and the user data associated with the social media account, wherein the hierarchy of additional content contains a plurality of second content. A customized video stream is generated based, at least in part, on the video stream and the hierarchy of additional content. The customized video stream is populated on a display screen of the user device, wherein the video stream is displayed on the display screen of the user device, and the hierarchy of additional content is displayed in a portion of the display screen and displayed concurrently with the video stream.

Abstract: A system permitting virtual server images to be reused and repurposed to provide for different application environments for performance-based testing by providing a plurality of virtual hard drive images.

Abstract: A method for performing voice analysis includes storing a simulation file having a script for conducting a training session with a user. The method also stores desired attributes associated with the simulation file. The method also includes retrieving the simulation file and providing a user interface to conduct the voice analysis using the simulation file. The method further includes receiving one or more voice impressions from a user and analyzing at least one of the voice impressions of the user. The method additionally includes determining attributes of the at least one voice impression in response to analyzing the at least one voice impression and comparing the determined attributes to the desired attributes associated with the simulation file. The method provides feedback to the user based on the comparison.

Abstract: A conversational holographic assistant displays a computer-generated human-like hologram capable of carrying on conversations in real-time with a user, remembering things about past interactions with the user to make the conversation realistic and more human-like. The system is intended to be utilized in retail, office, business and personal settings to provide service to users. The holographic person can interact with retail point of sale systems in order to process orders on behalf of a user, provide users with detailed directions, and answer questions about the holographic person's surroundings, among other things. In some settings, the holographic person can integrate with existing internet of things devices.

Abstract: A system and method for engaging in an automated dialog with a user. A processor retrieves a preset dialog flow that includes various blocks directing the dialog with the user. The processor provides a prompt to the user based on a current block of the dialog flow, receives an action from the user in response to the prompt, and retrieves a classification/decision tree corresponding to the dialog flow. The classification tree has a plurality of nodes mapped to the blocks of the dialog flow. Each of the nodes represents a user intent. The processor computes a probability for each of the nodes based on the action from the user. A particular one of the nodes is then selected based on the computed probabilities. A target block of the dialog flow is further identified based on the selected node, and a response is output in response to the identified target block.

Abstract: The present storage management system, described in detail in the following specification and accompanying drawings, includes an active (self-powered) Bluetooth® BLE transceiver beacon (hereinafter referred to as “beacon”), which, according to a preferred embodiment has a thin flat form factor with a self-adhesive-backing. A beacon is secured to each storage box and continuously transmits an “advertisement packet” to the surrounding area. A user's smart device (e.g., a smart phone) picks up the different signals sent by each beacon and is able to communicate with select ones. A software application allows a user to catalog items to be stored so that each is effectively “linked” to a particular storage box. At a later time, any of the catalogued items may be selected and the corresponding storage container in which the item resides is instructed to notify its location within the storage area using light and sound.

Abstract: Systems, methods and platforms for generating and improving conversational dialogs between a computer system and a user to create more intelligent, realistic human-like conversations. The systems, methods and platforms achieve a realistic human conversation by identify parameters such as the user's culture, age and known interests, identify a corpus that contains the knowledge appropriate for achieving conversational goals to a perceived topic of interest and generate expressions into dialog that may be extracted from human generated sources. The system appropriately matches the targeted user's parameters and topic based on the input of the user initiating the dialog interaction. The system may analyze and/or record the emotion of the user, cognitive context, gestures and the user's expressions, which may be performed using one or more recording systems to increase the accuracy of topic identification and the appropriate dialog responses.

Abstract: Implementations relate to generating and/or executing a customized interactive dialog application. The customized interactive dialog application may be generated from a state mapping tool that allows a user to generate custom states and custom transitions between the custom states. A customized configuration description is then generated based on the generated custom states and custom transitions. Further, a default configuration description is identified that includes additional or alternative states and transitions. In executing the customized interactive dialog application, dialog turns are generated based on the states and transition information, with the customized configuration description taking precedence and the default configuration description being utilized for any undefined states and/or transitions. Implementations additionally or alternatively relate to generating and/or executing a custom agent based on generated custom states and custom transitions, and a default configuration description.

Abstract: A computer system that performs in dialogue with a user and provides a prescribed service, comprising: an imaging device; a computer; and a generation device generating dialogue content on a basis of an algorithm for generating dialogue content. The computer couples to a database that stores an authentication image used for an authentication process that uses an image. The computer calculates a distance between the user and the imaging device; executes an attribute estimation process in a case where the distance is larger than a threshold, selects the algorithm on the basis of results of the attribute estimation process, and issues a notification of the selected algorithm to the generation device.

Abstract: A method of determining whether a sound has been generated by a loudspeaker comprises receiving an audio signal representing at least a part of the sound. The audio signal is separated into different frequency bands. The signal content of different frequency bands are compared. Based on said comparison, frequency-based variations in signal content indicative of use of a loudspeaker are identified.

Abstract: A voice controlled room automation system that includes a speaker device situated in a guest room, a hotel automation controller operatively coupled to one or more components in the guest room, and a web service operatively coupled to the speaker device and the hotel automation controller. The web service is configured to receiving voice commands from the speaker device, process the voice command using speech recognition, interpret the voice command to determine a corresponding command for the hotel automation controller, and transmit the corresponding command to the hotel automation controller. The hotel automation controller is configured to receive the corresponding command from the web service, and to carry out the corresponding command by interacting with one or more of the components in the room. In some cases, the hotel automation controller may be configured to initiate an announcement or query on the speaker device via the web service.

Abstract: Systems and methods are provided for notifying a wireless communication device user regarding an account payment. One method comprises dialing a phone number of a wireless communication device, preferably a cell phone. A communication relating to an account payment that includes a balance due is then transmitted or delivered to a wireless communication device user. Optionally, at the same time or a later time, input from the wireless communication device user may be received regarding payment of the balance due. Such notification methods may be carried out by a host computer system which has a record of when the account payment is due and dials and transmits within a predetermined time frame. Generally, such methods will further comprise pre-registering or enrolling the wireless communication device user.

Abstract: Systems and methods are provided for populating user information onto an electronic form using human interactions via touch, voice, gestures or an input device. The electronic form is selected by the user for completion using a user profile of stored data. When a form field requires a manual input—such as a form field with multiple potential values—a user is prompted to complete the field using one or more of the human interactions to allow the user to easily complete the field. These human interactions may include touching the form field with a finger on a touchscreen user interface, speaking the form field name, gesturing or selecting via the input device to generate a window of different potential values, and then touching, speaking, gesturing of selecting via the input device the value that the user prefers.

Abstract: A method and system for accessing information related to a physical document. An electronic copy of an existing physical document is identified and located. The electronic copy of the physical document is an exact replica of the physical document. A selected part of the physical document is identified and in response, data related to the selected part of the physical document is retrieved from the electronic copy of the physical document. The retrieved data is presented visually to a visually impaired person or orally to a blind person on the user system, which enables the visually impaired person to see or hear, respectively, the retrieved data.

Abstract: Classifying electronic communications is disclosed. An electronic communication is received. A first likelihood that a potential recipient of the electronic communication would conclude that the communication was transmitted on behalf of an authoritative entity is determined. An assessment of a second likelihood that the received communication was transmitted with authorization from the purported authoritative entity is performed. The electronic communication is classified based at least in part on the first and second likelihoods.

Abstract: In accordance with an example embodiment of the present invention, disclosed is a method and an apparatus for voice activity detection (VAD). The VAD comprises creating a signal indicative of a primary VAD decision and determining hangover addition. The determination on hangover addition is made in dependence of a short term activity measure and/or a long term activity measure. A signal indicative of a final VAD decision is then created.

Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: The present disclosure relates to a vehicle control device for a vehicle having a voice input unit, an audio output unit, and a display. The vehicle control device may include a communication unit configured to communicate with at least one of the voice input unit, the audio output unit, and the display, and a processor configured to control the communication unit to output a message for inducing an utterance of a passenger aboard the vehicle in at least one of an auditory manner and a visual manner when a preset event occurs, and identify the passenger based on receiving a response of the passenger to the message through the voice input unit, and perform a different function based on the identified passenger.

Abstract: Mechanisms are provided to implement a natural language request processing engine (NLRPE). The NRLPE performs natural language processing on a portion of unstructured text in an electronic data structure to generate textual characteristics of the portion of unstructured text. The NRLPE annotates at least one phrase in the portion of unstructured text at least by linking the at least one phrase to one or more concepts specified in at least one ontological data structure based on the textual characteristics of the portion of unstructured text. The NRLPE generates a model of the portion of unstructured text based on the one or more concepts linked to the at least one phrase. The NRLPE processes a request for information specifying a concept of interest based on the model of the portion of unstructured text by retrieving the at least one phrase or the at least one merged phrase as a response.