Abstract: Disclosed is a portable communication device, including a display, at least one microphone, a memory, and a processor operably connected to the display, the at least one microphone and the memory, wherein the processor is configured to display guide information, via the display, in response to a user input, the guide information including a first display object related to guide a user voice input for generation of a new voice command and a second display object related to at least one application executed by the new voice command via the portable communication device, receive audio data corresponding to the first display object from a user through the at least one microphone, generate the new voice command corresponding to the audio data, and store, in the memory, the new voice command corresponding to the received audio data and mapping information indicating that the new voice command and the at least one application are mapped.

Abstract: There is provided an image processing system including: an image processing device; a microphone that is capable of acquiring speech; a retaining unit configured to retain, in a history database, setting values for image processing utilized in the past; an acquiring unit configured to acquire, based at least on that a specific word has been recognized in a result of speech recognition on speech acquired by the microphone, one or more setting values from the history database using an extraction condition corresponding to the specific word, and a setting unit configured to set up a new job to be executed by the image processing device based on the one or more setting values.

Abstract: An information processing device includes a processor configured to receive, as an utterance, an instruction for executing a service, detect a physical operation for executing the service on a device, and cause the device where the operation is detected closest to a time of receiving the instruction to execute the received service.

Abstract: Systems and processes for operating a digital assistant are provided. In one example, a method includes receiving a first speech input from a user. The method further includes identifying context information and determining a user intent based on the first speech input and the context information. The method further includes determining whether the user intent is to perform a task using a searching process or an object managing process. The searching process is configured to search data, and the object managing process is configured to manage objects. The method further includes, in accordance with a determination the user intent is to perform the task using the searching process, performing the task using the searching process; and in accordance with the determination that the user intent is to perform the task using the object managing process, performing the task using the object managing process.

Abstract: A multi-tier architecture is provided for processing user voice queries and making routing decisions for generating responses, including responses to book browsing requests and other content requests. When an utterance is associated with multiple applications in a given domain, the applications may be organized into a subdomain and a tier of routing decisions may be added to the inter-domain and intra-domain routing decision system. The system uses contextual signals to make subdomain routing decisions, including signals regarding content items that are already in a user's content catalog, consumption status of individual content items in the user's catalog, and the like.

Abstract: A method includes determining a plurality of voice assistance systems located in a plurality of environments and receiving, from a headset of a user, a voice command from the user. The voice command lacks an identifier for a first voice assistance system of the plurality of voice assistance systems in a first environment of the plurality of environments. The method also includes predicting, based on the voice command, a subset of the plurality of voice assistance systems for executing the voice command and communicating, to the headset, images of environments of the plurality of environments in which the subset of the plurality of voice assistance systems are located. The method further includes detecting that the user selected, from the images, an image of the first environment that contains the first voice assistance system and in response, communicating the voice command to the first voice assistance system.

Abstract: An image forming system capable of improving the usability of an interactive agent function. The image forming system receives voice input thereto as an instruction related to execution of a job. The image forming system executes a job based on settings indicated by voice input thereto, and in a case where a specific word is included in the input voice, the image forming system executes the job based on a plurality of types of settings registered in advance in association with the specific word.

Abstract: An image reading apparatus includes a housing; a transparent plate that is provided in an opening formed in an upper part of the housing and on which an original is placed; an image reading unit that is disposed inside the housing and that scans in a main scanning direction while moving in a sub-scanning direction to read an image of the original placed on the transparent plate; a flexible flat cable having one end that is connected to a control board on which an electronic component that is configured to process the image read by the image reading unit is mounted and the other end that is connected to the image reading unit, the flexible flat cable being configured to electrically connect the image reading unit and the control board, the flexible flat cable being disposed such that a width direction of the flexible flat cable crosses a surface of the transparent plate, the flexible flat cable being partially fixed to a side wall of the housing facing the image reading unit in the main scanning direction;

Abstract: An agent control device capable of executing a plurality of agents, the agent control device including a processor. The processor is configured to output information from an agent that is being executed to a reporting section, and change a reporting style of the reporting section for each of the agents.

Abstract: An example process includes: receiving an audio stream; determining a plurality of acoustic representations of the audio stream, where each acoustic representation of the plurality of acoustic representations corresponds to a respective frame of the audio stream; obtaining a respective plurality of scores indicating whether each respective frame of the audio stream is directed to an electronic device, where the obtaining includes: determining, using a triggering model operating on the electronic device, for each acoustic representation, a score indicating whether the respective frame of the audio stream is directed to the electronic device; determining, based on the respective plurality of scores, a likelihood that the audio stream is directed to the electronic device; determining whether the likelihood is above or below a threshold; and in response to determining that the likelihood is below the threshold, ceasing to process the audio stream.

Abstract: Systems and methods to implement commands based on selection sequences to a user interface are disclosed. Exemplary implementations may: store, electronic storage, a library of terms utterable by users that facilitate implementation of intended results; obtain audio information representing sounds captured by a client computing platform; detect the spoken terms uttered by the user present within the audio information; determine whether the spoken terms detected are included in the library of terms; responsive to determination that the spoken terms are not included in the library of terms, effectuate presentation of an error message via the user interface; record a selection sequence that the user performs subsequent to the presentation of the error message that causes a result; correlate the selection sequence with the spoken terms based on the selection sequence recorded subsequent to error message to generate correlation; and store the correlation to the electronic storage.

Abstract: Systems and methods of selecting digital platforms for execution of voice-based commands are provided. The system receives an application that performs an action associated with a service via digital platforms. The system debugs the application to validate parameters of the action on at least two platforms of the digital platforms. The system receives data packets comprising an input audio signal detected by a sensor of a client device, and parses the input audio signal to identify the action and the service. The system selects a first platform from the digital platforms to perform the action. The system initiates, responsive to selection of the first platform, an interactive data exchange to populate parameters of an action data structure corresponding to the action. The system executes the action via the selected platform using the action data structure.

Abstract: An electronic apparatus includes a memory, a communication interface, and a processor configured to receive, from an external device through the communication interface, information corresponding to a user voice input obtained by the external device, perform a function corresponding to a trigger recognition on the user voice input based on trigger information corresponding to a trigger stored in the memory, and based on the user voice input not including the trigger corresponding to the trigger information based on the trigger recognition, perform a function corresponding to a voice recognition on the user voice input based on the information corresponding to the user voice input obtained by the external device, wherein the information corresponding to the user voice input obtained by the external device includes similarity information between the user voice input obtained by the external device and the trigger information.

Abstract: An electronic apparatus includes: at least one processor configured to: receive audio of a voice input of a user; obtain, from a plurality of voice recognizers capable of recognizing the voice input, a plurality of recognition results of the received audio; and perform an operation based on a recognition result of which recognition suitability for the voice input is identified to be high, among the plurality of recognition results.

Abstract: A conversation engine performs conversations with users using chatbots customized for performing a set of tasks that can be performed using an online system. The conversation engine loads a chatbot configuration that specifies the behavior of a chatbot including the tasks that can be performed by the chatbot, the types of entities relevant to each task, and so on. The conversation may be voice based and use natural language. The conversation engine may load different chatbot configurations to implement different chatbots. The conversation engine receives a conversation engine configuration that specifies the behavior of the conversation engine across chatbots. The system may be a multi-tenant system that allows customization of the chatbots for each tenant.

Abstract: A device implementing a system for providing content in response to a request includes a processor configured to receive a voice request for content associated with a home environment, the voice request corresponding to a user account, and determine, based on the voice request, not to provide the content via the device. The processor is further configured to select, in response to the determining, a second device from among multiple devices associated with the home environment, wherein the selecting is based at least in part on configuration settings associated with the home environment, and provide for the second device to output the content based on a profile of the user account.

Abstract: Described herein are dialog systems, and techniques for providing such dialog systems, that are suitable for use on standalone computing devices. In some embodiments, a dialog system includes a dialog manager, which takes as input an input logical form, which may be a representation of user input. The dialog, manager may include a dialog state tracker, an execution subsystem, a dialog policy subsystem, and a context stack. The dialog state tracker may generate an intermediate logical form from the input logical form combined with a context from the context stack. The context stack may maintain a history of a current dialog, and thus, the intermediate logical form may include contextual information potentially missing from the input logical form. The execution subsystem may execute the intermediate logical form to produce an execution result, and the dialog policy subsystem may generate an output logical form based on the execution result.

Abstract: A communication system that includes a server system, a voice terminal and a document reading apparatus. The document reading apparatus includes a reading unit configured to execute reading of a document, wherein recognition processing for recognizing a character written in the document is executed based on image data generated by the reading. Furthermore, the voice terminal comprises a receiving unit configured to receive a predetermined instruction by user's voice, and the server system comprises a processing unit configured to execute output processing for outputting the character recognized by the recognition processing by voice by the voice terminal based on receiving the predetermined instruction by the voice terminal.

Abstract: Implementations relate to an automated assistant that can respond to communications received via a third party application and/or other third party communication modality. The automated assistant can determine that the user is participating in multiple different conversations via multiple different third party communication services. In some implementations, conversations can be processed to identify particular features of the conversations. When the automated assistant is invoked to provide input to a conversation, the automated assistant can compare the input to the identified conversation features in order to select the particular conversation that is most relevant to the input. In this way, the automated assistant can assist with any of multiple disparate conversations that are each occurring via a different third party application.

Abstract: In various examples, systems and methods of the present disclosure combine open and closed dialog systems into an intelligent dialog management system. A text query may be processed by a natural language understanding model trained to associate the text query with a domain tag, intent classification, and/or input slots. Using the domain tag, the natural language understanding model may identify information in the text query corresponding to input slots needed for answering the text query. The text query and related information may then be passed to a dialog manager to direct the text query to the proper domain dialog system. Responses retrieved from the domain dialog system may be provided to the user via text output and/or via a text to speech component of the dialog management system.