Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content in association with travel. The program and method provide for receiving, by a messaging application, a request to perform a scan operation in association with an image captured by a device camera; determining a travel parameter associated with the request and an attribute of an object depicted in the image; selecting an augmented reality content item based on at least one of the travel parameter or the attribute, the augmented reality content item being configured to present augmented reality content based on speech input; receiving the speech input; obtaining at least one of a transcription or translation of the speech input; and presenting the augmented reality content item, including the transcription or translation, in association with the image.

Abstract: In various examples, systems and methods of the present disclosure combine open and closed dialog systems into an intelligent dialog management system. A text query may be processed by a natural language understanding model trained to associate the text query with a domain tag, intent classification, and/or input slots. Using the domain tag, the natural language understanding model may identify information in the text query corresponding to input slots needed for answering the text query. The text query and related information may then be passed to a dialog manager to direct the text query to the proper domain dialog system. Responses retrieved from the domain dialog system may be provided to the user via text output and/or via a text to speech component of the dialog management system.

Abstract: An image reading apparatus acquires first control data regarding generation of first rectangular image data that includes a whole of a document area corresponding to a document within a reading area of read image data. The image reading apparatus acquires second control data regarding generation of second rectangular image data that does not include a background area not corresponding to the document within the reading area of the read image data and includes at least a part of the document area.

Abstract: The disclosure provides technology for enhancing the ability of a computing device to conserve computing resources while providing special effects that are aligned with a text source being read aloud. An example method includes identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user; receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word of the text source; determining, by a processing device, that a triggering condition pertaining to the effects data and the text source is satisfied; loading content for the physical effect prior to an occurrence of the audible action, and providing the physical effect to modify an environment of the user.

Abstract: A speech control method, for a terminal device, includes: receiving an input speech control instruction, obtaining a recognition result of the speech control instruction; searching for an execution object matching the recognition result step by step within a preset search range; and responding to the speech control instruction based on a search result; in which the preset search range at least includes any one of: a current interface of the terminal device when receiving the speech control instruction, at least one application currently running on the terminal device when receiving the speech control instruction, and a system of the terminal device.

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

Abstract: A method for an electronic device to control at least one external electronic device is provided. The method includes receiving an input for calling a voice-based assistant of the electronic device from a user, broadcasting, in response to the input, a request signal for requesting transmission of a response signal, receiving the response signal including location information about at least one external electronic device from the at least one external electronic device, obtaining a location of the electronic device based on the response signal, receiving a control utterance from the user, and transmitting the control utterance and location information about the electronic device to a server device.

Abstract: An information providing method includes: generating first information indicating that a friendly gathering is occurring in a home when (i) a threshold amount of time or longer has elapsed from a start time of food preparation by a user and (ii) the volume of sound in a dining space is a first threshold volume or greater; obtaining, from a second information processing apparatus connected to a first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputting, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.

Abstract: A method for recording a plurality of augmented reality (AR) sessions between a set of user(s) and an AR computer system, receiving first user input, through the AR computer system and from a first user, identifying a first AR session of the plurality of AR sessions, and presenting at least a portion of the recording of the first AR session on the AR computer system for the first user.

Abstract: An online system, for example, a multi-tenant system interacts with various conversation channels, for example, various telephony services and artificial intelligence provider systems that perform artificial intelligence based analysis of conversations. The analysis of the conversation determines additional information describing the conversation, for example, sentiment of an utterance of the conversation, entities mentioned in an utterance of the conversation, intent of an utterance of the conversation, and so on. The online system stores the information describing conversations using a normalized representation that conforms to a unified conversation schema. Various applications may use the result of the analysis obtained from the AI provider systems to take further action, for example, recommend a specific workflow to an agent that is a participant in the conversation.

Abstract: A voice operation system includes: an image forming apparatus that forms an image on a recording material; a server that accepts voice information related to an operation on the image forming apparatus, and gives an operation instruction to the image forming apparatus; and a voice input/output device that converts an input voice into voice information, sends the voice information to the server, receives voice information as a response to the voice information related to the operation on the image forming apparatus, and emits a sound of the voice information, wherein the server has a hardware processor that stores information on a part of a function or configuration of the image forming apparatus, and the server determines executability of an operation associated with voice information transmitted from the voice input/output device, and causes the image forming apparatus to execute determination of executability of an operation that is not determinable.

Abstract: Implementations set forth herein relate to an automated assistant that can provide a selectable action intent suggestion when a user is accessing a third party application that is controllable via the automated assistant. The action intent can be initialized by the user without explicitly invoking the automated assistant using, for example, an invocation phrase (e.g., “Assistant . . . ”). Rather, the user can initialize performance of the corresponding action by identifying one or more action parameters. In some implementations, the selectable suggestion can indicate that a microphone is active for the user to provide a spoken utterance that identifies a parameter(s). When the action intent is initialized in response to the spoken utterance from the user, the automated assistant can control the third party application according to the action intent and any identified parameter(s).

Abstract: A computing system generates an extended reality environment for an end user. The extended reality environment includes a plurality of tasks and a plurality of goals to be achieved by the end user. The computing system receives input data from an extended reality system associated with the end user. The computing system updates a progress of the end user through the plurality of tasks and the plurality of goals based on the input data. The computing system receives a voice command from the end user. The voice command corresponds to a statement uttered by the end user within the extended reality environment. The computing system processes the voice command to generate a response to the voice command. The computing system causes the response to appear within the extended reality environment as an audible, visual or haptic feedback response to the voice command.

Abstract: An electronic device and a method for controlling thereof are provided. The electronic device includes a communicator comprising circuitry, a microphone, at least one memory configured to store at least one instruction and dialogue history information, and a processor configured to execute the at least one instruction, and the processor, by executing the at least one instruction, is further configured to determine whether to transmit, to a server storing a first dialogue system, a user speech that is input through the microphone, based on determining that the user speech is transmitted to the server, control the communicator to transmit the user speech and at least a part of the stored dialogue history information to the server, receive, from the server, dialogue history information associated with the user speech, through the communicator, and control the received dialogue history information to be stored in the memory.

Abstract: Methods to build an open smart speaker to orchestrate voice services from multiple providers, and open smart speakers that orchestrate voice services from multiple providers.

Abstract: An image processing apparatus receives destination information for use in data transmission, performs control, based on the received destination information including a destination in an email address format, so that a first screen, which is used to transmit data external to the image processing apparatus, and on which a transmission destination of the data is displayed, based on the received destination information, is displayed on the operation unit, and performs control, based on the received destination information including only a destination in a fax format so that a second screen, different from the first screen and used to perform fax transmission, on which a transmission destination of the fax transmission is displayed, based on the received destination information, is displayed on the operation unit.

Abstract: Systems and methods of selecting digital platforms for execution of voice-based commands are provided. The system receives an application that performs an action associated with a service via digital platforms. The system debugs the application to validate parameters of the action on at least two platforms of the digital platforms. The system receives data packets comprising an input audio signal detected by a sensor of a client device, and parses the input audio signal to identify the action and the service. The system selects a first platform from the digital platforms to perform the action. The system initiates, responsive to selection of the first platform, an interactive data exchange to populate parameters of an action data structure corresponding to the action. The system executes the action via the selected platform using the action data structure.

Abstract: Disclosed are an electronic apparatus and a method of controlling the same, the electronic apparatus including: interface circuitry; and a processor configured to control the electronic apparatus to: transmit information of a received voice command and information of an apparatus corresponding to the voice command to a sever through the interface circuitry, receive a response message to the voice command, the response message including a type corresponding to the apparatus among a plurality of types, from the server through the interface circuitry, and output the received response message through the electronic apparatus.

Abstract: A system and method for maintenance and supplying of a fleet of multifunction peripheral devices includes two or more networked devices including a decision engine. Devices discover one another and one device is designated as a server. The server creates a virtual lobby accessible by other devices and its decision engine is enabled. The server invites other devices into its virtual lobby, and these devices join the lobby in response. Devices provide their device state information to the lobby. The enabled decision engine generates recommendations for consumable replenishment, device servicing or device configuration, relaying the recommendations to a system administrator's tablet or smartphone. The administrator may accept, reject, modify or implement received suggestions. Consumable supplies or servicing recommendations can be done automatically if enabled. Administrator actions are fed back to the server for machine learning to improve future suggestions.

Abstract: An electronic device including a speaker; a microphone; a memory configured to store a voice recognition model; and a processor configured to: identify, while a first sound signal is input through the microphone, whether a wake-up word is included in a second sound signal that is output through the speaker by inputting the second sound signal into a wake-up word detection model, and identify, based on identifying that the wake-up word is not included in the second sound signal, whether the wake-up word is included in the first sound signal by inputting the first sound signal into the wake-up word detection model.