Abstract: Techniques are described herein for assembling/evaluating automated assistant responses for privacy concerns. In various implementations, a free-form natural language input may be received from a first user and may include a request for information pertaining to a second user. Multiple data sources may be identified that are accessible by an automated assistant to retrieve data associated with the second user. The multiple data sources may collectively include sufficient data to formulate a natural language response to the request. Respective privacy scores associated with the multiple data sources may be used to determine an aggregate privacy score associated with responding to the request. The natural language response may then be output at a client device operated by the first user in response to a determination that the aggregate privacy score associated with the natural language response satisfies a privacy criterion established for the second user with respect to the first user.

Abstract: Systems and methods for performing multi-factor authentication using a smart ring are disclosed. An exemplary method includes performing a first authentication operation by: collecting, by sensors, gestural data representing a candidate gesture corresponding to ring movement; comparing the candidate gesture to an authentication gesture for a known user; when the candidate gesture matches the authentication gesture, generating a first signal indicating that a particular user has been identified and authenticated as the known user; and transmitting the first signal to a second device, wherein the second device controls access to a resource. The method also includes performing a second authentication operation by detecting contact between the ring and an external component; and generating and transmitting a second signal in response to detecting the contact, and when the second device receives the first and the second signals, causing the second device to grant the particular user access to the resource.

Abstract: An information processing apparatus is connected to a peripheral apparatus that includes sound inputting means for outputting a sound signal representative of sound of surroundings. The information processing apparatus performs control such that, in a case where sound input is required in processing of an application determined in advance, in a state in which a sound signal accepted from the peripheral apparatus is cut off, the sound signal accepted from the peripheral apparatus is accepted and the sound signal is used only in the processing of the application determined in advance.

Abstract: A method and apparatus that dynamically adjust operational parameters of a text-to-speech engine in a speech-based system are disclosed. A voice engine or other application of a device provides a mechanism to alter the adjustable operational parameters of the text-to-speech engine. In response to one or more environmental conditions, the adjustable operational parameters of the text-to-speech engine are modified to increase the intelligibility of synthesized speech.

Abstract: To filter unwanted sounds from a conference call, a first voice signal is captured by a first device during a conference call and converted into corresponding text, which is then analyzed to determine that a first portion of the text was spoken by a first user and a second portion of the text was spoken by a second user. If the first user is relevant to the conference call while the second user is not, the first voice signal is prevented from being transmitted into the conference call, the first portion of text is converted into a second voice signal using a voice profile of the first user to synthesize the voice of the first user, and the second voice signal is then transmitted into the conference call. The second portion of text is not converted into a voice signal, as the second user is determined not to be relevant.

Abstract: A system for programming, controlling and monitoring wireless networks enabling a wireless device (Dev) being utilized and integrated into car electronic control module or home (or business) alarm/security system. This system also presents a general control (robotic) device, which controls general input and output functions, where plurality of cellular handsets, internet devices can co-control, monitor, share and exchange information through the cellular, the internet networks and other wire/wireless network.

Abstract: Described are apparatus, systems, and methods that are operable to periodically detected and record a voice of a user associated with or wearing a wearable device. As described, the wearable device apparatus is configured to transition various components of the device between a low power state and an active state to determine if audio data that includes voice is detected. If voice is not detected, the components are transitioned back to the low power state, thereby conserving power of the wearable device. If voice is detected, the audio data that includes that voice is collected for further processing.

Abstract: An approach is provided that receives a message and applies a deep analytic analysis to the message. The deep analytic analysis results in a set of enriched message embedding (EME) data that is passed to a trained neural network. Based on a set of scores received from the trained neural network, a conversation is identified from a number of available conversations to which the received message belongs. The received first message is then associated with the identified conversation.

Abstract: Disclosed are various embodiments for managing voice-driven application. In one embodiment, among others, a system includes a computing device and program instructions. The program instructions can cause the computing device to initiate a management session between a voice application service and a management service based on receiving a first request from the voice application service. The program instructions can cause the computing device to initiate an application session between a voice-driven application and the management service based at least in part on a second request received from the voice application service. The program instructions can cause the computing device to enforce a compliance policy on a data request for the voice-driven application. The data response can be transmitted to the voice application. The voice application service can provide the data response to the client device for playback.

Abstract: An approach is provided that receives a message and applies a deep analytic analysis to the message. The deep analytic analysis results in a set of enriched message embedding (EME) data that is passed to a trained neural network. Based on a set of scores received from the trained neural network, a conversation is identified from a number of available conversations to which the received message belongs. The received first message is then associated with the identified conversation.

Abstract: Methods, systems and computer program products for tracking, encoding and decoding the code-location of runtime events. The system modifies a request packet to access a resource initiated by a source address to indicate the request packet was sent by an intermediary address. The system injects an identifier pre-allocated for the source address into the request packet. The system updates the modified request packet by replacing the intermediary address with a substitute address that corresponds with the source address' pre-allocated identifier. The system sends the updated request packet to the resource, the updated request packet indicating a response to the updated request packet is to be sent back to the substitute address.

Abstract: A method and system are disclosed herein for accepting multimodal inputs and deriving synchronized and processed information. A reusable multimodal application is provided on the mobile device. A user transmits a multimodal command to the multimodal platform via the mobile network. The one or more modes of communication that are inputted are transmitted to the multimodal platform(s) via the mobile network(s) and thereafter synchronized and processed at the multimodal platform. The synchronized and processed information is transmitted to the multimodal application. If required, the user verifies and appropriately modifies the synchronized and processed information. The verified and modified information are transferred from the multimodal application to the visual application. The final result(s) are derived by inputting the verified and modified results into the visual application.

Abstract: A method for providing query responses to a user via online chat establishes a first communication connection for online chat between a user interface and an artificial intelligence (AI) entity comprising a processor and a memory element configured to store a database of query answers; receives a user input query transmitted via the first communication connection; performs a lookup in the database of query answers, to locate a query answer corresponding to the user input query; when unable to locate a query answer, establishes a second communication connection for online chat between the user interface and a live agent interface that transmits responses dynamically provided by a human operator; evaluates a chat between the user interface and the live agent interface; identifies an answer to the user input query, based on evaluating the chat; and stores the answer to be provided by the AI entity in the future.

Abstract: Implementations relate to automatic generation of speaker features for each of one or more particular text-dependent speaker verifications (TD-SVs) for a user. Implementations can generate speaker features for a particular TD-SV using instances of audio data that each capture a corresponding spoken utterance of the user during normal non-enrollment interactions with an automated assistant via one or more respective assistant devices. For example, a portion of an instance of audio data can be used in response to: (a) determining that recognized term(s) for the spoken utterance captured by that the portion correspond to the particular TD-SV; and (b) determining that an authentication measure, for the user and for the spoken utterance, satisfies a threshold. Implementations additionally or alternatively relate to utilization of speaker features, for each of one or more particular TD-SVs for a user, in determining whether to authenticate a spoken utterance for the user.

Abstract: Embodiments of the present disclosure provides a voice processing method, apparatus and device, where the method includes: acquiring, by a terminal device, first voice information; and acquiring, by the terminal device, response information corresponding to the first voice information, and performing an operation corresponding to the response information according to a type of the response information, where the type of the response information is at least one of a voice type, a text type, an image type, a video type, and a program operation type, which improves the flexibility of the voice processing.

Abstract: In an example of the described techniques, a wireless communication system includes first memory, second memory, a direct memory access (DMA) controller, an encryption engine in-line between the DMA controller and the second memory, a first microprocessor, and a second microprocessor. The first microprocessor communicates with other systems that generate application data to be wirelessly transmitted. The application data to be wirelessly transmitted is stored in the second memory and programs the DMA controller to transfer packets of the application data to the first memory from the second memory. The encryption engine receives the packets of the application data from the DMA controller, encrypts the packets to generate encrypted application data packets, and outputs the encrypted application data packets for storage to the first memory.

Abstract: Disclosed is a portable device for controlling an external device.

Abstract: Systems and methods for optimizing network microphone devices using noise classification are disclosed herein. In one example, individual microphones of a network microphone device (NMD) detect sound. The sound data is analyzed to detect a trigger event such as a wake word. Metadata associated with the sound data is captured in a lookback buffer of the NMD. After detecting the trigger event, the metadata is analyzed to classify noise in the sound data. Based on the classified noise, at least one performance parameter of the NMD is modified.

Abstract: A reproduced data output apparatus includes: a reproduced data receiver section to receive a reproduced data of a content from an external instrument having a reproduction function of the content; a report determiner section to determine whether an operation status report signal indicating that a status of a present operation of the external instrument is a status of a different operation is reported from the external instrument, in response to that an occurrence of an event is identified during a status of a first operation being identified as a status of a present operation of the external instrument; and a command transmission controller section to transmit a command that requires a re-start of the first operation to the external instrument, in response to that the operation status report signal is determined to be reported from the external instrument.

Abstract: Disclosed embodiments are directed an application program configured to run on a user's mobile device can allow voice-activated call pick-up to the user, without the user having to use his or her hands for picking up the call. For example, the application program can initially be trained to a user's voice command. When an incoming call is received at the mobile device, the user can pick up the call by issuing a voice command. In some embodiments, the application program can determine whether to allow voice-activated pick-up of calls based on data collected from multiple sensors associated with the vehicle, the mobile device, or a remote source.

Abstract: Systems and methods may be used to automatically detect a query in interactive content. A system may implement a method that includes receiving an audible signal. The method may include determining that a portion of the audible signal includes speech. The method may include translating at least the portion of the audible signal. The portion of the audible signal may be translated into a natural language output. The method may include generating an identifier (ID) associated with the speech. The ID may be generated on a condition that the natural language output includes a trigger. The method may include generating an inaudible signal that includes the ID. The method may include synchronizing the inaudible signal with the audible signal. The method may include transmitting the audible signal at a first frequency. The method may include transmitting the inaudible signal at a second frequency.

Abstract: A miniaturized multiprotocol audio/voice internet-of-things device (MAVID) initiates a wireless call in response to a command received from a first user. The MAVID carries out the wireless call between the first user and a second user. The wireless call utilizes wireless protocols such as WiFi, Bluetooth, third generation mobile technology (3G), fourth generation mobile technology (4G), and Digital Enhanced Cordless Telecommunications (DECT). The MAVID performs an in-call interaction, such as connecting to and utilizing an internet-based application or controlling a consumer electronic device, in response to a voice command from either the first user or the second user, while carrying out the wireless call.

Abstract: A user, such as an elderly person, may be assisted by an assistance device in his or her caregiving environment that operates in conjunction with one or more server computers. The assistance device may execute a schedule of assistance actions where each assistance action is associated with a time and is executed at that time to assist the user. An assistance action may present an input request to a user, process a voice input of the user, and analyze the voice input to determine that the voice input corresponds to a negative response event, a positive response event, or a non-response event. Based on the categorization of one or more voice inputs as negative response events, positive response events, or non-response events, it may be determined to notify a caregiver of the user, for example where the user has not responded to a number of assistance actions.

Abstract: After acceptance of a start instruction of voice input, a voice input device determines whether a volume of input sound into a microphone exceeds a specific acceptable upper limit volume (S83). Upon determination that the volume of the sound input into the microphone exceeds the acceptable upper limit volume (S83: affirmative), the voice input device notifies a request to move the voice input device (S85). Upon determination that the volume of the sound input into the microphone is equal to or smaller than the acceptable upper limit volume (S83: negative), the voice input device starts inputting voice through the microphone (S89).

Abstract: One embodiment provides a method, including: detecting, at an information handling device, voice command input; determining, using a processor, an orientation state of the information handling device, wherein the orientation state is one of: a closed state or an open state; and displaying, responsive to determining that the orientation state is associated with the closed state and on an auxiliary display of the information handling device, a notification acknowledging receipt of the voice command input. Other aspects are described and claimed.

Abstract: An interpreting assistant system which provides to a user captions of auditory communications in the user's vicinity. The interpreting assistant system includes a smart microphone transmitter that defines an input device which converts auditory communications into audio signals and transmit the signals a translation device, with a smart phone defining the translation device which generates a text transcript from the audio signals and send the transcript file to a display device, with the display device being defined by a wearable display interface which displays the transcript for a user to see. When in use, the interpreting assistant system provides for the display of a real time transcription and display of auditory communications such as spoken words for a user that may have hearing difficulties.

Abstract: In one embodiment, a mobile device application automatically identifies and annotates auditory data of a conversation between two or more parties. Digital auditory data is processed to identify at least one fact from the auditory data of the conversation. An identified fact is annotated, based on context and relevance, to search remotely-accessible data for information associated with the identified fact. The information is displayed while the conversation is ongoing to enable verification of the identified fact.

Abstract: Disclosed are a display device capable of voice recognition and a control method thereof. A display device, according to one embodiment of the present invention, comprises a display module which displays, on a first region, at least one icon arranged in a preset order; a sensing module which senses an action for entering a voice command mode; a memory for storing at least one item of data; and a controller which refers to the memory, and extracts text corresponding to the icon that is displayed on the first region, wherein the controller controls such as that the extracted text is displayed on a second region, and, if a voice command corresponding to the text displayed on the second region is recognized, the icon displayed on the first region is activated.

Abstract: An information processing device including a determination unit that determines a user interface for controlling a control target device in accordance with a communication scheme between the control target device and the information processing device for controlling the control target device and a notification control unit that controls a notification to a user of the user interface that is determined by the determination unit. An information processing method and a program corresponding to the information processing device.

Abstract: The invention relates to a voice recognition implemented in a carrier aircraft cockpit, for recognizing aircraft indicators used in operational audio messages received in or sent by the carrier aircraft. The system includes a computing device suitable implementing modules for: providing the aircraft indicator of the carrier aircraft, determining adjacent aircraft indicators located in a current air traffic control zone, updating and storing a voice recognition grammar of aircraft indicators from the carrier aircraft indicator and at least some of the adjacent aircraft indicators, voice recognition engine for audio messages received or sent using the stored aircraft indicator voice recognition grammar.

Abstract: Methods and systems may provide for technology to identify one or more operating conditions associated with a vehicle. The technology may further identify an environmental condition associated with the vehicle. The technology may further control a first sound to be emitted from one or more of an internal audio system or an external audio system based on the one or more operating conditions and the environmental condition. The internal audio system projects sounds to a cabin of the vehicle. The external audio system projects sounds away from the vehicle.

Abstract: A portable construction site data center for off-site monitoring and supervision of construction sites and for on-site construction worker interface. The portable construction site data center has a housing that is resistant to outdoor elements, with a mounting platform for supporting the housing on any common construction site fixture such as a safety barrel or drum. The housing has dimensions and a weight that enable portability for hand carry. The housing has a keyboard, a display, a camera, interactive color LEDs, and an RFID transponder for worker interface, and a CPU with memory to process the worker interface data. A battery and solar cell power the system. An antenna allows the system to access to Wi-Fi, Bluetooth, and cellular network signals thus enabling the system to access, via the internet, remote and local digital devices.

Abstract: A method, a system and an apparatus for automatically starting recording is disclosed. The method includes: detecting whether there is a preset recording startup button in a display interface of a terminal device; acquiring a sensor signal if there is the recording startup button, and determining whether the sensor signal meets a preset automatic recording condition; and starting a recording function automatically if the automatic recording condition is met.

Abstract: A method in accordance with the present disclosure may include receiving a message at a mobile computing device and performing natural language processing (NLP) based interpretation of the message. Embodiments may further include suggesting at least one of an action and an application configured to perform the action, the suggestion based upon, at least in part, the NLP-based interpretation of the message.

Abstract: Systems and methods having a local processor at the extreme edge of an environmental monitoring/control system are disclosed. A sensor is provided in close proximity to the processing module. The processing module is a relatively simple processor capable of detecting the occurrence of one particular event, or a limited number of particular events. The processing is done with a relatively simple neural network. Processing module outputs indicate that a particular event has occurred. The processing module includes a memory into which values can be loaded that are determined by “pre-training” for use with the processing module. The downloading and use of such pre-trained values allows the processing module to efficiently detect particular events for which the values were pre-trained.

Abstract: Techniques are disclosed for generating a voice user interface (VUI) modality within an application that includes graphical user interface (GUI) screens. A GUI screen parser analyzes the GUI screens to determine the various navigational GUI screen paths that are associated with edge objects within multiple GUI screens. Some edge objects are identified as select objects or prompt objects. A natural language processing system generates a select object synonym data structure and a prompt object data structure that may be utilized by a VUI generator to generate VUI data structures that give the application VUI modality.

Abstract: For presenting visual information on a display, a processor determines to show visual information in response to an audible command from a user. The processor further identifies a display that is viewable by the user and accessible via communication hardware. In addition, the processor presents the visual information on the display via the communication hardware.

Abstract: Techniques are disclosed for generating a voice user interface (VUI) modality within an application that includes graphical user interface (GUI) screens. A GUI screen parser analyzes the GUI screens to determine the various navigational GUI screen paths that are associated with edge objects within multiple GUI screens. Some edge objects are identified as select objects or prompt objects. A natural language processing system generates a select object synonym data structure and a prompt object data structure that may be utilized by a VUI generator to generate VUI data structures that give the application VUI modality.

Abstract: A method of processing a digitally encoded radio signal (102) comprising a bit to be determined is disclosed. The method comprises correlating a first bit sequence (103) comprising the bit with a plurality of predetermined filters (104a-h) to create a first set of filter coefficients (110a-h); calculating (120) a first likelihood data set (124) comprising a likelihood of said bit having a given value for each bit position from the first set of filter coefficients. A second bit sequence (103) comprising the bit at a different position is then correlated with the filters to create a second set of filter coefficients (10a-h), from which a second likelihood data set (124) is calculated. A soft output bit (26) comprising a probability weighted bit value from data corresponding to the bit at a first and second bit positions from the first and second likelihood data sets respectively is then calculated.

Abstract: An electronic device is provided. The electronic device includes a communication interface comprising communication circuitry and a processor configured to functionally connect with the communication interface, wherein the processor is configured to: obtain a voice signal, obtain context information associated with the user in connection with obtaining the voice signal, determine first response information corresponding to the voice signal, if the context information meets a first condition, determine second response information corresponding to the voice signal, if the context information meets a second condition and send at least part of response information corresponding to the first response information or the second response information to an output device operatively connected with the electronic device or an external electronic device for the electronic device.

Abstract: Feedback mechanisms to the user of a Head Mounted Display (HMD) are provided. It is important to provide feedback to the user when speech is recognized as soon as possible after the user utters a voice command. The HMD displays and/or audibly renders an ASR acknowledgment in a manner that ensures the user that the HMD has received/understood his voiced command.

Abstract: A loudspeaker is driven with a loudspeaker signal to generate sound, and sound is converted to one or more microphone signals with one or more microphones. The microphone signals are concurrently transformed into far-field beam signals and near-field beam signals. The far-field beam signals and the near-field beam signals are concurrently processed to produce one or more far-field output signals and one or more near-field output signals, respectively. Echo is detected and canceled in the far-field beam signals and in the near-field beam signals. When the echo is not detected above a threshold, the one or more far-field output signals are outputted. When the echo is detected above the threshold, the one or more near-field output signals are outputted. A signal based on the one or more output signals is transmitted.

Abstract: A Bluetooth microphone (10) comprises a controller (MCU) and Bluetooth transceiver (12) arranged to: establish a Bluetooth paired connection with a device; establish an Advanced Audio Distribution Profile, A2DP, connection with the paired device to receive a sequence of packets from the paired device for decoding by the microphone; and establish a Serial Port Profile, SPP, connection with the paired device for simultaneously transmitting a sequence of packets based on a microphone transducer signal to the paired device as the received sequence of packets are being decoded for transmission to a set of headphones.

Abstract: A smart headset communicates through the cellular transceiver with a cellular network when the smart headset in a first mode and communicates through a Bluetooth transceiver with a smart handset when the smart headset is in a second mode. A controller of the smart headset is configured to place the smart headset in the first mode when the smart handset is determined to be farther than a maximum proximity from the smart headset and configured to place the headset in the second mode when the smart handset is determined to be within the maximum proximity to the smart headset.

Abstract: Provided is a portable telephone or an earphone or an electromagnetic-type vibration unit that comprises an electromagnetic-type vibrator including two mutually relatively moving portions supported via an elastic body, and that is configured to produce vibrations from at least one of the two portions for cartilage conduction. The elastic body provides a cartilage conduction portion to be contacted with the ear cartilage. The elastic body is disposed on or in the vicinity of an upper corner portion of a housing. One of the two portions is supported on a housing structure with the elastic body supported by the housing structure, and the other of the two portions is supported by the elastic body. Of the two portions, one with a greater weight is supported by the elastic body.

Abstract: A Bluetooth microphone (10) comprises a controller (MCU) and Bluetooth transceiver (12) arranged to: establish a Bluetooth paired connection with a device; establish an Advanced Audio Distribution Profile, A2DP, connection with the paired device to receive a sequence of packets from the paired device for decoding by the microphone; and establish a Serial Port Profile, SPP, connection with the paired device for simultaneously transmitting a sequence of packets based on a microphone transducer signal to the paired device as the received sequence of packets are being decoded for transmission to a set of headphones.

Abstract: Embodiments disclosed herein provide a wireless controller which shows a voice, motion, or an image complying with or not complying with a user's command and controls an external device in accordance with the user's command. According to an embodiment, a wireless controller includes a main body provided in a shape of a flowerpot, and includes a voice recognition unit, a control unit generating a signal for controlling an object to be controlled, which is designated by a voice recognized in the voice recognition unit, in accordance with the voice, and a communication unit outputting the control signal generated in the control unit to the object to be controlled; and an indicator provided at the main body in a shape of at least one of a stem, a leaf, a flower, and a tree, and showing a motion corresponding to the voice recognized in the voice recognition unit.

Abstract: A peripheral device (e.g., a small wearable device) may operate in conjunction with a camera to enable in-the-moment capture and control. The peripheral device may receive voice commands and uses voice recognition to generate a control signal to control the camera, thereby enabling users to freely participate in their activities while seamlessly controlling the camera in a hands-free manner. Additionally, the peripheral device may operate as a wireless microphone source to capture high quality audio for instead of or in addition to audio captured by the camera. This may provide improved audio quality in certain operating conditions such as during narrating and interviewing.

Abstract: An electronic computing device includes a processing unit and system memory. The system memory includes instructions which, when executed by the processing unit, cause the electronic computing device to monitor audio from a conversation. One or more keywords are identified from the audio. A context of the conversation is identified from the audio. One or more alerts are displayed on a display screen of the electronic computing device. Each of the one or more alerts corresponds to the context of the conversation. Each of the one or more alerts corresponds to a notification to be communicated to an individual. One of the notifications is obtained. The notification is displayed on the display screen of the electronic computing device.

Abstract: A mobile device, such as a smart phone, receives and presents interactive audio content from an interactive voice response (IVR) system. The mobile device provides an interface that enables a user to navigate through a menu presented in the interactive content. The interface further presents action elements that identify actions that can be requested through the menu, and selection of the one of the action elements may cause the IVR to perform an associated action. For example, the interface may identify representatives at a call center, and a selection of one of the action elements causes the IVR to establish a communication between the mobile device and the selected representative. The action elements may further identify status information associated with the call center, such as an expected wait time.