Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for hotword detection on multiple devices are disclosed. In one aspect, a method includes the actions of receiving, by a computing device, audio data that corresponds to an utterance. The actions further include determining a likelihood that the utterance includes a hotword. The actions further include determining a loudness score for the audio data. The actions further include based on the loudness score, determining an amount of delay time. The actions further include, after the amount of delay time has elapsed, transmitting a signal that indicates that the computing device will initiate speech recognition processing on the audio data.

Abstract: One or more computing devices, systems, and/or methods for detecting trigger phrases and transmitting electronic messages to devices are provided. For example, audio received via a microphone of a first device may be monitored. Responsive to detecting a first trigger phrase in a first audio segment identified during the monitoring, a first electronic message comprising instructions to activate a microphone function of a second device may be generated and the first electronic message may be transmitted to the second device. Responsive to detecting a second trigger phrase in a second audio segment identified during the monitoring, a second electronic message comprising instructions to activate a microphone function of a third device may be generated and the second electronic message may be transmitted to the third device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for collaboration between multiple voice controlled devices are disclosed. In one aspect, a method includes the actions of identifying, by a first computing device, a second computing device that is configured to respond to a particular, predefined hotword; receiving audio data that corresponds to an utterance; receiving a transcription of additional audio data outputted by the second computing device in response to the utterance; based on the transcription of the additional audio data and based on the utterance, generating a transcription that corresponds to a response to the additional audio data; and providing, for output, the transcription that corresponds to the response.

Abstract: A method for recording a plurality of augmented reality (AR) sessions between a set of user(s) and an AR computer system, receiving first user input, through the AR computer system and from a first user, identifying a first AR session of the plurality of AR sessions, and presenting at least a portion of the recording of the first AR session on the AR computer system for the first user.

Abstract: In one embodiment, a process is performed during controlling Autonomous Driving Vehicle (ADV). Microphone signals sense sounds in an environment of the ADV. The microphone signals are combined and filtered to form an audio signal having the sounds sensed in the environment of the ADV. A neural network is applied to the audio signal to detect a presence of an audio signature of an emergency vehicle siren. If the siren is detected, a change in the audio signature to make a determination as to whether the emergency vehicle siren is a) moving towards the ADV, or b) not moving towards the ADV. The ADV can make a driving decision, such as slowing down, stopping, and/or steering to a side, based on if the emergency vehicle siren is moving towards the ADV.

Abstract: Systems and methods are disclosed herein for implementation of a vehicle command operation system that may use multi-modal technology to authenticate an occupant of the vehicle to authorize a command and receive natural language commands for vehicular operations. The system may utilize sensors to receive data indicative of a voice command from an occupant of the vehicle. The system may receive second sensor data to aid in the determination of the corresponding vehicular operation in response to the received command. The system may retrieve authentication data for the occupants of the vehicle. The system authenticates the occupant to authorize a vehicular operation command using a neural network based on at least one of the first sensor data, the second sensor data, and the authentication data. Responsive to the authentication, the system may authorize the operation to be performed in the vehicle based on the vehicular operation command.

Abstract: Provided are methods, systems, and apparatuses for detecting, processing, and responding to audio signals, including speech signals, within a designated area or space. A platform for multiple media devices connected via a network is configured to process speech, such as voice commands, detected at the media devices, and respond to the detected speech by causing the media devices to simultaneously perform one or more requested actions. The platform is capable of scoring the quality of a speech request, handling speech requests from multiple end points of the platform using a centralized processing approach, a de-centralized processing approach, or a combination thereof, and also manipulating partial processing of speech requests from multiple end points into a coherent whole when necessary.

Abstract: A home appliance is provided. The home appliance includes a sensor, a microphone, a speaker, and a processor. The processor is configured to, based on one of a first event wherein a user action is detected through the sensor or a second event wherein a trigger command for initiating a voice recognition mode is input through the microphone occurring, operate in the voice recognition mode, and control the speaker to output an audio signal corresponding to the event occurred, and the audio signal is an audio signal set differently for each of the first event and the second event.

Abstract: A first electronic device of a local group of connected electronic devices receives a first voice command including a request for a first operation, assigns a first target device from among a local group of connected electronic devices as an in-focus device for performing the first operation, causes the first operation to be performed by the first target device via operation of a server-implemented common network service, receives a second voice command including a request for a second operation, and based on a determination that the second voice command does not include an explicit designation of a second target device and a determination that the second operation can be performed by the first target device, assigning the first target device as the in-focus device for performing the second operation.

Abstract: A notification system includes: detection means (110) for detecting an acoustic event from voice data transmitted from a communication terminal held by a target person; and notification means (120) for sending a predetermined notification when the detection means (110) has detected the acoustic event. Accordingly, it is possible to determine the state of a target person regardless of the state of this person. Further, when the difference between an acoustic pattern of the voice data transmitted from the communication terminal and acoustic patterns registered in advance is outside a predetermined range, a management server (101) does not send a notification, whereby it is possible to prevent communication traffic from being increased based on unnecessary notifications.

Abstract: A question answering device includes: a reception unit configured to receive speech which is uttered in a vehicle; a generation unit configured to generate a character string which is indicated by the speech based on speech recognition; a first acquisition unit configured to acquire an answer to a question indicated by the character string; a second acquisition unit configured to acquire control information for localizing speech of the answer at a position associated with the answer in the vehicle; and an output unit configured to output the control information.

Abstract: A system and method to encode and decode multiple audio signals to provide independent control of the audio signals is provided. A host device may encode the audio signals to enable a complete separation of the constituent audio signals when the mixed stream is decoded on a playback device. The gains of the audio signals may be independently controlled before they are mixed to increase the intelligibility of one audio signal relative to another audio signal at the playback device. The ability to separate the constituent audio signals from the mixed signals at the playback device allows the processing operations performed on the constituent audio signals and the associated path latencies to be independently chosen. In addition, in applications where the mixed stream is transmitted from a single host device to multiple playback devices, the constituent audio signals may be selectively masked on a playback device to increase user privacy.

Abstract: Systems, methods, and computer-readable media are disclosed for voice activated devices with integrated heatsinks and speakers. In one embodiment, an example device may include a light ring, a first light emitting diode, a heatsink having a first side and a second side, and a speaker assembly coupled to the first side of the heatsink assembly. The heatsink and the speaker assembly together may form a first sealed cavity. The device may include a reflector component coupled to the second side and configured to direct light towards the light ring. The reflector component may optionally include a substantially linear member and a bent member.

Abstract: An electronic device and a control method therefor are provided. The electronic device comprises: a plurality of microphones for receiving audio signals in which voice signals are included; a communicator for receiving state information according to information about a connection with the electronic device; and a processor for determining the noise environment around the electronic device based on one or more of audio amplitude information that is received by the plurality of microphones and that is output by an external device, and state information of the external device, and for processing the voice signal based on the determined noise environment so as to perform voice recognition.

Abstract: Performing speech recognition in a multi-device system includes receiving a first audio signal that is generated by a first microphone in response to a verbal utterance, and a second audio signal that is generated by a second microphone in response to the verbal utterance; dividing the first audio signal into a first sequence of temporal segments; dividing the second audio signal into a second sequence of temporal segments; comparing a sound energy level associated with a first temporal segment of the first sequence to a sound energy level associated with a first temporal segment of the second sequence; based on the comparing, selecting, as a first temporal segment of a speech recognition audio signal, one of the first temporal segment of the first sequence and the first temporal segment of the second sequence; and performing speech recognition on the speech recognition audio signal.

Abstract: A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Abstract: A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.

Abstract: A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.

Abstract: A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.

Abstract: One embodiment provides a method, including: receiving, at an information handling device, user input, wherein the user input comprises an indication to perform a function associated with content comprising at least one image; analyzing, using a processor, the at least one image to determine at least one characteristic associated with the at least one image; and providing, based on the analyzing, output describing the at least one characteristic of the at least one image. Other aspects are described and claimed.

Abstract: A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.

Abstract: Personalized notifications of security events are sent. When an alarm condition is determined, a remote notification address may be retrieved. Personalized text may also be retrieved that describes the alarm condition. A notification message may thus be sent to the remote notification address, with the personalized text describing the alarm condition in a user's own words. The personalized text may then be converted to speech, thus providing an audible announcement of the alarm condition.

Abstract: A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.

Abstract: A vehicle personal assistant to engage a user in a conversational dialog about vehicle-related topics, such as those commonly found in a vehicle owner's manual, includes modules to interpret spoken natural language input, search a vehicle knowledge base and/or other data sources for pertinent information, and respond to the user's input in a conversational fashion. The dialog may be initiated by the user or more proactively by the vehicle personal assistant based on events that may be currently happening in relation to the vehicle. The vehicle personal assistant may use real-time inputs obtained from the vehicle and/or non-verbal inputs from the user to enhance its understanding of the dialog and assist the user in a variety of ways.

Abstract: Systems, methods, and devices for live paging from a mobile device in operable communication with a fire control panel are provided. Upon an occurrence of a stimulus activity at a fire control panel, e.g., an emergency event, an operator, remote from the fire control panel, may launch a control application from the mobile device. Upon launching the control application, a connection between the mobile device and the fire control panel may be established, and a microphone coupled to the mobile device may be activated for the operator to begin paging. The page may then be broadcasted in real-time via one or more annunciators operably connected to the fire control panel, or, as a recorded message.

Abstract: A location determination system includes a first mobile terminal and a second mobile terminal. The first mobile terminal includes a first processor to acquire a first sound signal, analyze the first sound signal to obtain a first analysis result, and transmit the first analysis result. The second mobile terminal includes a second processor to acquire a second sound signal, analyze the second sound signal to obtain a second analysis result, receive the first analysis result from the first mobile terminal, compare the second analysis result with the first analysis result to obtain a comparison result, and determine whether the first mobile terminal locates in an area in which the second mobile terminal locates, based on the comparison result.

Abstract: Embodiments of the present invention provide a system, method, and program product to deliver an announcement to people, such as a public announcement. A computer receives input representative of audio from one or more people speaking in one or more natural languages. The computer processes the input to identify the languages being spoken, and identifies a relative proportion of each of the identified languages. Using these proportions, the computer determines one or more languages in which to deliver the announcement. The computer then causes to be delivered the announcement in the determined languages. In other embodiments, the computer can also determine an order in which to deliver the announcement. Further, the computer can transmit the announcement in the determined languages and order for delivery in aural or visual form.

Abstract: A method for controlling a printing apparatus includes holding a plurality of jobs including a cover job having print data for a cover and a content job having print data for content, which are used in bookbinding processing, and performing control for displaying, on a display, a correspondence relationship between the cover job and the content job.

Abstract: A computing device includes at least one processor and at least one module, operable by the at least one processor, to determine a context of the computing device, the context including an indication of at least one of an application executing at the computing device and a location of the computing device and determine, based at least in part on the context, one or more contextual audio triggers usable to initiate interaction with the computing device, each of the one or more contextual audio triggers being associated with a respective operation of the computing device. The at least one module is further operable to receive audio data, and responsive to determining that a portion of the audio data corresponds to a particular contextual audio trigger from the one or more contextual audio triggers, perform the respective operation associated with the particular contextual audio trigger.

Abstract: A gem tester for testing a gem under test and a kit including a horizontal recharging stand are disclosed. In one embodiment of the gem tester, an elongated body has a line-of-sight contour tapering from a bulbous end to a radially deviating frontal nose having a probe extending therefrom. Internal circuitry measures electrical conductivity of the gem under test in order to identify the type of gem under test and drive a color control signal in response thereto. A light source is disposed proximate the probe in order to expose the gem under test to ultraviolet light prior to the internal circuitry measuring electrical conductivity. Identification of the gem under test may be made by audio or visual indication or a combination thereof.

Abstract: A subscriber device for use in an automated personal emergency response system implemented as a conference bridge on a remote computing network. The device, intended to be worn as a pendant, wristband or in another wearable configuration, includes a color high-resolution display for signaling a user of the subscriber device with notifications, arrows for directional guidance, and/or other status messages. The device also includes microphones and speakers for enabling a teleconference between a user of the subscriber device in need of assistance and parties joined to the teleconference via the automated personal emergency response system. The user of the subscriber device may initiate the call for assistance and teleconference via a press of a single button on the device; alternatively, accelerometers in the device may detect a fall and automatically initiate the call. The device can receive medical telemetry and provide it to conference participants and perform home automation tasks.

Abstract: Methods, apparatus, and computer program products are described for invoking tapered prompts in a multimodal application implemented with a multimodal browser and a multimodal application operating on a multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes. Embodiments include identifying, by a multimodal browser, a prompt element in a multimodal application; identifying, by the multimodal browser, one or more attributes associated with the prompt element; and playing a speech prompt according to the one or more attributes associated with the prompt element.

Abstract: A system, method and apparatus monitor sensors or instruments and provide outputs in the form of voice messages. Data output from the sensors may thus be presented to humans without reference to a visual display. The voice messages may either be assembled from a library of recordings in the form of voice message segments or derived from text and then converted to speech. The voice messages may be output through one or more loudspeakers or via a wireless headset, intercom or portable radio. The user can configure the system for use with different types of sensors and data protocols for a wide variety of different applications and use-cases, using a simple graphical user interface. In accordance with one embodiment the system may be implemented on a personal computer or tablet computer. In an alternative embodiment the processing is performed by an embedded processor and a personal or tablet computer is only connected when it is necessary to change the control program.

Abstract: Monitoring accuracy degrades due to a noise where many sound sources exist other than those to be monitored. A sound monitoring system includes a microphone array having multiple microphones and a location-based abnormal sound monitoring section. The location-based abnormal sound monitoring section is supplied with an input signal from the microphone array via a waveform acquisition section and a network. Using the input signal, the location-based abnormal sound monitoring section detects a temporal change in a sound source direction histogram. Based on a detected change result, the location-based abnormal sound monitoring section checks for abnormality in a sound field and outputs a monitoring result. The processing section searches for a microphone array near the sound source to be monitored. The processing section selects a sound field monitoring function for the sound source to be monitored based on various data concerning a microphone belonging to the searched microphone array.

Abstract: A system for biomedical measurement with a voice notification feature includes a biomedical measurement device that generates a command based on at least one of a physiological signal obtained by the biomedical measurement device as a result of a measured physiological condition of a user, and an operation phase of the biomedical measurement device, and a mobile device that is coupled to and separate from the biomedical measurement device. The mobile device receives the command from the biomedical measurement device, generates a voice notification signal according to the command and pre-established voice data, and outputs audibly the voice notification signal.

Abstract: A medical error alert device may comprise a controller; a first memory, a recording and playback module and a user interface. The user interface may be configured to enable a patient or a patient representative to record an announcement identifying at least a medical procedure to be carried out. The user interface may be further configured to enable later playback of the announcement before the medical procedure is carried out. A communication device may be provided, coupled to a network to enable reception of signals from the network comprising at least predetermined patient identification number and/or a unique medical alert device identifier. A predetermined alert may be generated responsive to the communication device receiving a signal associated with the predetermined alert and the patient identification number and/or the unique device identifier.

Abstract: A medical error alert device may comprise a controller; a first memory, a recording and playback module and a user interface. The user interface may be configured to enable a patient or a patient representative to record an announcement identifying at least a medical procedure to be carried out. The user interface may be further configured to enable later playback of the announcement before the medical procedure is carried out. A communication device may be provided, coupled to a network to enable reception of signals from the network comprising at least predetermined patient identification number and/or a unique medical alert device identifier. A predetermined alert may be generated responsive to the communication device receiving a signal associated with the predetermined alert and the patient identification number and/or the unique device identifier.

Abstract: The present invention refers to an audio module for a video surveillance system, a video surveillance system and a method for keeping a plurality of locations under surveillance. Video surveillance systems are widely used to monitor critical locations of public or private buildings or institutes like private homes, museums, prisons, factories, hazardous areas and so on from one or more central surveillance rooms. Commonly, the surveillance rooms are equipped with a plurality of monitors each displaying one of the critical locations or a mosaic display, which is divided in a plurality of cameos, whereby each cameo displays one of the critical locations. Additionally audio signals corresponding to the images displayed on the single monitors or cameos can be played.

Abstract: The invention is a portable electronic device that enables anyone to quickly schedule multiple voice reminders to play back at a specified time, date and frequency. Reminders can be either entered via voice command or manually via device keypad. Operation modes include voice, various audible alerts, visual alerts including but not limited LED lights, silent or vibration as well as motion detection activated. A microprocessor running under the control of a software program controls the keypad and electronic subsystems to implement the device.

Abstract: Dialogue apparatus configured to carry out a dialogue with a driver and including storage, concentration degree measuring and dialogue units. The storage unit maintains a preference database in which a dialogue candidate of content for a dialogue with the driver and a dialogue effect indicating a degree of improving driver's degree of concentration on driving, are associated with each other. The concentration degree measuring unit measures the driver's degree of concentration on driving. The dialogue unit selects a dialogue candidate based on the dialogue effect in the preference database when the degree of concentration measured by the concentration degree measuring unit falls below a predetermined threshold, then carries out a dialogue by the selected dialogue candidate, and based on the degree of concentration before and after carrying out the dialogue, calculates the dialogue effect of the dialogue, and updates the dialogue effect of the preference database.

Abstract: A context-aware voice guidance method is provided that interacts with other voice services of a user device. The voice guidance does not provide audible guidance while the user is making a verbal request to any of the voice-activated services. Instead, the voice guidance transcribes its output on the screen while the verbal requests from the user are received. In some embodiments, the voice guidance only provides a short warning sound to get the user's attention while the user is speaking on a phone call or another voice-activated service is providing audible response to the user's inquires. The voice guidance in some embodiments distinguishes between music that can be ducked and spoken words, for example from an audiobook, that the user wants to pause instead of being skipped. The voice guidance ducks music but pauses spoken words of an audio book in order to provide voice guidance to the user.

Abstract: Methods, systems, and products measure health data related to a user. A spoken phrase is received and time-stamped. The user is identified from the spoken phrase. A window of time is determined from a semantic content of the spoken phrase. A sensor measurement is received and time-stamped. A difference in time between the time-stamped spoken phrase and the time-stamped sensor measurement is determined and compared to the window of time. When the difference in time is within the window of time, then the sensor measurement is associated with the user.

Abstract: Various embodiments of methods and systems for providing informational updates, such as directional updates, to a user of a computing device are disclosed. The method and system may recognize an active conversation and monitor the conversation for a lull. During a detected lull, the method and system may deliver the informational updates. Certain embodiments may include receiving a voice update while the user is using other functionality of the computing device, such as a telecommunication function. Embodiments may also include scheduling an update window within which the update may be delivered. The update window may be a predetermined time window in which a voice update is broadcast, for example. Embodiments may also include alerting the user to a pending update.

Abstract: Audible navigation system produces direction updates, scheduled at predetermined time windows, during which the audio environment is monitored for the existence of a conversation. If no conversations are detected during an update window, or lulls in conversation are detected, the audible navigation system direction update is output. If uninterrupted conversations continue as the update window time is expiring, a system volume is lowered and the navigation system direction update is output.

Abstract: Apparatuses and methods are described to secure information contained within voice recordings. A voice recording is loaded into a data processing system, wherein the voice recording results from an utterance of a human during an interaction between the human and an interface of a business entity. The voice recording is processed to recognize at least one element of text in the voice recording. The data processing system determines if the at least one element of text represents special information that pertains to the human. A segment in the voice recording is rendered unintelligible if the at least one element of text represents special information that pertains to the human.

Abstract: A mobile terminal including an input unit configured to receive an input to activate a voice recognition function on the mobile terminal, a memory configured to store information related to operations performed on the mobile terminal, and a controller configured to activate the voice recognition function upon receiving the input to activate the voice recognition function, to determine a meaning of an input voice instruction based on at least one prior operation performed on the mobile terminal and a language included in the voice instruction, and to provide operations related to the determined meaning of the input voice instruction based on the at least one prior operation performed on the mobile terminal and the language included in the voice instruction and based on a probability that the determined meaning of the input voice instruction matches the information related to the operations of the mobile terminal.

Abstract: Verbal warning labels and other audible warning systems for use with different devices, containers, products and other things in various environments are disclosed herein. An audible warning system configured in accordance with an embodiment of the invention includes a device having a standardized textual warning associated therewith, and a sound playback system operably coupled to the device. The sound playback device can be configured to audibly output a verbal warning corresponding to the textual warning. The verbal warning can be provided by at least one of a manufacturer, supplier, distributor or retail vendor of the device, and the verbal warning can supplement or replace the standardized textual warning.

Abstract: A method including: obtaining, via a plurality of communication devices, a plurality of speech signals respectively associated with human speakers, the speech signals including verbal components and non-verbal components; identifying a plurality of geographical locations, each geographic location associated with a respective one of the plurality of the communication devices; extracting the non-verbal components from the obtained speech signals; deducing physiological or psychological conditions of the human speakers by analyzing, over a specified period, the extracted non-verbal components, using predefined relations between characteristics of the non-verbal components and physiological or psychological conditions of the human speakers; and providing a geographical distribution of the deduced physiological or psychological conditions of the human speakers by associating the deduced physiological or psychological conditions of the human speakers with geographical locations thereof.

Abstract: Arrangements described herein relate to providing an audio message. A calendar event can be detected. A voice relating to the detected calendar event can be automatically selected. A background sound relating to the detected calendar event can be automatically selected. The audio message can be generated using the automatically selected voice and background sound relating to the calendar event.

Abstract: Methods, systems, and products measure health data related to a user. A spoken phrase is received and time-stamped. The user is identified from the spoken phrase. A window of time is determined from a semantic content of the spoken phrase. A sensor measurement is received and time-stamped. A difference in time between the time-stamped spoken phrase and the time-stamped sensor measurement is determined and compared to the window of time. When the difference in time is within the window of time, then the sensor measurement is associated with the user.