Speech Controlled System Patents (Class 704/275)
  • Patent number: 10095473
    Abstract: An intent managing system and a method for operating the same are provided. The system, for example, may include, but is not limited to a processor communicatively coupled to an input system and a memory. The processor may be configured to receive a voice command, determine how many of a plurality of voice controllable systems utilize the voice command, automatically select one of the plurality of voice controllable systems, generate an indication of the selected one of the plurality of voice controllable systems, receive, from the at least one input system, confirmation of the selected one of the plurality of voice controllable systems, and execute the received voice command at the selected one of the plurality of voice controllable systems when the confirmation is received.
    Type: Grant
    Filed: November 3, 2015
    Date of Patent: October 9, 2018
    Assignee: HONEYWELL INTERNATIONAL INC.
    Inventors: Jeff Lancaster, Robert E De Mers, Erik T Nelson, Chaya Garg
  • Patent number: 10089070
    Abstract: In an example, there is disclosed a method of providing voice-activated network control (VANC), including: receiving a voice input; converting the voice input to a computer-usable form; parsing the voice input into key tokens; building a network policy macro from the key tokens; and causing commands based on the network policy macro to be executed on a target device. There is also disclosed one or more apparatuses for performing the method, and one or more computer-readable mediums having stored thereon executable instructions for realizing the method on a device.
    Type: Grant
    Filed: April 14, 2016
    Date of Patent: October 2, 2018
    Assignee: Cisco Technology, Inc.
    Inventors: Mitesh Mukesh Kanjariya, Mouli Vytla, Rahul BrajeshKumar Jain, Aditi Srivastava, Tejas Nagarmat, Hemanth Basappa Mallikarjunaswamy
  • Patent number: 10085619
    Abstract: Embodiments of a system and method for processing and recognizing non-contact types of human input to prevent contamination are generally described herein. In example embodiments, human input is captured, recognized, and used to provide active input for control or data entry into a user interface. The human input may be provided in variety of forms detectable by recognition techniques such as speech recognition, gesture recognition, identification recognition, and facial recognition. In one example, the human input recognition techniques are used in connection with a device cleaning workflow used to obtain data and human input during cleaning procedures while minimizing cross-contamination between the contaminated device or person and other objects or persons. In another example, the human input recognition techniques are used in connection with a device tracking workflow used to obtain data and human input while tracking interactions with and locations of the contaminated or uncontaminated device.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: October 2, 2018
    Assignee: Medivators Inc.
    Inventors: Ward Sly, Stacy Lemmer, Terry Mistalski, Michael Petersen
  • Patent number: 10088853
    Abstract: An HVAC controller may be controlled in response to a natural language message that is not recognizable by the HVAC controller as a command, where the natural language message is translated into a command recognizable by the HVAC controller. Voice recognition software may be used to create a natural language text based message from a recorded voice message, where the natural language text based message is translated into the command recognizable by the HVAC controller. In response to the command, the HVAC controller may perform an action and/or respond with a natural language text based message. Where the HVAC controller responds to the natural language text based message, the HVAC controller may send a natural language text based message back to the user. In some cases, a user may communicate with the thermostat via an on-line social network.
    Type: Grant
    Filed: May 1, 2013
    Date of Patent: October 2, 2018
    Assignee: Honeywell International Inc.
    Inventor: Soumitri Kolavennu
  • Patent number: 10089984
    Abstract: A system and method for an integrated, multi-modal, multi-device natural language voice services environment may be provided. In particular, the environment may include a plurality of voice-enabled devices each having intent determination capabilities for processing multi-modal natural language inputs in addition to knowledge of the intent determination capabilities of other devices in the environment. Further, the environment may be arranged in a centralized manner, a distributed peer-to-peer manner, or various combinations thereof. As such, the various devices may cooperate to determine intent of multi-modal natural language inputs, and commands, queries, or other requests may be routed to one or more of the devices best suited to take action in response thereto.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: October 2, 2018
    Assignee: VB Assets, LLC
    Inventors: Robert A. Kennewick, Chris Weider
  • Patent number: 10074371
    Abstract: A system configured to enable remote control to allow a first user to provide assistance to a second user. The system may receive a command from the second user granting remote control to the first user, enabling the first user to initiate a voice command on behalf of the second user. In some examples, the system may enable the remote control by treating a voice command originating from the first user as though it originated from the second user instead. For example, the system may receive the voice command from a first device associated with the first user but may route the voice command as though it was received by a second device associated with the second user. To enable this functionality, during a remote control session the first device may disable wakeword detection so that the voice command is correctly routed to the second device.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: September 11, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Peng Wang, Pathivada Rajsekhar Naidu
  • Patent number: 10071310
    Abstract: A thick-game client device includes all of the game data processing on-board while a thin-game client device includes only a small portion of game data processing such as to render visual displays while the majority of the game data processing is network based. A thick-voice client devices includes all of the voice processing on-board while a thin-voice client device includes only a small portion of the voice processing such as to generate acoustic parameter data discussed below while the remainder of the voice processing occurs at a voice services node. It will be appreciated that a client device may be thick with respect to both game processing and voice processing, may be thick with respect to one type of processing and thin with respect to the other, or may be thin with respect to both types of processing.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: September 11, 2018
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventors: David J. Anderson, Senis Busayapongchai
  • Patent number: 10062375
    Abstract: Inputs provided into user interface elements of an application are observed. Records are made of the inputs and the state(s) the application was in while the inputs were provided. For each state, a corresponding language model is trained based on the input(s) provided to the application while the application was in that state. When the application is next observed to be in a previously-observed state, a language model associated with the application's current state is applied to recognize speech input provided by a user and thereby to generate speech recognition output that is provided to the application. An application's state at a particular time may include the user interface element(s) that are displayed and/or in focus at that time, and is determined by an operating system hooking component embedded in the automatic speech recognition system.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: August 28, 2018
    Assignee: MModal IP LLC
    Inventors: Detlef Koll, Michael Finke
  • Patent number: 10057620
    Abstract: A method for voice control component installation is described. In one embodiment, a speech recognizable input spoken by an installer is identified, the speech recognizable input relating to installation of a system component. The system component is in communication with a control panel. An installation task for the system component is performed according to the speech recognizable input.
    Type: Grant
    Filed: May 1, 2017
    Date of Patent: August 21, 2018
    Assignee: Vivint, Inc.
    Inventor: James E. Nye
  • Patent number: 10048931
    Abstract: A machine is configured to identify a media file that, when played to a user, is likely to modify an emotional or physical state of the user to or towards a target emotional or physical state. The machine accesses play counts that quantify playbacks of media files for the user. The playbacks may be locally performed or detected by the machine from ambient sound. The machine accesses arousal scores of the media files and determines a distribution of the play counts over the arousal scores. The machine uses one or more relative maxima in the distribution in selecting a target arousal score for the user based on contextual data that describes an activity of the user. The machine selects one or more media files based on the target arousal score. The machine may then cause the selected media file to be played to the user.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: August 14, 2018
    Assignee: Gracenote, Inc.
    Inventors: Aneesh Vartakavi, Peter C. DiMaria, Michael Gubman, Markus K. Cremer, Cameron Aubrey Summers, Gregoire Tronel
  • Patent number: 10048973
    Abstract: A non-transitory storage maintains a project script including a sequence of steps, each step including a description of the step and a sound signature indicative of ambient sounds that occur during performance of the step. An audio processor is programmed to receive ambient audio input and perform a time frequency analysis of the ambient audio input. A controller is programmed to provide a description of a next step of the project script upon completion of a current step identified responsive to the time frequency analysis of the ambient audio input matching a sound signature corresponding to the next step of the project script.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: August 14, 2018
    Assignee: Harman International Industries, Incorporated
    Inventors: Meenakshi Barjatia, James M. Kirsch
  • Patent number: 10047970
    Abstract: An HVAC controller may be controlled in response to a natural language audio message that is not recognizable by the HVAC controller as a command, where the natural language audio message is translated into a command recognizable by the HVAC controller. The HVAC controller may be a thermostat and may include a housing that at least partially houses a control module, a microphone, a speaker, a display, and a voice recognition module. The voice recognition module recognizes a predetermined audible trigger from a recorded voice message or streamed voice message, and in response, provide one or more audio clips via the speaker and/or video clips via the display to assist users in operating the thermostat. A user may communicate with the thermostat via the thermostat and/or a remote device.
    Type: Grant
    Filed: August 20, 2014
    Date of Patent: August 14, 2018
    Assignee: Honeywell International Inc.
    Inventors: Jay Nelson, Hari Thiruvengada, Preston Gilmer, Thomas Gessner, Martin Adamek, Martin Skala, Juraj Buno, Soumitri Kolavennu, Max Peterschmidt, Libor Horky
  • Patent number: 10043537
    Abstract: Disclosed are a display apparatus, a voice acquiring apparatus and a voice recognition method thereof, the display apparatus including: a display unit which displays an image; a communication unit which communicates with a plurality of external apparatuses; and a controller which includes a voice recognition engine to recognize a user's voice, receives a voice signal from a voice acquiring unit, and controls the communication unit to receive candidate instruction words from at least one of the plurality of external apparatuses to recognize the received voice signal.
    Type: Grant
    Filed: November 11, 2013
    Date of Patent: August 7, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jong-hyuk Jang, Chan-hee Choi, Hee-seob Ryu, Kyung-mi Park, Seung-kwon Park, Jae-hyun Bae
  • Patent number: 10037677
    Abstract: Disclosed herein are speech therapeutic devices and methods. In one aspect, the speech therapeutic device includes audio input circuitry, signal processing circuitry, and stimulus circuitry. In certain embodiments, the audio input circuitry is configured to provide an input signal that is indicative of speech provided by a user and the signal processing circuitry is configured to utilize a reconfigurable rule that includes a condition, receive the input signal, process the input signal using the reconfigurable rule, and provide an alert signal responsive to attainment of the condition. The stimulus circuitry is configured to receive the alert signal and provide a stimulus to the user. The signal processing circuitry is additionally configured to (i) receive the reconfigurable rule from a communication network, and/or (ii) generate a record indicative of the alert signal, store the record in a memory, and send the record to a communication network.
    Type: Grant
    Filed: April 20, 2017
    Date of Patent: July 31, 2018
    Assignee: ARIZONA BOARD OF REGENTS ON BEHALF OF ARIZONA STATE UNIVERSITY
    Inventors: Xuan Zhong, William Yost, Michael Dorman, Julie Liss, Visar Berisha
  • Patent number: 10026394
    Abstract: A speech recognition platform configured to receive an audio signal that includes speech from a user and perform automatic speech recognition (ASR) on the audio signal to identify ASR results. The platform may identify: (i) a domain of a voice command within the speech based on the ASR results and based on context information associated with the speech or the user, and (ii) an intent of the voice command. In response to identifying the intent, the platform may perform a corresponding action, such as streaming audio to the device, setting a reminder for the user, purchasing an item on behalf of the user, making a reservation for the user or launching an application for the user. In some instances, the speech recognition platform engages in a back-and-forth dialog with the user in order to properly fulfill the user's request.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: July 17, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Peter Paul Henri Carbon, Vikram Kumar Gundeti, Frederic Johan Georges Deramat, Ajay Gopalakrishnan, John Daniel Thimsen
  • Patent number: 10026401
    Abstract: Techniques for naming devices via voice commands are described herein. For instance, a user may issue a voice command to a voice-controlled device stating, “you are the kitchen device”. Thereafter, the device may respond to voice commands directed, by name, to this device. For instance, the user may issue a voice command requesting to “play music on my kitchen device”. Given that the user has configured the device to respond to this name, the device may respond to the command by outputting the requested music.
    Type: Grant
    Filed: December 28, 2015
    Date of Patent: July 17, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Rohan Mutagi, Isaac Michael Taylor
  • Patent number: 10021344
    Abstract: Embodiments disclosed herein may be directed to a video communication server. In some embodiments, the video communication server includes: at least one memory including instructions; and at least one processing device configured for executing the instructions, wherein the instructions cause the at least one processing device to perform the operations of: determining a time duration of a video communication connection between a first user of a first user device and a second user of a second user device; analyzing video content transmitted between the first user device and the second user device; determining at least one gesture of at least one of the first user and the second user based on analyzing the video content; and generating a compatibility score of the first user and the second user based at least in part on the determined time duration and the at least one determined gesture.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: July 10, 2018
    Assignee: Krush Technologies, LLC
    Inventors: Matthew J. Farrell, John P. Nauseef, Christopher S. Wire, Brian T. Faust, Patrick M. Murray, Linsey Ann Free, Gary T. Riggins, John C. Nesbitt, Dustin L. Clinard
  • Patent number: 10019993
    Abstract: Methods, apparatus, and computer-readable media are described herein related to a user interface (UI) that can be implemented on a head-mountable device (HMD). The UI can include a voice-navigable UI. The voice-navigable UI can include a voice navigable menu that includes one or more menu items. The voice-navigable UI can also present a first visible menu that includes at least a portion of the voice navigable menu. In response to a first utterance comprising one of the one or more menu items, the voice-navigable UI can modify the first visible menu to display one or more commands associated with the first menu item. In response to a second utterance comprising a first command, the voice-navigable UI can invoke the first command. In some embodiments, the voice-navigable UI can display a second visible menu, where the first command can be displayed above other menu items in the second visible menu.
    Type: Grant
    Filed: July 6, 2017
    Date of Patent: July 10, 2018
    Assignee: Google LLC
    Inventors: Michael J. LeBeau, Clifford Ivar Nass
  • Patent number: 10019996
    Abstract: For orienting a microphone array to a user location, a processor detects a user location with a presence sensor that detects a user using electromagnetic signals. In addition, the processor orients a microphone array to the user location.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: July 10, 2018
    Assignee: LENOVO (Singapore) PTE. LTD.
    Inventors: Song Wang, John Weldon Nicholson, Ming Qian
  • Patent number: 10019991
    Abstract: Disclosed is an apparatus for speech recognition and automatic translation operated in a PC or a mobile device. The apparatus for speech recognition according to the present invention includes a display unit that displays a screen for selecting a domain as a unit for a speech recognition region previously sorted for speech recognition to a user; a user input unit that receives a selection of a domain from the user; and a communication unit that transmits the user selection information for the domain. According to the present invention, the apparatus for speech recognition using an intuitive and simple user interface is provided to a user to enable the user to easily select/correct a designation domain of a speech recognition system and improve accuracy and performance of speech recognition and automatic translation by the designated system for speech recognition.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: July 10, 2018
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Seung Hi Kim, Sang Hun Kim
  • Patent number: 10019485
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for populating a form using a search query. In one aspect, a method include actions of providing a form for display on a user device. Additional actions include, while a particular field of the form is selected, receiving a request to perform a search query, in response to receiving the request, receiving one or more query terms, obtaining a result of performing a search query that includes the one or more query terms, and automatically populating the particular field of the form with the result of the search query.
    Type: Grant
    Filed: August 14, 2015
    Date of Patent: July 10, 2018
    Assignee: Google LLC
    Inventors: Young Hoon Jung, Dong Hyun Kim
  • Patent number: 10013978
    Abstract: Optimization of sequence dependent operations in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. A prediction component can determine a thread based on the trigger keyword and the request that includes a first action, a second action subsequent to the first action, and a third action subsequent to the second action. A content selector component can select, based on the third action and the trigger keyword, a content item. An audio signal generator component can generate an output signal comprising the content item. An interface can transmit the output signal to cause a client computing device to drive a speaker to generate an acoustic wave corresponding to the output signal prior to occurrence of at least one of the first action and the second action.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: July 3, 2018
    Assignee: Google LLC
    Inventors: Gaurav Bhaya, Robert Stets
  • Patent number: 10013979
    Abstract: The present disclosure contemplates a variety of methods and systems for enabling users to automatically expand the set of commands a user can issue. An assistant device can receive a user instruction via microphone and determine a voice activatable command and device description. The assistant device can then identify that no adapter associated with the voice activatable command and device description is available. The user can be prompted to provide a second voice activatable command or a second device description which can then be used to identify an adapter. The assistant device can store the voice activatable command or the device description in association with the identified adapter.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: July 3, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10002527
    Abstract: Disclosed in the present invention are a remote control mobile terminal, a remote control system and a remote control method. A voice recognition module and a remote control module are arranged in the remote control mobile terminal; and the method includes: completing pairing between the remote control module and a remote controlled object; receiving a voice control instruction inputted by a user, obtaining a corresponding remote control instruction according to the voice control instruction and sending the remote control instruction to the remote control module via the voice recognition module; and sending the remote control instruction to the remote controlled object via the remote control module to control the remote controlled object.
    Type: Grant
    Filed: August 5, 2015
    Date of Patent: June 19, 2018
    Assignee: ZTE CORPORATION
    Inventor: Honghua Gao
  • Patent number: 10002130
    Abstract: A method includes converting a user's utterance to text; encapsulating the converted text in a rheme object; searching, for each of a plurality of topics, for keywords in the converted text; determining a relevancy metric for each of the plurality of topics based on such searching; selecting one or more topics based on determined relevancy metrics; comparing some or all of the converted text to names in one or more patient lists or databases; identifying a unique patient whose name is contained in the converted; attaching an indication of the identified patient to the rheme object; effecting an action based on the selected one or more topics and the attached patient indication; and saving the topic in a conversation history with a reference to the identified patient.
    Type: Grant
    Filed: May 15, 2014
    Date of Patent: June 19, 2018
    Assignee: Allscripts Software, LLC
    Inventors: Matthew David Dreselly Thomas, William Loftus, Harry Wepuri, Arif Ogan
  • Patent number: 9997158
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for handing off a user conversation between computer-implemented agents. One of the methods includes receiving, by a computer-implemented agent specific to a user device, a digital representation of speech encoding an utterance, determining, by the computer-implemented agent, that the utterance specifies a requirement to establish a communication with another computer-implemented agent, and establishing, by the computer-implemented agent, a communication between the other computer-implemented agent and the user device.
    Type: Grant
    Filed: March 21, 2017
    Date of Patent: June 12, 2018
    Assignee: Google LLC
    Inventors: Johnny Chen, Thomas L. Dean, Qiangfeng Peter Lau, Sudeep Gandhe, Gabriel Schine
  • Patent number: 9996168
    Abstract: A wearable device and a system to provide an input for a computing device are disclosed. The device comprises a sensing unit to deliver infrared signals to the facial region of a user and to receive transmitted or reflected signals therefrom, and a processing unit to determine the position or movement of the tongue of the user based on the received infrared signals. The processing unit is configured to provide an input to a computing device based on the determined position or movement of the tongue. The system further comprises a transmitter for wirelessly transmitting the input from the processing unit to the computing device.
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: June 12, 2018
    Assignee: Amerita Vishwa Vidyapeetham
    Inventors: K. A. Unnikrishnan Menon, Revathy Jayaram, Divya Pullarkatt, Maneesha Vinodini Ramesh
  • Patent number: 9996316
    Abstract: Devices, systems, and methods provide synchronization of multiple voice-controlled devices to establish priority of one of the devices to respond to an acoustic signal, preventing other devices from responding to a single user command. Each device is configured to mediate its response to a wakeword by, after detecting the wakeword in an audio input, generating a data packet and attempting to send it to the other devices over a communication channel that prevents data collision. One device will succeed in sending the packet, while the other devices cannot until they receive the first device's packet, indicating that the first device has priority. Additionally, the devices may process their audio inputs to determine a signal quality, the signal qualities are shared between all devices, and the device with the best signal quality assumes priority.
    Type: Grant
    Filed: September 28, 2015
    Date of Patent: June 12, 2018
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventor: Milos Jorgovanovic
  • Patent number: 9990916
    Abstract: Technology related to improving synthesis of foreign regional nouns using personalized and culturally correct phonetic transcription is described. The technology includes systems and methods for generating personalized speech by receiving an input, the input including textual data, identifying a regional noun in the textual data, and determining a user accent classification based on a context of the input. The method may further include determining a personalized phonetic transcription of the regional noun corresponding to the user accent classification and using a phonetic inventory stored in a database and outputting the personalized phonetic transcription.
    Type: Grant
    Filed: April 26, 2016
    Date of Patent: June 5, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: Jean-Francois Vanreusel, Vikas Kumar, Nandan Jha
  • Patent number: 9972343
    Abstract: Various embodiments describe a multi-step process for determining whether the keyword has been spoken. The first tier uses an onboard digital signal processor (DSP) to process converted audio signals. If the DSP analysis cannot confirm the keyword due to noise in the signal, a second tier of processing may use an applications processor (AP) and a more stringent audio filter to try to verify the keyword. If the AP analysis cannot confirm the keyword, a third tier of processing may use server side processor and an even more stringent audio filter to try to verify the keyword. Certain signal to noise ratios (SNRs) of the detected and converted audio signal are used to decide when and if to try the second and third tier of processing.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: May 15, 2018
    Assignee: Republic Wireless, Inc.
    Inventors: Dean Thorson, Jared Kashimba, Matthew Newton, Justin Milam
  • Patent number: 9972320
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for hotword detection on multiple devices are disclosed. In one aspect, a method includes the actions of receiving audio data that corresponds to an utterance. The actions further include determining that the utterance likely includes a particular, predefined hotword. The actions further include transmitting (i) data indicating that the computing device likely received the particular, predefined hotword, (ii) data identifying the computing device, and (iii) data identifying a group of nearby computing devices that includes the computing device. The actions further include receiving an instruction to commence speech recognition processing on the audio data. The actions further include in response to receiving the instruction to commence speech recognition processing on the audio data, processing at least a portion of the audio data using an automated speech recognizer on the computing device.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: May 15, 2018
    Assignee: Google LLC
    Inventors: Diego Melendo Casado, Alexander H. Gruenstein, Jakob Nicolaus Foerster
  • Patent number: 9971979
    Abstract: There is provided systems and methods for generating suggestions integrated into business applications. Parameters for generating suggestions relating to the plurality of business applications are stored in a dynamic database. At least one suggestion relating to a business currently being used by a user is generated, the at least one suggestion generated using the parameters stored in the dynamic database. The at least one suggestion is integrated into the user interface of the given business application. Input of the user into the given business application is monitored, including input reflecting whether the at least one suggestion has been actioned by the user; and the parameters stored in the dynamic database are updated based on the monitored input so that generation of future suggestions may be refined.
    Type: Grant
    Filed: March 4, 2015
    Date of Patent: May 15, 2018
    Assignee: ROSEBOARD INC.
    Inventor: Malek Hakim
  • Patent number: 9973641
    Abstract: A multi-function printer comprises: a printer engine unit having a function of switching the mode of the multi-function printer from a print mode to a power-saving mode based on predetermined conditions; a first to a third microphone arranged at intervals on the same plane; and a control section configured to determine the position of a sound source according to the difference between the moments sound sources are captured by the first to the third microphone and switch the mode of the multi-function printer from the power-saving mode to the print mode.
    Type: Grant
    Filed: October 22, 2015
    Date of Patent: May 15, 2018
    Assignees: KABUSHIKI KAISHA TOSHIBA, TOSHIBA TEC KABUSHIKI KAISHA
    Inventor: Nobuyuki Kato
  • Patent number: 9966079
    Abstract: For directing voice input based on eye tracking, a method is disclosed that includes receiving, by use of a processor, an audio signal, the audio signal comprising voice input, selecting a location from the group consisting of a computing device and an application being displayed on a screen of the computing device, the location being detected where a user's eyes are directed, and directing the voice input to the selected location.
    Type: Grant
    Filed: March 24, 2014
    Date of Patent: May 8, 2018
    Assignee: Lenovo (Singapore) PTE. LTD.
    Inventors: Russell Speight VanBlon, Manisha Bijjaragi, Jason Grimme, Spencer Michael Guy, Kyle Jared McDaniel
  • Patent number: 9967631
    Abstract: Aspects relate to computer implemented methods, systems, and processes to automatically enable audio-based display indicia during playback of a media content including receiving, by a processor, one or more user preference audio profiles, the user preference audio profiles defining at least one audio characteristic and an associated criteria, playing the media content having audio-based display indicia, monitoring, with one or more detectors, the at least one audio characteristic defined in the user preference audio profiles, and when the at least one audio characteristic meets the associated criteria, enabling the audio-based display indicia in the media content.
    Type: Grant
    Filed: November 11, 2015
    Date of Patent: May 8, 2018
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Richard E. D'Amelio, Heather L. Duschl, Kassidy B. Martz, Ha H. Nguyen, Luke M. Oppenhuis
  • Patent number: 9959129
    Abstract: Techniques are described for headlessly completing a task of an application in the background of a digital personal assistant. For example, a method can include receiving a voice input via a microphone. Natural language processing can be performed using the voice input to determine a user voice command. The user voice command can include a request to perform a task of the application. The application can be caused to execute the task as a background process without a user interface of the application appearing. A user interface of the digital personal assistant can provide a response to the user, based on a received state associated with the task, so that the response comes from within a context of the user interface of the digital personal assistant without surfacing the user interface of the application.
    Type: Grant
    Filed: January 9, 2015
    Date of Patent: May 1, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Vishwac Sena Kannan, Aleksandar Uzelac, Daniel J. Hwang, Robert L. Chambers, Thomas Soemo, Adina Magdalena Trufinescu, Khuram Shahid, Ali Emami
  • Patent number: 9953639
    Abstract: Disclosed are a voice recognition system and a construction method for the voice recognition system. By way of layering the system, a general semantic recognition operation for the system is separated from a specific semantic recognition operation for an application program; and by way of classifying the application programs and abstracting out a common performance function, the system can find the application program matching the voice content semantics very efficiently and a third-party program is easily added into the existing voice recognition system. The present invention maps the performance function to a regular expression with semantic variables, so that the system can recognize more semantic expression manners with optimization of the semantic recognition. Therefore, the system can show more humanized characteristics.
    Type: Grant
    Filed: June 26, 2014
    Date of Patent: April 24, 2018
    Inventor: Hua Xu
  • Patent number: 9953088
    Abstract: A user request is received from a mobile client device, where the user request includes at least a speech input and seeks an informational answer or performance of a task. A failure to provide a satisfactory response to the user request is detected. In response to detection of the failure, information relevant to the user request is crowd-sourced by querying one or more crowd sourcing information sources. One or more answers are received from the crowd sourcing information sources, and the response to the user request is generated based on at least one of the one or more answers received from the one or more crowd sourcing information sources.
    Type: Grant
    Filed: March 7, 2016
    Date of Patent: April 24, 2018
    Assignee: Apple Inc.
    Inventors: Thomas R. Gruber, Adam John Cheyer, Donald W. Pitschel
  • Patent number: 9953662
    Abstract: A low-power sound wave reception method in a computer which includes a microphone, a memory which stores at least one reference pattern, and a computer processor is provided. The low-power sound wave reception method includes: when a sound wave signal having an intensity greater than or equal to a threshold value is detected by the microphone, comparing the sound wave signal and the at least one reference pattern stored in the memory; and when there is a reference pattern matching the sound wave signal, turning on the computer processor, and deactivating the reference pattern matching the sound wave signal (excluding the deactivated reference pattern from the comparing step).
    Type: Grant
    Filed: November 20, 2014
    Date of Patent: April 24, 2018
    Assignee: SOUNDLLY INC.
    Inventor: Tae Hyun Kim
  • Patent number: 9954565
    Abstract: A method and a first node (110) for managing processing of an audio stream as well as a method and a second node (120) for enabling management, by a first node (110), of processing of an audio stream and corresponding computer programs and computer program products are disclosed. The audio stream is receivable from the second node (120). The first node (110) sends (204, 205), to the second node (120), information relating to at least one preference concerning acoustic characteristics of the audio stream. The second node (120) processes (208) the audio stream in response to the information relating to the at least one preference concerning the acoustic characteristics. The second node (120) transmits (209) the audio stream to the first node (110).
    Type: Grant
    Filed: June 25, 2013
    Date of Patent: April 24, 2018
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Frederic Gabin, Anders K. Eriksson, Tomas Frankkila
  • Patent number: 9939980
    Abstract: A method of providing a task assistant to provide an interface to an application is described. The method includes, in one embodiment, identifying a user and determining whether there is a push notification to be shown to the user. When there is a push notification to be shown to the user, the task assistant displaying the push notification to the user, such that when the user acknowledges the push notification, the user is directed to a push destination. When there is no push notification, receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.
    Type: Grant
    Filed: March 6, 2013
    Date of Patent: April 10, 2018
    Assignee: Nuance Communications, Inc.
    Inventors: David Andrew Mauro, Richard Lajoie, Elizabeth Ann Dykstra-Erickson, Aaron Kneiss, Aimee Piercy
  • Patent number: 9942692
    Abstract: A computing device may execute a device connection application on a processor of the computing device to provide operations including establishing an ad-hoc data connection between the computing device and a machine-to-machine device, the computing device configured to set up the machine-to-machine device to interact with a network-based service using a user account of the network-based service; receiving device information from the machine-to-machine device over the established ad-hoc data connection; and connecting the machine-to-machine device to the network-based service based on the device information received from the machine-to-machine device and according to authentication of the computing device as being associated with the user account. The computing device may further be configured to authenticate and authorize a user to configure the machine-to-machine device to join the network and network-based service.
    Type: Grant
    Filed: July 29, 2013
    Date of Patent: April 10, 2018
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: David C. Robbins, Paul T. Schultz, Mark J. Hahn
  • Patent number: 9934781
    Abstract: An electronic device, a method, and a chip set are provided. The electronic device includes a memory configured to store at least one of audio feature data of audio data and speech recognition data obtained by speech recognition of audio data; and a control module connected to the memory, wherein the control module is configured to update a voice command that is set to execute a function through voice, the function being selected based on at least one of the audio feature data, the speech recognition data, and function execution data executed in relation to the audio data.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: April 3, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Chakladar Subhojit, Sang Hoon Lee, Ji Min Lee
  • Patent number: 9934780
    Abstract: Sound related vehicle information representing one or more sounds may be received in the processor. The sound related vehicle information may or may not include an audio signal. Spoken dialog of a spoken dialog system associated with the vehicle based on the sound related vehicle information may be modified. The said modification comprises of modifying pitch, pace and timing of audio prompts associated with the said spoken dialog based on the sound related vehicle information.
    Type: Grant
    Filed: January 17, 2012
    Date of Patent: April 3, 2018
    Assignee: GM Global Technology Operations LLC
    Inventors: Eli Tzirkel-Hancock, Omer Tsimhoni
  • Patent number: 9924238
    Abstract: A method for allowing/supporting the usage of a computerized source device within a simulated virtual environment produced by a head mounted device associated with at least one processor. The method includes presenting at least one icon of at least one identified available source device within the virtual reality environment simulated by the head mounted device, enabling the user to select at least one icon using an applicable GUI interface at the head mounted device and projecting a 3D object which has at least one surface which displays the mirrored 2D image of the source device within the simulated virtual reality environment.
    Type: Grant
    Filed: March 21, 2017
    Date of Patent: March 20, 2018
    Assignee: SCREENOVATE TECHNOLOGIES LTD.
    Inventors: Joshua Glazer, Sagiv Philipp, Amit Perelstein
  • Patent number: 9922098
    Abstract: A computing device receives a trigger to surface relevant content. The device also obtains a variety of different types of cross-source contextual information. Items of content are identified and relevancy weights are obtained based on the contextual information. A relevancy is calculated, based on the relevancy weights, for each item of content. The items of content are surfaced.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: March 20, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matthew Vogel, Julie C. Seto, Darron Stepanich, Erez Kikin-Gil
  • Patent number: 9922642
    Abstract: An electronic device with one or more processors and memory includes a procedure for training a digital assistant. In some embodiments, the device detects an impasse in a dialog between the digital assistant and a user including a speech input. During a learning session, the device utilizes a subsequent clarification input from the user to adjust intent inference or task execution associated with the speech input to produce a satisfactory response. In some embodiments, the device identifies a pattern of success or failure associated with an aspect previously used to complete a task and generates a hypothesis regarding a parameter used in speech recognition, intent inference or task execution as a cause for the pattern. Then, the device tests the hypothesis by altering the parameter for a subsequent completion of the task and adopts or rejects the hypothesis based on feedback information collected from the subsequent completion.
    Type: Grant
    Filed: March 14, 2014
    Date of Patent: March 20, 2018
    Assignee: Apple Inc.
    Inventors: Donald W. Pitschel, Adam J. Cheyer, Christopher D. Brigham, Thomas R. Gruber
  • Patent number: 9924358
    Abstract: A method and apparatus for authenticating a wireless connection between a first device and a second device. In a first aspect, the first device generates a changing passkey code and converts the passkey code to an audio file that is played through a speaker of the first device as an audible signal. A user hears the audible signal and enters the passkey code into a keyboard of the second device. The second device sends the entered code to the first device for authentication. In a second aspect, the first device generates a passkey code and displays the code on a screen. A user speaks the code aloud to a microphone on the second device. The second device converts the speech into text and then sends the converted speech to the first device for authentication. If the codes of the first or second aspect match, the wireless connection is authenticated.
    Type: Grant
    Filed: April 2, 2016
    Date of Patent: March 20, 2018
    Assignee: Intel Corporation
    Inventors: Raz Weizman, Liraz Goldenthal, Alex Itkin
  • Patent number: 9916845
    Abstract: This method for determining alcohol use comprises the steps of: detecting an effective frame in an input audio signal; detecting a difference in signal within the original signal of the effective frame; performing a fast Fourier conversion on the difference signal to be transformed into a frequency domain; detecting high-frequency components within the difference signal subjected to the fast Fourier transform; and determining the state of alcohol use on the basis of a gradient difference between the high-frequency components. Accordingly, the present invention can identify the state and extent of alcohol use by a driver or an operator from a long distance and thus can prevent accidents caused by driving or operating vehicles and machines under the influence of alcohol.
    Type: Grant
    Filed: April 2, 2014
    Date of Patent: March 13, 2018
    Assignee: FOUNDATION OF SOONGSIL UNIVERSITY—INDUSTRY COOPERATION
    Inventors: Myung Jin Bae, Sang Gil Lee, Seong Geon Bae
  • Patent number: 9914057
    Abstract: Techniques for providing an immersive storytelling experience using a plurality of storytelling devices. Each of the storytelling devices may be configured to perform one or more actions based on a current context of a story and in response to a stimulus event. The actions include at least one of an auditory and a visual effect. Embodiments also provide a controller device configured to manage a playback of the story, by adjusting the stimulus event and the effect of each of the plurality of storytelling devices, based on the current context of the story, thereby creating an interactive and immersive storytelling experience.
    Type: Grant
    Filed: June 30, 2017
    Date of Patent: March 13, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Eric Wilson Muhlheim, Eric Charles Haseltine, Joseph O'Brien Garlington, Theodore Wei-Yun Leung, Gabriel Sebastian Schlumberger