Speech Controlled System Patents (Class 704/275)
  • Patent number: 10021344
    Abstract: Embodiments disclosed herein may be directed to a video communication server. In some embodiments, the video communication server includes: at least one memory including instructions; and at least one processing device configured for executing the instructions, wherein the instructions cause the at least one processing device to perform the operations of: determining a time duration of a video communication connection between a first user of a first user device and a second user of a second user device; analyzing video content transmitted between the first user device and the second user device; determining at least one gesture of at least one of the first user and the second user based on analyzing the video content; and generating a compatibility score of the first user and the second user based at least in part on the determined time duration and the at least one determined gesture.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: July 10, 2018
    Assignee: Krush Technologies, LLC
    Inventors: Matthew J. Farrell, John P. Nauseef, Christopher S. Wire, Brian T. Faust, Patrick M. Murray, Linsey Ann Free, Gary T. Riggins, John C. Nesbitt, Dustin L. Clinard
  • Patent number: 10019485
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for populating a form using a search query. In one aspect, a method include actions of providing a form for display on a user device. Additional actions include, while a particular field of the form is selected, receiving a request to perform a search query, in response to receiving the request, receiving one or more query terms, obtaining a result of performing a search query that includes the one or more query terms, and automatically populating the particular field of the form with the result of the search query.
    Type: Grant
    Filed: August 14, 2015
    Date of Patent: July 10, 2018
    Assignee: Google LLC
    Inventors: Young Hoon Jung, Dong Hyun Kim
  • Patent number: 10019996
    Abstract: For orienting a microphone array to a user location, a processor detects a user location with a presence sensor that detects a user using electromagnetic signals. In addition, the processor orients a microphone array to the user location.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: July 10, 2018
    Assignee: LENOVO (Singapore) PTE. LTD.
    Inventors: Song Wang, John Weldon Nicholson, Ming Qian
  • Patent number: 10019993
    Abstract: Methods, apparatus, and computer-readable media are described herein related to a user interface (UI) that can be implemented on a head-mountable device (HMD). The UI can include a voice-navigable UI. The voice-navigable UI can include a voice navigable menu that includes one or more menu items. The voice-navigable UI can also present a first visible menu that includes at least a portion of the voice navigable menu. In response to a first utterance comprising one of the one or more menu items, the voice-navigable UI can modify the first visible menu to display one or more commands associated with the first menu item. In response to a second utterance comprising a first command, the voice-navigable UI can invoke the first command. In some embodiments, the voice-navigable UI can display a second visible menu, where the first command can be displayed above other menu items in the second visible menu.
    Type: Grant
    Filed: July 6, 2017
    Date of Patent: July 10, 2018
    Assignee: Google LLC
    Inventors: Michael J. LeBeau, Clifford Ivar Nass
  • Patent number: 10019991
    Abstract: Disclosed is an apparatus for speech recognition and automatic translation operated in a PC or a mobile device. The apparatus for speech recognition according to the present invention includes a display unit that displays a screen for selecting a domain as a unit for a speech recognition region previously sorted for speech recognition to a user; a user input unit that receives a selection of a domain from the user; and a communication unit that transmits the user selection information for the domain. According to the present invention, the apparatus for speech recognition using an intuitive and simple user interface is provided to a user to enable the user to easily select/correct a designation domain of a speech recognition system and improve accuracy and performance of speech recognition and automatic translation by the designated system for speech recognition.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: July 10, 2018
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Seung Hi Kim, Sang Hun Kim
  • Patent number: 10013978
    Abstract: Optimization of sequence dependent operations in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. A prediction component can determine a thread based on the trigger keyword and the request that includes a first action, a second action subsequent to the first action, and a third action subsequent to the second action. A content selector component can select, based on the third action and the trigger keyword, a content item. An audio signal generator component can generate an output signal comprising the content item. An interface can transmit the output signal to cause a client computing device to drive a speaker to generate an acoustic wave corresponding to the output signal prior to occurrence of at least one of the first action and the second action.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: July 3, 2018
    Assignee: Google LLC
    Inventors: Gaurav Bhaya, Robert Stets
  • Patent number: 10013979
    Abstract: The present disclosure contemplates a variety of methods and systems for enabling users to automatically expand the set of commands a user can issue. An assistant device can receive a user instruction via microphone and determine a voice activatable command and device description. The assistant device can then identify that no adapter associated with the voice activatable command and device description is available. The user can be prompted to provide a second voice activatable command or a second device description which can then be used to identify an adapter. The assistant device can store the voice activatable command or the device description in association with the identified adapter.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: July 3, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10002130
    Abstract: A method includes converting a user's utterance to text; encapsulating the converted text in a rheme object; searching, for each of a plurality of topics, for keywords in the converted text; determining a relevancy metric for each of the plurality of topics based on such searching; selecting one or more topics based on determined relevancy metrics; comparing some or all of the converted text to names in one or more patient lists or databases; identifying a unique patient whose name is contained in the converted; attaching an indication of the identified patient to the rheme object; effecting an action based on the selected one or more topics and the attached patient indication; and saving the topic in a conversation history with a reference to the identified patient.
    Type: Grant
    Filed: May 15, 2014
    Date of Patent: June 19, 2018
    Assignee: Allscripts Software, LLC
    Inventors: Matthew David Dreselly Thomas, William Loftus, Harry Wepuri, Arif Ogan
  • Patent number: 10002527
    Abstract: Disclosed in the present invention are a remote control mobile terminal, a remote control system and a remote control method. A voice recognition module and a remote control module are arranged in the remote control mobile terminal; and the method includes: completing pairing between the remote control module and a remote controlled object; receiving a voice control instruction inputted by a user, obtaining a corresponding remote control instruction according to the voice control instruction and sending the remote control instruction to the remote control module via the voice recognition module; and sending the remote control instruction to the remote controlled object via the remote control module to control the remote controlled object.
    Type: Grant
    Filed: August 5, 2015
    Date of Patent: June 19, 2018
    Assignee: ZTE CORPORATION
    Inventor: Honghua Gao
  • Patent number: 9997158
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for handing off a user conversation between computer-implemented agents. One of the methods includes receiving, by a computer-implemented agent specific to a user device, a digital representation of speech encoding an utterance, determining, by the computer-implemented agent, that the utterance specifies a requirement to establish a communication with another computer-implemented agent, and establishing, by the computer-implemented agent, a communication between the other computer-implemented agent and the user device.
    Type: Grant
    Filed: March 21, 2017
    Date of Patent: June 12, 2018
    Assignee: Google LLC
    Inventors: Johnny Chen, Thomas L. Dean, Qiangfeng Peter Lau, Sudeep Gandhe, Gabriel Schine
  • Patent number: 9996316
    Abstract: Devices, systems, and methods provide synchronization of multiple voice-controlled devices to establish priority of one of the devices to respond to an acoustic signal, preventing other devices from responding to a single user command. Each device is configured to mediate its response to a wakeword by, after detecting the wakeword in an audio input, generating a data packet and attempting to send it to the other devices over a communication channel that prevents data collision. One device will succeed in sending the packet, while the other devices cannot until they receive the first device's packet, indicating that the first device has priority. Additionally, the devices may process their audio inputs to determine a signal quality, the signal qualities are shared between all devices, and the device with the best signal quality assumes priority.
    Type: Grant
    Filed: September 28, 2015
    Date of Patent: June 12, 2018
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventor: Milos Jorgovanovic
  • Patent number: 9996168
    Abstract: A wearable device and a system to provide an input for a computing device are disclosed. The device comprises a sensing unit to deliver infrared signals to the facial region of a user and to receive transmitted or reflected signals therefrom, and a processing unit to determine the position or movement of the tongue of the user based on the received infrared signals. The processing unit is configured to provide an input to a computing device based on the determined position or movement of the tongue. The system further comprises a transmitter for wirelessly transmitting the input from the processing unit to the computing device.
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: June 12, 2018
    Assignee: Amerita Vishwa Vidyapeetham
    Inventors: K. A. Unnikrishnan Menon, Revathy Jayaram, Divya Pullarkatt, Maneesha Vinodini Ramesh
  • Patent number: 9990916
    Abstract: Technology related to improving synthesis of foreign regional nouns using personalized and culturally correct phonetic transcription is described. The technology includes systems and methods for generating personalized speech by receiving an input, the input including textual data, identifying a regional noun in the textual data, and determining a user accent classification based on a context of the input. The method may further include determining a personalized phonetic transcription of the regional noun corresponding to the user accent classification and using a phonetic inventory stored in a database and outputting the personalized phonetic transcription.
    Type: Grant
    Filed: April 26, 2016
    Date of Patent: June 5, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: Jean-Francois Vanreusel, Vikas Kumar, Nandan Jha
  • Patent number: 9972320
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for hotword detection on multiple devices are disclosed. In one aspect, a method includes the actions of receiving audio data that corresponds to an utterance. The actions further include determining that the utterance likely includes a particular, predefined hotword. The actions further include transmitting (i) data indicating that the computing device likely received the particular, predefined hotword, (ii) data identifying the computing device, and (iii) data identifying a group of nearby computing devices that includes the computing device. The actions further include receiving an instruction to commence speech recognition processing on the audio data. The actions further include in response to receiving the instruction to commence speech recognition processing on the audio data, processing at least a portion of the audio data using an automated speech recognizer on the computing device.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: May 15, 2018
    Assignee: Google LLC
    Inventors: Diego Melendo Casado, Alexander H. Gruenstein, Jakob Nicolaus Foerster
  • Patent number: 9972343
    Abstract: Various embodiments describe a multi-step process for determining whether the keyword has been spoken. The first tier uses an onboard digital signal processor (DSP) to process converted audio signals. If the DSP analysis cannot confirm the keyword due to noise in the signal, a second tier of processing may use an applications processor (AP) and a more stringent audio filter to try to verify the keyword. If the AP analysis cannot confirm the keyword, a third tier of processing may use server side processor and an even more stringent audio filter to try to verify the keyword. Certain signal to noise ratios (SNRs) of the detected and converted audio signal are used to decide when and if to try the second and third tier of processing.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: May 15, 2018
    Assignee: Republic Wireless, Inc.
    Inventors: Dean Thorson, Jared Kashimba, Matthew Newton, Justin Milam
  • Patent number: 9973641
    Abstract: A multi-function printer comprises: a printer engine unit having a function of switching the mode of the multi-function printer from a print mode to a power-saving mode based on predetermined conditions; a first to a third microphone arranged at intervals on the same plane; and a control section configured to determine the position of a sound source according to the difference between the moments sound sources are captured by the first to the third microphone and switch the mode of the multi-function printer from the power-saving mode to the print mode.
    Type: Grant
    Filed: October 22, 2015
    Date of Patent: May 15, 2018
    Assignees: KABUSHIKI KAISHA TOSHIBA, TOSHIBA TEC KABUSHIKI KAISHA
    Inventor: Nobuyuki Kato
  • Patent number: 9971979
    Abstract: There is provided systems and methods for generating suggestions integrated into business applications. Parameters for generating suggestions relating to the plurality of business applications are stored in a dynamic database. At least one suggestion relating to a business currently being used by a user is generated, the at least one suggestion generated using the parameters stored in the dynamic database. The at least one suggestion is integrated into the user interface of the given business application. Input of the user into the given business application is monitored, including input reflecting whether the at least one suggestion has been actioned by the user; and the parameters stored in the dynamic database are updated based on the monitored input so that generation of future suggestions may be refined.
    Type: Grant
    Filed: March 4, 2015
    Date of Patent: May 15, 2018
    Assignee: ROSEBOARD INC.
    Inventor: Malek Hakim
  • Patent number: 9967631
    Abstract: Aspects relate to computer implemented methods, systems, and processes to automatically enable audio-based display indicia during playback of a media content including receiving, by a processor, one or more user preference audio profiles, the user preference audio profiles defining at least one audio characteristic and an associated criteria, playing the media content having audio-based display indicia, monitoring, with one or more detectors, the at least one audio characteristic defined in the user preference audio profiles, and when the at least one audio characteristic meets the associated criteria, enabling the audio-based display indicia in the media content.
    Type: Grant
    Filed: November 11, 2015
    Date of Patent: May 8, 2018
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Richard E. D'Amelio, Heather L. Duschl, Kassidy B. Martz, Ha H. Nguyen, Luke M. Oppenhuis
  • Patent number: 9966079
    Abstract: For directing voice input based on eye tracking, a method is disclosed that includes receiving, by use of a processor, an audio signal, the audio signal comprising voice input, selecting a location from the group consisting of a computing device and an application being displayed on a screen of the computing device, the location being detected where a user's eyes are directed, and directing the voice input to the selected location.
    Type: Grant
    Filed: March 24, 2014
    Date of Patent: May 8, 2018
    Assignee: Lenovo (Singapore) PTE. LTD.
    Inventors: Russell Speight VanBlon, Manisha Bijjaragi, Jason Grimme, Spencer Michael Guy, Kyle Jared McDaniel
  • Patent number: 9959129
    Abstract: Techniques are described for headlessly completing a task of an application in the background of a digital personal assistant. For example, a method can include receiving a voice input via a microphone. Natural language processing can be performed using the voice input to determine a user voice command. The user voice command can include a request to perform a task of the application. The application can be caused to execute the task as a background process without a user interface of the application appearing. A user interface of the digital personal assistant can provide a response to the user, based on a received state associated with the task, so that the response comes from within a context of the user interface of the digital personal assistant without surfacing the user interface of the application.
    Type: Grant
    Filed: January 9, 2015
    Date of Patent: May 1, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Vishwac Sena Kannan, Aleksandar Uzelac, Daniel J. Hwang, Robert L. Chambers, Thomas Soemo, Adina Magdalena Trufinescu, Khuram Shahid, Ali Emami
  • Patent number: 9954565
    Abstract: A method and a first node (110) for managing processing of an audio stream as well as a method and a second node (120) for enabling management, by a first node (110), of processing of an audio stream and corresponding computer programs and computer program products are disclosed. The audio stream is receivable from the second node (120). The first node (110) sends (204, 205), to the second node (120), information relating to at least one preference concerning acoustic characteristics of the audio stream. The second node (120) processes (208) the audio stream in response to the information relating to the at least one preference concerning the acoustic characteristics. The second node (120) transmits (209) the audio stream to the first node (110).
    Type: Grant
    Filed: June 25, 2013
    Date of Patent: April 24, 2018
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Frederic Gabin, Anders K. Eriksson, Tomas Frankkila
  • Patent number: 9953662
    Abstract: A low-power sound wave reception method in a computer which includes a microphone, a memory which stores at least one reference pattern, and a computer processor is provided. The low-power sound wave reception method includes: when a sound wave signal having an intensity greater than or equal to a threshold value is detected by the microphone, comparing the sound wave signal and the at least one reference pattern stored in the memory; and when there is a reference pattern matching the sound wave signal, turning on the computer processor, and deactivating the reference pattern matching the sound wave signal (excluding the deactivated reference pattern from the comparing step).
    Type: Grant
    Filed: November 20, 2014
    Date of Patent: April 24, 2018
    Assignee: SOUNDLLY INC.
    Inventor: Tae Hyun Kim
  • Patent number: 9953639
    Abstract: Disclosed are a voice recognition system and a construction method for the voice recognition system. By way of layering the system, a general semantic recognition operation for the system is separated from a specific semantic recognition operation for an application program; and by way of classifying the application programs and abstracting out a common performance function, the system can find the application program matching the voice content semantics very efficiently and a third-party program is easily added into the existing voice recognition system. The present invention maps the performance function to a regular expression with semantic variables, so that the system can recognize more semantic expression manners with optimization of the semantic recognition. Therefore, the system can show more humanized characteristics.
    Type: Grant
    Filed: June 26, 2014
    Date of Patent: April 24, 2018
    Inventor: Hua Xu
  • Patent number: 9953088
    Abstract: A user request is received from a mobile client device, where the user request includes at least a speech input and seeks an informational answer or performance of a task. A failure to provide a satisfactory response to the user request is detected. In response to detection of the failure, information relevant to the user request is crowd-sourced by querying one or more crowd sourcing information sources. One or more answers are received from the crowd sourcing information sources, and the response to the user request is generated based on at least one of the one or more answers received from the one or more crowd sourcing information sources.
    Type: Grant
    Filed: March 7, 2016
    Date of Patent: April 24, 2018
    Assignee: Apple Inc.
    Inventors: Thomas R. Gruber, Adam John Cheyer, Donald W. Pitschel
  • Patent number: 9939980
    Abstract: A method of providing a task assistant to provide an interface to an application is described. The method includes, in one embodiment, identifying a user and determining whether there is a push notification to be shown to the user. When there is a push notification to be shown to the user, the task assistant displaying the push notification to the user, such that when the user acknowledges the push notification, the user is directed to a push destination. When there is no push notification, receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.
    Type: Grant
    Filed: March 6, 2013
    Date of Patent: April 10, 2018
    Assignee: Nuance Communications, Inc.
    Inventors: David Andrew Mauro, Richard Lajoie, Elizabeth Ann Dykstra-Erickson, Aaron Kneiss, Aimee Piercy
  • Patent number: 9942692
    Abstract: A computing device may execute a device connection application on a processor of the computing device to provide operations including establishing an ad-hoc data connection between the computing device and a machine-to-machine device, the computing device configured to set up the machine-to-machine device to interact with a network-based service using a user account of the network-based service; receiving device information from the machine-to-machine device over the established ad-hoc data connection; and connecting the machine-to-machine device to the network-based service based on the device information received from the machine-to-machine device and according to authentication of the computing device as being associated with the user account. The computing device may further be configured to authenticate and authorize a user to configure the machine-to-machine device to join the network and network-based service.
    Type: Grant
    Filed: July 29, 2013
    Date of Patent: April 10, 2018
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: David C. Robbins, Paul T. Schultz, Mark J. Hahn
  • Patent number: 9934781
    Abstract: An electronic device, a method, and a chip set are provided. The electronic device includes a memory configured to store at least one of audio feature data of audio data and speech recognition data obtained by speech recognition of audio data; and a control module connected to the memory, wherein the control module is configured to update a voice command that is set to execute a function through voice, the function being selected based on at least one of the audio feature data, the speech recognition data, and function execution data executed in relation to the audio data.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: April 3, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Chakladar Subhojit, Sang Hoon Lee, Ji Min Lee
  • Patent number: 9934780
    Abstract: Sound related vehicle information representing one or more sounds may be received in the processor. The sound related vehicle information may or may not include an audio signal. Spoken dialog of a spoken dialog system associated with the vehicle based on the sound related vehicle information may be modified. The said modification comprises of modifying pitch, pace and timing of audio prompts associated with the said spoken dialog based on the sound related vehicle information.
    Type: Grant
    Filed: January 17, 2012
    Date of Patent: April 3, 2018
    Assignee: GM Global Technology Operations LLC
    Inventors: Eli Tzirkel-Hancock, Omer Tsimhoni
  • Patent number: 9922642
    Abstract: An electronic device with one or more processors and memory includes a procedure for training a digital assistant. In some embodiments, the device detects an impasse in a dialog between the digital assistant and a user including a speech input. During a learning session, the device utilizes a subsequent clarification input from the user to adjust intent inference or task execution associated with the speech input to produce a satisfactory response. In some embodiments, the device identifies a pattern of success or failure associated with an aspect previously used to complete a task and generates a hypothesis regarding a parameter used in speech recognition, intent inference or task execution as a cause for the pattern. Then, the device tests the hypothesis by altering the parameter for a subsequent completion of the task and adopts or rejects the hypothesis based on feedback information collected from the subsequent completion.
    Type: Grant
    Filed: March 14, 2014
    Date of Patent: March 20, 2018
    Assignee: Apple Inc.
    Inventors: Donald W. Pitschel, Adam J. Cheyer, Christopher D. Brigham, Thomas R. Gruber
  • Patent number: 9924238
    Abstract: A method for allowing/supporting the usage of a computerized source device within a simulated virtual environment produced by a head mounted device associated with at least one processor. The method includes presenting at least one icon of at least one identified available source device within the virtual reality environment simulated by the head mounted device, enabling the user to select at least one icon using an applicable GUI interface at the head mounted device and projecting a 3D object which has at least one surface which displays the mirrored 2D image of the source device within the simulated virtual reality environment.
    Type: Grant
    Filed: March 21, 2017
    Date of Patent: March 20, 2018
    Assignee: SCREENOVATE TECHNOLOGIES LTD.
    Inventors: Joshua Glazer, Sagiv Philipp, Amit Perelstein
  • Patent number: 9924358
    Abstract: A method and apparatus for authenticating a wireless connection between a first device and a second device. In a first aspect, the first device generates a changing passkey code and converts the passkey code to an audio file that is played through a speaker of the first device as an audible signal. A user hears the audible signal and enters the passkey code into a keyboard of the second device. The second device sends the entered code to the first device for authentication. In a second aspect, the first device generates a passkey code and displays the code on a screen. A user speaks the code aloud to a microphone on the second device. The second device converts the speech into text and then sends the converted speech to the first device for authentication. If the codes of the first or second aspect match, the wireless connection is authenticated.
    Type: Grant
    Filed: April 2, 2016
    Date of Patent: March 20, 2018
    Assignee: Intel Corporation
    Inventors: Raz Weizman, Liraz Goldenthal, Alex Itkin
  • Patent number: 9922098
    Abstract: A computing device receives a trigger to surface relevant content. The device also obtains a variety of different types of cross-source contextual information. Items of content are identified and relevancy weights are obtained based on the contextual information. A relevancy is calculated, based on the relevancy weights, for each item of content. The items of content are surfaced.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: March 20, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matthew Vogel, Julie C. Seto, Darron Stepanich, Erez Kikin-Gil
  • Patent number: 9914057
    Abstract: Techniques for providing an immersive storytelling experience using a plurality of storytelling devices. Each of the storytelling devices may be configured to perform one or more actions based on a current context of a story and in response to a stimulus event. The actions include at least one of an auditory and a visual effect. Embodiments also provide a controller device configured to manage a playback of the story, by adjusting the stimulus event and the effect of each of the plurality of storytelling devices, based on the current context of the story, thereby creating an interactive and immersive storytelling experience.
    Type: Grant
    Filed: June 30, 2017
    Date of Patent: March 13, 2018
    Assignee: Disney Enterprises, Inc.
    Inventors: Eric Wilson Muhlheim, Eric Charles Haseltine, Joseph O'Brien Garlington, Theodore Wei-Yun Leung, Gabriel Sebastian Schlumberger
  • Patent number: 9916845
    Abstract: This method for determining alcohol use comprises the steps of: detecting an effective frame in an input audio signal; detecting a difference in signal within the original signal of the effective frame; performing a fast Fourier conversion on the difference signal to be transformed into a frequency domain; detecting high-frequency components within the difference signal subjected to the fast Fourier transform; and determining the state of alcohol use on the basis of a gradient difference between the high-frequency components. Accordingly, the present invention can identify the state and extent of alcohol use by a driver or an operator from a long distance and thus can prevent accidents caused by driving or operating vehicles and machines under the influence of alcohol.
    Type: Grant
    Filed: April 2, 2014
    Date of Patent: March 13, 2018
    Assignee: FOUNDATION OF SOONGSIL UNIVERSITY—INDUSTRY COOPERATION
    Inventors: Myung Jin Bae, Sang Gil Lee, Seong Geon Bae
  • Patent number: 9911417
    Abstract: An internet of things (IOT) system includes an IOT server and multiple IOT devices and a voice-controlled device connected to the IOT server and the multiple IOT devices. The voice-controlled device receives a voice-controlled message of environmental sound information through a voice control interface, and broadcasts the voice-controlled message to neighboring IOT devices to drive a corresponding IOT device according to the voice-controlled message. When failing to recognize the voice-controlled message, the voice control interface uploads the voice-controlled message to a cloud server for query through the IOT server, and broadcasts a result of the query returned from the cloud server. A way of chain broadcasting is employed by the voice-controlled device to drive selected IOT device or receive returned information so as to enhance operational convenience in using IOT devices.
    Type: Grant
    Filed: April 1, 2016
    Date of Patent: March 6, 2018
    Inventor: Tai-An Lu
  • Patent number: 9911419
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining, for each of multiple words or sub-words, audio data corresponding to multiple users speaking the word or sub-word; training, for each of the multiple words or sub-words, a pre-computed hotword model for the word or sub-word based on the audio data for the word or sub-word; receiving a candidate hotword from a computing device; identifying one or more pre-computed hotword models that correspond to the candidate hotword; and providing the identified, pre-computed hotword models to the computing device.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: March 6, 2018
    Assignee: Google LLC
    Inventor: Matthew Sharifi
  • Patent number: 9904360
    Abstract: A head gesture-based recognition system in Headset Computers (HSC) is disclosed. Notification dialogue boxes can be acknowledged by head nodding or ticking movement in the user interface. Question dialog boxes can be assured by head nods or head shakes in the user interface. Head swiping is also a recognizable form of user input through a head tracker of the HSC. Progress indicators and other visual display feedback are utilized.
    Type: Grant
    Filed: November 13, 2014
    Date of Patent: February 27, 2018
    Assignee: Kopin Corporation
    Inventors: Sean Hennelly, Nathan Andrews
  • Patent number: 9892155
    Abstract: It is one object of the present invention to disclose a method for filtering targeted data comprising steps of: a. providing a plurality of M devices Di; each of the Di is adapted to measure a physiological parameter; b. providing a data base of plurality of classified data; the classification is according to the physiological parameters; c. measuring a plurality of N physiological parameters of a mammalian subject using the devices; d. storing results of the measurement in a computer readable medium having instruction thereon; wherein the method, additionally comprising step of e. selecting via the instructions, at least some of the classified data according to the result of measurement of physiological parameters.
    Type: Grant
    Filed: September 1, 2013
    Date of Patent: February 13, 2018
    Assignee: BEYOND VERBAL COMMUNICATION LTD
    Inventor: Yoram Levanon
  • Patent number: 9894460
    Abstract: In general, the subject matter described in this specification can be embodied in methods, systems, and program products for receiving a voice query at a mobile computing device and generating data that represents content of the voice query. The data is provided to a server system. A textual query that has been determined by a speech recognizer at the server system to be a textual form of at least part of the data is received at the mobile computing device. The textual query is determined to include a carrier phrase of one or more words that is reserved by a first third-party application program installed on the computing device. The first third-party application is selected, from a group of one or more third-party applications, to receive all or a part of the textual query. All or a part of the textual query is provided to the selected first application program.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: February 13, 2018
    Assignee: Google Inc.
    Inventors: Michael J. LeBeau, John Nicholas Jitkoff, William J. Byrne
  • Patent number: 9870083
    Abstract: A grip of a primary user on a touch-sensitive computing device and a grip of a secondary user on the touch-sensitive computing device are sensed and correlated to determine whether the primary user is sharing or handing off the computing device to the secondary user. In the case of handoff, capabilities of the computing device may be restricted, while in a sharing mode only certain content on the computing device is shared. In some implementations both a touch-sensitive pen and the touch-sensitive computing device are passed from a primary user to a secondary user. Sensor inputs representing the grips of the users on both the pen and the touch-sensitive computing device are correlated to determine the context of the grips and to initiate a context-appropriate command in an application executing on the touch-sensitive pen or the touch-sensitive computing device. Meta data is also derived from the correlated sensor inputs.
    Type: Grant
    Filed: June 12, 2014
    Date of Patent: January 16, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ken Hinckley, Hrvoje Benko, Michel Pahud, Andrew D. Wilson, Pourang Polad Irani, Francois Guimbretiere
  • Patent number: 9870539
    Abstract: A rich media notice board enables users to communicate with others in their own and related communities who use the rich media notice board or other rich media notice boards, such as those in related communities, as well as with others who use conventional interfaces via the Internet. The users of the rich media notice board can post notices including text, images, audio, and video to the rich media notice board. The notices may also include usage metaphors that may allow users to relate to the notices. A user interface of the rich media notice board may employ the usage metaphors to provide an interface that may be used by users who may not read or write with sufficient proficiency to otherwise use a computer. The users may access the rich media notice boards from computers, mobile phones, and kiosk systems.
    Type: Grant
    Filed: December 3, 2010
    Date of Patent: January 16, 2018
    Assignee: Google LLC
    Inventors: Mandayam Thondanur Raghunath, Deepak Achuthan Menon, Rahul Suresh Kulkarni, Balaji Gopalan, Anshu Surana, Suhas Abhimanyu Phand
  • Patent number: 9871974
    Abstract: A camera control device may include a housing to store the camera and various control modules. The housing may also have a movable camera shutter operating on a shutter track that is close to the camera inside the camera housing. The shutter may include an open portion and a closed portion and a knob which extends beyond a surface area of the camera housing to control movement of the shutter along the shutter track. The movement of the shutter may also be automated and may be subject to sensors triggering sensed conditions.
    Type: Grant
    Filed: December 5, 2014
    Date of Patent: January 16, 2018
    Assignee: AMX, LLC
    Inventors: Shaun Robinson, Miguel Alejandro Sereno
  • Patent number: 9865264
    Abstract: Disclosed are computer-implemented methods and systems for dynamic selection of speech recognition systems for the use in Chat Information Systems (CIS) based on multiple criteria and context of human-machine interaction. Specifically, once a first user audio input is received, it is analyzed so as to locate specific triggers, determine the context of the interaction or predict the subsequent user audio inputs. Based on at least one of these criteria, one of a free-diction recognizer, pattern-based recognizer, address book based recognizer or dynamically created recognizer is selected for recognizing the subsequent user audio input. The methods described herein increase the accuracy of automatic recognition of user voice commands, thereby enhancing overall user experience of using CIS, chat agents and similar digital personal assistant systems.
    Type: Grant
    Filed: May 14, 2016
    Date of Patent: January 9, 2018
    Assignee: GOOGLE LLC
    Inventors: Ilya Genadevich Gelfenbeyn, Artem Goncharuk, Ilya Andreevich Platonov, Pavel Aleksandrovich Sirotin, Olga Aleksandrovna Gelfenbeyn
  • Patent number: 9865280
    Abstract: Systems and processes for structured dictation using intelligent automated assistants are provided. In one example process, a speech input representing a user request can be received. In addition, metadata associated with the speech input can be received. A text string corresponding to the speech input can be determined. The process can determine whether to perform natural language processing on the text string and whether the metadata identifies one or more domains corresponding to the user request. In response to the determination that natural language processing is to be performed on the text string and that the metadata identifies one or more domains corresponding to the user request, natural language processing of the text string can be constrained to the one or more domains. A result can be obtained based on the one or more domains and the result can be outputted from the electronic device.
    Type: Grant
    Filed: August 28, 2015
    Date of Patent: January 9, 2018
    Assignee: APPLE INC.
    Inventors: Michael R. Sumner, Brandon J. Newendorp, Ryan M. Orr
  • Patent number: 9858920
    Abstract: Adaptation methods and systems are provided for a speech system of a vehicle. In one embodiment a method comprises: receiving speech data; determining a speech pace based on the speech data; determining a user model based on the speech pace; and generating adaptation parameters for at least one of a speech recognition system and a dialog manager based on the user model.
    Type: Grant
    Filed: June 30, 2014
    Date of Patent: January 2, 2018
    Inventors: Peggy Wang, Ute Winter, Timothy J. Grost, Matthew M. Highstrom
  • Patent number: 9847083
    Abstract: A speech recognition engine is provided voice data indicative of at least a brand of a target appliance. The speech recognition engine uses the voice data indicative of at least a brand of the target appliance to identify within a library of codesets at least one codeset that is cross-referenced to the brand of the target appliance. The at least one codeset so identified is then caused to be provisioned to the controlling device for use in commanding functional operations of the target appliance.
    Type: Grant
    Filed: November 17, 2011
    Date of Patent: December 19, 2017
    Assignee: Universal Electronics Inc.
    Inventor: Jonathan Lim
  • Patent number: 9847084
    Abstract: The methods, apparatus, and systems described herein assist a user with a request. The methods in part retrieve or determine a personality type of the user from three or more personality types based on one or more user communications, determine a set of outputs based on the user communication, rank outputs based on the user's personality, engage with an external service to perform an action based on the communication, and determine a distress level or engagement level of the user, or both, based on the ranked and selected output and the modality of delivery, and weight the ranked and selected outputs for one or more future interactions with the user.
    Type: Grant
    Filed: June 20, 2016
    Date of Patent: December 19, 2017
    Assignee: MATTERSIGHT CORPORATION
    Inventors: David Gustafson, Christopher Danson
  • Patent number: 9842589
    Abstract: A voice input device provided with an input section for inputting a voice of a user, a recognition section for recognizing the voice of the user inputted by the input section, a generation section for generating characters or a command based on a recognition result of the recognition section, a detection section for detecting a device's own posture, and an instruction section for instructing the generation section to generate the command when a detection result of the detection section represents a specific posture as compared to instructing the generation section to generate the characters when the detection result of the detection section represents a posture other than the specific posture. Accordingly, character input and command input during dictation is correctly distinguished, or more specifically unexpected character input during dictation is avoided.
    Type: Grant
    Filed: October 10, 2012
    Date of Patent: December 12, 2017
    Assignee: NEC CORPORATION
    Inventor: Yusuke Inutsuka
  • Patent number: 9834978
    Abstract: A power side door system for a motor vehicle includes a vehicle side door connected to a vehicle body and an actuator for displacing the side door between an open and a closed position. The system further includes a presence sensor to determine a change in presence of an individual in a seat position adjacent the side door. Further, the system includes a controller responsive to the presence sensor to control operation of the actuator. Advantageously the system automatically closes the door either after an individual enters the vehicle and occupies the seat or after an individual vacates the seat and leaves the vehicle.
    Type: Grant
    Filed: April 4, 2014
    Date of Patent: December 5, 2017
    Assignee: Ford Global Technologies, LLC
    Inventor: Adrian Nania
  • Patent number: 9836531
    Abstract: A systems and methods for determining crowd sentiment based on unstructured data are presented. The system includes scrapers that continuously scour a computer network to obtain one or more published documents and stores the documents in a document repository. The system further processes each of the documents through a filter (or percolator) to extract one or more system keywords, links and statistical information such as number of occurrences of the system keyword, rate of change and direction of change for each system keyword and crowd sentiment for the system keyword. The system further includes a keyword cache system for maintaining the system keywords so that up to date crowd sentiment is available upon demand.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: December 5, 2017
    Assignee: BCO HOLDINGS, LLC
    Inventor: Steven Batiste