Speech Controlled System Patents (Class 704/275)
  • Patent number: 10726837
    Abstract: According to one embodiment, a voice interactive device configure to transmit a voice content to a plurality of voice interactive services through a network, wherein the plurality of voice interactive services are selected based at least in part on the voice content.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: July 28, 2020
    Assignees: HISENSE VISUAL TECHNOLOGY CO., LTD., TOSHIBA VISUAL SOLUTIONS CORPORATION
    Inventors: Takero Kobayashi, Kunio Honsawa, Hidehito Izawa, Reiko Kawachi, Hiroyuki Nomoto
  • Patent number: 10726204
    Abstract: A computer-implemented method for training a natural language classifier associated with a chat interface of a computer system is provided. The method may include receiving a training dataset comprising an initial set of expressions corresponding to an intent. Additional expressions corresponding to the intent may be generated, wherein the additional expressions are generated based on the initial set of expressions corresponding to the intent. The natural language classifier may be trained based on the initial set of expressions and the additional expressions corresponding to the intent. The trained natural language classifier may be implemented to determine an intent expressed by a detected query based on the initial set of expressions and the additional expressions by which the natural language classifier was trained.
    Type: Grant
    Filed: May 24, 2018
    Date of Patent: July 28, 2020
    Assignee: International Business Machines Corporation
    Inventors: Michele Crudele, Antonio Perrone
  • Patent number: 10720155
    Abstract: A speech-based audio device may be configured to detect a user-uttered wake expression. For example, the audio device may generate a parameter indicating whether output audio is currently being produced by an audio speaker, whether the output audio contains speech, whether the output audio contains a predefined expression, loudness of the output audio, loudness of input audio, and/or an echo characteristic. Based on the parameter, the audio device may determine whether an occurrence of the predefined expression in the input audio is a result of an utterance of the predefined expression by a user.
    Type: Grant
    Filed: July 17, 2017
    Date of Patent: July 21, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Michael Alan Pogue, Philip Ryan Hilmes
  • Patent number: 10720046
    Abstract: A method of controlling an external apparatus includes receiving a user input information; obtaining apparatus information regarding a plurality of external apparatuses; selecting one or more external apparatuses, from the plurality of external apparatuses, which is communicable with and controllable based on the user input information; generating a control information for controlling the one or more external apparatuses based on a user's input and the apparatus information; and transmitting a control command to the one or more external apparatuses, the control command being generated based on the received control information.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: July 21, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Hang-sik Shin, Jae-woo Ko, Se-jun Park
  • Patent number: 10720159
    Abstract: Methods and systems for rendering lists of instructions and performing actions associated with those lists are described herein. In some embodiments, an individual may request that a voice activated electronic device associated with their user account assist in performing a task using a list of instructions. The list of instructions may include metadata that indicates actions capable of being performed by additional Internet of Things (“IoT”) devices. When the instructions are rendered, an instructions speechlet may recognize the metadata and may cause one or more of the IoT devices to perform a particular action. Furthermore, the metadata may also correspond to content capable of being rendered by the voice activated electronic device to assist the individual in performing a particular step of the instructions.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: July 21, 2020
    Assignee: Amazon Technologies, Inc.
    Inventor: Manoj Sindhwani
  • Patent number: 10718625
    Abstract: A method of providing navigation on an electronic device when the display screen is locked. The method receives a verbal request to start navigation while the display is locked. The method identifies a route from a current location to a destination based on the received verbal request. While the display screen is locked, the method provides navigational directions on the electronic device from the current location of the electronic device to the destination. Some embodiments provide a method for processing a verbal search request. The method receives a navigation-related verbal search request and prepares a sequential list of the search results based on the received request. The method then provides audible information to present a search result from the sequential list. The method presents the search results in a batch form until the user selects a search result, the user terminates the search, or the search items are exhausted.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: July 21, 2020
    Assignee: Apple Inc.
    Inventors: Marcel van Os, Sarah G. Barbour, Brady A. Law, Bradford A. Moore
  • Patent number: 10714093
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for hotword detection on multiple devices are disclosed. In one aspect, a method includes the actions of receiving audio data that corresponds to an utterance. The actions further include determining that the utterance likely includes a particular, predefined hotword. The actions further include transmitting (i) data indicating that the computing device likely received the particular, predefined hotword, (ii) data identifying the computing device, and (iii) data identifying a group of nearby computing devices that includes the computing device. The actions further include receiving an instruction to commence speech recognition processing on the audio data. The actions further include in response to receiving the instruction to commence speech recognition processing on the audio data, processing at least a portion of the audio data using an automated speech recognizer on the computing device.
    Type: Grant
    Filed: March 22, 2019
    Date of Patent: July 14, 2020
    Assignee: Google LLC
    Inventors: Diego Melendo Casado, Alexander H. Gruenstein, Jakob Nicolaus Foerster
  • Patent number: 10715906
    Abstract: A modular speaker system, comprising an exoskeleton, configured to mechanically support and quick attach and release at least one functional panel and an electrical interface provided within the exoskeleton, configured to mate with a corresponding electrical connector of the functional panel. An optional endoskeleton is provided to support internal components. The system preferably provides a digital electronic controller, and the electrical interface is a digital data and power bus, with multiplexed communications between the elements of the system. The elements of the system preferably include at least one speaker, and other audiovisual and communications components. Multiple modules may be interconnected, communicating through the electrical interface. A base module may be provided to provide power and typical control, user and audiovisual interface connectors.
    Type: Grant
    Filed: July 23, 2018
    Date of Patent: July 14, 2020
    Assignee: Sonic Blocks, Inc.
    Inventors: Scott D. Wilker, Jordan D. Wilker
  • Patent number: 10713288
    Abstract: A system that generates natural language content. The system generates and maintains a dialogue state representation having a process view, query view, and data view. The three-view dialogue state representation is continuously updated during discourse between an agent and a user, and rules can be automatically generated based on the discourse. Upon a content generation event, an object description can be generated based on the dialogue state representation. A string is then determined from the object description, using a hybrid approach of the automatically generated rules and other rules learned from annotation and other user input. The string is translated to text or speech and output by the agent. The present system also incorporates learning techniques, for example when ranking output and processing annotation templates.
    Type: Grant
    Filed: February 8, 2018
    Date of Patent: July 14, 2020
    Assignee: Semantic Machines, Inc.
    Inventors: Jacob Daniel Andreas, David Leo Wright Hall, Daniel Klein, Adam David Pauls
  • Patent number: 10713695
    Abstract: Methods and systems for facilitating payment of a bill are described. The methods use voice and context recognition to create an inventory of items for a specific user. When it is time to split the bill among a group at a table, each user is apportioned their share of the bill based on their inventory so that each user pays for what they ordered. The users may decide to split the bill differently, such as equally among themselves.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: July 14, 2020
    Assignee: PAYPAL, INC.
    Inventor: Kamal Zamer
  • Patent number: 10715380
    Abstract: Disclosed are systems, methods, and non-transitory computer-readable storage media for setting a reminder triggered by a target device. A requesting device sends a request to a server to set a reminder triggered by a target device. The request includes parameters, such as a location and a condition that define when the reminder is triggered. The server sends instruction to the target device to set the reminder based on the parameters. When the condition such as arrival is met by the target device in relation to the location the target device sends a message to the server that the reminder has been triggered. The target device can set a geo-fence to determine the position of the target device in relation to the location, and the requesting user can dictate the size of the geo-fence. The server sends a notification to the requesting device that the reminder has been triggered.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: July 14, 2020
    Assignee: Apple Inc.
    Inventors: Raghu Pai, Joshua B. Dickens, Karthik Narayanan, Megan M. Frost, Patrice Olivier Gautier
  • Patent number: 10715604
    Abstract: Techniques for implementing a “sticky” user ID are described. A system receives first input audio data and determines first speech processing results therefrom. The system also determines a first user ID of a user that spoke an utterance represented in the first input audio data and associates the first user ID with a device, which originated the first input audio data, for a predetermined length of time. The system determines first output data responsive to the first speech processing data and causes the device to present first output content corresponding thereto. The system then receives second input audio data and determines second speech processing results therefrom. The system also determines a time of receipt of the second input audio data is within the predetermined length of time. Based at least in part thereon, the system determined second output data responsive to the second speech processing data using the first user ID.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: July 14, 2020
    Assignee: Amazon Technologies, Inc.
    Inventor: Yu Bao
  • Patent number: 10708448
    Abstract: A system including at least one server includes an obtaining unit that, in a case where a print instruction is issued by voice to a voice control device, obtains information based on the print instruction, and a generation unit that generates print data based on the obtained information, where the generation unit generates the print data by using a previously registered print setting when a print setting is not included in the obtained information.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: July 7, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Toshiki Shiga, Ayumi Kabata, Ryohei Saito
  • Patent number: 10706854
    Abstract: Features are disclosed for performing functions in response to user requests based on contextual data regarding prior user requests. Users may engage in conversations with a computing device in order to initiate some function or obtain some information. A dialog manager may manage the conversations and store contextual data regarding one or more of the conversations. Processing and responding to subsequent conversations may benefit from the previously stored contextual data by, e.g., reducing the amount of information that a user must provide if the user has already provided the information in the context of a prior conversation. Additional information associated with performing functions responsive to user requests may be shared among applications, further improving efficiency and enhancing the user experience.
    Type: Grant
    Filed: September 4, 2017
    Date of Patent: July 7, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Nishant Kumar, David Robert Thomas, Sumedha Arvind Kshirsagar, Vikas Jain, Jeff Bradley Beal, Ajay Gopalakrishnan, Shishir Sridhar Bharathi
  • Patent number: 10705948
    Abstract: The invention utilizes a plurality of robotic process automation (RPA) bots to generate data regarding production issues within applications. The RPA bots may simulate user access to the environment (i.e. user load) to predict possible issues or failures of the application within the particular environment. The RPA bots may further be used to identify the needs of an application when migrating the application from one environment to another. To this end, the bots may perform a dynamic simulation sequence for accessing applications, which may provide a realistic simulation of user load for an application within a certain environment. In this way, bots may be used to monitor and understand the complete runtime sequence and behavior of applications that would enable administrators to select the appropriate stack of modules of the destination infrastructure.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: July 7, 2020
    Assignee: Bank of America Corporation
    Inventors: Suki Ramasamy, Sasidhar Purushothaman
  • Patent number: 10706210
    Abstract: In an automatic speech recognition (ASR) dictation application, a user interface may be provided for informing a user how to dictate desired text. Input may be received from the user of the dictation application, specifying a desired text sequence. In response to the received input, output may automatically be provided to the user via the user interface, indicating one or more speech sequences that, when spoken by a user and recognized by the dictation application using ASR, would cause the dictation application to output the desired text sequence as a recognition result.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: July 7, 2020
    Assignee: Nuance Communications, Inc.
    Inventor: Kaarel Kaljurand
  • Patent number: 10706716
    Abstract: A vehicle interface system for a vehicle, the vehicle interface system comprising: a vehicle computing system comprising a processor that is configured to collect cabin conditions including cabin temperature of the vehicle; an on board diagnostic (OBD) device attached to the vehicle and configured to communicate data collected from the vehicle computing system to a communication service over a network; and a mobile device comprising a processor and that is connected remote from the vehicle over the network, the mobile device being configured to connect to the network to obtain the data from the OBD device and to receive a command from a user to control one or more components of the vehicle to control the internal temperature of the cabin of the vehicle.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: July 7, 2020
    Assignee: K-9 ICE, LLC
    Inventor: Manning Drake
  • Patent number: 10692094
    Abstract: A systems and methods for determining crowd sentiment based on unstructured data are presented. The system includes scrapers that continuously scour a computer network to obtain one or more published documents and stores the documents in a document repository. The system further processes each of the documents through a filter (or percolator) to extract one or more system keywords, links and statistical information such as number of occurrences of the system keyword, rate of change and direction of change for each system keyword and crowd sentiment for the system keyword. The system further includes a keyword cache system for maintaining the system keywords so that up to date crowd sentiment is available upon demand.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: June 23, 2020
    Inventor: Steven Batiste
  • Patent number: 10692495
    Abstract: An electronic device is provided. The electronic device includes at least one processor and a memory electrically connected to the processor. The memory stores instructions, and the instructions are configured to cause the processor, when executed, to activate a voice recognition service in response receiving a specified user input, receive a voice command while activating the voice recognition service, provide a feedback for the voice command, deactivate the voice recognition service after providing the feedback, receive a voice signal distinct from the specified user input while deactivating the voice recognition service, in response to receiving the voice signal, identify whether at least a portion of the voice signal corresponds to a wake-up command that is obtained from the voice command, and in response to identifying that the at least the portion of the voice signal corresponds to the wake-up command, activate the voice recognition service.
    Type: Grant
    Filed: August 27, 2018
    Date of Patent: June 23, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Kwang-Taek Woo, Kwan-Shik Park, Chang-Hoon Shin, Ki-Seok Kim, Jin-Wan An
  • Patent number: 10685385
    Abstract: A system and method of intelligently recommending items based on social media communications are provided. A communication with an audio portion in a first format is intercepted from a first service. An intent to transact is then detected within the communication at least in part based on analyzed sound in the audio portion. A recommendation engine can then be used to identify one or search results based on the intent to transact within the communication. Then a reply communication can be posted to the first service in the first format, with the reply communication including the one or more identified items.
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: June 16, 2020
    Assignee: EBAY INC.
    Inventors: Han-Sheong Lai, Jiri Medlen
  • Patent number: 10685183
    Abstract: In one embodiment, a method includes receiving a request to generate a visualization of public sentiments regarding a particular subject by a plurality of clusters, where each cluster includes a plurality of words semantically close to each other, constructing a first corpus of text by collecting text containing the input n-gram from a plurality of user-created content objects in the online social network, identifying a list of unique n-grams appearing in the first corpus of text, generating a table comprising unique n-grams in the list and their corresponding word vectors using a word embedding model, classifying word vectors in the table into a plurality of clusters based on semantic similarities of the word vectors, and sending, as a response to the request, instructions to display n-grams in the table in a two-dimensional display space, where n-grams corresponding to word vectors that belong to a cluster are displayed together.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: June 16, 2020
    Assignee: Facebook, Inc.
    Inventors: Jonathan Michael Arfa, Nikhil Girish Nawathe, Bryan Kauder, Shriram Subramanian
  • Patent number: 10685669
    Abstract: This disclosure describes techniques for identifying a voice-enabled device from a group of voice-enabled devices to respond to a speech utterance of a user. A speech-processing system may receive an audio signal representing the speech utterance captured in an environment of a voice-enabled device, and identify another voice-enabled device located in the environment. The system may analyze the audio signal using a different natural-language-understanding model for each of the voice-enabled devices to identify an intent for each of the voice-enabled devices to respond to the speech utterance. The system may determine confidence scores that the intents are responsive to the speech utterance, and select the intent with the highest confidence score. The system may use the selected intent to generate a command for the corresponding voice-enabled device to respond to the user.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: June 16, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Gang Lan, Joseph Pedro Tavares, Deepak Uttam Shah, Mckay Clawson, Vijay Shankar Tennety, Ravi Kiran Rachakonda, Venkata Snehith Cherukuri, Charles James Torbert
  • Patent number: 10685651
    Abstract: An information processing apparatus includes an acquiring unit, a detecting unit, and a voice command unit. The acquiring unit acquires voice information of a speaker. The detecting unit detects operation related to speech by the speaker. The voice command unit performs a voice command in accordance with the voice information acquired by the acquiring unit after the detecting unit detects the operation.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: June 16, 2020
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Yoshihiko Nemoto, Kengo Tokuchi
  • Patent number: 10687109
    Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: June 16, 2020
    Assignee: Google LLC
    Inventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
  • Patent number: 10678901
    Abstract: A cabinet or cart has at least one limited-access drawer or compartment and employs facial recognition (FR) to permit an authorized user to access the limited-access drawer or compartment. A visible light image of the user and a thermal image of the user are taken simultaneously or nearly simultaneously, with the thermal image serving to confirm the validity of the FR and authenticate the user's identity.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: June 9, 2020
    Assignee: S&S X-ray Products, Inc.
    Inventors: Norman A. Shoenfeld, Bryan Scott Sangalli
  • Patent number: 10679397
    Abstract: An animation system includes an animated figure, multiple sensors, and an animation controller that includes a processor and a memory. The memory stores instructions executable by the processor. The instructions cause the animation controller to receive guest detection data from the multiple sensors, receive shiny object detection data from the multiple sensors, determine an animation sequence of the animated figure based on the guest detection data and shiny object detection data, and transmit a control signal indicative of the animation sequence to cause the animated figure to execute the animation sequence. The guest detection data is indicative of a presence of a guest near the animated figure. The animation sequence is responsive to a shiny object detected on or near the guest based on the guest detection data and the shiny object detection data.
    Type: Grant
    Filed: February 6, 2019
    Date of Patent: June 9, 2020
    Assignee: Universal City Studios LLC
    Inventors: David Michael Churchill, Clarisse Vamos, Jeffrey A. Bardt
  • Patent number: 10679623
    Abstract: The disclosed embodiments include methods, devices, and storage mediums for adjusting the output volume of audio content. In one aspect, a method performed at an audio device includes: (1) identifying a remote location for audio content; (2) streaming the audio content from the remote location; (3) producing an audible output from the audio content at a first volume level; and (4) while producing the audible output: (a) receiving an indication that a user is about to submit verbal input to the electronic device; (b) in response to the indication, adjusting the audible output from the first volume level to a second volume level, less than the first volume level; (c) receiving the verbal input from the user; and (d) after receiving the verbal input, adjusting the audible output from the second volume level to the first volume level.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: June 9, 2020
    Assignee: GOOGLE LLC
    Inventors: Kenneth Mixter, Raunaq Shah
  • Patent number: 10670415
    Abstract: An approach is provided for mobility-based language model adaptation for navigational speech interfaces. The approach involves receiving a word lattice resulting from a speech recognition process applied on a speech input received from a user via a navigational speech interface. The word lattice includes a respective speech recognition score for each word in the word lattice. The approach further involves adapting a language model comprising a plurality of location entities according to a mobility relevance and a search relevance of the plurality of location entities to the user. In one embodiment, the mobility relevance and the search relevance are determined by computing a probability of the user visiting the location entities associated with said each word after the user queries for said each word. The approach further involves initiating a re-scoring of said each word in the word lattice using the adapted language model to generate a speech recognition output.
    Type: Grant
    Filed: July 6, 2017
    Date of Patent: June 2, 2020
    Assignee: HERE GLOBAL B.V.
    Inventors: Eduardo Vellasques, Tadej Stajner, Augusto Hentz, Olivier Dousse
  • Patent number: 10667878
    Abstract: A surgical system includes a plurality of voice sensors located in a surgical environment and configured to detect sound and generate a first plurality of signals. The surgical system also includes a position indicator, in proximity to a designated user, configured to indicate a first position of the designated user and generate a second signal representative of the first position. The surgical system further includes a processor configured to receive the first plurality of signals and the second signal and determine, based on the first plurality of signals, a second position. The processor is also configured to compare the detected sound with registered voice command of the designated user stored in a memory to verify the designated user's credentials, and send a command signal to a surgical instrument to carry out an operation related to the voice command based on at least one of the verification of the designated user's credentials, the first position and the second position.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: June 2, 2020
    Assignee: Ethicon LLC
    Inventors: David J. Cagle, Eric Smith, Jeffrey L. Aldridge, Mary E. Mootoo, Ryan Asher
  • Patent number: 10663938
    Abstract: A voice controlled device comprises a plurality of microphones, a communication interface, and a controller. The plurality of microphones are configured to receive voice inputs from one or more users for operation of the voice controlled device. The communication interface is configured to receive sensor data from an external device, the sensor data describing an environment of the voice controlled device. The controller is configured to operate a first subset of the plurality of microphones in response to first sensor data and a second subset of the plurality of microphones in response to second sensor data.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: May 26, 2020
    Assignee: KOHLER CO.
    Inventors: Rafael Rexach, Jessica Schroeder, Miguel Arciniega, Ashley Springer, Shi Chao Zhang, Eric Plate, Marwan Estiban
  • Patent number: 10664533
    Abstract: In one aspect, a device includes at least one processor and storage accessible to the at least one processor. The storage bears instructions executable by the at least one processor to identify at least one context and, based on the at least one context, dynamically determine a response cue for a digital assistant. The instructions are also executable by the at least one processor to, responsive to receipt of the response cue, operate the digital assistant to perform a task according to the response cue.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: May 26, 2020
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: Russell Speight VanBlon, Arnold S. Weksler, John Carl Mese, Nathan J. Peterson
  • Patent number: 10657983
    Abstract: System and techniques for automatic gain control for speech recognition are described herein. An audio signal may be obtained. A signal-to-noise ratio (SNR) may be derived from the audio signal. The SNR may be compared to a threshold. A stored gain value may be updated when the SNR is beyond the threshold and the stored gain value may be applied to a descendant (e.g., later) of the audio signal otherwise.
    Type: Grant
    Filed: December 22, 2016
    Date of Patent: May 19, 2020
    Assignee: Intel Corporation
    Inventors: Przemyslaw Maziewski, Adam Kupryjanow
  • Patent number: 10659548
    Abstract: Various techniques provided herein generate trigger events in an organization information distribution system. Various implementations establish a connection between an invocation device and a server using a communication network. Establishing the connection can include authenticating the invocation device to the server and/or authenticating the server to the invocation device. In response to establishing the connection to the server, one or more implementations detect a trigger event, such as the actuation of a hardware mechanism and/or a sensor detecting the trigger event without user-intervention. Some implementations capture content based on a point in time associated with when the trigger event occurs. Upon detecting the trigger event, various implementations forward a notification of the trigger event and/or the captured content.
    Type: Grant
    Filed: July 23, 2018
    Date of Patent: May 19, 2020
    Assignee: NRS Systems
    Inventors: John Michael Gehlsen, William L. Colpitts, Jr., Jeffrey Brian Jarvis, Joseph Alan Kogut, Michael Steven Liddicoat
  • Patent number: 10657967
    Abstract: An apparatus and method for executing a voice command in an electronic device. In an exemplary embodiment, a voice signal is detected and speech thereof is recognized. When the recognized speech contains a wakeup command, a voice command mode is activated, and a signal containing at least a portion of the detected voice signal is transmitted to a server. The server generates a control signal or a result signal corresponding to the voice command, and transmits the same to the electronic device. The device receives and processes the control or result signal, and awakens. Thereby, voice commands are executed without the need for the user to physically touch the electronic device.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: May 19, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Subhojit Chakladar, Sang-Hoon Lee, Hee-Woon Kim
  • Patent number: 10650823
    Abstract: A voice-enabled digital communications assistant powered in part using tailored machine learning models and other algorithms is used to engage with and control one or more healthcare devices or instruments such that a user is able to control the devices or instruments using natural language, conversational-like, voice commands. A command processor processes the audible instructions, while a context-aware processor monitors the present states and conditions of all devices and instruments, as well as the environment, for situational awareness purposes, including situations where executing commands may be incompatible with or conflict with the present states or conditions of devices and instruments as well as their expected future states. In addition to speech responses by the digital assistant, a separate notification engine provides audible or visual feedback to the user.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: May 12, 2020
    Assignee: CES Advancements, LLC
    Inventors: Martin G. Paul, PV Subramanian
  • Patent number: 10652337
    Abstract: Embodiments can enable a passenger to connect his/her portable device, such as smart phone to a display positioned to be used by the passenger. After the passenger connects the portable device to the passenger display, the passenger may be enabled to control the portable device by providing inputs through the passenger display and/or the portable device. In some embodiments, the passenger may be enabled to control one or more in-vehicle devices through the portable device after it is connected to the passenger display.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: May 12, 2020
    Assignee: Thundar Power New Energy Vehicle Developmont Company Limited
    Inventor: Massimiliano Brusco
  • Patent number: 10650647
    Abstract: The various implementations described herein include methods, devices, and systems for monitoring activity in a home environment. In one aspect, a method performed at a voice-assistant device includes: while operating in an assistant mode, receiving an occupant command to operate in a monitoring mode; in response to the command, transitioning to operating in the monitoring mode; while operating in the monitoring mode, detecting a sound; obtaining a determination as to whether the sound meets one or more monitoring criteria; and in accordance with a determination that the sound meets the one or more monitoring criteria: obtaining a classification of the sound; and generating an alert or notification in accordance with the classification of the sound.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: May 12, 2020
    Assignee: GOOGLE LLC
    Inventor: Bryan Horling
  • Patent number: 10636424
    Abstract: Systems and processes for providing multi-turn canned dialog are provided. An example method includes, at an electronic device, receiving a natural-language input; determining whether the natural-language input satisfies dialog criteria for multi-turn canned dialog; in accordance with a determination that the natural-language input satisfies the dialog criteria for multi-turn canned dialog: identifying a natural-language output of the multi-turn canned dialog corresponding to the natural-language input; and outputting the natural-language output; and in accordance with a determination that the natural-language input does not satisfy the dialog criteria for multi-turn canned dialog: identifying a task associated with the natural-language input; and performing the task associated with the natural-language input.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: April 28, 2020
    Assignee: Apple Inc.
    Inventors: Philippe P. Piernot, Kevin D. Pitolin
  • Patent number: 10636420
    Abstract: Disclosed is an electronic device including: at least one processor; and a memory electrically connected to the at least one processor, wherein the memory stores instructions to recognize a received first voice, recognizes a first speaker based on the recognized first voice, and determines a response corresponding to the first voice based on a result of the recognition of the first speaker. Other embodiments are possible.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: April 28, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Shin-Jae Kang, Jeong-Hyun Ha, Seok-Yeong Jung
  • Patent number: 10631661
    Abstract: A voice control system for a seating/reclining furniture includes the seating/reclining furniture having at least one component which is manipulated by an actuator, an intelligent personal assistant (IPA) which accepts a voice command to actuate the actuator and to convert the voice command into a control command for controlling the actuator, a data interface which receives the control command from the intelligent personal assistant (IPA), and a control unit which is connected in a technical signal manner between the data interface and the actuator. The control unit selectively actuates the actuator based on the control command.
    Type: Grant
    Filed: January 12, 2018
    Date of Patent: April 28, 2020
    Assignee: UNITERS S.P.A.
    Inventors: Diego Bertinato, Gordian Conrad Anton Tork
  • Patent number: 10635462
    Abstract: A computerized personal assistant communicatively couples to a computer database including a plurality of available skills for the computerized personal assistant. The computerized personal assistant recognizes a current context of the user. The computerized personal assistant operates a previously-trained machine learning classifier to assess a match confidence for a candidate skill, the match confidence indicating a quality of match between the current context and a reference context previously associated with the candidate skill. The computerized personal assistant executes instructions defining an assistive action associated with the candidate skill responsive to the match confidence exceeding a predefined match confidence threshold. The computerized personal assistant executes the instructions defining a complementary help action associated with the candidate skill responsive to the match confidence not exceeding the predefined match confidence threshold.
    Type: Grant
    Filed: May 23, 2018
    Date of Patent: April 28, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Vipindeep Vangala, Swati Valecha, Suryanarayana Shastri, Nitin Pande, Tulasi Menon, Madan Gopal Jhanwar, Nishchay Kumar
  • Patent number: 10628960
    Abstract: An information processing apparatus includes an obtaining unit configured to obtain information in which positions of an object in a vertical direction, positions in a horizontal direction, and positions in a depth direction at multiple points in time are associated with each other; a prediction unit configured to, based on a position of a predetermined object in the information previously obtained by the obtaining unit, predict a position of the predetermined object in the information currently obtained by the obtaining unit; and an extraction unit configured to extract, from the current information, multiple objects that satisfy a predetermined condition corresponding to the position of the predetermined object, and extract, based on a degree of similarity between each image of the multiple objects and an image of the predetermined object, a same object, of the multiple objects in the current information, as the predetermined object in the previous information.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: April 21, 2020
    Assignee: Ricoh Company, Ltd.
    Inventor: Genki Watanabe
  • Patent number: 10627896
    Abstract: Embodiments selectively present of virtual reality device content in response to the excitement of monitored persons. Thus, processors are configured to link a user's virtual reality system to a biometric sensor that acquires biometric data from a monitored person, wherein the virtual reality system is presenting immersive sensory content to the user, and the monitored person is viewing alternative content that is different from the immersive sensory content presented to the user. Processors configured according to the present invention determine whether the monitored person is currently in a threshold state of excitement as a function of biometric data acquired by the biometric sensor; and in response to determining that the monitored person is currently in the threshold state of excitement, automatically switch content presented by the virtual reality system to the user to the alternative content viewed by the monitored person.
    Type: Grant
    Filed: October 4, 2018
    Date of Patent: April 21, 2020
    Assignee: International Business Machines Coporation
    Inventors: Craig M. Trim, Ahmed Nassar, Victor Povar, Sarbajit K. Rakshit
  • Patent number: 10629206
    Abstract: The present invention relates to an extended-function device for selectively retrieving information in response to naturally spoken commands provided via an electronic-communication device of a user that is used to query a corresponding descriptor file that identifies a web-accessible information source and fetches responsive data specified by select data identified by the accessed descriptor file. An audio response data containing indicia of a message for the user, which message is responsive to the identified naturally spoken command, and based on the responsive data is directed to the electronic-communication device of the user.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: April 21, 2020
    Assignee: Parus Holdings, Inc.
    Inventors: Alexander Kurganov, Valery Zhukoff
  • Patent number: 10623798
    Abstract: A display device including a first communication interface configured to communicate with at least one remote controller, a display configured to output an image, a speaker configured to output sound, and a processor configured to detect a control code from a signal received from the at least one remote controller through the first communication interface, analyze a channel change operation corresponding to a changing of a channel according to an intention of a user based on the control code and at least one of the image and the sound, select at least one preferred channel preferred by the user based on a result of the analysis, and create at least one control instruction for performing the channel change operation to the at least one preferred channel.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: April 14, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Byuk Sun Kim
  • Patent number: 10623246
    Abstract: Systems and methods for device control by a natural language processing system are disclosed. A user may desire to utilize a voice-enabled device to associate an accessory device with a hub device without having to utilize third-party software associated with the accessory device and/or the hub device. The user may provide a user utterance to associate the accessory device with the hub device. Audio data corresponding to the user utterance may be analyzed and utilized to generate and send directive data to a third-party remote system to transition the hub device to a join mode. Upon association completion, audio may be output confirming that the association has been established successfully.
    Type: Grant
    Filed: March 27, 2018
    Date of Patent: April 14, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Hersh Sridhar Iyer, Willy Lew Yuk Vong, Venkatesh Krishnamoorthy, Gregg Taylor Lehman, Ramesh Kamasamodram
  • Patent number: 10613826
    Abstract: Operability of head-mounted display systems is enhanced by incorporating the following: a microphone which receives an utterance input by a person and outputs voice information; a character string generation unit which generates an uttered character string by converting the voice information into a character string; a specific utterance information storage unit which stores specific utterance information that associates at least one program to be started or stopped and/or at least one operating mode to be started or stopped, with specific utterances for starting or stopping each of the programs and/or operating modes; a specific utterance extraction unit which extracts a specific utterance included in the uttered character string with reference to the specific utterance information, and generates an extracted specific utterance signal indicating the extraction result; and a control unit which starts or stops a program or an operating mode with reference to the extracted specific utterance signal.
    Type: Grant
    Filed: December 25, 2014
    Date of Patent: April 7, 2020
    Assignee: MAXELL, LTD.
    Inventor: Seiji Imagawa
  • Patent number: 10614812
    Abstract: A speech recognition system for resolving impaired utterances can have a speech recognition engine configured to receive a plurality of representations of an utterance and concurrently to determine a plurality of highest-likelihood transcription candidates corresponding to each respective representation of the utterance. The recognition system can also have a selector configured to determine a most-likely accurate transcription from among the transcription candidates. As but one example, the plurality of representations of the utterance can be acquired by a microphone array, and beamforming techniques can generate independent streams of the utterance across various look directions using output from the microphone array.
    Type: Grant
    Filed: April 19, 2019
    Date of Patent: April 7, 2020
    Assignee: Apple Inc.
    Inventors: Sean A. Ramprashad, Harvey D. Thornburg, Arvindh Krishnaswamy, Aram M. Lindahl
  • Patent number: 10607607
    Abstract: There is provided a control device to improve convenience for a user by resolving or alleviating a disadvantage of a known voice interaction, the control device including: a device control unit configured to control one or more controlled devices; a voice notification unit configured to output user-oriented voice notification regarding at least the one controlled device; and a display control unit configured to cause a display device to display a message corresponding to the voice notification output by the voice notification unit.
    Type: Grant
    Filed: October 4, 2016
    Date of Patent: March 31, 2020
    Assignee: SONY CORPORATION
    Inventor: Hideo Nagasaka
  • Patent number: 10608837
    Abstract: The present invention relates to a control device for controlling an operation of at least one electric device. The control device includes a user interface unit configured to display a first screen having an icon corresponding to the at least one electric device and a state window of the at least one electric device, and receive an operation command for the at least one electric device; and a control unit configured to, when an icon of any one electric device is selected, perform control such that a control screen for controlling the selected any one electric device is displayed on the user interface, and when a state window of any one electric device is selected, perform control such that a current operation of the selected any one electric device is switched.
    Type: Grant
    Filed: January 6, 2015
    Date of Patent: March 31, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ji Hyun Jeon, Hye Jung Chang, Young Sun Shin, Kwang Seok Kang, Hyun Cheol Oh, Sun Young Seo, Ji Yoon Yoon, Eun Kyung Hong, So Young Yun