Patents by Inventor Ruhi Sarikaya

Ruhi Sarikaya has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10600419
    Abstract: Techniques for performing command processing are described. A system receives, from a device, input data corresponding to a command. The system determines NLU processing results associated with multiple applications. The system also determines NLU confidences for the NLU processing results for each application. The system sends NLU processing results to a portion of the multiple applications, and receives output data or instructions from the portion of the applications. The system ranks the portion of the applications based at least in part on the NLU processing results associated with the portion of the applications as well as the output data or instructions provided by the portion of the applications. The system may also rank the portion of the applications using other data. The system causes content corresponding to output data or instructions provided by the highest ranked application to be output to a user.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: March 24, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Ruhi Sarikaya, Rohit Prasad, Kerry Hammil, Spyridon Matsoukas, Nikko Strom, Frédéric Johan Georges Deramat, Stephen Frederick Potter, Young-Bum Kim
  • Patent number: 10572602
    Abstract: Tools are provided to allow developers to enable applications for Conversational Understanding (CU) using assets from a CU service. The tools may be used to select functionality from existing domains, extend the coverage of one or more domains, as well as to create new domains in the CU service. A developer may provide example Natural Language (NL) sentences that are analyzed by the tools to assist the developer in labeling data that is used to update the models in the CU service. For example, the tools may assist a developer in identifying domains, determining intent actions, determining intent objects and determining slots from example NL sentences. After the developer tags all or a portion of the example NL sentences, the models in the CU service are automatically updated and validated. For example, validation tools may be used to determine an accuracy of the model against test data.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: February 25, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ruhi Sarikaya, Daniel Boies, Larry Heck, Tasos Anastasakos
  • Patent number: 10572810
    Abstract: Examples of the present disclosure improve decision-making for input understanding to assist in determining how to best respond to a user input. A received input is analyzed using an input recognition component, input understanding component and input context component. Potential response options are determined. If uncertainty exists with respect to responding to the received input, an uncertainty value and a cost of misclassification are generated for the potential response options to assist in making a decision as to how to best respond to the received input. The uncertainty value is determined for a potential response and parameters associated with the potential response and the cost of misclassification is a cost associated with pursuing a potential response if the potential response turns out to be incorrect. A response is selected to transmit to a user based on analyzing the generated uncertainty value and the generated cost of misclassification for the potential responses.
    Type: Grant
    Filed: January 7, 2015
    Date of Patent: February 25, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Omar Zia Khan, Ruhi Sarikaya
  • Publication number: 20200058300
    Abstract: Techniques for determining a command or intent likely to be subsequently invoked by a user of a system are described. A user inputs a command (either via a spoken utterance or textual input) to a system. The system determines content responsive to the command. The system also determines a second command or corresponding intent likely to be invoked by the user subsequent to the previous command. Such determination may involve analyzing pairs of intents, with each pair being associated with a probability that one intent of the pair will be invoked by a user subsequent to a second intent of the pair. The system then outputs first content responsive to the first command and second content soliciting the user as to whether the system to execute the second command.
    Type: Application
    Filed: August 26, 2019
    Publication date: February 20, 2020
    Inventors: Anjishnu Kumar, Xing Fan, Arpit Gupta, Ruhi Sarikaya
  • Patent number: 10504512
    Abstract: Techniques for limiting natural language processing performed on input data are described. A system receives input data from a device. The input data corresponds to a command to be executed by the system. The system determines applications likely configured to execute the command. The system performs named entity recognition and intent classification with respect to only the applications likely configured to execute the command.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: December 10, 2019
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Ruhi Sarikaya, Rohit Prasad, Kerry Hammil, Spyridon Matsoukas, Nikko Strom, Frédéric Johan Georges Deramat, Stephen Frederick Potter, Young-Bum Kim
  • Patent number: 10474439
    Abstract: Systems and methods for building conversational understanding systems are provided. More specifically, the systems and methods utilize prebuilt conversational items that can form a CU system upon selection by a builder without requiring any further input from the builder. Accordingly, the systems and methods for building a conversational understanding system reduce the expertise, time, and resources necessary to build a conversational understanding system for an application when compared to systems and methods that utilize conversational items that require further input from the builder.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: November 12, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Omar Zia Khan, Paul Anthony Crook, Marius Alexandru Marin, Ruhi Sarikaya
  • Patent number: 10467345
    Abstract: Aspects herein provide third-party application authors with a resolver chaining platform that simplifies the task of creating customized resolvers to gather information from user input while also allowing those authors to chain their custom resolvers with generic resolvers provided by the platform's host and that relate to commonly used parameter types. In particular, the present disclosure provides a method and system for authoring and using these resolver chains made up of a combination of custom and generic resolvers.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: November 5, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Vasiliy Radostev, Ruhi Sarikaya
  • Publication number: 20190318000
    Abstract: A computer-implemented technique is described for facilitating the creation of a language understanding (LU) component for use with an application. The technique allows a developer to select a subset of parameters from a larger set of parameters. The subset of parameters pertains to a LU scenario to be handled by the application. The larger set of parameters pertains to a plurality of LU scenarios handled by an already-existing generic LU model. The technique creates a constrained LU component that is based on the subset of parameters in conjunction with the generic LU model. At runtime, the constrained LU component interprets input language items using the generic LU model in a manner that is constrained by the subset of parameters that have been selected, to provide an output result. The technique also allows the developer to create new rules and/or supplemental models.
    Type: Application
    Filed: June 25, 2019
    Publication date: October 17, 2019
    Inventors: Young-Bum Kim, Ruhi Sarikaya, Alexandre Rochette
  • Patent number: 10446137
    Abstract: Systems, components, devices, and methods for resolving ambiguity in a conversational understanding system are provided. A non-limiting example is a system or method for resolving ambiguity in a conversational understanding system. The method includes the steps of receiving a natural language input and identifying an agent action based on the natural language input. The method also includes the steps of determining an ambiguity value associated with the agent action and evaluating the ambiguity value against an ambiguity condition. The method includes the steps of when determined that the ambiguity value meets the ambiguity condition: selecting a prompting action based on the ambiguity associated with the identified agent action, performing the prompting action, receiving additional input in response to the prompting action, and updating the agent action to resolve the ambiguity based on the additional input. The method also includes the step of performing the agent action.
    Type: Grant
    Filed: October 19, 2016
    Date of Patent: October 15, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Omar Zia Khan, Ruhi Sarikaya, Divya Jetley
  • Publication number: 20190294680
    Abstract: Multi-turn cross-domain natural language understanding (NLU) systems and platforms for building the multi-turn cross-domain NLU system are provided. Further, methods for using and building the multi-turn cross-domain NLU system are provided. More specifically, the multi-turn cross-domain NLU system supports multi-turn bot/agent/application scenarios for new domains without having to select a task definition and/or define a new schema during the building of the NLU system. Accordingly, the platform for building the multi-turn cross-domain NLU system that does not require the builder to select a task and/or build a schema for a selected task provides an easy to use, cost effective, and efficient service for building a NLU system. Further, the multi-turn cross-domain NLU system provides a more versatile NLU system than previously utilized NLU systems that were trained for and limited to a selected task and/or domain.
    Type: Application
    Filed: June 12, 2019
    Publication date: September 26, 2019
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Ruhi SARIKAYA, Young-Bum KIM, Alexandre ROCHETTE
  • Patent number: 10417346
    Abstract: A computer-implemented technique is described for facilitating the creation of a language understanding (LU) component for use with an application. The technique allows a developer to select a subset of parameters from a larger set of parameters. The subset of parameters pertains to a LU scenario to be handled by the application. The larger set of parameters pertains to a plurality of LU scenarios handled by an already-existing generic LU model. The technique creates a constrained LU component that is based on the subset of parameters in conjunction with the generic LU model. At runtime, the constrained LU component interprets input language items using the generic LU model in a manner that is constrained by the subset of parameters that have been selected, to provide an output result. The technique also allows the developer to create new rules and/or supplemental models.
    Type: Grant
    Filed: January 23, 2016
    Date of Patent: September 17, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Young-Bum Kim, Ruhi Sarikaya, Alexandre Rochette
  • Patent number: 10417566
    Abstract: A computer-implemented technique is described herein for training a personal digital assistant (PDA) component and a simulated user (SU) component via a self-learning strategy. The technique involves conducting interactions between the PDA component and the SU component over the course of plural dialogs, and with respect to plural tasks. These interactions yield training data. A training system uses the training data to generate and update analysis components used by both the PDA component and the SU component. According to one illustrative aspect, the SU component is configured to mimic the behavior of actual users, across a range of different user types.
    Type: Grant
    Filed: May 22, 2016
    Date of Patent: September 17, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ruhi Sarikaya, Paul A. Crook, Marius Alexandru Marin
  • Patent number: 10395655
    Abstract: Techniques for determining a command or intent likely to be subsequently invoked by a user of a system are described. A user inputs a command (either via a spoken utterance or textual input) to a system. The system determines content responsive to the command. The system also determines a second command or corresponding intent likely to be invoked by the user subsequent to the previous command. Such determination may involve analyzing pairs of intents, with each pair being associated with a probability that one intent of the pair will be invoked by a user subsequent to a second intent of the pair. The system then outputs first content responsive to the first command and second content soliciting the user as to whether the system to execute the second command.
    Type: Grant
    Filed: September 13, 2017
    Date of Patent: August 27, 2019
    Assignee: Amazon Technologies, Inc.
    Inventors: Anjishnu Kumar, Xing Fan, Arpit Gupta, Ruhi Sarikaya
  • Patent number: 10366690
    Abstract: A canonicalizer can be used with or implemented within a natural language understanding (NLU) component of a speech processing system to enable the system to properly identify an entity to which a user refers in a spoken utterance. The canonicalizer may determine a first canonical value using a gazetteer associated with a determined intent of the spoken utterance. The canonicalizer may determine a second canonical value using a look-up table of canonical values. The canonicalizer may then output either the first canonical value or the second canonical value for further NLU processing, such as entity resolution.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: July 30, 2019
    Assignee: Amazon Technologies, Inc.
    Inventor: Ruhi Sarikaya
  • Patent number: 10360300
    Abstract: Multi-turn cross-domain natural language understanding (NLU) systems and platforms for building the multi-turn cross-domain NLU system are provided. Further, methods for using and building the multi-turn cross-domain NLU system are provided. More specifically, the multi-turn cross-domain NLU system supports multi-turn bot/agent/application scenarios for new domains without having to select a task definition and/or define a new schema during the building of the NLU system. Accordingly, the platform for building the multi-turn cross-domain NLU system that does not require the builder to select a task and/or build a schema for a selected task provides an easy to use, cost effective, and efficient service for building a NLU system. Further, the multi-turn cross-domain NLU system provides a more versatile NLU system than previously utilized NLU systems that were trained for and limited to a selected task and/or domain.
    Type: Grant
    Filed: August 24, 2016
    Date of Patent: July 23, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ruhi Sarikaya, Young-Bum Kim, Alexandre Rochette
  • Patent number: 10338959
    Abstract: Non-limiting examples of the present disclosure describe decoupling task state tracking that is managed by a shared task completion platform from execution of tasks by a task resource owner. Task registration data is received at a shared task state platform for a task that is executable by a task owner resource. Task registration data comprises parameters to be collected for execution of the task and ancillary information, such as the name of the task and whether to confirm the values of the parameters after collection. During interaction with a user, the shared task completion platform receives an input and determines the task is associated with the received input. During the interaction, parameters of the received task registration data are utilized to collect data for execution of the task. The collected data is transmitted to the task owner resource for execution of the task.
    Type: Grant
    Filed: July 13, 2015
    Date of Patent: July 2, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Omar Zia Khan, Paul Anthony Crook, Marius Alexandru Marin, Ruhi Sarikaya, Jean-Philippe Robichaud
  • Patent number: 10339916
    Abstract: Non-limiting examples of the present disclosure describe generation and application of a universal hypothesis ranking model to rank/re-re-rank dialog hypotheses. An input is received through a user interface of an application for dialog processing. A plurality of dialog hypotheses are generated based on input understanding processing of the received input. The plurality of dialog hypotheses are ranked using a universal hypothesis ranking model that is applicable to a plurality of languages and locales. The ranking of the plurality of dialog hypotheses comprises using the universal hypothesis ranking model to analyze language independent features of the plurality of dialog hypotheses for policy determination. Other examples are also described including examples directed to generation of the universal hypothesis ranking model.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: July 2, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ruhi Sarikaya, Paul Anthony Crook
  • Patent number: 10304448
    Abstract: Environmental conditions, along with other information, are used to adjust a response of a conversational dialog system. The environmental conditions may be used at different times within the conversational dialog system. For example, the environmental conditions can be used to adjust the dialog manager's output (e.g., the machine action). The dialog state information that is used by the dialog manager includes environmental conditions for the current turn in the dialog as well as environmental conditions for one or more past turns in the dialog. The environmental conditions can also be used after receiving the machine action to adjust the response that is provided to the user. For example, the environmental conditions may affect the machine action that is determined as well as how the action is provided to the user. The dialog manager and the response generation components in the conversational dialog system each use the available environmental conditions.
    Type: Grant
    Filed: February 21, 2017
    Date of Patent: May 28, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Daniel Boies, Larry Heck, Tasos Anastasakos, Ruhi Sarikaya
  • Patent number: 10249297
    Abstract: Examples of the present disclosure describe processing by an input understanding system/service. A received input is processed to generate a set of alternatives for recognizing the received input. The set of alternatives is filtered. Filtering comprises ranking the set of alternatives and propagating a plurality of the ranked alternatives for additional processing. The propagated alternatives are processed to generate an expanded set of alternatives for potential hypotheses based on the received input. The expanded set of alternatives is filtered. Filtering comprises ranking alternatives of the expanded set and propagating a plurality of the ranked alternatives of the expanded set for additional processing. The propagated alternatives of the expanded set are evaluated based on application of knowledge data fetched from external resources. A response to the received input is generated.
    Type: Grant
    Filed: July 13, 2015
    Date of Patent: April 2, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Omar Zia Khan, Ruhi Sarikaya
  • Patent number: 10229687
    Abstract: A computer-implemented technique is described for processing a linguistic item (e.g., a query) in an efficient and scalable manner. The technique interprets the linguistic item using a language understanding (LU) system in a manner that is based on a particular endpoint mechanism from which the linguistic item originated. The LU system may include an endpoint-independent subsystem, an endpoint-dependent subsystem, and a ranking component. The endpoint-independent subsystem interprets the linguistic item in a manner that is independent of the particular endpoint mechanism. The endpoint-dependent subsystem interprets the linguistic item in a manner that is dependent on the particular endpoint mechanism. The ranking component generates final interpretation results based on intermediate results generated by the endpoint-independent subsystem and the endpoint-dependent subsystem, e.g., by identifying the most likely interpretation of the linguistic item.
    Type: Grant
    Filed: March 10, 2016
    Date of Patent: March 12, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Minwoo Jeong, Ruhi Sarikaya