Patents Assigned to SigOpt, Inc.
-
Patent number: 10740695Abstract: Systems and methods for tuning hyperparameters of a model includes: receiving a multi-criteria tuning work request for tuning hyperparameters of the model of the subscriber to the remote tuning service, wherein the multi-criteria tuning work request includes: a first objective function of the model to be optimized by the remote tuning service; a second objective function to be optimized by the remote tuning service, the second objective function being distinct from the first objective function; computing a joint tuning function based on a combination of the first objective function and the second objective function; executing a tuning operation of the hyperparameters for the model based on a tuning of the joint function; and identifying one or more proposed hyperparameter values based on one or more hyperparameter-based points along a convex Pareto optimal curve.Type: GrantFiled: November 26, 2019Date of Patent: August 11, 2020Assignee: SigOpt, Inc.Inventors: Bolong Cheng, Olivia Kim, Michael McCourt, Patrick Hayes, Scott Clark
-
Patent number: 10621514Abstract: Systems and methods for tuning hyperparameters of a model includes: receiving at a remote tuning service a multi-criteria tuning work request for tuning hyperparameters of the model of a subscriber, wherein the multi-criteria tuning work request includes: a first objective function of the model to be optimized by the remote tuning service; a second objective function to be optimized by the remote tuning service, the second objective function being distinct from the first objective function; computing a first conditionally constrained joint function for the model based on subjecting the first objective function to the second objective function; a second conditionally constrained joint function for the model based on subjecting the second objective function to the first objective function of the model; executing a tuning operation of the hyperparameters for the model; and identifying proposed hyperparameter values based on one or more hyperparameter-based points along a non-convex Pareto optimal curve.Type: GrantFiled: November 26, 2019Date of Patent: April 14, 2020Assignee: SigOpt, Inc.Inventors: Bolong Cheng, Olivia Kim, Michael McCourt, Patrick Hayes, Scott Clark
-
Patent number: 10607159Abstract: A system and method includes receiving a tuning work request for tuning an external machine learning model; implementing a plurality of distinct queue worker machines that perform various tuning operations based on the tuning work data of the tuning work request; implementing a plurality of distinct tuning sources that generate values for each of the one or more hyperparameters of the tuning work request; selecting, by one or more queue worker machines of the plurality of distinct queue worker machines, one or more tuning sources of the plurality of distinct tuning sources for tuning the one or more hyperparameters; and using the selected one or more tuning sources to generate one or more suggestions for the one or more hyperparameters, the one or more suggestions comprising values for the one or more hyperparameters of the tuning work request.Type: GrantFiled: January 9, 2019Date of Patent: March 31, 2020Assignee: SigOpt, Inc.Inventors: Patrick Hayes, Michael McCourt, Alexandra Johnson, George Ke, Scott Clark
-
Patent number: 10565025Abstract: Systems and methods for implementing an application programming interface (API) that controls operations of a machine learning tuning service for tuning a machine learning model for improved accuracy and computational performance includes an API that is in control communication the tuning service that: executes a first API call function that includes an optimization work request that sets tuning parameters for tuning hyperparameters of a machine learning model; and initializes an operation of distinct tuning worker instances of the service that each execute distinct tuning tasks for tuning the hyperparameters; executes a second API call function that identifies raw values for the hyperparameters; and generates suggestions comprising proposed hyperparameter values selected from the plurality of raw values for each of the hyperparameters; and executes a third API call function that returns performance metrics relating to a real-world performance of the subscriber machine learning model executed with the proposeType: GrantFiled: September 4, 2019Date of Patent: February 18, 2020Assignee: SigOpt, Inc.Inventors: Alexandra Johnson, Patrick Hayes, Scott Clark
-
Patent number: 10558934Abstract: Systems and methods for tuning hyperparameters of a model includes: receiving at a remote tuning service a multi-criteria tuning work request for tuning hyperparameters of the model of a subscriber, wherein the multi-criteria tuning work request includes: a first objective function of the model to be optimized by the remote tuning service; a second objective function to be optimized by the remote tuning service, the second objective function being distinct from the first objective function; computing a first conditionally constrained joint function for the model based on subjecting the first objective function to the second objective function; a second conditionally constrained joint function for the model based on subjecting the second objective function to the first objective function of the model; executing a tuning operation of the hyperparameters for the model; and identifying proposed hyperparameter values based on one or more hyperparameter-based points along a non-convex Pareto optimal curve.Type: GrantFiled: July 31, 2019Date of Patent: February 11, 2020Assignee: SigOpt, Inc.Inventors: Bolong Cheng, Olivia Kim, Michael McCourt, Patrick Hayes, Scott Clark
-
Patent number: 10528891Abstract: Systems and methods for tuning hyperparameters of a model includes: receiving a multi-criteria tuning work request for tuning hyperparameters of the model of the subscriber to the remote tuning service, wherein the multi-criteria tuning work request includes: a first objective function of the model to be optimized by the remote tuning service; a second objective function to be optimized by the remote tuning service, the second objective function being distinct from the first objective function; computing a joint tuning function based on a combination of the first objective function and the second objective function; executing a tuning operation of the hyperparameters for the model based on a tuning of the joint function; and identifying one or more proposed hyperparameter values based on one or more hyperparameter-based points along a convex Pareto optimal curve.Type: GrantFiled: July 31, 2019Date of Patent: January 7, 2020Assignee: SigOpt, Inc.Inventors: Bolong Cheng, Olivia Kim, Michael McCourt, Patrick Hayes, Scott Clark
-
Patent number: 10445150Abstract: Systems and methods for implementing an application programming interface (API) that controls operations of a machine learning tuning service for tuning a machine learning model for improved accuracy and computational performance includes an API that is in control communication the tuning service that: executes a first API call function that includes an optimization work request that sets tuning parameters for tuning hyperparameters of a machine learning model; and initializes an operation of distinct tuning worker instances of the service that each execute distinct tuning tasks for tuning the hyperparameters; executes a second API call function that identifies raw values for the hyperparameters; and generates suggestions comprising proposed hyperparameter values selected from the plurality of raw values for each of the hyperparameters; and executes a third API call function that returns performance metrics relating to a real-world performance of the subscriber machine learning model executed with the proposeType: GrantFiled: June 24, 2019Date of Patent: October 15, 2019Assignee: SigOpt, Inc.Inventors: Alexandra Johnson, Patrick Hayes, Scott Clark
-
Patent number: 10379913Abstract: Systems and methods for implementing an application programming interface (API) that controls operations of a machine learning tuning service for tuning a machine learning model for improved accuracy and computational performance includes an API that is in control communication the tuning service that: executes a first API call function that includes an optimization work request that sets tuning parameters for tuning hyperparameters of a machine learning model; and initializes an operation of distinct tuning worker instances of the service that each execute distinct tuning tasks for tuning the hyperparameters; executes a second API call function that identifies raw values for the hyperparameters; and generates suggestions comprising proposed hyperparameter values selected from the plurality of raw values for each of the hyperparameters; and executes a third API call function that returns performance metrics relating to a real-world performance of the subscriber machine learning model executed with the proposeType: GrantFiled: March 20, 2019Date of Patent: August 13, 2019Assignee: SigOpt, Inc.Inventors: Alexandra Johnson, Patrick Hayes, Scott Clark
-
Patent number: 10282237Abstract: Systems and methods for implementing an application programming interface (API) that controls operations of a machine learning tuning service for tuning a machine learning model for improved accuracy and computational performance includes an API that is in control communication the tuning service that: executes a first API call function that includes an optimization work request that sets tuning parameters for tuning hyperparameters of a machine learning model; and initializes an operation of distinct tuning worker instances of the service that each execute distinct tuning tasks for tuning the hyperparameters; executes a second API call function that identifies raw values for the hyperparameters; and generates suggestions comprising proposed hyperparameter values selected from the plurality of raw values for each of the hyperparameters; and executes a third API call function that returns performance metrics relating to a real-world performance of the subscriber machine learning model executed with the proposeType: GrantFiled: October 29, 2018Date of Patent: May 7, 2019Assignee: SigOpt, Inc.Inventors: Alexandra Johnson, Patrick Hayes, Scott Clark
-
Patent number: 10217061Abstract: A system and method includes receiving a tuning work request for tuning an external machine learning model; implementing a plurality of distinct queue worker machines that perform various tuning operations based on the tuning work data of the tuning work request; implementing a plurality of distinct tuning sources that generate values for each of the one or more hyperparameters of the tuning work request; selecting, by one or more queue worker machines of the plurality of distinct queue worker machines, one or more tuning sources of the plurality of distinct tuning sources for tuning the one or more hyperparameters; and using the selected one or more tuning sources to generate one or more suggestions for the one or more hyperparameters, the one or more suggestions comprising values for the one or more hyperparameters of the tuning work request.Type: GrantFiled: May 11, 2018Date of Patent: February 26, 2019Assignee: SigOpt, Inc.Inventors: Patrick Hayes, Michael McCourt, Alexandra Johnson, George Ke, Scott Clark