Patents by Inventor Zohar Karnin

Zohar Karnin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12061963
    Abstract: Techniques for automated machine learning (ML) pipeline exploration and deployment are described. An automated ML pipeline generation system allows users to easily construct optimized ML pipelines by providing a dataset, identifying a target column in the dataset, and providing an exploration budget. Multiple candidate ML pipelines can be identified and evaluated through an exploration process, and a best ML pipeline can be provided to the requesting user or deployed for production inference. Users can configure, monitor, and adapt the exploration at multiple points in time throughout.
    Type: Grant
    Filed: June 23, 2023
    Date of Patent: August 13, 2024
    Assignee: Amazon Technologies, Inc.
    Inventors: Tanya Bansal, Piali Das, Leo Parker Dirac, Fan Li, Zohar Karnin, Philip Gautier, Patricia Grao Gil, Laurence Louis Eric Rouesnel, Ravikumar Anantakrishnan Venkateswar, Orchid Majumder, Stefano Stefani, Vladimir Zhukov
  • Patent number: 11727314
    Abstract: Techniques for automated machine learning (ML) pipeline exploration and deployment are described. An automated ML pipeline generation system allows users to easily construct optimized ML pipelines by providing a dataset, identifying a target column in the dataset, and providing an exploration budget. Multiple candidate ML pipelines can be identified and evaluated through an exploration process, and a best ML pipeline can be provided to the requesting user or deployed for production inference. Users can configure, monitor, and adapt the exploration at multiple points in time throughout.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: August 15, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Tanya Bansal, Piali Das, Leo Parker Dirac, Fan Li, Zohar Karnin, Philip Gautier, Patricia Grao Gil, Laurence Louis Eric Rouesnel, Ravikumar Anantakrishnan Venkateswar, Orchid Majumder, Stefano Stefani, Vladimir Zhukov
  • Patent number: 11537439
    Abstract: Techniques for intelligent compute resource selection and utilization for machine learning training jobs are described. At least a portion of a machine learning (ML) training job is executed a plurality of times using a plurality of different resource configurations, where each of the plurality of resource configurations includes at least a different type or amount of compute instances. A performance metric is measured for each of the plurality of the executions, and can be used along with a desired performance characteristic to generate a recommended resource configuration for the ML training job. The ML training job is executed using the recommended resource configuration.
    Type: Grant
    Filed: March 23, 2018
    Date of Patent: December 27, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Edo Liberty, Thomas Albert Faulhaber, Jr., Zohar Karnin, Gowda Dayananda Anjaneyapura Range, Amir Sadoughi, Swaminathan Sivasubramanian, Alexander Johannes Smola, Stefano Stefani, Craig Wiley
  • Patent number: 11449798
    Abstract: Methods, systems, and computer-readable media for automated problem detection for machine learning models are disclosed. A machine learning analysis system receives data associated with use of a machine learning model. The data was collected by a machine learning inference system and comprises input to the model or a plurality of inferences representing output of the machine learning model. The machine learning analysis system performs analysis of the data associated with the use of the machine learning model. The machine learning analysis system detects one or more problems associated with the use of the machine learning model based at least in part on the analysis. The machine learning analysis system initiates one or more remedial actions associated with the one or more problems associated with the use of the machine learning model.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: September 20, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Andrea Olgiati, Maximiliano Maccanti, Arun Babu Nagarajan, Lakshmi Naarayanan Ramakrishnan, Urvashi Chowdhary, Gowda Dayananda Anjaneyapura Range, Zohar Karnin, Laurence Louis Eric Rouesnel, Stefano Stefani, Vladimir Zhukov
  • Patent number: 11257002
    Abstract: Techniques for dynamic accuracy-based experimentation and deployment of machine learning (ML) models are described. Inference traffic flowing to ML models and the accuracy of the models is analyzed and used to ensure that better performing models are executed more often via model selection. A predictive component can evaluate which model is more likely to be accurate for certain input data elements. Ensemble techniques can combine inference results of multiple ML models to aim to achieve a better overall result than any individual model could on its own.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: February 22, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Thomas Albert Faulhaber, Jr., Edo Liberty, Stefano Stefani, Zohar Karnin, Craig Wiley, Steven Andrew Loeppky, Swaminathan Sivasubramanian, Alexander Johannes Smola, Taylor Goodhart
  • Publication number: 20210097433
    Abstract: Methods, systems, and computer-readable media for automated problem detection for machine learning models are disclosed. A machine learning analysis system receives data associated with use of a machine learning model. The data was collected by a machine learning inference system and comprises input to the model or a plurality of inferences representing output of the machine learning model. The machine learning analysis system performs analysis of the data associated with the use of the machine learning model. The machine learning analysis system detects one or more problems associated with the use of the machine learning model based at least in part on the analysis. The machine learning analysis system initiates one or more remedial actions associated with the one or more problems associated with the use of the machine learning model.
    Type: Application
    Filed: September 30, 2019
    Publication date: April 1, 2021
    Applicant: Amazon Technologies, Inc.
    Inventors: Andrea Olgiati, Maximiliano Maccanti, Arun Babu Nagarajan, Lakshmi Naarayanan Ramakrishnan, Urvashi Chowdhary, Gowda Dayananda Anjaneyapura Range, Zohar Karnin, Laurence Louis Eric Rouesnel, Stefano Stefani, Vladimir Zhukov
  • Publication number: 20210097444
    Abstract: Techniques for automated machine learning (ML) pipeline exploration and deployment are described. An automated ML pipeline generation system allows users to easily construct optimized ML pipelines by providing a dataset, identifying a target column in the dataset, and providing an exploration budget. Multiple candidate ML pipelines can be identified and evaluated through an exploration process, and a best ML pipeline can be provided to the requesting user or deployed for production inference. Users can configure, monitor, and adapt the exploration at multiple points in time throughout.
    Type: Application
    Filed: September 30, 2019
    Publication date: April 1, 2021
    Inventors: Tanya BANSAL, Piali DAS, Leo Parker DIRAC, Fan LI, Zohar KARNIN, Philip GAUTIER, Patricia GRAO GIL, Laurence Louis Eric ROUESNEL, Ravikumar Anantakrishnan VENKATESWAR, Orchid MAJUMDER, Stefano Stefani, Vladimir Zhukov
  • Patent number: 10885548
    Abstract: Disclosed is a system and method for email management that leverages information derived from automatically generated templates in order to identify types of message and message content. The systems and methods discussed herein involve identifying messages matching specific template types and structures, and automatically extracting important data from email messages matching those templates. The extracted data enables improvements for a user's experience and increased monetization. That is, templates can be analyzed to determine a type of email message, which in turn can be presented to a receiving user within an automatic folder or tag designation. Additionally, email snippets or previews can be generated from the extracted data for display within a user's inbox. Also, the extracted data can be used for monetization purposes, by serving targeted advertisements based upon the data extracted from such messages.
    Type: Grant
    Filed: September 6, 2013
    Date of Patent: January 5, 2021
    Assignee: VERIZON MEDIA INC.
    Inventors: Zohar Karnin, Edo Liberty, David Wajc, Guy Halawi
  • Patent number: 10778618
    Abstract: A computer system, computer program product, and computer-implemented method for communicating electronic messages over a communication network coupled thereto are provided. The computer system comprises a network interface for receiving messages sent over the network and addressed to a user of the computer system; and computer executable electronic message processing software. The software comprises instructions for directing the computer system to receive a message over the network, and to identify whether a sender of the received electronic message is a human or a machine. The identifying includes first and second phases of operation. The first phase includes an offline phase employing information and activities resident on the computer system. The second phase includes an online phase employing resources remotely accessible over the network.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: September 15, 2020
    Assignee: OATH INC.
    Inventors: Zohar Karnin, Guy Halawi, David Wajc, Edo Liberty
  • Patent number: 10699198
    Abstract: Method, system, and programs for estimating interests of a plurality of users with respect to a new piece of information are disclosed. In one example, historical interests of the plurality of users are obtained with respect to one or more existing pieces of information. One or more users are selected from the plurality of users. Historical interests of the one or more users can minimize an objective function over the plurality of users. Interests of the one or more users are obtained with respect to the new piece of information. Estimated interests of the plurality of users are generated with respect to the new piece of information based on the obtained interests of the one or more users.
    Type: Grant
    Filed: October 21, 2014
    Date of Patent: June 30, 2020
    Assignee: Oath Inc.
    Inventors: Oren Shlomo Somekh, Shahar Golan, Nadav Golbandi, Zohar Karnin, Oleg Rokhlenko, Oren Anava, Ronny Lempel
  • Patent number: 10397152
    Abstract: Disclosed is a system, method, and non-transitory computer readable storage medium for predicting future messages. A processor receives a message sent to a user operating a client device, analyzes the message in light of previously identified patterns and scores assigned to scanned messages, determines a future message that should be received by the client device based on the received message, and transmits an item of information based on the determined future message.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: August 27, 2019
    Assignee: EXCALIBUR IP, LLC
    Inventors: Zohar Karnin, Yoelle Maarek, David Wajc, Iftah Gamzu
  • Patent number: 10374995
    Abstract: As is disclosed herein, user behavior in connection with a number of electronic messages, such as electronic mail (email) messages, can be used to automatically learn from, and predict, whether a message is wanted or unwanted by the user, where an unwanted message is referred to herein as gray spam. A gray spam predictor is personalized for a given user in vertical learning that uses the user's electronic message behavior and horizontal learning that uses other users' message behavior. The gray spam predictor can be used to predict whether a new message for the user is, or is not, gray spam. A confidence in a prediction may be used in determining the disposition of the message, such as and without limitation placing the message in a spam folder, a gray spam folder and/or requesting input from the user regarding the disposition of the message, for example.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: August 6, 2019
    Assignee: OATH INC.
    Inventors: Liane Lewin-Eytan, Guy Halawi, Dotan Di Castro, Zohar Karnin, Yoelle Maarek, Michael Albers
  • Publication number: 20190156247
    Abstract: Techniques for dynamic accuracy-based experimentation and deployment of machine learning (ML) models are described. Inference traffic flowing to ML models and the accuracy of the models is analyzed and used to ensure that better performing models are executed more often via model selection. A predictive component can evaluate which model is more likely to be accurate for certain input data elements. Ensemble techniques can combine inference results of multiple ML models to aim to achieve a better overall result than any individual model could on its own.
    Type: Application
    Filed: March 13, 2018
    Publication date: May 23, 2019
    Inventors: Thomas Albert FAULHABER, JR., Edo LIBERTY, Stefano STEFANI, Zohar KARNIN, Craig WILEY, Steven Andrew LOEPPKY, Swaminathan SIVASUBRAMANIAN, Alexander Johannes SMOLA, Taylor GOODHART
  • Patent number: 9838348
    Abstract: A search query for searching electronic messages, such as email, may be used to search for different types of items, such as and without limitation electronic messages, contacts, photos, documents, such as and without limitation papers, presentations, etc., business entities, personal information extracted from messages, such as and without limitation purchase orders, shipments, reservations, travel itineraries, etc. Several sources of data, which may be indexed for searching, such as and without limitation a personal mail search index, contacts, or business entity, index, attachments index, extracted data index, etc. may be searched using the search query. A number of top search result items, which may include different types of items, may be presented apart from other search result items.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: December 5, 2017
    Assignee: YAHOO HOLDINGS, INC.
    Inventors: Yoelle Maarek, Liane Lewin-Eytan, Ariel Raviv, David Carmel, Guy Halawi, Zohar Karnin, Peter Monaco
  • Patent number: 9596205
    Abstract: Disclosed is a system and method for managing mailing list newsletter messages for a recipient user, and organizing such messages in accordance with a receiving user's interests. The present disclosure enables novel organizational tools for emails by intuitively organizing received newsletters and providing highly visible features within a user's inbox respective the newsletters. Organization of received newsletters is ensured through ranking users' mailing lists according to his/her interest in them, based on actions made by the respective user, in addition to actions of other users receiving the same newsletters. Additionally, upon reception of such newsletters, the present disclosure provides a specialized view, in addition to added functionality within a user's inbox, thereby enhancing a user's experience and engagement with received messages of a newsletter.
    Type: Grant
    Filed: August 14, 2013
    Date of Patent: March 14, 2017
    Assignee: Yahoo! Inc.
    Inventors: Zohar Karnin, Michal Aharon, Edo Liberty, Yoelle Maarek Smadja
  • Publication number: 20170005962
    Abstract: As is disclosed herein, user behavior in connection with a number of electronic messages, such as electronic mail (email) messages, can be used to automatically learn from, and predict, whether a message is wanted or unwanted by the user, where an unwanted message is referred to herein as gray spam. A gray spam predictor is personalized for a given user in vertical learning that uses the user's electronic message behavior and horizontal learning that uses other users' message behavior. The gray spam predictor can be used to predict whether a new message for the user is, or is not, gray spam. A confidence in a prediction may be used in determining the disposition of the message, such as and without limitation placing the message in a spam folder, a gray spam folder and/or requesting input from the user regarding the disposition of the message, for example.
    Type: Application
    Filed: June 30, 2015
    Publication date: January 5, 2017
    Inventors: Liane Lewin-Eytan, Guy Halawi, Dotan Di Castro, Zohar Karnin, Yoelle Maarek, Michael Albers
  • Publication number: 20160188599
    Abstract: A search query for searching electronic messages, such as email, may be used to search for different types of items, such as and without limitation electronic messages, contacts, photos, documents, such as and without limitation papers, presentations, etc., business entities, personal information extracted from messages, such as and without limitation purchase orders, shipments, reservations, travel itineraries, etc. Several sources of data, which may be indexed for searching, such as and without limitation a personal mail search index, contacts, or business entity, index, attachments index, extracted data index, etc. may be searched using the search query. A number of top search result items, which may include different types of items, may be presented apart from other search result items.
    Type: Application
    Filed: December 31, 2014
    Publication date: June 30, 2016
    Inventors: Yoelle Maarek, Liane Lewin-Eytan, Ariel Raviv, David Carmel, Guy Halawi, Zohar Karnin, Peter Monaco
  • Publication number: 20160110646
    Abstract: Method, system, and programs for estimating interests of a plurality of users with respect to a new piece of information are disclosed. In one example, historical interests of the plurality of users are obtained with respect to one or more existing pieces of information. One or more users are selected from the plurality of users. Historical interests of the one or more users can minimize an objective function over the plurality of users. Interests of the one or more users are obtained with respect to the new piece of information. Estimated interests of the plurality of users are generated with respect to the new piece of information based on the obtained interests of the one or more users.
    Type: Application
    Filed: October 21, 2014
    Publication date: April 21, 2016
    Inventors: Oren Shlomo Somekh, Shahar Golan, Nadav Golbandi, Zohar Karnin, Oleg Rokhlenko, Oren Anava, Ronny Lempel
  • Publication number: 20150350132
    Abstract: Disclosed is a system, method, and non-transitory computer readable storage medium for predicting future messages. A processor receives a message sent to a user operating a client device, analyzes the message in light of previously identified patterns and scores assigned to scanned messages, determines a future message that should be received by the client device based on the received message, and transmits an item of information based on the determined future message.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Yahoo! Inc.
    Inventors: Zohar Karnin, Yoelle Maarek, David Wajc, Iftah Gamzu
  • Publication number: 20150195224
    Abstract: A computer system, computer program product, and computer-implemented method for communicating electronic messages over a communication network coupled thereto are provided. The computer system comprises a network interface for receiving messages sent over the network and addressed to a user of the computer system; and computer executable electronic message processing software. The software comprises instructions for directing the computer system to receive a message over the network, and to identify whether a sender of the received electronic message is a human or a machine. The identifying includes first and second phases of operation. The first phase includes an offline phase employing information and activities resident on the computer system. The second phase includes an online phase employing resources remotely accessible over the network.
    Type: Application
    Filed: January 9, 2014
    Publication date: July 9, 2015
    Applicant: Yahoo! Inc.
    Inventors: Zohar KARNIN, Guy Halawi, David Wajc, Edo Liberty