Patents by Inventor Jurij Leskovec

Jurij Leskovec has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240152754
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.
    Type: Application
    Filed: January 16, 2024
    Publication date: May 9, 2024
    Applicant: Pinterest, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Patent number: 11922308
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.
    Type: Grant
    Filed: January 17, 2022
    Date of Patent: March 5, 2024
    Assignee: Pinterest, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Publication number: 20230385338
    Abstract: This disclosure describes systems and methods that facilitate the generation of recommendations by traversing a graph. Walks that traverse the graph may be initiated from a plurality of different nodes in the node graph. In order to give greater or lesser weight to particular nodes, the walks may have different lengths depending on the nodes from which they are initiated, or an unequal amount of walks may be distributed between nodes from which walks are initiated. A plurality of walks through a node graph may be tracked, and visit counts or scores for nodes in the node graph may be determined. For example, scores may be increased for nodes that are visited by a walk initiated from a first node and a second walk initiated from a second node, or scores may be decreased for nodes that are not visited by a first walk initiated from a first node and a second walk initiated from a second node. Content corresponding to nodes may be recommended based on the scores or visit counts.
    Type: Application
    Filed: August 3, 2023
    Publication date: November 30, 2023
    Applicant: Pinterest, Inc.
    Inventors: Chantat Eksombatchai, Jurij Leskovec, Rahul Sharma, Charles Walsh Sugnet, Mark Bormann Ulrich
  • Patent number: 11797838
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. The embeddings correspond to aggregated embedding vectors for nodes of the corpus graph. Without processing the entire corpus graph to generate all aggregated embedding vectors, a relevant neighborhood of nodes within the corpus graph are identified for a target node of the corpus graph. Based on embedding information of the target node's immediate neighbors, and also upon neighborhood embedding information from the target node's relevant neighborhood, an aggregated embedding vector can be generated for the target node that comprises both an embedding vector portion corresponding to the target node, as well as a neighborhood embedding vector portion, corresponding to embedding information of the relevant neighborhood of the target node. Utilizing both portions of the aggregated embedding vector leads to improved content recommendation to a user in response to a query.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: October 24, 2023
    Assignee: Pinterest, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Ruining He, Kaifeng Chen, Rex Ying
  • Patent number: 11783175
    Abstract: Systems and methods for efficiently training a machine learning model are presented. More particularly, using information regarding the relevant neighborhoods of target nodes within a body of training data, the training data can be organized such that the initial state of the training data is relatively easy for a machine learning model to differentiate. Once trained on the initial training data, the training data is then updated such that differentiating between a matching and a non-matching node is more difficult. Indeed, by iteratively updating the difficulty of the training data and then training the machine learning model on the updated training data, the speed that the machine learning model reaches a desired level of accuracy is significantly improved, resulting in reduced time and effort in training the machine learning model.
    Type: Grant
    Filed: February 12, 2019
    Date of Patent: October 10, 2023
    Assignee: Pinterest, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Patent number: 11762908
    Abstract: This disclosure describes systems and methods that facilitate the generation of recommendations by traversing a graph. Walks that traverse the graph may be initiated from a plurality of different nodes in the node graph. In order to give greater or lesser weight to particular nodes, the walks may have different lengths depending on the nodes from which they are initiated, or an unequal amount of walks may be distributed between nodes from which walks are initiated. A plurality of walks through a node graph may be tracked, and visit counts or scores for nodes in the node graph may be determined. For example, scores may be increased for nodes that are visited by a walk initiated from a first node and a second walk initiated from a second node, or scores may be decreased for nodes that are not visited by a first walk initiated from a first node and a second walk initiated from a second node. Content corresponding to nodes may be recommended based on the scores or visit counts.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: September 19, 2023
    Assignee: Pinterest, Inc.
    Inventors: Chantat Eksombatchai, Jurij Leskovec, Rahul Sharma, Charles Walsh Sugnet, Mark Bormann Ulrich
  • Publication number: 20230252550
    Abstract: Described are systems and methods for providing a multi-tasked trained machine learning model that may be configured to generate product embeddings from multiple types of product information. The exemplary product embeddings may be generated for a corpus of products (e.g., products included in a product catalog, etc.) based on both image information and text information associated with each respective product. Accordingly, the generated product embeddings may be compatible with learned representations of the different types of product information (e.g., image information, text information, etc.) and may be used to create a product index, which can be used to determine and serve product recommendations in connection with multiple different recommendation services that may be configured to receive different types of inputs (e.g., a single image, multiple images, text-based information, etc.).
    Type: Application
    Filed: February 9, 2023
    Publication date: August 10, 2023
    Applicant: Pinterest, Inc.
    Inventors: Paul Baltescu, Andrew Huan Zhai, Haoyu Chen, Jurij Leskovec, Nikil Pancha, Charles Joseph Rosenberg
  • Publication number: 20220374474
    Abstract: Systems and methods for recommending content to an online service subscriber are presented. For each subscriber, content items that were the subject of the subscriber's prior interactions are projected, via associated embedding vectors, into a content item embedding space. The content items, via their projections into the content item embedding space, are clustered to form a plurality of interest clusters for the subscriber. A representative embedding vector is determined for each interest cluster, and a plurality of these embedding vectors are stored as the representative embedding vectors for the subscriber. The online service, in response to a request for recommended content for a subscriber, selects a first representative embedding vector associated with the subscriber and identifies a new content item from a corpus of content items according to a similarity measure between the first representative embedding vector and an embedding vector associated with the new content item.
    Type: Application
    Filed: August 8, 2022
    Publication date: November 24, 2022
    Inventors: Aditya Pal, Chantat Eksombatchai, Yitong Zhou, Bo Zhao, Charles Joseph Rosenberg, Jurij Leskovec
  • Publication number: 20220318307
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.
    Type: Application
    Filed: January 17, 2022
    Publication date: October 6, 2022
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Patent number: 11409821
    Abstract: Systems and methods for recommending content to an online service subscriber are presented. For each subscriber, content items that were the subject of the subscriber's prior interactions are projected, via associated embedding vectors, into a content item embedding space. The content items, via their projections into the content item embedding space, are clustered to form a plurality of interest clusters for the subscriber. A representative embedding vector is determined for each interest cluster, and a plurality of these embedding vectors are stored as the representative embedding vectors for the subscriber. The online service, in response to a request for recommended content for a subscriber, selects a first representative embedding vector associated with the subscriber and identifies a new content item from a corpus of content items according to a similarity measure between the first representative embedding vector and an embedding vector associated with the new content item.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: August 9, 2022
    Assignee: Pinterest, Inc.
    Inventors: Aditya Pal, Chantat Eksombatchai, Yitong Zhou, Bo Zhao, Charles Joseph Rosenberg, Jurij Leskovec
  • Publication number: 20220092413
    Abstract: System and method for completing knowledge graph. The system includes a computing device, the computing device has a processer and a storage device storing computer executable code. The computer executable code is configured to: provide an incomplete knowledge graph comprising a plurality of nodes and a plurality of edges, each of the edges connecting two of the plurality of nodes; calculate an attention matrix of the incomplete knowledge graph based on one-hop attention between any two of the plurality of the nodes that are connected by one of the plurality of the edges; calculate multi-head diffusion attention for any two of the plurality of nodes from the attention matrix; obtain updated embedding of the incomplete knowledge graph using the multi-head diffusion attention; and update the incomplete knowledge graph to obtain updated knowledge graph based on the updated embedding.
    Type: Application
    Filed: May 24, 2021
    Publication date: March 24, 2022
    Inventors: Guangtao Wang, Zhitao Ying, Jing Huang, Jurij Leskovec
  • Patent number: 11256747
    Abstract: This disclosure describes systems and methods that facilitate reducing a data set that may be used to construct a node graph. For example, the data set may include collections, representations, and associations between the collections and the representations. Topic scores may be determined for the representations, and diversity scores for each collection may be determined based on the topic scores of representations that are associated with the respective collection. If the diversity score is too high, then the collection and its associations are excluded from being incorporated into a node graph that is subsequently constructed from the data set. Topic scores may also be determined for collections in the data set based on the topic scores of representations that are associated with each collection.
    Type: Grant
    Filed: January 12, 2018
    Date of Patent: February 22, 2022
    Assignee: Pinterest, Inc.
    Inventors: Chantat Eksombatchai, Jurij Leskovec, Zitao Liu, Rahul Sharma, Mark Bormann Ulrich
  • Patent number: 11232152
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.
    Type: Grant
    Filed: November 1, 2018
    Date of Patent: January 25, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Patent number: 11227012
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.
    Type: Grant
    Filed: February 12, 2019
    Date of Patent: January 18, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Patent number: 11227014
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, embedding information of a target node may be based on the node itself, as well as related, relevant nodes to the target node within a corpus graph. The information of various nodes among the relevant nodes to the target node can be used to weight or influence the embedding information. Disclosed systems and methods include generating neighborhood embedding information for a target node, where the neighborhood embedding information includes embedding information from neighborhood nodes of the target node's relevant neighborhood, and where certain nodes having more relevance to the target node can be weighted to influence the generation of the neighborhood embedding information over nodes having less relevance to the target node.
    Type: Grant
    Filed: February 12, 2019
    Date of Patent: January 18, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Patent number: 11227013
    Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.
    Type: Grant
    Filed: February 12, 2019
    Date of Patent: January 18, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Jurij Leskovec, Chantat Eksombatchai, Kaifeng Chen, Ruining He, Rex Ying
  • Publication number: 20210360077
    Abstract: Described are systems and methods for determining session intent of a user. Different users can use a network-based application in many different ways based on, for example, the user's purpose for using the application, the device on which the user is executing the application, the user themselves, date, time, location, etc. Through the collection of user activities during a user session, the intent of a user session can be determined. Once determined, content provided through the application can be further personalized to correspond to the determined session intent.
    Type: Application
    Filed: August 2, 2021
    Publication date: November 18, 2021
    Inventors: Dorna Bandari, Daniel Isaac Lurie, Jurij Leskovec, Shuo Xiang, Tien Tran Tu Quynh Nguyen
  • Patent number: 11082509
    Abstract: Described are systems and methods for determining session intent of a user. Different users can use a network-based application in many different ways based on, for example, the user's purpose for using the application, the device on which the user is executing the application, the user themselves, date, time, location, etc. Through the collection of user activities during a user session, the intent of a user session can be determined. Once determined, content provided through the application can be further personalized to correspond to the determined session intent.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: August 3, 2021
    Assignee: Pinterest, Inc.
    Inventors: Dorna Bandari, Daniel Isaac Lurie, Jurij Leskovec, Shuo Xiang, Tien Tran Tu Quynh Nguyen
  • Patent number: 10762134
    Abstract: This disclosure describes systems and methods that facilitate the generation of recommendations by traversing a graph. Walks that traverse the graph may be initiated from a plurality of different nodes in the node graph. In order to give greater or lesser weight to particular nodes, the walks may have different lengths depending on the nodes from which they are initiated, or an unequal amount of walks may be distributed between nodes from which walks are initiated. A plurality of walks through a node graph may be tracked, and visit counts or scores for nodes in the node graph may be determined. For example, scores may be increased for nodes that are visited by a walk initiated from a first node and a second walk initiated from a second node, or scores may be decreased for nodes that are not visited by a first walk initiated from a first node and a second walk initiated from a second node. Content corresponding to nodes may be recommended based on the scores or visit counts.
    Type: Grant
    Filed: January 12, 2018
    Date of Patent: September 1, 2020
    Assignee: Pinterest, Inc.
    Inventors: Chantat Eksombatchai, Jurij Leskovec, Rahul Sharma, Charles Walsh Sugnet, Mark Bormann Ulrich
  • Patent number: 10740399
    Abstract: This disclosure describes systems and methods that facilitate generating recommendations by traversing a node graph. For example, recommendations may be generated for a node in the node graph by running a plurality of walks through the node graph and tracking the nodes visited by the walks. For example, a visit count or score may be maintained and/or updated for each node as the walks traverse through the node graph. The walks may be terminated after a defined amount of nodes in the node graph have visit counts or scores that satisfy a criterion. Content corresponding to nodes with the highest visit counts or scores may be recommended.
    Type: Grant
    Filed: January 12, 2018
    Date of Patent: August 11, 2020
    Assignee: Pinterest, Inc.
    Inventors: Chantat Eksombatchai, Jurij Leskovec, Pranav Jindal, Rahul Sharma, Mark Bormann Ulrich