Patents by Inventor Nedim Lipka

Nedim Lipka has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240152799
    Abstract: Systems and methods for data augmentation are described. Embodiments of the present disclosure receive a dataset that includes a plurality of nodes and a plurality of edges, wherein each of the plurality of edges connects two of the plurality of nodes; compute a first nonnegative matrix representing a homophilous cluster affinity; compute a second nonnegative matrix representing a heterophilous cluster affinity; compute a probability of an additional edge based on the dataset using a machine learning model that represents a homophilous cluster and a heterophilous cluster based on the first nonnegative matrix and the second nonnegative matrix; and generate an augmented dataset including the plurality of nodes, the plurality of edges, and the additional edge.
    Type: Application
    Filed: October 31, 2022
    Publication date: May 9, 2024
    Inventors: Sudhanshu Chanpuriya, Ryan A. Rossi, Nedim Lipka, Anup Bandigadi Rao, Tung Mai, Zhao Song
  • Publication number: 20240135096
    Abstract: Systems and methods for document classification are described. Embodiments of the present disclosure generate classification data for a plurality of samples using a neural network trained to identify a plurality of known classes; select a set of samples for annotation from the plurality of samples using an open-set metric based on the classification data, wherein the annotation includes an unknown class; and train the neural network to identify the unknown class based on the annotation of the set of samples.
    Type: Application
    Filed: October 23, 2022
    Publication date: April 25, 2024
    Inventors: Rajiv Bhawanji Jain, Michelle Yuan, Vlad Ion Morariu, Ani Nenkova Nenkova, Smitha Bangalore Naresh, Nikolaos Barmpalios, Ruchi Deshpande, Ruiyi Zhang, Jiuxiang Gu, Varun Manjunatha, Nedim Lipka, Andrew Marc Greene
  • Patent number: 11948058
    Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize recurrent neural networks to determine the existence of one or more open intents in a text input, and then extract the one or more open intents from the text input. In particular, in one or more embodiments, the disclosed systems utilize a trained intent existence neural network to determine the existence of an actionable intent within a text input. In response to verifying the existence of an actionable intent, the disclosed systems can apply a trained intent extraction neural network to extract the actionable intent from the text input. Furthermore, in one or more embodiments, the disclosed systems can generate a digital response based on the intent identified from the text input.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: April 2, 2024
    Assignee: Adobe Inc.
    Inventors: Nedim Lipka, Nikhita Vedula
  • Publication number: 20240056309
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that fill in digital documents using user identity models of client devices. For instance, in one or more embodiments, the disclosed systems receive a digital document comprising a digital fillable field. The disclosed systems further retrieve, for a client device associated with the digital document, a decentralized identity credential comprising a user attribute established under a decentralized identity framework. Using the user attribute of the decentralized identity credential, the disclosed systems modify the digital document by filling in the digital fillable field.
    Type: Application
    Filed: August 12, 2022
    Publication date: February 15, 2024
    Inventors: Songlin He, Tong Sun, Nedim Lipka, Curtis Wigington, Rajiv Jain, Anindo Roy
  • Patent number: 11880655
    Abstract: Embodiments are disclosed for performing fact correction of natural language sentences using data tables. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input sentence, tokenizing elements of the input sentence, and identifying, by a first machine learning model, a data table associated with the input sentence. The systems and methods further comprise a second machine learning model identifying a tokenized element of the input sentence that renders the input sentence false based on the data table and masking the tokenized element of the tokenized input sentence that renders the input sentence false. The systems and method further includes a third machine learning model predicting a new value for the masked tokenized element based on the input sentence with the masked tokenized element and the identified data table and providing an output including a modified input sentence with the new value.
    Type: Grant
    Filed: April 19, 2022
    Date of Patent: January 23, 2024
    Assignee: Adobe Inc.
    Inventors: Christopher Tensmeyer, Danilo Neves Ribeiro, Varun Manjunatha, Nedim Lipka, Ani Nenkova
  • Patent number: 11836187
    Abstract: In implementations of systems for generating occurrence contexts for objects in digital content collections, a computing device implements a context system to receive context request data describing an object that is depicted with additional objects in digital images of a digital content collection. The context system generates relationship embeddings for the object and each of the additional objects using a representation learning model trained to predict relationships for objects. A relationship graph is formed for the object that includes a vertex for each relationship between the object and the additional objects indicated by the relationship embeddings. The context system clusters the vertices of the relationship graph into contextual clusters that each represent an occurrence context of the object in the digital images of the digital content collection.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: December 5, 2023
    Assignee: Adobe Inc.
    Inventors: Manoj Kilaru, Vishwa Vinay, Vidit Jain, Shaurya Goel, Ryan A. Rossi, Pratyush Garg, Nedim Lipka, Harkanwar Singh
  • Publication number: 20230377363
    Abstract: Systems and methods for machine learning based multipage scanning are provided. In one embodiment, one or more processing devices perform operations that include receiving a video stream that includes image frames that capture a plurality of pages of a document. The operations further include detection, via a machine learning model that is trained to infer events from the video stream detects, a new page event. Detection of the new page event indicates that a page of the plurality of pages available for scanning has changed from a first page to a second page. Based on the detection of the new page event, the one or more processing devices capture an image frame of the page from the video stream. In some embodiments, the machine learning model detects events based on a weighted use of video data, inertial data, audio samples, image depth information, image statistics and/or other information.
    Type: Application
    Filed: May 17, 2022
    Publication date: November 23, 2023
    Inventors: Tong SUN, Nicholas Sergei REWKOWSKI, Nedim LIPKA, Jennifer Anne HEALEY, Curtis Michael WIGINGTON, Anshul MALIK
  • Publication number: 20230368265
    Abstract: Embodiments provide systems, methods, and computer storage media for a Nonsymmetric Determinantal Point Process (NDPPs) for compatible set recommendations in a setting where data representing entities (e.g., items) arrives in a stream. A stream representing compatible sets of entities is received and used to update a latent representation of the entities and a compatibility distribution indicating likelihood of compatibility of subsets of the entities. The probability distribution is accessed in a single sequential pass to predict a compatible complete set of entities that completes an incomplete set of entities. The predicted complete compatible set is provided a recommendation for entities that complete the incomplete set of entities.
    Type: Application
    Filed: May 12, 2022
    Publication date: November 16, 2023
    Inventors: Ryan A. Rossi, Aravind Reddy Talla, Zhao Song, Anup Rao, Tung Mai, Nedim Lipka, Gang Wu, Anup Rao
  • Publication number: 20230334244
    Abstract: Embodiments are disclosed for performing fact correction of natural language sentences using data tables. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input sentence, tokenizing elements of the input sentence, and identifying, by a first machine learning model, a data table associated with the input sentence. The systems and methods further comprise a second machine learning model identifying a tokenized element of the input sentence that renders the input sentence false based on the data table and masking the tokenized element of the tokenized input sentence that renders the input sentence false. The systems and method further includes a third machine learning model predicting a new value for the masked tokenized element based on the input sentence with the masked tokenized element and the identified data table and providing an output including a modified input sentence with the new value.
    Type: Application
    Filed: April 19, 2022
    Publication date: October 19, 2023
    Applicant: Adobe Inc.
    Inventors: Christopher TENSMEYER, Danilo Neves Ribeiro, Varun MANJUNATHA, Nedim LIPKA, Ani NENKOVA
  • Patent number: 11768869
    Abstract: The present disclosure describes systems and methods for information retrieval. Embodiments of the disclosure provide a retrieval network that leverages external knowledge to provide reformulated search query suggestions, enabling more efficient network searching and information retrieval. For example, a search query from a user (e.g., a query mention of a knowledge graph entity that is included in a search query from a user) may be added to a knowledge graph as a surrogate entity via entity linking. Embedding techniques are then invoked on the updated knowledge graph (e.g., the knowledge graph that includes additional edges between surrogate entities and other entities of the original knowledge graph), and entities neighboring the surrogate entity are retrieved based on the embedding (e.g., based on a computed distance between the surrogate entity and candidate entities in the embedding space). Search results can then be ranked and displayed based on relevance to the neighboring entity.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: September 26, 2023
    Assignee: ADOBE, INC.
    Inventors: Nedim Lipka, Seyedsaed Rezayidemne, Vishwa Vinay, Ryan Rossi, Franck Dernoncourt, Tracy Holloway King
  • Patent number: 11709690
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating coachmarks and concise instructions based on operation descriptions for performing application operations. For example, the disclosed systems can utilize a multi-task summarization neural network to analyze an operation description and generate a coachmark and a concise instruction corresponding to the operation description. In addition, the disclosed systems can provide a coachmark and a concise instruction for display within a user interface to, directly within a client application, guide a user to perform an operation by interacting with a particular user interface element.
    Type: Grant
    Filed: March 9, 2020
    Date of Patent: July 25, 2023
    Assignee: Adobe Inc.
    Inventors: Nedim Lipka, Doo Soon Kim
  • Patent number: 11574123
    Abstract: In some embodiments, a content analysis system accesses input content associated with a user of an online platform. The content analysis system extracts entity tags for entities contained in the input content and links the identities to standard entities in a knowledge base to generate linked entities. The content analysis system further generates a knowledge graph to include the linked entities and other standard entities connected to the linked entities as nodes and edges connecting these nodes. Based on the knowledge graph, the content analysis system identifies related entities that are similar to the linked entities and cause the online platform to be modified based on the related entities.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: February 7, 2023
    Assignee: Adobe Inc.
    Inventor: Nedim Lipka
  • Publication number: 20230033114
    Abstract: Systems and methods for natural language processing are described. One or more embodiments of the present disclosure identify a claim from a document, wherein the claim corresponds to a topic, create a graph comprising a plurality of nodes having a plurality of node types and a plurality of edges having a plurality of edge types, wherein one of the nodes represents the claim, and wherein each of the edges represents a relationship between a corresponding pair of the nodes, encode the claim based on the graph using a graph convolutional network (GCN) to obtain an encoded claim, classify the claim by decoding the encoded claim to obtain a stance label that indicates a stance of the claim towards the topic, and transmit information indicating a viewpoint of the document towards the topic based on the stance label.
    Type: Application
    Filed: July 23, 2021
    Publication date: February 2, 2023
    Inventors: Joseph Barrow, Rajiv Bhawanji Jain, Nedim Lipka, Vlad Ion Morariu, Franck Dernoncourt, Varun Manjunatha
  • Publication number: 20230030341
    Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize a dynamic user interface and machine learning tools to generate data-driven digital content and multivariate testing recommendations for distributing digital content across computer networks. In particular, in one or more embodiments, the disclosed systems utilize machine learning models to generate digital recommendations at multiple development stages of digital communications that are targeted on particular performance metrics. For example, the disclosed systems utilize historical information and recipient profile data to generate recommendations for digital communication templates, fragment variants of content fragments, and content variants of digital content items.
    Type: Application
    Filed: July 22, 2021
    Publication date: February 2, 2023
    Inventors: Eunyee Koh, Tak Yeon Lee, Andrew Thomson, Vasanthi Holtcamp, Ryan Rossi, Fan Du, Caroline Kim, Tong Yu, Shunan Guo, Nedim Lipka, Shriram Venkatesh Shet Revankar, Nikhil Belsare
  • Publication number: 20220414338
    Abstract: System and methods for a text summarization system are described. In one example, a text summarization system receives an input utterance and determines whether the utterance should be included in a summary of the text. The text summarization system includes an embedding network, a convolution network, an encoding component, and a summary component. The embedding network generates a semantic embedding of an utterance. The convolution network generates a plurality of feature vectors based on the semantic embedding. The encoding component identifies a plurality of latent codes respectively corresponding to the plurality of feature vectors. The summary component identifies a prominent code among the latent codes and to select the utterance as a summary utterance based on the prominent code.
    Type: Application
    Filed: June 29, 2021
    Publication date: December 29, 2022
    Inventors: SANGWOO CHO, Franck Dernoncourt, Timothy Jeewun Ganter, Trung Huu Bui, Nedim Lipka, Varun Manjunatha, Walter Chang, Hailin Jin, Jonathan Brandt
  • Publication number: 20220358280
    Abstract: Embodiments are disclosed for recommending fonts based on text inputs are described. In some embodiments, a method of recommending fonts includes receiving a selection of text, providing a representation of the selection of text to a font recommendation model, generating, by the font recommendation model, a prediction score for each of a plurality of fonts based on the representation of the selection of text, and returning at least one recommended font based on the prediction score for each of the plurality of fonts.
    Type: Application
    Filed: September 29, 2021
    Publication date: November 10, 2022
    Inventors: Amirreza SHIRANI, Franck DERNONCOURT, Jose Ignacio ECHEVARRIA VALLESPI, Paul ASENTE, Nedim LIPKA, Thamar I. SOLORIO MARTINEZ
  • Publication number: 20220309334
    Abstract: Techniques are provided for training graph neural networks with heterophily datasets and generating predictions for such datasets with heterophily. A computing device receives a dataset including a graph data structure and processes the dataset using a graph neural network. The graph neural network defines prior belief vectors respectively corresponding to nodes of the graph data structure, executes a compatibility-guided propagation from the set of prior belief vectors and using a compatibility matrix. The graph neural network predicts predicting a class label for a node of the graph data structure based on the compatibility-guided propagations and a characteristic of at least one node within a neighborhood of the node. The computing device outputs the graph data structure where it is usable by a software tool for modifying an operation of a computing environment.
    Type: Application
    Filed: March 23, 2021
    Publication date: September 29, 2022
    Inventors: Ryan Rossi, Tung Mai, Nedim Lipka, Jiong Zhu, Anup Rao, Viswanathan Swaminathan
  • Publication number: 20220270152
    Abstract: Techniques are provided herein for identifying contrasting items based on a target item and presenting each of the target item and contrasting items together to a user. The target item may be any item that is of interest to the user. The contrasting items are identified using a system that compares features of the items together and also considers historical user data associated with the items. Natural language processes are used to label and identify salient portions of the catalog data for the items. Historical user data between items may be determined based on one or more documented event actions that occur with regards to co-viewing the items in some fashion. Both the historical user data and catalog comparisons between items are combined to determine a similarity score or metric between items. Items having highest similarity scores with the target item within a same cluster or group are presented.
    Type: Application
    Filed: February 19, 2021
    Publication date: August 25, 2022
    Applicant: Adobe Inc.
    Inventors: Georgios Theocharous, Nedim Lipka, Michele Saad
  • Publication number: 20220253477
    Abstract: The present disclosure describes systems and methods for information retrieval. Embodiments of the disclosure provide a retrieval network that leverages external knowledge to provide reformulated search query suggestions, enabling more efficient network searching and information retrieval. For example, a search query from a user (e.g., a query mention of a knowledge graph entity that is included in a search query from a user) may be added to a knowledge graph as a surrogate entity via entity linking. Embedding techniques are then invoked on the updated knowledge graph (e.g., the knowledge graph that includes additional edges between surrogate entities and other entities of the original knowledge graph), and entities neighboring the surrogate entity are retrieved based on the embedding (e.g., based on a computed distance between the surrogate entity and candidate entities in the embedding space). Search results can then be ranked and displayed based on relevance to the neighboring entity.
    Type: Application
    Filed: February 8, 2021
    Publication date: August 11, 2022
    Inventors: NEDIM LIPKA, Seyedsaed Rezayidemne, Vishwa Vinay, Ryan Rossi, Franck Dernoncourt, Tracy Holloway King
  • Publication number: 20220188895
    Abstract: Unstructured texts associated with a product is received, where the unstructured texts include, for example, a title of the product, one or more reviews of the product, questions and/or answers associated with the product. A phrase in an unstructured text is identified. A first knowledge base is searched, to identify that the phrase is a feature value that is associated with a feature. For example, the first knowledge base lists the feature value to be an instance of the feature. Accordingly, a tuple is generated, where the tuple includes the product as a subject, the feature as a predicate, and the feature value comprising the phrase as an object. A second knowledge base is updated with the tuple. The second knowledge base is usable for processing queries about the product. For example, the second knowledge base is used to generate a result of a query about the product.
    Type: Application
    Filed: December 14, 2020
    Publication date: June 16, 2022
    Applicant: Adobe Inc.
    Inventors: Nedim Lipka, Michele Saad, Georgios Theocharous