Patents Assigned to Adobe Inc.
-
Publication number: 20250217193Abstract: Embodiments are directed to systems and techniques to process inference requests in a fine-tuned model environment. Embodiments include receiving a request to perform a task using the fine-tuned model. Determining whether an instance of the fine-tuned model, which includes a specific layer identified by a model instance identifier, is currently executing in an orchestration platform's environment. If the instance of the fine-tuned model is not currently executing, embodiments include proceeding to load the identified layer into a base model within the environment. This process generates an instance of the fine-tuned model to perform the requested task.Type: ApplicationFiled: December 27, 2023Publication date: July 3, 2025Applicant: Adobe Inc.Inventors: Yuanyou Wang, Naveen Vangala, Mayank Anand, Kunal Kumar Jain, Jose Mathew, Eapen Jose, Divyanshu Goyal, Asmita Chihnara, Arif Abdullah, Anand Dantu
-
Patent number: 12347005Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate and implement behavioral policy graphs for digital image editing. For instance, in some embodiments, the disclosed systems generate, for a client device, a behavioral policy graph that assigns behaviors to object classes based on object relationships. The disclosed systems receive, from the client device, a digital image portraying a plurality of objects. Further, the disclosed systems determine behaviors of the plurality of objects utilizing the behavioral policy graph by determining, for each object of the plurality of objects, a behavior based on a relationship of the object with an additional object of the plurality of objects in accordance with the behavioral policy graph. The disclosed systems modify the digital image by modifying one or more objects based on the behaviors of the plurality of objects.Type: GrantFiled: January 31, 2023Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventor: Kevin Gary Smith
-
Patent number: 12347080Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing using image understanding facilitated by artificial intelligence. For example, in one or more embodiments the disclosed systems utilize generative machine learning models to create modified digital images portraying human subjects. In particular, the disclosed systems generate modified digital images by performing infill modifications to complete a digital image or human inpainting for portions of a digital image that portrays a human. Moreover, in some embodiments, the disclosed systems perform reposing of subjects portrayed within a digital image to generate modified digital images. In addition, the disclosed systems in some embodiments perform facial expression transfer and facial expression animations to generate modified digital images or animations.Type: GrantFiled: March 27, 2023Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Krishna Kumar Singh, Yijun Li, Jingwan Lu, Duygu Ceylan Aksit, Yangtuanfeng Wang, Jimei Yang, Tobias Hinz, Qing Liu, Jianming Zhang, Zhe Lin
-
Patent number: 12347034Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating digital chain pull paintings in digital images. The disclosed system generate, utilizing a neural network, a plurality of matrices over an ambient space for a plurality of polygons of a three-dimensional mesh based on a plurality of features of the plurality of polygons associated with the three-dimensional mesh. The disclosed system determines a gradient field based on the plurality of matrices of the plurality of polygons. The disclosed system generates a mapping for the three-dimensional mesh based on the gradient field and a differential operator corresponding to the three-dimensional mesh.Type: GrantFiled: June 24, 2022Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Noam Aigerman, Kunal Gupta, Jun Saito, Thibault Groueix, Vladimir Kim, Siddhartha Chaudhuri
-
Patent number: 12347003Abstract: Graphical constructs are efficiently described by integer-based identifiers, and graphical constructs of the same type are stored in a definitional component. Each client maintains both a pending state representation and a synchronized state representation of the graphical design to independently track the state of the representation at a live editing server. The use of integer-based identifiers for graphical constructs provides an efficient change representation that can be communicated with minimal network traffic. All copies of the graphical design represented among clients reach a consistent state quickly even when multiple users are making changes to the same vector path, eliminating the need to track changes manually or to move large files.Type: GrantFiled: January 19, 2023Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Vishwas Jain, Vineet Batra, Souymodip Chakraborty, Kevin Wampler, Ankit Phogat
-
Patent number: 12346361Abstract: Embodiments are disclosed for a digital design system trained to segment unstructured text into topically coherent segments. The method may include receiving unstructured text, the unstructured text including a sequence of sentences. The disclosed systems and methods further comprise generating, by a neural network, a hierarchically segmented tree structure representing the unstructured text. The tree structure comprises a plurality of tree structure nodes, where a node of the tree structure nodes represents a sentence from the sequence of sentences. The segments and sub-segments of the unstructured text can then be determined based on node data for nodes of the hierarchically segmented tree structure. Using the determined segments and sub-segments of the unstructured text, a modified representation of the unstructured text can be displayed.Type: GrantFiled: November 16, 2023Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Inderjeet Nair, Sumit Shekhar, Srikrishna Karanam, Niyati Himanshu Chhaya, Natwar Modani, Balaji Vasan Srinivasan, Aparna Garimella
-
Patent number: 12347116Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize a progressive refinement network to refine alpha mattes generated utilizing a mask-guided matting neural network. In particular, the disclosed systems can use the matting neural network to process a digital image and a coarse guidance mask to generate alpha mattes at discrete neural network layers. In turn, the disclosed systems can use the progressive refinement network to combine alpha mattes and refine areas of uncertainty. For example, the progressive refinement network can combine a core alpha matte corresponding to more certain core regions of a first alpha matte and a boundary alpha matte corresponding to uncertain boundary regions of a second, higher resolution alpha matte. Based on the combination of the core alpha matte and the boundary alpha matte, the disclosed systems can generate a final alpha matte for use in image matting processes.Type: GrantFiled: February 27, 2023Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Qihang Yu, Jianming Zhang, He Zhang, Yilin Wang, Zhe Lin, Ning Xu
-
Patent number: 12347135Abstract: Embodiments are disclosed for generating a gesture reenactment video sequence corresponding to a target audio sequence using a trained network based on a video motion graph generated from a reference speech video. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a first input including a reference speech video and generating a video motion graph representing the reference speech video, where each node is associated with a frame of the reference video sequence and reference audio features of the reference audio sequence. The disclosed systems and methods further comprise receiving a second input including a target audio sequence, generating target audio features, identifying a node path through the video motion graph based on the target audio features and the reference audio features, and generating an output media sequence based on the identified node path through the video motion graph paired with the target audio sequence.Type: GrantFiled: November 14, 2022Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Yang Zhou, Jimei Yang, Jun Saito, Dingzeyu Li, Deepali Aneja
-
Patent number: 12347124Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating three-dimensional meshes representing two-dimensional images for editing the two-dimensional images. The disclosed system utilizes a first neural network to determine density values of pixels of a two-dimensional image based on estimated disparity. The disclosed system samples points in the two-dimensional image according to the density values and generates a tessellation based on the sampled points. The disclosed system utilizes a second neural network to estimate camera parameters and modify the three-dimensional mesh based on the estimated camera parameters of the pixels of the two-dimensional image. In one or more additional embodiments, the disclosed system generates a three-dimensional mesh to modify a two-dimensional image according to a displacement input.Type: GrantFiled: November 15, 2022Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Matheus Gadelha, Radomir Mech
-
Patent number: 12346827Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating semantic scene graphs for digital images using an external knowledgebase for feature refinement. For example, the disclosed system can determine object proposals and subgraph proposals for a digital image to indicate candidate relationships between objects in the digital image. The disclosed system can then extract relationships from an external knowledgebase for refining features of the object proposals and the subgraph proposals. Additionally, the disclosed system can generate a semantic scene graph for the digital image based on the refined features of the object/subgraph proposals. Furthermore, the disclosed system can update/train a semantic scene graph generation network based on the generated semantic scene graph. The disclosed system can also reconstruct the image using object labels based on the refined features to further update/train the semantic scene graph generation network.Type: GrantFiled: June 3, 2022Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Handong Zhao, Zhe Lin, Sheng Li, Mingyang Ling, Jiuxiang Gu
-
Patent number: 12346655Abstract: Systems and methods for performing Document Visual Question Answering tasks are described. A document and query are received. The document encodes document tokens and the query encodes query tokens. The document is segmented into nested document sections, lines, and tokens. A nested structure of tokens is generated based on the segmented document. A feature vector for each token is generated. A graph structure is generated based on the nested structure of tokens. Each graph node corresponds to the query, a document section, a line, or a token. The node connections correspond to the nested structure. Each node is associated with the feature vector for the corresponding object. A graph attention network is employed to generate another embedding for each node. These embeddings are employed to identify a portion of the document that includes a response to the query. An indication of the identified portion of the document is be provided.Type: GrantFiled: November 17, 2021Date of Patent: July 1, 2025Assignee: Adobe Inc.Inventors: Shijie Geng, Christopher Tensmeyer, Curtis Michael Wigington, Jiuxiang Gu
-
Patent number: 12341903Abstract: Systems, methods, and non-transitory computer readable media fill in digital documents using user identity models of client devices. For instance, one or more embodiments involve maintaining a user identity model that includes various details related to a client device, such as verifiable credentials and unverified claims. Upon receiving a digital document for the client device, one or more user attributes associated with the verifiable credentials and/or unverified claims are retrieved from the user identity model. Using the user attribute(s), one or more digital fillable fields of the digital document are filled.Type: GrantFiled: August 12, 2022Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Songlin He, Tong Sun, Nedim Lipka, Curtis Wigington, Rajiv Jain, Anindo Roy
-
Patent number: 12340544Abstract: Embodiments are disclosed for user-guided variable-rate compression. A method of user-guided variable-rate compression includes receiving a request to compress an image, the request including the image, a corresponding importance data, and a target bitrate, providing the image, the corresponding importance data, and the target bitrate to a compression network, generating, by the compression network, a learned importance map and a representation of the image, and generating, by the compressing network, a compressed representation of the image based on the learned importance map and the representation of the image.Type: GrantFiled: April 6, 2022Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Suryateja Bv, Sharmila Reddy Nangi, Rushil Gupta, Rajat Jaiswal, Nikhil Kapoor, Kuldeep Kulkarni
-
Patent number: 12340166Abstract: Techniques for document decomposition based on determined logical visual layering of document content. The techniques include iteratively identifying a plurality of logical visual layers of a document resulting in each logical visual layer being associated with one or more document content objects of the document. The one or more document content objects associated with each logical visual layer are annotated to be indicative of the associated logical visual layer. The document is then displayed with an indication of one or more of the annotated document objects.Type: GrantFiled: June 2, 2023Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Punit Singh, Jayant Vaibhav Srivastava, Ankit Bal
-
Patent number: 12340441Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure receive a raster image depicting a radial color gradient; compute an origin point of the radial color gradient based on an orthogonality measure between a color gradient vector at a point in the raster image and a relative position vector between the point and the origin point; construct a vector graphics representation of the radial color gradient based on the origin point; and generate a vector graphics image depicting the radial color gradient based on the vector graphics representation.Type: GrantFiled: August 31, 2022Date of Patent: June 24, 2025Assignee: ADOBE INC.Inventors: Michal Lukac, Souymodip Chakraborty, Matthew David Fisher, Vineet Batra, Ankit Phogat
-
Patent number: 12340606Abstract: Embodiments are disclosed for providing customizable, visually aesthetic color diverse template recommendations derived from a source image. A method may include receiving a source image and determining a source image background by separating a foreground of the source image from a background of the source image. The method separates a foreground from the background by identifying portions of the image that belong to the background and stripping out the rest of the image. The method includes identifying a text region of the source image using a machine learning model and identifying font type using the identified text region. The method includes generating an editable template image using the source image background, the text region, and the font type.Type: GrantFiled: November 9, 2022Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Prasenjit Mondal, Sachin Soni, Anshul Malik
-
Patent number: 12340571Abstract: Various embodiments classify one or more portions of an image based on deriving an “intrinsic” modality. Such intrinsic modality acts as a substitute to a “text” modality in a multi-modal network. A text modality in image processing is typically a natural language text that describes one or more portions of an image. However, explicit natural language text may not be available across one or more domains for training a multi-modal network. Accordingly, various embodiments described herein generate an intrinsic modality, which is also a description of one or more portions of an image, except that such description is not an explicit natural language description, but rather a machine learning model representation. Some embodiments additionally leverage a visual modality obtained from a vision-only model or branch, which may learn domain characteristics that are not present in the multi-modal network.Type: GrantFiled: October 28, 2022Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Puneet Mangla, Milan Aggarwal, Balaji Krishnamurthy
-
Patent number: 12340333Abstract: Embodiments provide systems, methods, and computer storage media for management, assessment, navigation, and/or discovery of data based on data quality, consumption, and/or utility metrics. Data may be assessed using attribute-level and/or record-level metrics that quantify data: “quality”—the condition of data (e.g., presence of incorrect or incomplete values), its “consumption”—the tracked usage of data in downstream applications (e.g., utilization of attributes in dashboard widgets or customer segmentation rules), and/or its “utility”—a quantifiable impact resulting from the consumption of data (e.g., revenue or number of visits resulting from marketing campaigns that use particular datasets, storage costs of data). This data assessment may be performed at different stages of a data intake, preparation, and/or modeling lifecycle.Type: GrantFiled: March 14, 2022Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Arpit Ajay Narechania, Fan Du, Atanu R. Sinha, Ryan A. Rossi, Jane Elizabeth Hoffswell, Shunan Guo, Eunyee Koh, John Anderson, Sonali Surange, Saurabh Mahapatra, Vasanthi Holtcamp
-
Patent number: 12339916Abstract: Systems and methods for dynamic user profile management are provided. One aspect of the systems and methods includes receiving, by a lookup component, a request for a user profile; computing, by a profile component, a time-to-live (TTL) refresh value for the user profile based on a lookup history of the user profile; updating, by the profile component, a TTL value of the user profile based on the request and the TTL refresh value; storing, by the profile component, the user profile and the updated TTL value in the edge database; and removing, by the edge database, the user profile from the edge database based on the updated TTL value.Type: GrantFiled: October 24, 2022Date of Patent: June 24, 2025Assignee: ADOBE INC.Inventors: Nathan Ng, Tung Mai, Thomas Greger, Kelly Quinn Nicholes, Antonio Cuevas, Saayan Mitra, Somdeb Sarkhel, Anup Bandigadi Rao, Ryan A. Rossi, Viswanathan Swaminathan, Shivakumar Vaithyanathan
-
Patent number: 12340563Abstract: Embodiments are disclosed for correlating video sequences and audio sequences by a media recommendation system using a trained encoder network.Type: GrantFiled: May 11, 2022Date of Patent: June 24, 2025Assignee: Adobe Inc.Inventors: Justin Salamon, Bryan Russell, Didac Suris Coll-Vinent