Patents Assigned to Adobe Inc.
  • Patent number: 12367626
    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating three-dimensional meshes representing two-dimensional images for editing the two-dimensional images. The disclosed system utilizes a first neural network to determine density values of pixels of a two-dimensional image based on estimated disparity. The disclosed system samples points in the two-dimensional image according to the density values and generates a tessellation based on the sampled points. The disclosed system utilizes a second neural network to estimate camera parameters and modify the three-dimensional mesh based on the estimated camera parameters of the pixels of the two-dimensional image. In one or more additional embodiments, the disclosed system generates a three-dimensional mesh to modify a two-dimensional image according to a displacement input.
    Type: Grant
    Filed: November 15, 2022
    Date of Patent: July 22, 2025
    Assignee: Adobe Inc.
    Inventors: Radomir Mech, Nathan Carr, Matheus Gadelha
  • Patent number: 12367586
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for panoptically guiding digital image inpainting utilizing a panoptic inpainting neural network. In some embodiments, the disclosed systems utilize a panoptic inpainting neural network to generate an inpainted digital image according to panoptic segmentation map that defines pixel regions corresponding to different panoptic labels. In some cases, the disclosed systems train a neural network utilizing a semantic discriminator that facilitates generation of digital images that are realistic while also conforming to a semantic segmentation. The disclosed systems generate and provide a panoptic inpainting interface to facilitate user interaction for inpainting digital images. In certain embodiments, the disclosed systems iteratively update an inpainted digital image based on changes to a panoptic segmentation map.
    Type: Grant
    Filed: October 3, 2022
    Date of Patent: July 22, 2025
    Assignee: Adobe Inc.
    Inventors: Zhe Lin, Haitian Zheng, Elya Shechtman, Jianming Zhang, Jingwan Lu, Ning Xu, Qing Liu, Scott Cohen, Sohrab Amirghodsi
  • Patent number: 12367238
    Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for a visual and text search interface used to navigate a video transcript. In an example embodiment, a freeform text query triggers a visual search for frames of a loaded video that match the freeform text query (e.g., frame embeddings that match a corresponding embedding of the freeform query), and triggers a text search for matching words from a corresponding transcript or from tags of detected features from the loaded video. Visual search results are displayed (e.g., in a row of tiles that can be scrolled to the left and right), and textual search results are displayed (e.g., in a row of tiles that can be scrolled up and down). Selecting (e.g., clicking or tapping on) a search result tile navigates a transcript interface to a corresponding portion of the transcript.
    Type: Grant
    Filed: October 17, 2022
    Date of Patent: July 22, 2025
    Assignee: ADOBE INC.
    Inventors: Lubomira Assenova Dontcheva, Dingzeyu Li, Kim Pascal Pimmel, Hijung Shin, Hanieh Deilamsalehy, Aseem Omprakash Agarwala, Joy Oakyung Kim, Joel Richard Brandt, Cristin Ailidh Fraser
  • Patent number: 12367562
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for panoptically guiding digital image inpainting utilizing a panoptic inpainting neural network. In some embodiments, the disclosed systems utilize a panoptic inpainting neural network to generate an inpainted digital image according to panoptic segmentation map that defines pixel regions corresponding to different panoptic labels. In some cases, the disclosed systems train a neural network utilizing a semantic discriminator that facilitates generation of digital images that are realistic while also conforming to a semantic segmentation. The disclosed systems generate and provide a panoptic inpainting interface to facilitate user interaction for inpainting digital images. In certain embodiments, the disclosed systems iteratively update an inpainted digital image based on changes to a panoptic segmentation map.
    Type: Grant
    Filed: October 3, 2022
    Date of Patent: July 22, 2025
    Assignee: Adobe Inc.
    Inventors: Zhe Lin, Haitian Zheng, Elya Shechtman, Jianming Zhang, Jingwan Lu, Ning Xu, Qing Liu, Scott Cohen, Sohrab Amirghodsi
  • Publication number: 20250232488
    Abstract: A visibility color recommendation system includes functionality operable to receive a user input defining a glyph to be displayed along with a digital image in a user interface. A color recommendation is generated, automatically and without user intervention, based on visibility of the glyph with respect to one or more colors of the digital image. The glyph is presented in the user interface as having a color from the digital image based on the color recommendation.
    Type: Application
    Filed: January 11, 2024
    Publication date: July 17, 2025
    Applicant: Adobe Inc.
    Inventors: Alok Kumar Singh, Shikhar Garg, Saikat Chakrabarty
  • Publication number: 20250231674
    Abstract: Curvilinear perspective digital image editing techniques are described. In one or more examples, a digital image and a curvilinear grid are presented for display in a user interface. The curvilinear grid depicts a plurality of axis connecting vanishing points as indicating a curvilinear perspective. An input is received defining an edit operation to the digital image. The input is conformed based on the curvilinear grid and the user interface is output having the edit operation applied to the digital image as conformed based on the curvilinear grid. The user interface is output having the edit operation applied to the digital image as conformed based on the curvilinear grid.
    Type: Application
    Filed: January 11, 2024
    Publication date: July 17, 2025
    Applicant: Adobe Inc.
    Inventors: Karan Batra, Prem Kumar, Navodit Madal, Ayush Bansal
  • Patent number: 12361300
    Abstract: Certain embodiments involve using machine-learning methods to generate a recommendation for sequential content items. A method involves accessing a content item associated with an interaction stage in an online environment. A stage graph, which includes a ratio of interactions, of the content item is generated. An additional content item that includes additional stage-transition content is identified. A sequencing function outcome indicating a portion of the ratio of interactions is determined. A transition probability of receiving an interaction with stage-transition content and an additional interaction with the additional stage-transition content is calculated. A content provider system is caused to provide a recipient device with interactive content that includes the additional content item.
    Type: Grant
    Filed: April 22, 2021
    Date of Patent: July 15, 2025
    Assignee: ADOBE INC.
    Inventors: Niyati Himanshu Chhaya, Niranjan Kumbi, Balaji Vasan Srinivasan, Akangsha Bedmutha, Ajay Awatramani, Sreekanth Reddy
  • Patent number: 12361601
    Abstract: Techniques for identity preserved controllable facial image manipulation are described that support generation of a manipulated digital image based on a facial image and a render image. For instance, a facial image depicting a facial representation of an individual is received as input. A feature space including an identity parameter and at least one other visual parameter is extracted from the facial image. An editing module edits one or more of the visual parameters and preserves the identity parameter. A renderer generates a render image depicting a morphable model reconstruction of the facial image based on the edit. The render image and facial image are encoded, and a generator of a neural network is implemented to generate a manipulated digital image based on the encoded facial image and the encoded render image.
    Type: Grant
    Filed: March 31, 2022
    Date of Patent: July 15, 2025
    Assignee: Adobe Inc.
    Inventors: Zhixin Shu, Zhe Lin, Yuchen Liu, Yijun Li, Richard Zhang
  • Patent number: 12361013
    Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for guided visual search. A visual search query can be represented as a sketch sequence that includes ordering information of the constituent strokes in the sketch. The visual search query can be encoded into a structural search encoding in a common search space by a structural neural network. Indexed visual search results can be identified in the common search space and clustered in an auxiliary semantic space. Sketch suggestions can be identified from a plurality of indexed sketches in the common search space. A sketch suggestion can be identified for each semantic cluster of visual search results and presented with the cluster to guide a user towards relevant content through an iterative search process. Selecting a sketch suggestion as a target sketch can automatically transform the visual search query to the target sketch via adversarial images.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: July 15, 2025
    Assignee: Adobe Inc.
    Inventors: Hailin Jin, John Collomosse
  • Patent number: 12361512
    Abstract: This disclosure describes one or more implementations of a digital image semantic layout manipulation system that generates refined digital images resembling the style of one or more input images while following the structure of an edited semantic layout. For example, in various implementations, the digital image semantic layout manipulation system builds and utilizes a sparse attention warped image neural network to generate high-resolution warped images and a digital image layout neural network to enhance and refine the high-resolution warped digital image into a realistic and accurate refined digital image.
    Type: Grant
    Filed: April 11, 2023
    Date of Patent: July 15, 2025
    Assignee: Adobe Inc.
    Inventors: Haitian Zheng, Zhe Lin, Jingwan Lu, Scott Cohen, Jianming Zhang, Ning Xu
  • Patent number: 12361607
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating digital images utilizing a diffusion neural network to preserve color harmony and image composition from a sample digital image while modifying image content. In some embodiments, the disclosed systems receive, via user input, a text prompt defining query image content and a sample digital image depicting a color harmony. In some cases, the disclosed systems generate a blurred digital image by blurring pixels of the sample digital image while preserving the color harmony. In some embodiments, the disclosed systems generate, utilizing a diffusion neural network, a modified digital image depicting the query image content having the color harmony of the sample digital image by denoising the blurred digital image toward a noise vector of the text prompt.
    Type: Grant
    Filed: September 19, 2023
    Date of Patent: July 15, 2025
    Assignee: Adobe Inc.
    Inventor: Ashutosh Sharma
  • Patent number: 12361616
    Abstract: Systems and methods for image generation are provided. An aspect of the systems and methods for image generation includes obtaining an original image depicting an element and a target prompt describing a modification to the element. The system may then compute a first output and a second output using a diffusion model. The first output is based on a description of the element and the second output is based on the target prompt. The system then computes a difference between the first output and the second output, and generates a modified image including the modification to the element of the original image based on the difference.
    Type: Grant
    Filed: February 15, 2023
    Date of Patent: July 15, 2025
    Assignee: ADOBE INC.
    Inventors: Nicholas Isaac Kolkin, Elya Shechtman
  • Publication number: 20250225609
    Abstract: In implementation of techniques for re-dimensioning images based on foreground objects, a computing device implements a re-dimension system to receive a digital image and an input specifying an update to a dimension of the digital image. The re-dimension system then generates, using the machine learning model, a re-dimensioned background by changing the background based on the update to the dimension specified by the input. Using the machine learning model, the re-dimension system generates a re-dimensioned digital image by positioning the foreground object over the re-dimensioned background. The re-dimension system then displays the re-dimensioned digital image in a user interface.
    Type: Application
    Filed: January 5, 2024
    Publication date: July 10, 2025
    Applicant: Adobe Inc.
    Inventors: Vangala Naveen Reddy, Umang Moorarka, Kunal Kumar Jain
  • Publication number: 20250225375
    Abstract: Embodiments are generally directed to extending artificial intelligence (AI) and machine learning (ML) techniques to generate content predicted to elicit a performance response from an intended recipient of a target audience. One method of generating content includes determining content generation information from a user prompt, the content generation information comprising a subject, an audience segment, and a performance indicator; and providing the content generation information to a content generation model to generate at least one item of audience-targeted content corresponding to the subject targeted to the audience segment to elicit a response defined by the performance indicator, wherein the content generation module comprises a natural language processing (NLP) model trained, via a content generation training module, using reinforcement learning based on a reward of a performance prediction determined by a performance prediction model based on historical performance data.
    Type: Application
    Filed: January 10, 2024
    Publication date: July 10, 2025
    Applicant: Adobe Inc.
    Inventors: Shubham Lohiya, Meghanath M y, Varsha Sankar, Luiz Fernando Teixeira Maykot, Debraj Debashish Basu, Deepak Pai
  • Publication number: 20250225697
    Abstract: Techniques for prompt-based image relighting and editing are described that support automatic generation of an edited digital image with high-fidelity and realistic lighting effects and background features. A processing device, for instance, receives as input a digital image that depicts a digital object, a lighting prompt, and a background prompt. The processing device generates a relit digital object that has a lighting condition specified by the lighting prompt applied to the digital object. The processing device further generates a background that includes a feature specified by the background prompt and the lighting condition. The processing device generates an edited digital object for output that includes the relit digital object and the background. The processing device further leverages a shadow synthesis model to edit shadows in the edited digital image. In this way, the techniques described herein preserve content details of the digital object when applying background and lighting effects.
    Type: Application
    Filed: January 5, 2024
    Publication date: July 10, 2025
    Applicant: Adobe Inc.
    Inventors: Ambareesh Revanur, Shradha Agrawal, Deepak Pai
  • Patent number: 12354149
    Abstract: Navigation and reward techniques involving physical goods and services are described. In one example, digital content is configured to aid navigation of a user between different physical goods or services. This navigation includes user specified good or services as well as recommended goods or services that are not specified by the user. In another example, digital content is provided as part of a reward system. In return for permitting access to user data, the user is provided with rewards that are based on this monitored interaction. In this way, an owner of the store may gain detailed knowledge which may be used to increase likelihood of offering goods or services of interest to the user. In return, the user is provided with rewards to permit access to this detailed knowledge.
    Type: Grant
    Filed: August 29, 2022
    Date of Patent: July 8, 2025
    Assignee: Adobe Inc.
    Inventors: Peter Raymond Fransen, Matthew William Rozen, Brian David Williams, Cory Lynn Edwards
  • Patent number: 12354197
    Abstract: A computing system captures a first image, comprising an object in a first position, using a camera. The object has indicators indicating points of interest on the object. The computing system receives first user input linking at least a subset of the indicators and establishing relationships between the points of interest on the object and second user input comprising a graphic element and a mapping between the graphic element and the object. The computing system captures second images, comprising the object in one or more modified positions using, the camera. The computing system tracks the modified positions of the object across the second images using the indicators and the relationships between the points of interest. The computing system generates a virtual graphic based on the one or more modified positions, the graphic element, and the mappings between the graphic element and the object.
    Type: Grant
    Filed: May 10, 2022
    Date of Patent: July 8, 2025
    Assignee: Adobe Inc.
    Inventors: Jiahao Li, Li-Yi Wei, Stephen DiVerdi, Kazi Rubaiat Habib
  • Patent number: 12354236
    Abstract: In implementations of systems for joint trimap estimation and alpha matte prediction, a computing device implements a matting system to estimate a trimap for a frame of a digital video using a first stage of a machine learning model. An alpha matte is predicted for the frame based on the trimap and the frame using a second stage of the machine learning model. The matting system generates a refined trimap and a refined alpha matte for the frame based on the alpha matte, the trimap, and the frame using a third stage of the machine learning model. An additional trimap is estimated for an additional frame of the digital video based on the refined trimap and the refined alpha matte using the first stage of the machine learning model.
    Type: Grant
    Filed: May 4, 2022
    Date of Patent: July 8, 2025
    Assignee: Adobe Inc.
    Inventors: Joon-Young Lee, Seoungwug Oh, Brian Lynn Price, Hongje Seong
  • Patent number: 12354194
    Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure receive an image depicting an object; generate a sequence of tokens including a set of tokens corresponding to the object and a set of mask tokens corresponding to an additional object to be inserted into the image; generate a placement token value for the set of mask tokens based on the sequence of tokens using a sequence encoder, wherein the placement token value represents position information of the additional object; and insert the additional object into the image based on the position information to obtain a composite image.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: July 8, 2025
    Assignee: ADOBE INC.
    Inventors: Kerem Can Turgutlu, Sanat Sharma, Jayant Kumar, Rohith Mohan Dodle, Vipul Dalal
  • Patent number: 12354214
    Abstract: Digital image editing techniques are described as implemented by a depth-aware system of a computing device. The depth-aware system employs a depth-aware grid that defines constraints for depth-aware editing of digital images involving perspective. These techniques support automated editing in which changes to directional spacing, perspective arrangement, perspective movement, object redistribution, and so on are implemented in real time, which is not possible in conventional techniques involving object distortion. As such, these techniques improve operation of the computing device that implements these techniques as well as user efficiency in interacting with the computing device to perform digital image editing that involves perspective.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: July 8, 2025
    Assignee: Adobe Inc.
    Inventors: Rakesh Baidya, Praveen Kumar Dhanuka, Nitin Sharma, Arushi Jain