Patents by Inventor Nathan A. Carr

Nathan A. Carr has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210319256
    Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.
    Type: Application
    Filed: May 27, 2021
    Publication date: October 14, 2021
    Inventors: Xin Sun, Sohrab Amirghodsi, Nathan Carr, Michal Lukac
  • Publication number: 20210279916
    Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
    Type: Application
    Filed: May 26, 2021
    Publication date: September 9, 2021
    Inventors: Gwendal Simon, Viswanathan Swaminathan, Nathan Carr, Stefano Petrangeli
  • Patent number: 11049290
    Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: June 29, 2021
    Assignee: Adobe Inc.
    Inventors: Gwendal Simon, Viswanathan Swaminathan, Nathan Carr, Stefano Petrangeli
  • Patent number: 11037019
    Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: June 15, 2021
    Assignee: ADOBE INC.
    Inventors: Xin Sun, Sohrab Amirghodsi, Nathan Carr, Michal Lukac
  • Patent number: 10964100
    Abstract: According to one general aspect, systems and techniques for rendering a painting stroke of a three-dimensional digital painting include receiving a painting stroke input on a canvas, where the painting stroke includes a plurality of pixels. For each of the pixels in the plurality of pixels, a neighborhood patch of pixels is selected and input into a neural network and a shading function is output from the neural network. The painting stroke is rendered on the canvas using the shading function.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: March 30, 2021
    Assignee: ADOBE INC.
    Inventors: Xin Sun, Zhili Chen, Nathan Carr, Julio Marco Murria, Jimei Yang
  • Publication number: 20210032118
    Abstract: The present disclosure provides for compositions, methods of making compositions, and methods of using the composition. In an aspect, the composition can be a reactive material that can be used to split a gas such as water or carbon dioxide.
    Type: Application
    Filed: July 30, 2020
    Publication date: February 4, 2021
    Inventors: Helena Hagelin-Weaver, Samantha Roberts, Nathan Carr
  • Publication number: 20200302684
    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that use a local-lighting-estimation-neural network to estimate lighting parameters for specific positions within a digital scene for augmented reality. For example, based on a request to render a virtual object in a digital scene, a system uses a local-lighting-estimation-neural network to generate location-specific-lighting parameters for a designated position within the digital scene. In certain implementations, the system also renders a modified digital scene comprising the virtual object at the designated position according to the parameters. In some embodiments, the system generates such location-specific-lighting parameters to spatially vary and adapt lighting conditions for different positions within a digital scene.
    Type: Application
    Filed: May 18, 2020
    Publication date: September 24, 2020
    Inventors: Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Mathieu Garon
  • Publication number: 20200302658
    Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
    Type: Application
    Filed: September 26, 2019
    Publication date: September 24, 2020
    Inventors: Gwendal Simon, Viswanathan Swaminathan, Nathan Carr, Stefano Petrangeli
  • Patent number: 10783431
    Abstract: Image search techniques and systems involving emotions are described. In one or more implementations, a digital medium environment of a content sharing service is described for image search result configuration and control based on a search request that indicates an emotion. The search request is received that includes one or more keywords and specifies an emotion. Images are located that are available for licensing by matching one or more tags associated with the image with the one or more keywords and as corresponding to the emotion. The emotion of the images is identified using one or more models that are trained using machine learning based at least in part on training images having tagged emotions. Output is controlled of a search result having one or more representations of the images that are selectable to license respective images from the content sharing service.
    Type: Grant
    Filed: November 11, 2015
    Date of Patent: September 22, 2020
    Assignee: Adobe Inc.
    Inventors: Zeke Koch, Gavin Stuart Peter Miller, Jonathan W. Brandt, Nathan A. Carr, Radomir Mech, Walter Wei-Tuh Chang, Scott D. Cohen, Hailin Jin
  • Publication number: 20200254133
    Abstract: A system and method for an air purification assembly that creates high volume, sterilized straight-line airflow with a significant reduction in electricity consumption utilizing counter rotation of two propellers mounted in reverse to create linear airflow and thrust that sucks in air through an inlet and blows the air out through an outlet. Air purification assembly may also sterilize the air as it passes through light utilizing a light core system with a ring-shaped assembly that has one or more UV-C LEDs that may kill bio-organisms within proximity to the air purification assembly while dissipating the heat created by the UVC LED lights in the light core system.
    Type: Application
    Filed: February 11, 2020
    Publication date: August 13, 2020
    Inventor: Nathan Carr
  • Patent number: 10692277
    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that use a local-lighting-estimation-neural network to estimate lighting parameters for specific positions within a digital scene for augmented reality. For example, based on a request to render a virtual object in a digital scene, a system uses a local-lighting-estimation-neural network to generate location-specific-lighting parameters for a designated position within the digital scene. In certain implementations, the system also renders a modified digital scene comprising the virtual object at the designated position according to the parameters. In some embodiments, the system generates such location-specific-lighting parameters to spatially vary and adapt lighting conditions for different positions within a digital scene.
    Type: Grant
    Filed: March 21, 2019
    Date of Patent: June 23, 2020
    Assignee: ADOBE INC.
    Inventors: Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Mathieu Garon
  • Patent number: 10665011
    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that use a local-lighting-estimation-neural network to render a virtual object in a digital scene by using a local-lighting-estimation-neural network to analyze both global and local features of the digital scene and generate location-specific-lighting parameters for a designated position within the digital scene. For example, the disclosed systems extract and combine such global and local features from a digital scene using global network layers and local network layers of the local-lighting-estimation-neural network. In certain implementations, the disclosed systems can generate location-specific-lighting parameters using a neural-network architecture that combines global and local feature vectors to spatially vary lighting for different positions within a digital scene.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: May 26, 2020
    Assignees: ADOBE INC., UNIVERSITÉ LAVAL
    Inventors: Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Jean-Francois Lalonde, Mathieu Garon
  • Patent number: 10650599
    Abstract: The present disclosure includes methods and systems for rendering digital images of a virtual environment utilizing full path space learning. In particular, one or more embodiments of the disclosed systems and methods estimate a global light transport function based on sampled paths within a virtual environment. Moreover, in one or more embodiments, the disclosed systems and methods utilize the global light transport function to sample additional paths. Accordingly, the disclosed systems and methods can iteratively update an estimated global light transport function and utilize the estimated global light transport function to focus path sampling on regions of a virtual environment most likely to impact rendering a digital image of the virtual environment from a particular camera perspective.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: May 12, 2020
    Assignee: ADOBE INC.
    Inventors: Xin Sun, Nathan Carr, Hao Qin
  • Publication number: 20200082610
    Abstract: According to one general aspect, systems and techniques for rendering a painting stroke of a three-dimensional digital painting include receiving a painting stroke input on a canvas, where the painting stroke includes a plurality of pixels. For each of the pixels in the plurality of pixels, a neighborhood patch of pixels is selected and input into a neural network and a shading function is output from the neural network. The painting stroke is rendered on the canvas using the shading function.
    Type: Application
    Filed: September 10, 2018
    Publication date: March 12, 2020
    Inventors: Xin Sun, Zhili Chen, Nathan Carr, Julio Marco Murria, Jimei Yang
  • Patent number: 10546212
    Abstract: The present disclosure is directed toward systems and methods for image patch matching. In particular, the systems and methods described herein sample image patches to identify those image patches that match a target image patch. The systems and methods described herein probabilistically accept image patch proposals as potential matches based on an oracle. The oracle is computationally inexpensive to evaluate but more approximate than similarity heuristics. The systems and methods use the oracle to quickly guide the search to areas of the search space more likely to have a match. Once areas are identified that likely include a match, the systems and methods use a more accurate similarity function to identify patch matches.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: January 28, 2020
    Assignee: Adobe Inc.
    Inventors: Nathan Carr, Kalyan Sunkavalli, Michal Lukac, Elya Shechtman
  • Patent number: 10489676
    Abstract: The present disclosure is directed toward systems and methods for image patch matching. In particular, the systems and methods described herein sample image patches to identify those image patches that match a target image patch. The systems and methods described herein probabilistically accept image patch proposals as potential matches based on an oracle. The oracle is computationally inexpensive to evaluate but more approximate than similarity heuristics. The systems and methods use the oracle to quickly guide the search to areas of the search space more likely to have a match. Once areas are identified that likely include a match, the systems and methods use a more accurate similarity function to identify patch matches.
    Type: Grant
    Filed: November 3, 2016
    Date of Patent: November 26, 2019
    Assignee: Adobe Inc.
    Inventors: Nathan Carr, Kalyan Sunkavalli, Michal Lukac, Elya Shechtman
  • Patent number: 10489937
    Abstract: Paintbrush and liquid simulation techniques are described. In one or more implementations, input is received to perform brush strokes with a virtual paintbrush on a virtual canvas. For virtual paint on the virtual canvas, lifelike paint qualities are simulated. However, the lifelike paint qualities are simulated solely for the virtual paint that is within a region of the canvas. The lifelike paint qualities are not simulated for virtual paint located outside the region. As part of simulating the interaction between the virtual paint, the virtual paintbrush, and the virtual canvas, various parts of the simulation may be performed by different processing units. For example, bristles of the virtual paintbrush may be simulated utilizing a first processing device such as a central processing unit (CPU). A second processing unit, such as a graphics processing unit (GPU), may be employed to simulate the lifelike effects of the virtual paint.
    Type: Grant
    Filed: March 15, 2017
    Date of Patent: November 26, 2019
    Assignee: Adobe Inc.
    Inventors: Byungmoon Kim, Nathan A. Carr, Zhili Chen
  • Patent number: 10467777
    Abstract: Texture modeling techniques for image data are described. In one or more implementations, texels in image data are discovered by one or more computing devices, each texel representing an element that repeats to form a texture pattern in the image data. Regularity of the texels in the image data is modeled by the one or more computing devices to define translations and at least one other transformation of texels in relation to each other.
    Type: Grant
    Filed: March 23, 2018
    Date of Patent: November 5, 2019
    Assignee: Adobe Inc.
    Inventors: Siying Liu, Kalyan Sunkavalli, Nathan A. Carr, Elya Shechtman
  • Publication number: 20190266438
    Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.
    Type: Application
    Filed: February 27, 2018
    Publication date: August 29, 2019
    Inventors: Xin Sun, Sohrab Amirghodsi, Nathan Carr, Michal Lukac
  • Patent number: 10389804
    Abstract: Content creation and sharing integration techniques and systems are described. In one or more implementations, techniques are described in which modifiable versions of content (e.g., images) are created and shared via a content sharing service such that image creation functionality used to create the images is preserved to permit continued creation using this functionality. In one or more additional implementations, image creation functionality employed by a creative professional to create content is leveraged to locate similar images from a content sharing service.
    Type: Grant
    Filed: November 11, 2015
    Date of Patent: August 20, 2019
    Assignee: Adobe Inc.
    Inventors: Zeke Koch, Gavin Stuart Peter Miller, Jonathan W. Brandt, Nathan A. Carr, Radomir Mech, Walter Wei-Tuh Chang, Scott D. Cohen, Hailin Jin