Patents by Inventor Garrett M. Johnson

Garrett M. Johnson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180352134
    Abstract: Techniques of reducing or eliminating artifact pixels in high dynamic range (HDR) imaging are described. One embodiment includes obtaining a first image of a scene at a first time with first exposure settings and obtaining a second image of the scene at a second time with second exposure settings that differ from the first exposure settings. The obtained images may be downsampled. The images may be compared to each other to assist with determining a number of potential artifact pixels in the scene. Depending on a relationship between the number of potential artifact pixels and a threshold value, the first image or second image may be selected as a reference image for registering the images with each other. A type of registration performed between the images may depend on which of the two images is the selected reference image. The registered images may be used to generate an HDR image.
    Type: Application
    Filed: May 14, 2018
    Publication date: December 6, 2018
    Inventors: Hao Sun, Fabio Riccardi, Garrett M. Johnson, Farhan A. Baqai
  • Patent number: 10147166
    Abstract: This invention provides methods for spatially localized image editing. For example, an input image is divided into multiple bins in each dimension. For each bin, a histogram is computed, along with local image statistics such as mean, medium and cumulative histogram. Next, for each tile, a type of adjustment is determined and applied, including adjustment associated with Exposure, Brightness, Shadows, Highlights, Contrast, and Blackpoint. The adjustments are done for all tiles in the input image to render a small adjustment image. The small image is then interpolated, for example, using an edge-preserving interpolation, to get a full size adjustment image with adjustment curve for each pixel. Subsequently, per-pixel image adjustments can be performed across an entire input image to render a final adjusted image.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: December 4, 2018
    Assignee: APPLE INC.
    Inventors: Garrett M. Johnson, David Hayward
  • Publication number: 20180338078
    Abstract: Some embodiments provide a method of operating a device to capture an image of a high dynamic range (HDR) scene. Upon the device entering an HDR mode, the method captures and stores multiple images at a first image exposure level. Upon receiving a command to capture the HDR scene, the method captures a first image at a second image exposure level. The method selects a second image from the captured plurality of images. The method composites the first and second images to produce a composite image that captures the HDR scene. In some embodiments, the method captures multiple images at multiple different exposure levels.
    Type: Application
    Filed: July 30, 2018
    Publication date: November 22, 2018
    Applicant: Apple Inc.
    Inventors: Guy Cote, Garrett M. Johnson, James Edmund Orr, IV
  • Patent number: 10038855
    Abstract: Some embodiments provide a method of operating a device to capture an image of a high dynamic range (HDR) scene. Upon the device entering an HDR mode, the method captures and stores multiple images at a first image exposure level. Upon receiving a command to capture the HDR scene, the method captures a first image at a second image exposure level. The method selects a second image from the captured plurality of images. The method composites the first and second images to produce a composite image that captures the HDR scene. In some embodiments, the method captures multiple images at multiple different exposure levels.
    Type: Grant
    Filed: August 15, 2016
    Date of Patent: July 31, 2018
    Assignee: Apple Inc.
    Inventors: Guy Cote, Garrett M. Johnson, James Edmund Orr, IV
  • Patent number: 9955085
    Abstract: Adaptive bracketing techniques for photography are described. An adaptive bracketing logic/module directs an imaging device to capture an adaptive bracket. The adaptive bracket can include a first image captured at a first exposure value, a second image captured at a second exposure value, and a third image captured at the first exposure value. The first exposure value can be underexposed in comparison to the second exposure value. The adaptive bracketing logic/module can determine that a difference between the first and second images; determine that the third image is more similar to the second image than the first image; and generate a composite image using the first image and the third image. The adaptive bracketing logic/module can also update the adaptive bracket to include the composite image. Optionally, the updated adaptive bracket can be used to generate one or more high dynamic range (HDR) images. Other embodiments are described.
    Type: Grant
    Filed: September 22, 2016
    Date of Patent: April 24, 2018
    Assignee: Apple Inc.
    Inventors: Todd S. Sachs, Garrett M. Johnson
  • Publication number: 20180089800
    Abstract: Disclosed herein are methods and systems for fast and edge preserving upsampling of a small data image based on one or more guide images. During the upsampling process, selected data from the one or more guide images are combined with data from the data image to generate an upsampled pixel in an upsampled image. The upsampling can occur directly from the data image or sequentially via one or more intermediate upsampled images.
    Type: Application
    Filed: June 26, 2017
    Publication date: March 29, 2018
    Inventors: David HAYWARD, Garrett M. JOHNSON
  • Publication number: 20180089799
    Abstract: This invention provides methods for spatially localized image editing. For example, an input image is divided into multiple bins in each dimension. For each bin, a histogram is computed, along with local image statistics such as mean, medium and cumulative histogram. Next, for each tile, a type of adjustment is determined and applied, including adjustment associated with Exposure, Brightness, Shadows, Highlights, Contrast, and Blackpoint. The adjustments are done for all tiles in the input image to render a small adjustment image. The small image is then interpolated, for example, using an edge-preserving interpolation, to get a full size adjustment image with adjustment curve for each pixel. Subsequently, per-pixel image adjustments can be performed across an entire input image to render a final adjusted image.
    Type: Application
    Filed: September 23, 2016
    Publication date: March 29, 2018
    Inventors: Garrett M. Johnson, David Hayward
  • Publication number: 20180084181
    Abstract: Adaptive bracketing techniques for photography are described. An adaptive bracketing logic/module directs an imaging device to capture an adaptive bracket. The adaptive bracket can include a first image captured at a first exposure value, a second image captured at a second exposure value, and a third image captured at the first exposure value. The first exposure value can be underexposed in comparison to the second exposure value. The adaptive bracketing logic/module can determine that a difference between the first and second images; determine that the third image is more similar to the second image than the first image; and generate a composite image using the first image and the third image. The adaptive bracketing logic/module can also update the adaptive bracket to include the composite image. Optionally, the updated adaptive bracket can be used to generate one or more high dynamic range (HDR) images. Other embodiments are described.
    Type: Application
    Filed: September 22, 2016
    Publication date: March 22, 2018
    Inventors: Todd S. Sachs, Garrett M. Johnson
  • Patent number: 9652867
    Abstract: A method and system for providing a dynamic grain effect tool for a media-editing application that generates a grain effect and applies the grain effect to a digital image. The application first generates a random pixel field for the image based on a seed value. The application then generates a film grain pattern for the image by consecutively applying a blurring function and an unsharp masking function, based on an ISO value, to the randomly generated pixel field. The application then blends the grain field with the original image by adjusting each pixel based on the value of the corresponding pixel location in the grain field. The application then adjusts the grain amount in the previously generated full-grain image by receiving a grain amount value from a user and applying this value to the full-grain image.
    Type: Grant
    Filed: October 18, 2013
    Date of Patent: May 16, 2017
    Assignee: APPLE INC.
    Inventors: Russell Y. Webb, Garrett M. Johnson, Alexis Gatt
  • Publication number: 20170048442
    Abstract: Some embodiments provide a method of operating a device to capture an image of a high dynamic range (HDR) scene. Upon the device entering an HDR mode, the method captures and stores multiple images at a first image exposure level. Upon receiving a command to capture the HDR scene, the method captures a first image at a second image exposure level. The method selects a second image from the captured plurality of images. The method composites the first and second images to produce a composite image that captures the HDR scene. In some embodiments, the method captures multiple images at multiple different exposure levels.
    Type: Application
    Filed: August 15, 2016
    Publication date: February 16, 2017
    Applicant: Apple Inc.
    Inventors: Guy Cote, Garrett M. Johnson, James Edmund Orr, IV
  • Patent number: 9536290
    Abstract: Some embodiments provide a novel method for tempering an adjustment of an image to account for prior adjustments to the image. The adjustment in some embodiments is an automatic exposure adjustment. The method performs an operation for a first adjustment on a first set of parameters (e.g., saturation, sharpness, luminance). The method compares the first set of parameters to a second set of parameters to produce a third set of parameters that expresses the difference between the first adjustment and a second adjustment. The method performs a third operation to produce an adjusted image. The first set of parameters quantify a set of prior adjustments to the image by an image capturing device when the image was captured in some embodiments. The second set of parameters is a set of target parameters. The third set of parameters specify the tempered adjustment of the image.
    Type: Grant
    Filed: September 27, 2012
    Date of Patent: January 3, 2017
    Assignee: APPLE INC.
    Inventors: Garrett M. Johnson, Russell Y. Webb
  • Patent number: 9420198
    Abstract: Some embodiments provide a method of operating a device to capture an image of a high dynamic range (HDR) scene. Upon the device entering an HDR mode, the method captures and stores multiple images at a first image exposure level. Upon receiving a command to capture the HDR scene, the method captures a first image at a second image exposure level. The method selects a second image from the captured plurality of images. The method composites the first and second images to produce a composite image that captures the HDR scene. In some embodiments, the method captures multiple images at multiple different exposure levels.
    Type: Grant
    Filed: November 10, 2014
    Date of Patent: August 16, 2016
    Assignee: Apple Inc.
    Inventors: Guy Cote, Garrett M. Johnson, James Edmund Orr, IV
  • Patent number: 9412183
    Abstract: A system and method that receives and edits image data of an underwater scene in a digital image in order to remove undesirable tints from objects in the scene. In some embodiments, colors near the color of the water itself are protected to leave the water looking blue. Removing undesirable tints without removing the tint of the water itself results in images with more realistic coloring of people and objects in the scene, without eliminating the color cues (e.g., blue water) that indicate that the image is a photograph of an underwater scene.
    Type: Grant
    Filed: October 21, 2013
    Date of Patent: August 9, 2016
    Assignee: APPLE INC.
    Inventors: Garrett M. Johnson, Russell Y. Webb, Timothy D. Cherna
  • Patent number: 9323996
    Abstract: A method and system for controlling multiple image editing controls using one master control. The system identifies various characteristics of an image being edited. The system generates, for each of multiple image editing controls, a relationship between the master control and the image editing control. The relationship is based on at least one of the identified characteristics of the image being edited. The relationship is different for different images when the different images have different characteristics, such as different average color component values at a particular percentile of pixels in the images.
    Type: Grant
    Filed: June 1, 2014
    Date of Patent: April 26, 2016
    Assignee: APPLE INC.
    Inventors: Garrett M. Johnson, Russell Y. Webb, Russell Reid
  • Patent number: 9299168
    Abstract: A non-transitory machine readable medium that has a computer program for adjusting color values of an image represented in a color space. The image includes several pixels. Each pixel includes a set of color values. The computer program receives a selection of a location on the image. The computer program determines a type of content that is associated with the selected location on the image. From several different image editing operations, the computer program selects a set of image editing operations based on the determined type of content. The computer program displays a set of user interface controls that is associated with the selected set of image editing operations.
    Type: Grant
    Filed: September 27, 2012
    Date of Patent: March 29, 2016
    Assignee: APPLE INC.
    Inventors: Randy Ubillos, Timothy D. Cherna, Garrett M. Johnson, Christopher R. Cunningham
  • Publication number: 20150347858
    Abstract: A method and system for controlling multiple image editing controls using one master control. The system identifies various characteristics of an image being edited. The system generates, for each of multiple image editing controls, a relationship between the master control and the image editing control. The relationship is based on at least one of the identified characteristics of the image being edited. The relationship is different for different images when the different images have different characteristics, such as different average color component values at a particular percentile of pixels in the images.
    Type: Application
    Filed: June 1, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Garrett M. Johnson, Russell Y. Webb, Russell Reid
  • Publication number: 20150331595
    Abstract: Some embodiments provide a novel user interface (UI) tool that is a unified slider control, which includes multiple sliders that slide along a region. The region is a straight line in some embodiments, while it is an angular arc in other embodiments. In some embodiments, the unified slider control is used in a media editing application to allow a user to modify several different properties of the image by moving several different sliders along the region. Each slider is associated with a property of the image. A position of the slider in the region corresponds to a value of the property associated with the slider.
    Type: Application
    Filed: July 24, 2015
    Publication date: November 19, 2015
    Inventors: Randy Ubillos, Garrett M. Johnson, Russell Y. Webb, Timothy D. Cherna, Samuel M. Roberts, Peter Warner
  • Patent number: 9159144
    Abstract: A non-transitory machine readable medium that has a computer program for adjusting color values of an image represented in a color space. The image includes a set of pixels. Each pixel has a set of color values. The computer program receives a user input on a user interface (UI) item for adjusting color values of an image that are associated with a type of content. The computer program identifies a subset of pixels having color values that fall within a range of color values associated with the type of content. The computer program performs a color adjustment operation on the identified subset of pixels.
    Type: Grant
    Filed: September 27, 2012
    Date of Patent: October 13, 2015
    Assignee: APPLE INC.
    Inventors: Timothy D. Cherna, Randy Ubillos, Garrett M. Johnson
  • Patent number: 9131192
    Abstract: Some embodiments provide a novel user interface (UI) tool that is a unified slider control, which includes multiple sliders that slide along a region. The region is a straight line in some embodiments, while it is an angular arc in other embodiments. In some embodiments, the unified slider control is used in a media editing application to allow a user to modify several different properties of the image by moving several different sliders along the region. Each slider is associated with a property of the image. A position of the slider in the region corresponds to a value of the property associated with the slider.
    Type: Grant
    Filed: September 27, 2012
    Date of Patent: September 8, 2015
    Assignee: APPLE INC.
    Inventors: Randy Ubillos, Garrett M. Johnson, Russell Y. Webb, Timothy D. Cherna, Samuel M. Roberts, Peter Warner
  • Patent number: 9105121
    Abstract: A non-transitory machine readable medium that has a computer program for adjusting color values of an image represented in a color space. The image includes several pixels. Each pixel includes a set of color values. The computer program receives a selection of a location on the image. The computer program determines a type of content that is associated with the selected location on the image. From several different image editing operations, the computer program selects a set of image editing operations based on the determined type of content. The computer program displays a set of user interface controls that is associated with the selected set of image editing operations.
    Type: Grant
    Filed: September 27, 2012
    Date of Patent: August 11, 2015
    Assignee: APPLE INC.
    Inventors: Randy Ubillos, Timothy D. Cherna, Garrett M. Johnson