Patents by Inventor Todd S. Sachs

Todd S. Sachs has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180352241
    Abstract: In one embodiment, a method includes: obtaining a first image of a scene while an illumination component is set to an inactive state; obtaining a second image of the scene while the illumination component is set to a pre-flash state; determining one or more illumination control parameters for the illumination component for a third image of the scene that satisfy a foreground-background balance criterion based on a function of the first and second images in order to discriminate foreground data from background data within the scene; and obtaining the third image of the scene while the illumination component is set to an active state in accordance with the one or more illumination control parameters.
    Type: Application
    Filed: May 12, 2018
    Publication date: December 6, 2018
    Inventors: Alexis Gatt, Todd S. Sachs, Garrett M. Johnson, Claus Moelgaard
  • Patent number: 9955085
    Abstract: Adaptive bracketing techniques for photography are described. An adaptive bracketing logic/module directs an imaging device to capture an adaptive bracket. The adaptive bracket can include a first image captured at a first exposure value, a second image captured at a second exposure value, and a third image captured at the first exposure value. The first exposure value can be underexposed in comparison to the second exposure value. The adaptive bracketing logic/module can determine that a difference between the first and second images; determine that the third image is more similar to the second image than the first image; and generate a composite image using the first image and the third image. The adaptive bracketing logic/module can also update the adaptive bracket to include the composite image. Optionally, the updated adaptive bracket can be used to generate one or more high dynamic range (HDR) images. Other embodiments are described.
    Type: Grant
    Filed: September 22, 2016
    Date of Patent: April 24, 2018
    Assignee: Apple Inc.
    Inventors: Todd S. Sachs, Garrett M. Johnson
  • Patent number: 9942486
    Abstract: For cameras that capture several images in a burst mode, some embodiments of the invention provide a method that presents one or more of the captured images differently than the remaining captured images. The method identifies at least one captured image as dominant image and at least another captured image as a non-dominant image. The method then displays each dominant image different from each non-dominant image in a concurrent presentation of the images captured during the burst mode. The dominant images may appear larger than non-dominant images, and/or appear with a marking that indicates that the images are dominant.
    Type: Grant
    Filed: April 4, 2016
    Date of Patent: April 10, 2018
    Assignee: APPLE INC.
    Inventors: Claus Mølgaard, Mikael Rousson, Vincent Yue-Tao Wong, Brett M. Keating, Jeffrey A. Brasket, Karl C. Hsu, Todd S. Sachs, Justin Titi, Elliott B. Harris
  • Publication number: 20180084181
    Abstract: Adaptive bracketing techniques for photography are described. An adaptive bracketing logic/module directs an imaging device to capture an adaptive bracket. The adaptive bracket can include a first image captured at a first exposure value, a second image captured at a second exposure value, and a third image captured at the first exposure value. The first exposure value can be underexposed in comparison to the second exposure value. The adaptive bracketing logic/module can determine that a difference between the first and second images; determine that the third image is more similar to the second image than the first image; and generate a composite image using the first image and the third image. The adaptive bracketing logic/module can also update the adaptive bracket to include the composite image. Optionally, the updated adaptive bracket can be used to generate one or more high dynamic range (HDR) images. Other embodiments are described.
    Type: Application
    Filed: September 22, 2016
    Publication date: March 22, 2018
    Inventors: Todd S. Sachs, Garrett M. Johnson
  • Publication number: 20180068473
    Abstract: Image fusion techniques hide artifacts that can arise at seams between regions of different image quality. According to these techniques, image registration may be performed on multiple images having at least a portion of image content in common. A first image may be warped to a spatial domain of a second image based on the image registration. A fused image may be generated from a blend of the warped first image and the second image, wherein relative contributions of the warped first image and the second image are weighted according to a distribution pattern based on a size of a smaller of the pair of images. In this manner, contributions of the different images vary at seams that otherwise would appear.
    Type: Application
    Filed: September 6, 2016
    Publication date: March 8, 2018
    Inventors: Marius Tico, Lech J. Szumilas, Xiaoxing Li, Paul M. Hubel, Todd S. Sachs
  • Patent number: 9860446
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: January 2, 2018
    Assignee: Apple Inc.
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Publication number: 20170358101
    Abstract: Depth determination includes obtaining a first image of a scene captured by a camera at a first position, obtaining a second image of the scene captured by the camera at a second position directed by an optical image stabilization (OIS) actuator, determining a virtual baseline between the camera at the first position and the second position, and determining a depth of the scene based on the first image, the second image, and the virtual baseline.
    Type: Application
    Filed: June 9, 2017
    Publication date: December 14, 2017
    Inventors: Thomas E. Bishop, Benjamin A. Darling, Kevin A. Gross, Marius Tico, Paul M. Hubel, Todd S. Sachs
  • Patent number: 9692995
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: June 27, 2017
    Assignee: Apple Inc.
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Publication number: 20170171466
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Application
    Filed: February 24, 2017
    Publication date: June 15, 2017
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Publication number: 20170070731
    Abstract: Camera calibration includes capturing a first image of an object by a first camera, determining spatial parameters between the first camera and the object using the first image, obtaining a first estimate for an optical center, iteratively calculating a best set of optical characteristics and test setup parameters based on the first estimate for the optical center until the difference in a most recent calculated set of optical characteristics and previously calculated set of optical characteristics satisfies a predetermined threshold, and calibrating the first camera based on the best set of optical characteristics. Multi-camera system calibration may include calibrating, based on a detected misalignment of features in multiple images, the multi-camera system using a context of the multi-camera system and one or more prior stored contexts.
    Type: Application
    Filed: September 3, 2016
    Publication date: March 9, 2017
    Inventors: Benjamin A. Darling, Thomas E. Bishop, Kevin A. Gross, Paul M. Hubel, Todd S. Sachs, Guangzhi Cao, Alexander Lindskog, Stefan Weber, Jianping Zhou
  • Patent number: 9565370
    Abstract: The present disclosure relates to image processing and analysis and in particular automatic segmentation of identifiable items in an image, for example the segmentation and identification of characters or symbols in an image. Upon user indication, multiple images of a subject are captured and variations between the images are created using lighting, spectral content, angles and other factors. The images are processed together so that characters and symbols may be recognized from the surface of the image subject.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: February 7, 2017
    Assignee: Apple Inc.
    Inventors: Paul M. Hubel, Todd S. Sachs
  • Publication number: 20160295130
    Abstract: For cameras that capture several images in a burst mode, some embodiments of the invention provide a method that presents one or more of the captured images differently than the remaining captured images. The method identifies at least one captured image as dominant image and at least another captured image as a non-dominant image. The method then displays each dominant image different from each non-dominant image in a concurrent presentation of the images captured during the burst mode. The dominant images may appear larger than non-dominant images, and/or appear with a marking that indicates that the images are dominant.
    Type: Application
    Filed: April 4, 2016
    Publication date: October 6, 2016
    Inventors: Claus Mølgaard, Mikael Rousson, Vincent Yue-Tao Wong, Brett M. Keating, Jeffrey A. Brasket, Karl C. Hsu, Todd S. Sachs, Justin Titi, Elliott B. Harris
  • Publication number: 20160227137
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Application
    Filed: February 1, 2016
    Publication date: August 4, 2016
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Patent number: 9344638
    Abstract: Systems, methods, and computer readable media to capture and process high dynamic range (HDR) images when appropriate for a scene are disclosed. When appropriate, multiple images at a single—slightly underexposed—exposure value are captured (making a constant bracket HDR capture sequence) and local tone mapping (LTM) applied to each image. Local tone map and histogram information can be used to generate a noise-amplification mask which can be used during fusion operations. Images obtained and fused in the disclosed manner provide high dynamic range with improved noise and de-ghosting characteristics.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: May 17, 2016
    Assignee: Apple Inc.
    Inventors: Xuemei Zhang, Marius Tico, Yingjun Bai, Farhan A. Baqai, Fabio Riccardi, Juanqing Chen, Paul M. Hubel, George E. Williams, Todd S. Sachs, Yongfang Liang
  • Patent number: 9307112
    Abstract: For cameras that capture several images in a burst mode, some embodiments of the invention provide a method that presents one or more of the captured images differently than the remaining captured images. The method identifies at least one captured image as dominant image and at least another captured image as a non-dominant image. The method then displays each dominant image different from each non-dominant image in a concurrent presentation of the images captured during the burst mode. The dominant images may appear larger than non-dominant images, and/or appear with a marking that indicates that the images are dominant.
    Type: Grant
    Filed: December 5, 2013
    Date of Patent: April 5, 2016
    Assignee: APPLE INC.
    Inventors: Claus Mølgaard, Mikael Rousson, Vincent Yue-Tao Wong, Brett M. Keating, Jeffrey A. Brasket, Karl C. Hsu, Todd S. Sachs, Justin Titi, Elliott B. Harris
  • Patent number: 9253373
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Grant
    Filed: June 11, 2012
    Date of Patent: February 2, 2016
    Assignee: Apple Inc.
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Patent number: 9247133
    Abstract: This disclosure pertains to devices, methods, and computer readable media for performing image registration. A few generalized steps may be used to carry out the image registration techniques described herein: 1) acquiring image data from an image sensor; 2) selecting a pair of overlapping image portions from the acquired image data for registration; 3) determining an area of “maximum energy” in one of the image portions being registered; 4) placing an image registration window over both image portions at the determined location of maximum energy; 5) registering the overlapping image portions using only the image data falling within the image registration windows; and 6) determining, according to one or more metrics, whether the image registration window should be shifted from a current location before registering subsequently acquired image portions.
    Type: Grant
    Filed: June 1, 2011
    Date of Patent: January 26, 2016
    Assignee: Apple Inc.
    Inventors: Frank Doepke, Todd S. Sachs, Kevin L. Hunter, Alexis Gatt
  • Publication number: 20150350562
    Abstract: The present disclosure relates to image processing and analysis and in particular automatic segmentation of identifiable items in an image, for example the segmentation and identification of characters or symbols in an image. Upon user indication, multiple images of a subject are captured and variations between the images are created using lighting, spectral content, angles and other factors. The images are processed together so that characters and symbols may be recognized from the surface of the image subject.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Paul M. Hubel, Todd S. Sachs
  • Publication number: 20150350513
    Abstract: Systems, methods, and computer readable media to capture and process high dynamic range (HDR) images when appropriate for a scene are disclosed. When appropriate, multiple images at a single—slightly underexposed—exposure value are captured (making a constant bracket HDR capture sequence) and local tone mapping (LTM) applied to each image. Local tone map and histogram information can be used to generate a noise-amplification mask which can be used during fusion operations. Images obtained and fused in the disclosed manner provide high dynamic range with improved noise and de-ghosting characteristics.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Xuemei Zhang, Marius Tico, Yingjun Bai, Farhan A. Baqai, Fabio Riccardi, Juanqing Chen, Paul M. Hubel, George E. Williams, Todd S. Sachs, Yongfang Liang
  • Patent number: 9092853
    Abstract: A method for dynamically calibrating rotational offset in a device includes obtaining an image captured by a camera of the device. Orientation information of the device at the time of image capture may be associated with the image. Pixel data of the image may be analyzed to determine an image orientation angle for the image. A device orientation angle may be determined from the orientation information. A rotational offset, based on the image orientation angle and the device orientation angle, may be determined. The rotational offset is relative to the camera or orientation sensor. A rotational bias may be determined from statistical analysis of numerous rotational offsets from numerous respective images. In some embodiments, various thresholds and predetermined ranges may be used to exclude some rotational offsets from the statistical analysis or to discontinue processing for that image.
    Type: Grant
    Filed: October 13, 2014
    Date of Patent: July 28, 2015
    Assignee: Apple Inc.
    Inventors: Todd S. Sachs, Kevin L. Hunter, Marco Zuliani, Claus Molgaard