Patents by Inventor Claus Molgaard

Claus Molgaard has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11927874
    Abstract: Some embodiments include methods and/or systems for using multiple cameras to provide optical zoom to a user. Some embodiments include a first camera unit of a multifunction device capturing a first image of a first visual field. A second camera unit of the multifunction device simultaneously captures a second image of a second visual field. In some embodiments, the first camera unit includes a first optical package with a first focal length. In some embodiments, the second camera unit includes a second optical package with a second focal length. In some embodiments, the first focal length is different from the second focal length, and the first visual field is a subset of the second visual field. In some embodiments, the first image and the second image are preserved to a storage medium as separate data structures.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: March 12, 2024
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Iain A. McAllister
  • Patent number: 10706892
    Abstract: The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: July 7, 2020
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Brett M. Keating, George E. Williams, Marco Zuliani, Vincent Y. Wong, Frank Doepke, Ethan J. Tira-Thompson
  • Patent number: 10616471
    Abstract: Techniques are described for automated analysis and filtering of image data. Image data is analyzed to identify regions of interest (ROIs) within the image content. The image data also may have depth estimates applied to content therein. One or more of the ROIs may be designated to possess a base depth, representing a depth of image content against which depths of other content may be compared. Moreover, the depth of the image content within a spatial area of an ROI may be set to be a consistent value, regardless of depth estimates that may have been assigned from other sources. Thereafter, other elements of image content may be assigned content adjustment values in gradients based on their relative depth in image content as compared to the base depth and, optionally, based on their spatial distance from the designated ROI. Image content may be adjusted based on the content adjustment values.
    Type: Grant
    Filed: September 6, 2017
    Date of Patent: April 7, 2020
    Assignee: APPLE INC.
    Inventors: Claus Molgaard, Paul M. Hubel, Ziv Attar, Ilana Volfin
  • Patent number: 10609348
    Abstract: Pixel binning is performed by summing charge from some pixels positioned diagonally in a pixel array. Pixel signals output from pixels positioned diagonally in the pixel array may be combined on the output lines. A signal representing summed charge produces a binned 2×1 cluster. A signal representing combined voltage signals produces a binned 2×1 cluster. A signal representing summed charge and a signal representing combined pixel signals can be combined digitally to produce a binned 2×2 pixel. Orthogonal binning may be performed on other pixels in the pixel array by summing charge on respective common sense regions and then combining the voltage signals that represent the summed charge on respective output lines.
    Type: Grant
    Filed: June 19, 2017
    Date of Patent: March 31, 2020
    Assignee: Apple Inc.
    Inventors: Gennadiy A. Agranov, Claus Molgaard, Ashirwad Bahukhandi, Chiajen Lee, Xiangli Li
  • Patent number: 10523894
    Abstract: Systems and methods for improving automatic selection of keeper images from a commonly captured set of images are described. A combination of image type identification and image quality metrics may be used to identify one or more images in the set as keeper images. Image type identification may be used to categorize the captured images into, for example, three or more categories. The categories may include portrait, action, or “other.” Depending on the category identified, the images may be analyzed differently to identify keeper images. For portrait images, an operation may be used to identify the best set of faces. For action images, the set may be divided into sections such that keeper images selected from each section tell the story of the action. For the “other” category, the images may be analyzed such that those having higher quality metrics for an identified region of interest are selected.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: December 31, 2019
    Assignee: Apple Inc.
    Inventors: Brett Keating, Vincent Wong, Todd Sachs, Claus Molgaard, Michael Rousson, Elliott Harris, Justin Titi, Karl Hsu, Jeff Brasket, Marco Zuliani
  • Patent number: 10432861
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Grant
    Filed: March 22, 2019
    Date of Patent: October 1, 2019
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Publication number: 20190222766
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Application
    Filed: March 22, 2019
    Publication date: July 18, 2019
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Publication number: 20190208125
    Abstract: A method for generating a depth map is described. The method includes obtaining a first image of a scene from a first image capture unit, the first image having a first depth-of-field (DOF), obtaining a second image of the scene from a second image capture unit, the second image having a second DOF that is different than the first DOF. Each pixel in the second image has a corresponding pixel in the first image. The method also includes generating a plurality of third images, each corresponding to a blurred version of the second image at each of a plurality of specified depths, generating a plurality of fourth images, each representing a difference between the first image and one or the plurality of third images, and generating a depth map where each pixel in the depth map is based on the pixels in one of the plurality of fourth images.
    Type: Application
    Filed: March 11, 2019
    Publication date: July 4, 2019
    Inventors: Claus Molgaard, Thomas E. Bishop
  • Patent number: 10284835
    Abstract: Generating an image with a selected level of background blur includes capturing, by a first image capture device, a plurality of frames of a scene, wherein each of the plurality of frames has a different focus depth, obtaining a depth map of the scene, determining a target object and a background in the scene based on the depth map, determining a goal blur for the background, and selecting, for each pixel in an output image, a corresponding pixel from the focus stack.
    Type: Grant
    Filed: September 24, 2015
    Date of Patent: May 7, 2019
    Assignee: Apple Inc.
    Inventors: Thomas E. Bishop, Alexander Lindskog, Claus Molgaard, Frank Doepke
  • Patent number: 10277820
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Grant
    Filed: July 9, 2018
    Date of Patent: April 30, 2019
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Publication number: 20190096441
    Abstract: The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.
    Type: Application
    Filed: November 26, 2018
    Publication date: March 28, 2019
    Inventors: Claus Molgaard, Brett M. Keating, George E. Williams, Marco Zuliani, Vincent Y. Wong, Frank Doepke, Ethan J. Tira-Thompson
  • Patent number: 10237473
    Abstract: A method for generating a depth map is described. The method includes obtaining a first image of a scene from a first image capture unit, the first image having a first depth-of-field (DOF), obtaining a second image of the scene from a second image capture unit, the second image having a second DOF that is different than the first DOF. Each pixel in the second image has a corresponding pixel in the first image. The method also includes generating a plurality of third images, each corresponding to a blurred version of the second image at each of a plurality of specified depths, generating a plurality of fourth images, each representing a difference between the first image and one or the plurality of third images, and generating a depth map where each pixel in the depth map is based on the pixels in one of the plurality of fourth images.
    Type: Grant
    Filed: September 24, 2015
    Date of Patent: March 19, 2019
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Thomas E. Bishop
  • Patent number: 10170157
    Abstract: The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.
    Type: Grant
    Filed: September 25, 2015
    Date of Patent: January 1, 2019
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Brett M. Keating, George E. Williams, Marco Zuliani, Vincent Y. Wong, Frank Doepke, Ethan J. Tira-Thompson
  • Publication number: 20180316864
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Application
    Filed: July 9, 2018
    Publication date: November 1, 2018
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Patent number: 10033927
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: July 24, 2018
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Publication number: 20180109742
    Abstract: Pixel binning is performed by summing charge from some pixels positioned diagonally in a pixel array. Pixel signals output from pixels positioned diagonally in the pixel array may be combined on the output lines. A signal representing summed charge produces a binned 2×1 cluster. A signal representing combined voltage signals produces a binned 2×1 cluster. A signal representing summed charge and a signal representing combined pixel signals can be combined digitally to produce a binned 2×2 pixel. Orthogonal binning may be performed on other pixels in the pixel array by summing charge on respective common sense regions and then combining the voltage signals that represent the summed charge on respective output lines.
    Type: Application
    Filed: June 19, 2017
    Publication date: April 19, 2018
    Inventors: Gennadiy A. Agranov, Claus Molgaard, Ashirwad Bahukhandi, Chiajen Lee, Xiangli Li
  • Patent number: 9942486
    Abstract: For cameras that capture several images in a burst mode, some embodiments of the invention provide a method that presents one or more of the captured images differently than the remaining captured images. The method identifies at least one captured image as dominant image and at least another captured image as a non-dominant image. The method then displays each dominant image different from each non-dominant image in a concurrent presentation of the images captured during the burst mode. The dominant images may appear larger than non-dominant images, and/or appear with a marking that indicates that the images are dominant.
    Type: Grant
    Filed: April 4, 2016
    Date of Patent: April 10, 2018
    Assignee: APPLE INC.
    Inventors: Claus Mølgaard, Mikael Rousson, Vincent Yue-Tao Wong, Brett M. Keating, Jeffrey A. Brasket, Karl C. Hsu, Todd S. Sachs, Justin Titi, Elliott B. Harris
  • Publication number: 20180070007
    Abstract: Techniques are described for automated analysis and filtering of image data. Image data is analyzed to identify regions of interest (ROIs) within the image content. The image data also may have depth estimates applied to content therein. One or more of the ROIs may be designated to possess a base depth, representing a depth of image content against which depths of other content may be compared. Moreover, the depth of the image content within a spatial area of an ROI may be set to be a consistent value, regardless of depth estimates that may have been assigned from other sources. Thereafter, other elements of image content may be assigned content adjustment values in gradients based on their relative depth in image content as compared to the base depth and, optionally, based on their spatial distance from the designated ROI. Image content may be adjusted based on the content adjustment values.
    Type: Application
    Filed: September 6, 2017
    Publication date: March 8, 2018
    Inventors: Claus Molgaard, Paul M. Hubel, Ziv Attar, Ilana Volfin
  • Publication number: 20180063441
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Application
    Filed: October 30, 2017
    Publication date: March 1, 2018
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Patent number: 9843730
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Grant
    Filed: May 5, 2017
    Date of Patent: December 12, 2017
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel