Patents by Inventor Paul M Hubel

Paul M Hubel has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9344636
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: May 17, 2016
    Assignee: Apple Inc.
    Inventors: Marius Tico, Rolf Toft, Paul M. Hubel
  • Patent number: 9344638
    Abstract: Systems, methods, and computer readable media to capture and process high dynamic range (HDR) images when appropriate for a scene are disclosed. When appropriate, multiple images at a single—slightly underexposed—exposure value are captured (making a constant bracket HDR capture sequence) and local tone mapping (LTM) applied to each image. Local tone map and histogram information can be used to generate a noise-amplification mask which can be used during fusion operations. Images obtained and fused in the disclosed manner provide high dynamic range with improved noise and de-ghosting characteristics.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: May 17, 2016
    Assignee: Apple Inc.
    Inventors: Xuemei Zhang, Marius Tico, Yingjun Bai, Farhan A. Baqai, Fabio Riccardi, Juanqing Chen, Paul M. Hubel, George E. Williams, Todd S. Sachs, Yongfang Liang
  • Patent number: 9342871
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: May 17, 2016
    Assignee: Apple Inc.
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Patent number: 9253373
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Grant
    Filed: June 11, 2012
    Date of Patent: February 2, 2016
    Assignee: Apple Inc.
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Patent number: 9213822
    Abstract: A device with a touch sensitive display and a plurality of applications, including a camera application, while the device is in a locked, passcode-protected state: displays a lock screen interface, the lock screen interface including a camera access indicia; detects a gesture; in response to a determination that the gesture starts on the camera access indicia: ceases to display the lock screen interface; starts a restricted session for the camera application; displays an interface for the camera application, without displaying a passcode entry interface; and maintains the device in the locked, passcode-protected state for the applications other than the camera application; and in response to a determination that the gesture starts at a location other than the camera access indicia: displays a passcode entry interface, wherein in response to entry of a correct passcode in the passcode entry interface, the device enters an unlocked state.
    Type: Grant
    Filed: January 17, 2013
    Date of Patent: December 15, 2015
    Assignee: Apple Inc.
    Inventors: Richard R. Dellinger, Imran Chaudhri, Gregory Christie, Scott Forstall, Paul M. Hubel
  • Publication number: 20150348242
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Application
    Filed: September 30, 2014
    Publication date: December 3, 2015
    Inventors: Claus Molgaard, Marius Tico, Rolf Toft, Paul M. Hubel
  • Publication number: 20150350513
    Abstract: Systems, methods, and computer readable media to capture and process high dynamic range (HDR) images when appropriate for a scene are disclosed. When appropriate, multiple images at a single—slightly underexposed—exposure value are captured (making a constant bracket HDR capture sequence) and local tone mapping (LTM) applied to each image. Local tone map and histogram information can be used to generate a noise-amplification mask which can be used during fusion operations. Images obtained and fused in the disclosed manner provide high dynamic range with improved noise and de-ghosting characteristics.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Xuemei Zhang, Marius Tico, Yingjun Bai, Farhan A. Baqai, Fabio Riccardi, Juanqing Chen, Paul M. Hubel, George E. Williams, Todd S. Sachs, Yongfang Liang
  • Publication number: 20150350509
    Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Marius Tico, Rolf Toft, Paul M. Hubel
  • Publication number: 20150350562
    Abstract: The present disclosure relates to image processing and analysis and in particular automatic segmentation of identifiable items in an image, for example the segmentation and identification of characters or symbols in an image. Upon user indication, multiple images of a subject are captured and variations between the images are created using lighting, spectral content, angles and other factors. The images are processed together so that characters and symbols may be recognized from the surface of the image subject.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Paul M. Hubel, Todd S. Sachs
  • Patent number: 9080916
    Abstract: The color response of camera devices may be calibrated, using a correction factor that can account for differences in the spectra of light emitted by different light sources used during calibration. The correction factor may be calculated based on the expected spectral sensitivities of the camera devices, the power spectrum of an actual light source, and the power spectrum of a canonical light source. The correction factor is then applied to adjust a measured color response of a given camera device, so that the adjusted color response is effectively the response of the given camera device if it had been illuminated by the canonical light source. In this manner, any measured color response differences, which may be due to differences between the actual light source used and the canonical light source, can be effectively reduced (if not essentially eliminated.) Other embodiments are also described and claimed.
    Type: Grant
    Filed: August 30, 2012
    Date of Patent: July 14, 2015
    Assignee: Apple Inc.
    Inventors: Edward T. Chang, Scott T. Smith, Damien J. Thivent, Richard L. Baer, Paul M. Hubel
  • Publication number: 20140362256
    Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel combination of image quality and commonality metrics are used to identify a reference frame from a set of commonly captured images which, when the set's other images are combined with it, results in a quality stabilized image. The disclosed image quality and commonality metrics may also be used to optimize the use of a limited amount of image buffer memory during image capture sequences that return more images that the memory may accommodate at one time. Image quality and commonality metrics may also be used to effect the combination of multiple relatively long-exposure images which, when combined with a one or more final (relatively) short-exposure images, yields images exhibiting motion-induced blurring in interesting and visually pleasing ways.
    Type: Application
    Filed: June 6, 2013
    Publication date: December 11, 2014
    Inventors: Anita Nariani Schulze, Rolf Toft, Paul M. Hubel, Marius Tico, Jianping Zhou, Ralph Brunner, Claus Molgaard
  • Publication number: 20140063283
    Abstract: The color response of camera devices may be calibrated, using a correction factor that can account for differences in the spectra of light emitted by different light sources used during calibration. The correction factor may be calculated based on the expected spectral sensitivities of the camera devices, the power spectrum of an actual light source, and the power spectrum of a canonical light source. The correction factor is then applied to adjust a measured color response of a given camera device, so that the adjusted color response is effectively the response of the given camera device if it had been illuminated by the canonical light source. In this manner, any measured color response differences, which may be due to differences between the actual light source used and the canonical light source, can be effectively reduced (if not essentially eliminated.) Other embodiments are also described and claimed.
    Type: Application
    Filed: August 30, 2012
    Publication date: March 6, 2014
    Applicant: Apple Inc.
    Inventors: Edward T. Chang, Scott T. Smith, Damien J. Thivent, Richard L. Baer, Paul M. Hubel
  • Publication number: 20130329132
    Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
    Type: Application
    Filed: June 11, 2012
    Publication date: December 12, 2013
    Applicant: APPLE INC.
    Inventors: Marius Tico, Paul M. Hubel, Frank Doepke, Todd S. Sachs
  • Publication number: 20130229530
    Abstract: Determining, applying and storing model spectral response parameters used to correct colors in a digital image. The model spectral response parameters may be estimated through a recursive error analysis and applied or stored to all digital imaging devices of a particular type, thereby occupying minimal firmware storage space and permitting on the fly correction of images.
    Type: Application
    Filed: March 2, 2012
    Publication date: September 5, 2013
    Applicant: Apple Inc.
    Inventors: Paul M. Hubel, Richard L. Baer
  • Publication number: 20120314086
    Abstract: Systems and methods for testing and calibrating camera modules based on a benchmark standard are provided. The systems can include a receptacle for receiving a camera module under test and a spectrometer. The test station can capture a test measurement using the camera module under test while contemporaneously capturing a true measurement using the spectrometer. Using the true measurement, the test station can predict how the benchmark standard would have performed in those conditions and compare that expected performance to the test measurement. Any differences can be stored in memory within the camera module under test for later retrieval to optimize image processing.
    Type: Application
    Filed: June 7, 2012
    Publication date: December 13, 2012
    Applicant: APPLE INC.
    Inventors: Paul M. Hubel, Richard L. Baer
  • Patent number: 7349117
    Abstract: An imaging appliance family is a cooperative system of two or more imaging appliances that are linked together to share images, command and control. Imaging appliances may be linked to each other by introducing the appliances to each other, establishing a communications link, and exchanging appliance information. The appliances may be introduced by a number of different manual or auto-sensing triggers, including buttons and presence detect circuits. Communications may be automatically established in response to the introduction. After communications are established, appliance information is exchanged and the appliances are dynamically configured into a cooperative system. Once linked, the appliances remain logically connected until they are removed from the family.
    Type: Grant
    Filed: March 31, 2005
    Date of Patent: March 25, 2008
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Donald J Stavely, K Douglas Gennetten, Paul M Hubel
  • Patent number: 7339216
    Abstract: An array of vertical color filter (VCF) sensor groups, optionally including or coupled to circuitry for converting photogenerated carriers produced in the sensors to electrical signals, and methods for reading out any embodiment of the array. The array has a top layer (including the top sensors of the sensor group) and at least one low layer including other ones of the sensors. Only the top layer can be read out with full resolution. Each low layer can only be read out with less than full resolution to generate fewer sensor output values than the total number of pixel sensor locations. Typically, the sensor groups are arranged in cells, each cell including a S sensor groups (e.g., S=4), with S sensors in the top layer and fewer than S sensors in each low layer of the cell. Typically, each cell includes at least one shared sensor (a sensor shared by two or more VCF sensor groups) in each low layer, and each cell includes sensor selection switches (e.g., transistors) between the cell's sensors and a sense node.
    Type: Grant
    Filed: November 22, 2005
    Date of Patent: March 4, 2008
    Assignee: Foveon, Inc.
    Inventors: Richard F. Lyon, Paul M. Hubel, Mark O. Bagula, Richard B. Merrill
  • Patent number: 7262798
    Abstract: A digital camera simulates the use of fill flash. The camera takes a series of photographs of a scene at various focus distances. The photographs are stored, along with their corresponding focus distances. The photographs are analyzed to determine the distance to objects at various locations of the scene. Regions of a final photograph are selectively adjusted in brightness based on the distance information to simulate the effect that would have resulted had fill flash been used.
    Type: Grant
    Filed: September 17, 2001
    Date of Patent: August 28, 2007
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Donald J Stavely, K Douglas Gennetten, David K. Campbell, Paul M Hubel
  • Patent number: 7200264
    Abstract: The probability of a chromaticity being a white point of image scene illumination is estimated by convolving a chromaticity histogram with a function of log probability distribution of chromaticities under an illuminant.
    Type: Grant
    Filed: April 10, 2002
    Date of Patent: April 3, 2007
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Paul M. Hubel, Graham D. Finlayson, Steven D. Hordley
  • Patent number: 7166880
    Abstract: A vertical color filter sensor group formed on a substrate (preferably a semiconductor substrate) and including at least two vertically stacked, photosensitive sensors, and an array of such sensor groups. In some embodiments, a carrier-collection element of at least one sensor of the group has substantially larger area, projected in a plane perpendicular to a normal axis defined by a top surface of a top sensor of the group, than does each minimum-sized carrier-collection element of the group. In some embodiments, the array includes at least two sensor groups that share at least one carrier-collection element. Optionally, the sensor group includes at least one filter positioned relative to the sensors such that radiation that has propagated through or reflected from the filter will propagate into at least one sensor of the group.
    Type: Grant
    Filed: October 27, 2004
    Date of Patent: January 23, 2007
    Assignee: Foveon, Inc.
    Inventors: Richard B. Merrill, Richard F. Lyon, Richard M. Turner, Paul M. Hubel