Patents by Inventor Mark Zimmer

Mark Zimmer has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8493473
    Abstract: An automated RAW image processing method and system are disclosed. A RAW image and metadata related to the RAW image are obtained from a digital camera or other source. The RAW image and the related metadata are automatically processed using an Operating System service of a processing device to produce a resulting image in an absolute color space. The resulting image is then made available to an application program executing on the processing device through an application program interface with the Operating System service.
    Type: Grant
    Filed: July 7, 2010
    Date of Patent: July 23, 2013
    Assignee: Apple Inc.
    Inventors: Mark Zimmer, David Hayward, Gabriel G. Marcu
  • Patent number: 8452090
    Abstract: A system and method for performing Bayer reconstruction of images using a programmable graphics processing unit (GPU) are described herein. A Bayer filtered image in RAW format is uploaded to the GPU, unpacked, and reconstructed. Optionally, the reconstructed image may be transformed into any desired color space and/or displayed by a video card in which the GPU resides. The reconstruction is performed independently on each of the red, blue, and green image fields. The red and blue image fields are reconstructed using first and second interpolation passes in first and second orthogonal directions. Each reconstruction pass preferably employs a two-lobed Lanczos filter. The green image field is interpolated using a single interpolation pass in a direction diagonal to the first and second orthogonal directions, and preferably employs a box filter.
    Type: Grant
    Filed: April 25, 2005
    Date of Patent: May 28, 2013
    Assignee: Apple Inc.
    Inventors: Ralph Brunner, Mark Zimmer, Kok Chen
  • Patent number: 8446416
    Abstract: Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU.
    Type: Grant
    Filed: February 11, 2011
    Date of Patent: May 21, 2013
    Assignee: Apple Inc.
    Inventors: John Harper, Ralph Brunner, Peter Graffagnino, Mark Zimmer
  • Patent number: 8390699
    Abstract: A method, system and device for enhancing detail in areas of saturated color in an image are described. As areas of saturated color are detected in an image the opponent color channel is used to calculate a factor to apply to the original pixel value. By calculating this factor to adjust the pixel values of the image detail may be enhanced in the color saturated areas. A user supplied value may also be included to control the amount of automatic adjustment to the pixel values.
    Type: Grant
    Filed: November 11, 2011
    Date of Patent: March 5, 2013
    Assignee: Apple Inc.
    Inventor: Mark Zimmer
  • Patent number: 8358351
    Abstract: A device, method, computer useable medium, and processor programmed to automatically generate tone mapping curves in a digital camera based on image metadata are described. By examining image metadata from a digital camera's sensor, such as the light-product, one can detect sun-lit, high-light, and low-light scenes. Once the light-product value has been calculated for a given image, a tone mapping curve can automatically be generated within the sensor and adjusted appropriately for the scene based on predetermined parameters. Further, it has been determined that independently varying the slopes of the tone mapping curve at the low end (S0) and high end (S1) of the curve results in more visually appealing images. By dynamically and independently selecting S0 and S1 values based on image metadata, more visually pleasing images can be generated.
    Type: Grant
    Filed: June 5, 2009
    Date of Patent: January 22, 2013
    Assignee: Apple Inc.
    Inventors: Ralph Brunner, Mark Zimmer, Guy Cote
  • Publication number: 20120308132
    Abstract: This disclosure pertains to apparatuses, methods, and computer readable media for automatic red-eye repair using multiple recognition channels. While it is possible to manually specify all of the eyes in an image to be repaired, it is desirable for repair to happen automatically. Since red-eye repair algorithms are dependent upon knowing the image position and size of each artifact to be repaired, in an automatic repair mode, the algorithm must be directed as to where the repair should be applied. Face detection is one way to determine eye positions and the interocular distance (IOD) with some degree of certainty. In some embodiments, red, golden, and white recognition channels may be used to locate and determine the type of the artifacts. Once an artifact has been characterized by, e.g., type, size, and location, the techniques disclosed herein may then repair the artifact, replacing it with a photographically reasonable result.
    Type: Application
    Filed: July 14, 2011
    Publication date: December 6, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Publication number: 20120287149
    Abstract: Disclosed is a system and method for processing graphic operations on a plurality of data structures of an image with a graphics processing unit and memory. The disclosed techniques of the system and method create an accumulation buffer of the data structures for accumulating changes to the data structures. A separate buffer is then created from at least a portion of the data structures of the accumulation buffer. The disclosed techniques read the data structures from the separate buffer with the graphics processing unit. The graphics processing unit operates on the data structures read from the separate buffer with the operation. Then, the disclosed techniques write the results of the operation onto the portion of the accumulation buffer corresponding to the separate buffer.
    Type: Application
    Filed: July 13, 2011
    Publication date: November 15, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Patent number: 8311355
    Abstract: Increasing color saturation and contrast in images generally leads to more pleasing images; however, doing so uniformly to all colors in the image can make skin tones appear with an overly red tint. One embodiment of an improved method of skin tone aware color boosting identifies areas of the image which look like skin tones and areas that do not look like skin tones. A blurred “skin tone mask” can then be created over the image. One large boost operation and one small boost operation can be applied to the image. A final version of the image may then be created, applying the pixel values resulting from the small boosting operation to the skin tone regions and applying the pixel values resulting from the large boosting operation to the non-skin tone regions, using the blurred mask to provide a smooth transition between the skin tone and non-skin tone regions.
    Type: Grant
    Filed: June 5, 2009
    Date of Patent: November 13, 2012
    Assignee: Apple Inc.
    Inventors: Ralph Brunner, Mark Zimmer
  • Patent number: 8284271
    Abstract: A system, apparatus, computer readable medium, and method for noise reduction in image capturing devices involving an edge-preserving blur window is disclosed. In one embodiment, the edge-preserving blur includes only those pixels in the blur window that are visually close to the blur window's current center pixel in its blurring calculation. Limiting the pixels considered in the blur to those that are visually close to the center pixel ensures that the image's colors are not blurred along color edges within the image. Light-product information taken from the image's metadata, for example, the camera sensor's gain level, may be used to adjust the blur filter parameters dynamically. This allows the method to perform the appropriate amount of processing depending on the lighting situation of the image that is currently being processed.
    Type: Grant
    Filed: June 5, 2009
    Date of Patent: October 9, 2012
    Assignee: Apple Inc.
    Inventors: Mark Zimmer, Ralph Brunner, David Hayward
  • Publication number: 20120243783
    Abstract: This disclosure pertains to apparatuses, methods, and computer readable media for red-eye removal techniques using multiple recognition channels. In the following examples, red, golden, and white recognition channels are used. A recognition channel is the monochrome extraction from a color photograph in a manner designed to make one kind of red-eye artifact glow with maximum contrast. Once the red-eye artifact has been characterized by, e.g., size and location, the techniques disclosed herein may then discern whether the red-eye artifact is, for example, a red-, golden-, or white-eye case by examining the configuration and characteristics of prominence bitmasks created for the various recognition channels. Once the type of red-eye case has been discerned, the techniques disclosed herein may then replace the artifact with a photographically reasonable result based on the type of red-eye case being repaired. Specular reflection may also be re-added to the photograph.
    Type: Application
    Filed: March 21, 2011
    Publication date: September 27, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Publication number: 20120242861
    Abstract: This disclosure pertains to apparatuses, methods, and computer readable media for red-eye removal techniques using multiple recognition channels. In the following examples, red, golden, and white recognition channels are used. A recognition channel is the monochrome extraction from a color photograph in a manner designed to make one kind of red-eye artifact glow with maximum contrast. Once the red-eye artifact has been characterized by, e.g., size and location, the techniques disclosed herein may then discern whether the red-eye artifact is, for example, a red-, golden-, or white-eye case by examining the configuration and characteristics of prominence bitmasks created for the various recognition channels. Once the type of red-eye case has been discerned, the techniques disclosed herein may then replace the artifact with a photographically reasonable result based on the type of red-eye case being repaired. Specular reflection may also be re-added to the photograph.
    Type: Application
    Filed: March 21, 2011
    Publication date: September 27, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Publication number: 20120242675
    Abstract: This disclosure pertains to apparatuses, methods, and computer readable media for red-eye removal techniques using multiple recognition channels. In the following examples, red, golden, and white recognition channels are used. A recognition channel is the monochrome extraction from a color photograph in a manner designed to make one kind of red-eye artifact glow with maximum contrast. Once the red-eye artifact has been characterized by, e.g., size and location, the techniques disclosed herein may then discern whether the red-eye artifact is, for example, a red-, golden-, or white-eye case by examining the configuration and characteristics of prominence bitmasks created for the various recognition channels. Once the type of red-eye case has been discerned, the techniques disclosed herein may then replace the artifact with a photographically reasonable result based on the type of red-eye case being repaired. Specular reflection may also be re-added to the photograph.
    Type: Application
    Filed: March 21, 2011
    Publication date: September 27, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Publication number: 20120242681
    Abstract: This disclosure pertains to apparatuses, methods, and computer readable media for red-eye removal techniques using multiple recognition channels. In the following examples, red, golden, and white recognition channels are used. A recognition channel is the monochrome extraction from a color photograph in a manner designed to make one kind of red-eye artifact glow with maximum contrast. Once the red-eye artifact has been characterized by, e.g., size and location, the techniques disclosed herein may then discern whether the red-eye artifact is, for example, a red-, golden-, or white-eye case by examining the configuration and characteristics of pro prominence bitmasks created for the various recognition channels. Once the type of red-eye case has been discerned, the techniques disclosed herein may then replace the artifact with a photographically reasonable result based on the type of red-eye case being repaired. Specular reflection may also be re-added to the photograph.
    Type: Application
    Filed: March 21, 2011
    Publication date: September 27, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Publication number: 20120243780
    Abstract: This disclosure pertains to apparatuses, methods, and computer readable media for red-eye removal techniques using multiple recognition channels. In the following examples, red, golden, and white recognition channels are used. A recognition channel is the monochrome extraction from a color photograph in a manner designed to make one kind of red-eye artifact glow with maximum contrast. Once the red-eye artifact has been characterized by, e.g., size and location, the techniques disclosed herein may then discern whether the red-eye artifact is, for example, a red-, golden-, or white-eye case by examining the configuration and characteristics of prominence bitmasks created for the various recognition channels. Once the type of red-eye case has been discerned, the techniques disclosed herein may then replace the artifact with a photographically reasonable result based on the type of red-eye case being repaired. Specular reflection may also be re-added to the photograph.
    Type: Application
    Filed: March 21, 2011
    Publication date: September 27, 2012
    Applicant: Apple Inc.
    Inventor: Mark Zimmer
  • Patent number: 8274583
    Abstract: A system, apparatus, computer readable medium, and method for radially-dependent noise reduction in image capturing devices involving an edge-preserving blur window are disclosed. In one embodiment, the edge-preserving blur includes only those pixels in the blur window that are within a threshold value of the blur window's current center pixel in its blurring calculation. By creating a threshold function that varies radially from the center of the image sensor's light intensity falloff function, a more appropriate threshold value can be chosen for each pixel, allowing for more noise farther from the center of the image, and allowing for less noise closer to the center of the image. Light-product information taken from the image's metadata may be used to scale the threshold value parameters dynamically. This allows the method to perform the appropriate amount of processing depending on the lighting situation of the image that is currently being processed.
    Type: Grant
    Filed: April 7, 2010
    Date of Patent: September 25, 2012
    Assignee: Apple Inc.
    Inventors: Mark Zimmer, Ralph Brunner, David Hayward
  • Publication number: 20120147011
    Abstract: Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU.
    Type: Application
    Filed: February 13, 2012
    Publication date: June 14, 2012
    Applicant: APPLE INC.
    Inventors: John Harper, Ralph Brunner, Peter Graffagnino, Mark Zimmer
  • Publication number: 20120131479
    Abstract: Graphical user interface material map objects are specified by a collection of attribute-value pairs, the collection of which comprises a complete description of the material map and may be used by a rendering engine to create a visual representation of the material map at any resolution. That is, material map representations in accordance with the invention are resolution independent. Another benefit of representing material maps in accordance with the invention is that they may be encrypted to prevent unauthorized inspection or use.
    Type: Application
    Filed: January 26, 2012
    Publication date: May 24, 2012
    Applicant: APPLE INC.
    Inventor: Mark Zimmer
  • Publication number: 20120120076
    Abstract: Graphical user interface objects are specified by a collection of attribute-value pairs, the collection of which comprise a complete description of the object and may be used by a rendering element to create a visual representation of the object. In practice, each of a first portion of attributes may be associated with two or more values—each value (for a given attribute) specifying that attribute's value for a unique resolution. A second portion of attributes are associated with a single value and are, therefore, display resolution independent. Accordingly, the target object may be displayed at any of the specified design display resolutions or accurately displayed at any resolution between the specified design display resolutions.
    Type: Application
    Filed: January 20, 2012
    Publication date: May 17, 2012
    Applicant: Apple Inc.
    Inventors: Mark Zimmer, Peter Graffagnino, Bas Ording
  • Publication number: 20120114227
    Abstract: A method, system and device for enhancing detail in areas of saturated color in an image are described. As areas of saturated color are detected in an image the opponent color channel is used to calculate a factor to apply to the original pixel value. By calculating this factor to adjust the pixel values of the image detail may be enhanced in the color saturated areas. A user supplied value may also be included to control the amount of automatic adjustment to the pixel values.
    Type: Application
    Filed: November 11, 2011
    Publication date: May 10, 2012
    Applicant: APPLE INC.
    Inventor: Mark Zimmer
  • Patent number: 8134561
    Abstract: Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU.
    Type: Grant
    Filed: April 16, 2004
    Date of Patent: March 13, 2012
    Assignee: Apple Inc.
    Inventors: John Harper, Ralph Brunner, Peter Graffagnino, Mark Zimmer