Patents by Inventor Kenneth I. Greenebaum

Kenneth I. Greenebaum has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10249263
    Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content. An HDR rendering and display system may support the rendering and display of standard dynamic range (SDR) and HDR content to both HDR-enabled and standard displays. The HDR rendering and display system renders digital image content into the HDR space and maps the rendered HDR content into the display space of HDR or standard displays using display processing techniques that may preserve at least some of the HDR content even for standard displays. The HDR rendering and display system may take into account various information including but not limited to display characteristics such as size, control inputs, current image characteristics such as image brightness, and environmental information such as viewer position and ambient lighting levels to dynamically adapt the rendering and display of the digital image content according to ambient viewing conditions at the target display.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: April 2, 2019
    Assignee: Apple Inc.
    Inventors: Ian C. Hendry, Kenneth I. Greenebaum, Eric L. Dacquay
  • Patent number: 10217438
    Abstract: A method and user interface for direct setting of black and white points. Black point is set using a slider and matching of gray shades. White point setting is performed by having a setting object move within a defined region, such as a square or circle, with the area where the setting object moves being adjusted dynamically based on the location of the setting object with respect to the defined region. When the area is the desired white, the setting is complete. Preferably the defined region has a varying color border to allow a reference for the user in moving the setting object. A more detailed setting of gray levels can be accomplished by providing a gray scale with reference points. Each reference point has an associated white point setting area, so that settings are developed for each reference point. Settings at other locations are determined by interpolation or extrapolation.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: February 26, 2019
    Assignee: Apple Inc.
    Inventors: Gabriel Marcu, Kenneth I. Greenebaum, Ian C. Hendry
  • Patent number: 10176781
    Abstract: A display device is used in conjunction with: (1) optical sensors to collect information about ambient conditions in the environment of a viewer of the display device; and/or (2) privacy element identification and detection mechanisms (PEDMs) to collect information about the presence, orientation, and/or type of privacy elements being used in conjunction with the display device. For one embodiment, a processor in communication with the display device may create a view model based, at least in part, on the predicted effects of the ambient environmental conditions and/or presence of privacy elements being used in conjunction with the display device on the user's viewing experience. The view model may be a function of gamma, black point, white point, privacy element orientation and/or type, backlighting, field of view, number of viewers, color offset, or a combination thereof. The view model is also referred to as an ambient/privacy model.
    Type: Grant
    Filed: September 22, 2016
    Date of Patent: January 8, 2019
    Assignee: Apple Inc.
    Inventors: Kenneth I. Greenebaum, Robert L. Ridenour
  • Publication number: 20180315160
    Abstract: The present disclosure describes techniques for removing unnecessary processing stages from a graphics processing pipeline based on the format of data passed between the stages. Starting with a stage at a middle point in a pipeline, formats of data that are input to and output from the middle stage may be compared to each other. If the formats match, the middle stage may be removed from the pipeline. Thereafter, the format of data input to a pair of middle stages of the pipeline and output from the pipeline may be compared and, if they match, the middle pair may be deleted. This process may repeat until a middle pair is found where no match occurs between the input and output format. The remaining stages of the pipeline may be retained. In cases where a pipeline is not symmetrical, the formats of data at each node may be compared to each other.
    Type: Application
    Filed: April 30, 2018
    Publication date: November 1, 2018
    Inventors: Aaron M. Ballow, Kenneth I. Greenebaum
  • Patent number: 10089960
    Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content according to a perceptual model. A model of viewer perceptual range may be determined according to the perceptual model based on inputs including ambient lighting conditions, display panel characteristics (e.g., light leakage and reflected ambient light), and/or display panel settings. The system may determine, according to the model of viewer perceptual range, a brightness level that defines a lower portion and an upper portion of a display space of the display panel, and a maximum rendering value M. Digital image content may be rendered according to the maximum rendering value M to generate HDR content in a dynamic range of (0.0-M). The rendered HDR content may then be mapped into the display space of the display panel according to the brightness level.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: October 2, 2018
    Assignee: Apple Inc.
    Inventors: Kenneth I. Greenebaum, Ian C. Hendry, Eric L. Dacquay
  • Patent number: 9984434
    Abstract: The present disclosure describes techniques for removing unnecessary processing stages from a graphics processing pipeline based on the format of data passed between the stages. Starting with a stage at a middle point in a pipeline, formats of data that are input to and output from the middle stage may be compared to each other. If the formats match, the middle stage may be removed from the pipeline. Thereafter, the format of data input to a pair of middle stages of the pipeline and output from the pipeline may be compared and, if they match, the middle pair may be deleted. This process may repeat until a middle pair is found where no match occurs between the input and output format. The remaining stages of the pipeline may be retained. In cases where a pipeline is not symmetrical, the formats of data at each node may be compared to each other.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: May 29, 2018
    Assignee: APPLE INC.
    Inventors: Aaron M. Ballow, Kenneth I. Greenebaum
  • Patent number: 9973723
    Abstract: A method and system for adaptively mixing video components with graphics/UI components, where the video components and graphics/UI components may be of different types, e.g., different dynamic ranges (such as HDR, SDR) and/or color gamut (such as WCG). The mixing may result in a frame optimized for a display device's color space, ambient conditions, viewing distance and angle, etc., while accounting for characteristics of the received data. The methods include receiving video and graphics/UI elements, converting the video to HDR and/or WCG, performing statistical analysis of received data and any additional applicable rendering information, and assembling a video frame with the received components based on the statistical analysis. The assembled video frame may be matched to a color space and displayed. The video data and graphics/UI data may have or be adjusted to have the same white point and/or primaries.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: May 15, 2018
    Assignee: Apple Inc.
    Inventors: Haitao Guo, Kenneth I. Greenebaum, Guy Cote, David W. Singer, Alexandros Tourapis
  • Publication number: 20170093434
    Abstract: Systems, methods, and computer readable media are described for effectively using dither techniques upon signals having a predicted quantization error that varies across the range of the signal. In some embodiments, predicted error is used to shape a precision input signal so that the newly-shaped signal yields a uniform or relatively uniform predicted quantization error. A dither is applied to the re-shaped signal, and the shaping is reversed, after which the signal may be slope limited and/or quantized, taking full and efficient advantage of the dithering technique.
    Type: Application
    Filed: September 23, 2016
    Publication date: March 30, 2017
    Inventors: Kenneth I. Greenebaum, Eric L. Dacquay, Ian C. Hendry
  • Publication number: 20170092229
    Abstract: A display device is used in conjunction with: (1) optical sensors to collect information about ambient conditions in the environment of a viewer of the display device; and/or (2) privacy element identification and detection mechanisms (PEDMs) to collect information about the presence, orientation, and/or type of privacy elements being used in conjunction with the display device. For one embodiment, a processor in communication with the display device may create a view model based, at least in part, on the predicted effects of the ambient environmental conditions and/or presence of privacy elements being used in conjunction with the display device on the user's viewing experience. The view model may be a function of gamma, black point, white point, privacy element orientation and/or type, backlighting, field of view, number of viewers, color offset, or a combination thereof. The view model is also referred to as an ambient/privacy model.
    Type: Application
    Filed: September 22, 2016
    Publication date: March 30, 2017
    Inventors: Kenneth I. Greenebaum, Robert L. Ridenour
  • Patent number: 9602725
    Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.
    Type: Grant
    Filed: June 10, 2014
    Date of Patent: March 21, 2017
    Assignee: Apple Inc.
    Inventors: William E. Mantzel, Kenneth I. Greenebaum, Gregory Keith Mullins
  • Publication number: 20160358346
    Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content. An HDR rendering and display system may support the rendering and display of standard dynamic range (SDR) and HDR content to both HDR-enabled and standard displays. The HDR rendering and display system renders digital image content into the HDR space and maps the rendered HDR content into the display space of HDR or standard displays using display processing techniques that may preserve at least some of the HDR content even for standard displays. The HDR rendering and display system may take into account various information including but not limited to display characteristics such as size, control inputs, current image characteristics such as image brightness, and environmental information such as viewer position and ambient lighting levels to dynamically adapt the rendering and display of the digital image content according to ambient viewing conditions at the target display.
    Type: Application
    Filed: June 3, 2016
    Publication date: December 8, 2016
    Applicant: Apple Inc.
    Inventors: Ian C. Hendry, Kenneth I. Greenebaum, Eric L. Dacquay
  • Publication number: 20160358584
    Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content according to a perceptual model. A model of viewer perceptual range may be determined according to the perceptual model based on inputs including ambient lighting conditions, display panel characteristics (e.g., light leakage and reflected ambient light), and/or display panel settings. The system may determine, according to the model of viewer perceptual range, a brightness level that defines a lower portion and an upper portion of a display space of the display panel, and a maximum rendering value M. Digital image content may be rendered according to the maximum rendering value M to generate HDR content in a dynamic range of (0.0-M). The rendered HDR content may then be mapped into the display space of the display panel according to the brightness level.
    Type: Application
    Filed: June 3, 2016
    Publication date: December 8, 2016
    Applicant: Apple Inc.
    Inventors: Kenneth I. Greenebaum, Ian C. Hendry, Eric L. Dacquay
  • Publication number: 20150348502
    Abstract: A method and user interface for direct setting of black and white points. Black point is set using a slider and matching of gray shades. White point setting is performed by having a setting object move within a defined region, such as a square or circle, with the area where the setting object moves being adjusted dynamically based on the location of the setting object with respect to the defined region. When the area is the desired white, the setting is complete. Preferably the defined region has a varying color border to allow a reference for the user in moving the setting object. A more detailed setting of gray levels can be accomplished by providing a gray scale with reference points. Each reference point has an associated white point setting area, so that settings are developed for each reference point. Settings at other locations are determined by interpolation or extrapolation.
    Type: Application
    Filed: May 30, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Gabriel Marcu, Kenneth I. Greenebaum, Ian C. Hendry
  • Publication number: 20150245043
    Abstract: Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.
    Type: Application
    Filed: February 25, 2015
    Publication date: August 27, 2015
    Applicant: APPLE INC.
    Inventors: Kenneth I. Greenebaum, Haitao Guo, Hao Pan, Guy Cote, Andrew Bai
  • Publication number: 20150243243
    Abstract: Adaptive video processing for a target display panel may be implemented in or by a server/encoding pipeline. The adaptive video processing methods may obtain and take into account video content and display panel-specific information including display characteristics and environmental conditions (e.g., ambient lighting and viewer location) when processing and encoding video content to be streamed to the target display panel in an ambient setting or environment. The server-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to generate video content in the color gamut and dynamic range of the target display panel that is adapted to the display panel characteristics and ambient viewing conditions.
    Type: Application
    Filed: February 25, 2015
    Publication date: August 27, 2015
    Applicant: APPLE INC.
    Inventors: Kenneth I. Greenebaum, Haitao Guo, Hao Pan, Guy Cote, Andrew Bai
  • Publication number: 20150245004
    Abstract: A method and system for adaptively mixing video components with graphics/UI components, where the video components and graphics/UI components may be of different types, e.g., different dynamic ranges (such as HDR, SDR) and/or color gamut (such as WCG). The mixing may result in a frame optimized for a display device's color space, ambient conditions, viewing distance and angle, etc., while accounting for characteristics of the received data. The methods include receiving video and graphics/UI elements, converting the video to HDR and/or WCG, performing statistical analysis of received data and any additional applicable rendering information, and assembling a video frame with the received components based on the statistical analysis. The assembled video frame may be matched to a color space and displayed. The video data and graphics/UI data may have or be adjusted to have the same white point and/or primaries.
    Type: Application
    Filed: September 30, 2014
    Publication date: August 27, 2015
    Inventors: Haitao GUO, Kenneth I. GREENEBAUM, Guy COTE, David W. SINGER, Alexandros TOURAPIS
  • Publication number: 20140320681
    Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.
    Type: Application
    Filed: June 10, 2014
    Publication date: October 30, 2014
    Inventors: William E. Mantzel, Kenneth I. Greenebaum, Gregory Keith Mullins
  • Patent number: 8823813
    Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.
    Type: Grant
    Filed: June 6, 2011
    Date of Patent: September 2, 2014
    Assignee: Apple Inc.
    Inventors: William E. Mantzel, Kenneth I. Greenebaum, Gregory Keith Mullins
  • Patent number: 8648919
    Abstract: Several methods, devices and systems for stabilizing images and correcting rolling shutter effects are described. In one embodiment, a computer implemented method for image stabilization for an image-capturing device with associated calibration data includes determining motion data for the image-capturing device using a motion-estimating device. The method also includes matching motion data to a sequence of frames captured by the image-capturing device to determine motion data for each frame, constructing a target motion path of the image-capturing device based on the motion data for each frame, and computing a desired motion correction from a motion path observed in the motion data to the target motion path.
    Type: Grant
    Filed: June 6, 2011
    Date of Patent: February 11, 2014
    Assignee: Apple Inc.
    Inventors: William E. Mantzel, Kenneth I. Greenebaum
  • Patent number: 8600159
    Abstract: Some embodiments of the invention provide novel methods for converting the color region of images. For instance, the method of some embodiments converts the color of an image from one color region (e.g., from a Rec. 601 color region) to another color region (e.g., to a Rec. 709 color region). In some embodiments, the method receives the image in a first color format that is non-linearly encoded within a first color region. Without performing a linearization operation to linearize the color component values of the image, the method then converts the image into a second color format that is defined with respect to a second color region. In some embodiments, the color-converted image is non-linearly encoded in the second color region.
    Type: Grant
    Filed: June 17, 2011
    Date of Patent: December 3, 2013
    Assignee: Apple Inc.
    Inventors: Kenneth I. Greenebaum, Steve Swen, John S. Bushell