Patents by Inventor Kenneth I. Greenebaum
Kenneth I. Greenebaum has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10271054Abstract: Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.Type: GrantFiled: February 25, 2015Date of Patent: April 23, 2019Assignee: Apple, Inc.Inventors: Kenneth I. Greenebaum, Haitao Guo, Hao Pan, Guy Cote, Andrew Bai
-
Patent number: 10249263Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content. An HDR rendering and display system may support the rendering and display of standard dynamic range (SDR) and HDR content to both HDR-enabled and standard displays. The HDR rendering and display system renders digital image content into the HDR space and maps the rendered HDR content into the display space of HDR or standard displays using display processing techniques that may preserve at least some of the HDR content even for standard displays. The HDR rendering and display system may take into account various information including but not limited to display characteristics such as size, control inputs, current image characteristics such as image brightness, and environmental information such as viewer position and ambient lighting levels to dynamically adapt the rendering and display of the digital image content according to ambient viewing conditions at the target display.Type: GrantFiled: June 3, 2016Date of Patent: April 2, 2019Assignee: Apple Inc.Inventors: Ian C. Hendry, Kenneth I. Greenebaum, Eric L. Dacquay
-
Patent number: 10217438Abstract: A method and user interface for direct setting of black and white points. Black point is set using a slider and matching of gray shades. White point setting is performed by having a setting object move within a defined region, such as a square or circle, with the area where the setting object moves being adjusted dynamically based on the location of the setting object with respect to the defined region. When the area is the desired white, the setting is complete. Preferably the defined region has a varying color border to allow a reference for the user in moving the setting object. A more detailed setting of gray levels can be accomplished by providing a gray scale with reference points. Each reference point has an associated white point setting area, so that settings are developed for each reference point. Settings at other locations are determined by interpolation or extrapolation.Type: GrantFiled: May 30, 2014Date of Patent: February 26, 2019Assignee: Apple Inc.Inventors: Gabriel Marcu, Kenneth I. Greenebaum, Ian C. Hendry
-
Patent number: 10176781Abstract: A display device is used in conjunction with: (1) optical sensors to collect information about ambient conditions in the environment of a viewer of the display device; and/or (2) privacy element identification and detection mechanisms (PEDMs) to collect information about the presence, orientation, and/or type of privacy elements being used in conjunction with the display device. For one embodiment, a processor in communication with the display device may create a view model based, at least in part, on the predicted effects of the ambient environmental conditions and/or presence of privacy elements being used in conjunction with the display device on the user's viewing experience. The view model may be a function of gamma, black point, white point, privacy element orientation and/or type, backlighting, field of view, number of viewers, color offset, or a combination thereof. The view model is also referred to as an ambient/privacy model.Type: GrantFiled: September 22, 2016Date of Patent: January 8, 2019Assignee: Apple Inc.Inventors: Kenneth I. Greenebaum, Robert L. Ridenour
-
Publication number: 20180315160Abstract: The present disclosure describes techniques for removing unnecessary processing stages from a graphics processing pipeline based on the format of data passed between the stages. Starting with a stage at a middle point in a pipeline, formats of data that are input to and output from the middle stage may be compared to each other. If the formats match, the middle stage may be removed from the pipeline. Thereafter, the format of data input to a pair of middle stages of the pipeline and output from the pipeline may be compared and, if they match, the middle pair may be deleted. This process may repeat until a middle pair is found where no match occurs between the input and output format. The remaining stages of the pipeline may be retained. In cases where a pipeline is not symmetrical, the formats of data at each node may be compared to each other.Type: ApplicationFiled: April 30, 2018Publication date: November 1, 2018Inventors: Aaron M. Ballow, Kenneth I. Greenebaum
-
Patent number: 10089960Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content according to a perceptual model. A model of viewer perceptual range may be determined according to the perceptual model based on inputs including ambient lighting conditions, display panel characteristics (e.g., light leakage and reflected ambient light), and/or display panel settings. The system may determine, according to the model of viewer perceptual range, a brightness level that defines a lower portion and an upper portion of a display space of the display panel, and a maximum rendering value M. Digital image content may be rendered according to the maximum rendering value M to generate HDR content in a dynamic range of (0.0-M). The rendered HDR content may then be mapped into the display space of the display panel according to the brightness level.Type: GrantFiled: June 3, 2016Date of Patent: October 2, 2018Assignee: Apple Inc.Inventors: Kenneth I. Greenebaum, Ian C. Hendry, Eric L. Dacquay
-
Patent number: 9984434Abstract: The present disclosure describes techniques for removing unnecessary processing stages from a graphics processing pipeline based on the format of data passed between the stages. Starting with a stage at a middle point in a pipeline, formats of data that are input to and output from the middle stage may be compared to each other. If the formats match, the middle stage may be removed from the pipeline. Thereafter, the format of data input to a pair of middle stages of the pipeline and output from the pipeline may be compared and, if they match, the middle pair may be deleted. This process may repeat until a middle pair is found where no match occurs between the input and output format. The remaining stages of the pipeline may be retained. In cases where a pipeline is not symmetrical, the formats of data at each node may be compared to each other.Type: GrantFiled: September 23, 2016Date of Patent: May 29, 2018Assignee: APPLE INC.Inventors: Aaron M. Ballow, Kenneth I. Greenebaum
-
Patent number: 9973723Abstract: A method and system for adaptively mixing video components with graphics/UI components, where the video components and graphics/UI components may be of different types, e.g., different dynamic ranges (such as HDR, SDR) and/or color gamut (such as WCG). The mixing may result in a frame optimized for a display device's color space, ambient conditions, viewing distance and angle, etc., while accounting for characteristics of the received data. The methods include receiving video and graphics/UI elements, converting the video to HDR and/or WCG, performing statistical analysis of received data and any additional applicable rendering information, and assembling a video frame with the received components based on the statistical analysis. The assembled video frame may be matched to a color space and displayed. The video data and graphics/UI data may have or be adjusted to have the same white point and/or primaries.Type: GrantFiled: September 30, 2014Date of Patent: May 15, 2018Assignee: Apple Inc.Inventors: Haitao Guo, Kenneth I. Greenebaum, Guy Cote, David W. Singer, Alexandros Tourapis
-
Publication number: 20170092229Abstract: A display device is used in conjunction with: (1) optical sensors to collect information about ambient conditions in the environment of a viewer of the display device; and/or (2) privacy element identification and detection mechanisms (PEDMs) to collect information about the presence, orientation, and/or type of privacy elements being used in conjunction with the display device. For one embodiment, a processor in communication with the display device may create a view model based, at least in part, on the predicted effects of the ambient environmental conditions and/or presence of privacy elements being used in conjunction with the display device on the user's viewing experience. The view model may be a function of gamma, black point, white point, privacy element orientation and/or type, backlighting, field of view, number of viewers, color offset, or a combination thereof. The view model is also referred to as an ambient/privacy model.Type: ApplicationFiled: September 22, 2016Publication date: March 30, 2017Inventors: Kenneth I. Greenebaum, Robert L. Ridenour
-
Publication number: 20170093434Abstract: Systems, methods, and computer readable media are described for effectively using dither techniques upon signals having a predicted quantization error that varies across the range of the signal. In some embodiments, predicted error is used to shape a precision input signal so that the newly-shaped signal yields a uniform or relatively uniform predicted quantization error. A dither is applied to the re-shaped signal, and the shaping is reversed, after which the signal may be slope limited and/or quantized, taking full and efficient advantage of the dithering technique.Type: ApplicationFiled: September 23, 2016Publication date: March 30, 2017Inventors: Kenneth I. Greenebaum, Eric L. Dacquay, Ian C. Hendry
-
Patent number: 9602725Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.Type: GrantFiled: June 10, 2014Date of Patent: March 21, 2017Assignee: Apple Inc.Inventors: William E. Mantzel, Kenneth I. Greenebaum, Gregory Keith Mullins
-
Publication number: 20160358584Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content according to a perceptual model. A model of viewer perceptual range may be determined according to the perceptual model based on inputs including ambient lighting conditions, display panel characteristics (e.g., light leakage and reflected ambient light), and/or display panel settings. The system may determine, according to the model of viewer perceptual range, a brightness level that defines a lower portion and an upper portion of a display space of the display panel, and a maximum rendering value M. Digital image content may be rendered according to the maximum rendering value M to generate HDR content in a dynamic range of (0.0-M). The rendered HDR content may then be mapped into the display space of the display panel according to the brightness level.Type: ApplicationFiled: June 3, 2016Publication date: December 8, 2016Applicant: Apple Inc.Inventors: Kenneth I. Greenebaum, Ian C. Hendry, Eric L. Dacquay
-
Publication number: 20160358346Abstract: Methods and apparatus for rendering and displaying high dynamic range (HDR) digital image content. An HDR rendering and display system may support the rendering and display of standard dynamic range (SDR) and HDR content to both HDR-enabled and standard displays. The HDR rendering and display system renders digital image content into the HDR space and maps the rendered HDR content into the display space of HDR or standard displays using display processing techniques that may preserve at least some of the HDR content even for standard displays. The HDR rendering and display system may take into account various information including but not limited to display characteristics such as size, control inputs, current image characteristics such as image brightness, and environmental information such as viewer position and ambient lighting levels to dynamically adapt the rendering and display of the digital image content according to ambient viewing conditions at the target display.Type: ApplicationFiled: June 3, 2016Publication date: December 8, 2016Applicant: Apple Inc.Inventors: Ian C. Hendry, Kenneth I. Greenebaum, Eric L. Dacquay
-
Publication number: 20150348502Abstract: A method and user interface for direct setting of black and white points. Black point is set using a slider and matching of gray shades. White point setting is performed by having a setting object move within a defined region, such as a square or circle, with the area where the setting object moves being adjusted dynamically based on the location of the setting object with respect to the defined region. When the area is the desired white, the setting is complete. Preferably the defined region has a varying color border to allow a reference for the user in moving the setting object. A more detailed setting of gray levels can be accomplished by providing a gray scale with reference points. Each reference point has an associated white point setting area, so that settings are developed for each reference point. Settings at other locations are determined by interpolation or extrapolation.Type: ApplicationFiled: May 30, 2014Publication date: December 3, 2015Applicant: Apple Inc.Inventors: Gabriel Marcu, Kenneth I. Greenebaum, Ian C. Hendry
-
Publication number: 20150243243Abstract: Adaptive video processing for a target display panel may be implemented in or by a server/encoding pipeline. The adaptive video processing methods may obtain and take into account video content and display panel-specific information including display characteristics and environmental conditions (e.g., ambient lighting and viewer location) when processing and encoding video content to be streamed to the target display panel in an ambient setting or environment. The server-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to generate video content in the color gamut and dynamic range of the target display panel that is adapted to the display panel characteristics and ambient viewing conditions.Type: ApplicationFiled: February 25, 2015Publication date: August 27, 2015Applicant: APPLE INC.Inventors: Kenneth I. Greenebaum, Haitao Guo, Hao Pan, Guy Cote, Andrew Bai
-
Publication number: 20150245004Abstract: A method and system for adaptively mixing video components with graphics/UI components, where the video components and graphics/UI components may be of different types, e.g., different dynamic ranges (such as HDR, SDR) and/or color gamut (such as WCG). The mixing may result in a frame optimized for a display device's color space, ambient conditions, viewing distance and angle, etc., while accounting for characteristics of the received data. The methods include receiving video and graphics/UI elements, converting the video to HDR and/or WCG, performing statistical analysis of received data and any additional applicable rendering information, and assembling a video frame with the received components based on the statistical analysis. The assembled video frame may be matched to a color space and displayed. The video data and graphics/UI data may have or be adjusted to have the same white point and/or primaries.Type: ApplicationFiled: September 30, 2014Publication date: August 27, 2015Inventors: Haitao GUO, Kenneth I. GREENEBAUM, Guy COTE, David W. SINGER, Alexandros TOURAPIS
-
Publication number: 20150245043Abstract: Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.Type: ApplicationFiled: February 25, 2015Publication date: August 27, 2015Applicant: APPLE INC.Inventors: Kenneth I. Greenebaum, Haitao Guo, Hao Pan, Guy Cote, Andrew Bai
-
Publication number: 20140320681Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.Type: ApplicationFiled: June 10, 2014Publication date: October 30, 2014Inventors: William E. Mantzel, Kenneth I. Greenebaum, Gregory Keith Mullins
-
Patent number: 8823813Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.Type: GrantFiled: June 6, 2011Date of Patent: September 2, 2014Assignee: Apple Inc.Inventors: William E. Mantzel, Kenneth I. Greenebaum, Gregory Keith Mullins
-
Patent number: 8648919Abstract: Several methods, devices and systems for stabilizing images and correcting rolling shutter effects are described. In one embodiment, a computer implemented method for image stabilization for an image-capturing device with associated calibration data includes determining motion data for the image-capturing device using a motion-estimating device. The method also includes matching motion data to a sequence of frames captured by the image-capturing device to determine motion data for each frame, constructing a target motion path of the image-capturing device based on the motion data for each frame, and computing a desired motion correction from a motion path observed in the motion data to the target motion path.Type: GrantFiled: June 6, 2011Date of Patent: February 11, 2014Assignee: Apple Inc.Inventors: William E. Mantzel, Kenneth I. Greenebaum