Patents by Inventor Haiyan He

Haiyan He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11551336
    Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: January 10, 2023
    Assignee: Apple Inc.
    Inventors: Jim C. Chou, Haiyan He, Yun Gong
  • Patent number: 11473971
    Abstract: A device comprises memory, a display characterized by a display characteristic, and processors coupled to the memory. The processors execute instructions causing the processors to receive data indicative of the display characteristic, data indicative of ambient lighting, and data indicative of content characteristics for a content item; determine a tone mapping curve for the content item based on the data indicative of content characteristics; determine a first, so-called “anchor” point along the tone mapping curve; modify a first portion of the tone mapping curve below the anchor point based on the data indicative of ambient lighting; modify a second portion of the tone mapping curve above the anchor point based on the data indicative of the display characteristic; perform tone mapping for the content item based on the modified toned mapping curve to obtain a tone mapped content item; and cause the display to display the tone mapped content item.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: October 18, 2022
    Assignee: Apple Inc.
    Inventors: Xiaohua Yang, Ruiqi Hu, Hao Pan, Vaidyanath Mani, Qiang Wang, Haiyan He, Xin Wang, Gui Xie, Jin Wook Chang
  • Publication number: 20210096023
    Abstract: A device comprises memory, a display characterized by a display characteristic, and processors coupled to the memory. The processors execute instructions causing the processors to receive data indicative of the display characteristic, data indicative of ambient lighting, and data indicative of content characteristics for a content item; determine a tone mapping curve for the content item based on the data indicative of content characteristics; determine a first, so-called “anchor” point along the tone mapping curve; modify a first portion of the tone mapping curve below the anchor point based on the data indicative of ambient lighting; modify a second portion of the tone mapping curve above the anchor point based on the data indicative of the display characteristic; perform tone mapping for the content item based on the modified toned mapping curve to obtain a tone mapped content item; and cause the display to display the tone mapped content item.
    Type: Application
    Filed: September 27, 2019
    Publication date: April 1, 2021
    Inventors: Xiaohua Yang, Ruiqi Hu, Hao Pan, Vaidyanath Mani, Qiang Wang, Haiyan He, Xin Wang, Gui Xie, Jin Wook Chang
  • Publication number: 20200394764
    Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.
    Type: Application
    Filed: August 28, 2020
    Publication date: December 17, 2020
    Inventors: Jim C. Chou, Haiyan He, Yun Gong
  • Patent number: 10764588
    Abstract: Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: September 1, 2020
    Assignee: APPLE INC.
    Inventors: Xiang Fu, Linfeng Guo, Haiyan He, Wei Li, Xu Gang Zhao, Hao Pan, Xiaohua Yang, Krishnakanth Rapaka, Munehiro Nakazato, Haitao Guo
  • Patent number: 10762604
    Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: September 1, 2020
    Assignee: Apple Inc.
    Inventors: Jim C. Chou, Haiyan He, Yun Gong
  • Patent number: 10719916
    Abstract: An electronic device may include noise statistics circuitry to receive input image data corresponding to an image displayable on an electronic display. The input image data may include one or more channels of pixel data. The noise statistics circuitry may also determine a subset of pixel data of a channel of pixel data that qualifies for statistics gathering according to qualification criteria. Additionally, the noise statistics circuitry may determine noise statistics based on the subset of pixel data, and identify image features within the subset of pixel data based on the noise statistics. The image features may include frequency signatures, differentiated from noise, that correspond to features of content of the image. The electronic device may also include enhancement circuitry to enhance the input image data based on the noise statistics and the identified image features. Such enhancement circuitry may substantially preserve the image features within the input image data.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: July 21, 2020
    Assignee: Apple Inc.
    Inventors: Haiyan He, Jim C. Chou
  • Publication number: 20200053362
    Abstract: Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders.
    Type: Application
    Filed: August 10, 2018
    Publication date: February 13, 2020
    Inventors: Xiang Fu, Linfeng Guo, Haiyan He, Wei Li, Xu Gang Zhao, Hao Pan, Xiaohua Yang, Krishnakanth Rapaka, Munehiro Nakazato, Haitao Guo
  • Publication number: 20200043137
    Abstract: An electronic device may include noise statistics circuitry to receive input image data corresponding to an image displayable on an electronic display. The input image data may include one or more channels of pixel data. The noise statistics circuitry may also determine a subset of pixel data of a channel of pixel data that qualifies for statistics gathering according to qualification criteria. Additionally, the noise statistics circuitry may determine noise statistics based on the subset of pixel data, and identify image features within the subset of pixel data based on the noise statistics. The image features may include frequency signatures, differentiated from noise, that correspond to features of content of the image. The electronic device may also include enhancement circuitry to enhance the input image data based on the noise statistics and the identified image features. Such enhancement circuitry may substantially preserve the image features within the input image data.
    Type: Application
    Filed: August 2, 2018
    Publication date: February 6, 2020
    Inventors: Haiyan He, Jim C. Chou
  • Publication number: 20200043138
    Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.
    Type: Application
    Filed: August 2, 2018
    Publication date: February 6, 2020
    Inventors: Jim C. Chou, Haiyan He, Yun Gong
  • Patent number: 10063824
    Abstract: An image processing system performs intensity mapping in a manner that avoids color shifts and conserves processing resources while adapting image data for a target display device. The image processing system may convert input image data to a target color space in which brightness components are orthogonal to other color components. When intensity mapping is performed on image data, the intensity mapping operations do not induce the color shifts that were created in these other proposals. Resource conservation may be achieved by altering operation of perceptual quantization processes as used in other intensity mapping systems. Where prior proposals performed perceptual quantization on all color components of the image data being processed, the disclosed embodiments perform perceptual quantization on only a brightness color component of image data. Thus, these embodiments avoid resource expenditures that otherwise would be spent on perceptual quantization of two other color components.
    Type: Grant
    Filed: March 3, 2015
    Date of Patent: August 28, 2018
    Assignee: Apple Inc.
    Inventor: Haiyan He
  • Patent number: 9569816
    Abstract: An image signal processing system may include processing circuitry that may reduce banding artifacts in image data to be depicted on a display. The processing circuitry may receive a first pixel value associated with a first pixel of the image data and detect a first set of pixels located in a first direction along a same row of pixels or a same column of pixels with respect to the first pixel. The first set of pixels is associated with a first band. The processing circuitry may then interpolate a second pixel value based on an average of a first set of pixel values that correspond to the first set of pixels and a distance between the first pixel and a closest pixel in the first band. The processing circuitry may then output the second pixel value for the first pixel.
    Type: Grant
    Filed: April 15, 2015
    Date of Patent: February 14, 2017
    Assignee: Apple Inc.
    Inventors: Jim C. Chou, Guy Cote, Haiyan He
  • Patent number: 9495731
    Abstract: A method for attenuating banding in image data may involve receiving a stream of input pixels. The method may then include applying a bi-lateral filter to a first portion of the stream of input pixels to generate a first filtered output and applying a high pass filter to a second portion of the stream of input pixels to generate a second filtered output. The method may then determine a local activity and a local intensity associated with the first portion of the stream. The method may then include blending the first filtered output with the first portion of the stream of input pixels based at least in part on the local activity and the local intensity to generate a third filtered output. Afterward, the method may combine the third filtered output with the second filtered output to generate a fourth filtered output that may be output as the image data.
    Type: Grant
    Filed: April 15, 2015
    Date of Patent: November 15, 2016
    Assignee: Apple Inc.
    Inventors: Jim C. Chou, Guy Cote, Haiyan He
  • Publication number: 20160307302
    Abstract: A method for attenuating banding in image data may involve receiving a stream of input pixels. The method may then include applying a bi-lateral filter to a first portion of the stream of input pixels to generate a first filtered output and applying a high pass filter to a second portion of the stream of input pixels to generate a second filtered output. The method may then determine a local activity and a local intensity associated with the first portion of the stream. The method may then include blending the first filtered output with the first portion of the stream of input pixels based at least in part on the local activity and the local intensity to generate a third filtered output. Afterward, the method may combine the third filtered output with the second filtered output to generate a fourth filtered output that may be output as the image data.
    Type: Application
    Filed: April 15, 2015
    Publication date: October 20, 2016
    Inventors: Jim C. Chou, Guy Cote, Haiyan He
  • Publication number: 20160307298
    Abstract: An image signal processing system may include processing circuitry that may reduce banding artifacts in image data to be depicted on a display. The processing circuitry may receive a first pixel value associated with a first pixel of the image data and detect a first set of pixels located in a first direction along a same row of pixels or a same column of pixels with respect to the first pixel. The first set of pixels is associated with a first band. The processing circuitry may then interpolate a second pixel value based on an average of a first set of pixel values that correspond to the first set of pixels and a distance between the first pixel and a closest pixel in the first band. The processing circuitry may then output the second pixel value for the first pixel.
    Type: Application
    Filed: April 15, 2015
    Publication date: October 20, 2016
    Inventors: Jim C. Chou, Guy Cote, Haiyan He
  • Publication number: 20160125580
    Abstract: An image processing system performs intensity mapping in a manner that avoids color shifts and conserves processing resources while adapting image data for a target display device. The image processing system may convert input image data to a target color space in which brightness components are orthogonal to other color components. When intensity mapping is performed on image data, the intensity mapping operations do not induce the color shifts that were created in these other proposals. Resource conservation may be achieved by altering operation of perceptual quantization processes as used in other intensity mapping systems. Where prior proposals performed perceptual quantization on all color components of the image data being processed, the disclosed embodiments perform perceptual quantization on only a brightness color component of image data. Thus, these embodiments avoid resource expenditures that otherwise would be spent on perceptual quantization of two other color components.
    Type: Application
    Filed: March 3, 2015
    Publication date: May 5, 2016
    Inventor: Haiyan He
  • Patent number: 8908100
    Abstract: Image data is processed to present a pleasing display. According to an example embodiment, each pixel of an input video frame is filtered using a variable frequency response filter that is responsive to the motion velocity of the pixel being filtered (e.g., filters data above or below a threshold based upon the motion velocity). A peaked video frame and a blurred video frame are generated for each input video frame using the filtered pixels.
    Type: Grant
    Filed: December 26, 2008
    Date of Patent: December 9, 2014
    Assignee: Entropic Communications, Inc.
    Inventors: Haiyan He, Johan Gerard Willem Maria Janssen, Erwin Ben Bellers
  • Patent number: 8531610
    Abstract: Image data is processed to produce an output using a frame insertion approach. According to an example embodiment, frames are generated for video data, based upon the video data and the presence (or absence) of artifacts in the video data. In one application, a dynamic frame insertion approach is used to selectively generate peaked and blurred video frames in a manner that mitigates undesirable display and/or enhancement of artifacts by tuning down or turning off the generation and/or insertion of video frames.
    Type: Grant
    Filed: December 26, 2008
    Date of Patent: September 10, 2013
    Assignee: Entropic Communications, Inc.
    Inventors: Haiyan He, Johan Gerard Willem Maria Janssen, Erwin Ben Bellers, Franciscus Hendrikus Van Heesch
  • Publication number: 20120256906
    Abstract: A system and method to render 3D images from a 2D source are described. An embodiment of a method to render 3D images from a 2D source comprises the steps of providing a graphics rendering device to estimate depth of a 2D image; providing video or graphics textures and depth-maps to describe an object in a 3D scene; creating, in one embodiment, a single view angle and in another preferred embodiment at least two view angles of the 3D scene to represent an intraocular distance using the graphics rendering device; and presenting both of the at least two view angles on a display using the graphics rendering device and especially the commonly available 3D imaging technology of the graphics rendering device.
    Type: Application
    Filed: September 30, 2011
    Publication date: October 11, 2012
    Applicant: TRIDENT MICROSYSTEMS (FAR EAST) LTD.
    Inventors: Kevin Ross, Robertus Vogelaar, Om Prakash Gangwal, Johan Janssen, Haiyan He, Wim Michiels, Erwin Bellers
  • Patent number: D930216
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: September 7, 2021
    Inventor: Haiyan He