Patents by Inventor Hsi-Jung Wu

Hsi-Jung Wu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190068992
    Abstract: Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.
    Type: Application
    Filed: October 29, 2018
    Publication date: February 28, 2019
    Inventors: Alexandros TOURAPIS, David W. SINGER, Haitao GUO, Hsi-Jung WU, Sorin C. CISMAS, Xiaohua YANG, Yeping SU, Dazhong ZHANG
  • Publication number: 20190058846
    Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.
    Type: Application
    Filed: August 24, 2018
    Publication date: February 21, 2019
    Applicant: Apple Inc.
    Inventors: Xiasong Zhou, Hsi-Jung Wu, Chris Y. Chung, James Normile, Joe S. Abuan, Hyeonkuk Jeong, Yan Yang, Gobind Johar, Thomas Christopher Jansen
  • Patent number: 10212456
    Abstract: Methods of in-loop deblocking filter for high dynamic range (HDR) video compression are disclosed. HDR processing and standard dynamic range (SDR) processing adopt different electro-optical transfer function (EOTF) to convert digital code words to linear luminance. For compressing HDR video, EOTF is proposed to be involved in the selection of two deblocking parameters, ? and tC, which control the strength of deblocking filter. In local activity checking for filter decisions, the calculated local signal characteristics and the thresholds are adjusted according to EOTF. After deblocking filter, the clipping range is modified based on EOTF. The chroma deblocking filter is also extended to inter-inter block boundary.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: February 19, 2019
    Assignee: Apple Inc.
    Inventors: Mei Guo, Feng Yi, Jun Xin, Chris Y. Chung, Yeping Su, Xiaosong Zhou, Jun Xu, Hsi-Jung Wu, Jingteng Xue
  • Patent number: 10205953
    Abstract: Embodiments of the present invention provide techniques for coding video data efficiently based on detection of objects within video sequences. A video coder may perform object detection on the frame and when an object is detected, develop statistics of an area of the frame in which the object is located. The video coder may compare pixels adjacent to the object location to the object's statistics and may define an object region to include pixel blocks corresponding to the object's location and pixel blocks corresponding to adjacent pixels having similar statistics as the detected object. The coder may code the video frame according to a block-based compression algorithm wherein pixel blocks of the object region are coded according to coding parameters generating relatively high quality coding and pixel blocks outside the object region are coded according to coding parameters generating relatively lower quality coding.
    Type: Grant
    Filed: January 26, 2012
    Date of Patent: February 12, 2019
    Assignee: APPLE INC.
    Inventors: Douglas Scott Price, Hsi-Jung Wu, Xiaosong Zhou, Dazhong Zhang
  • Patent number: 10200687
    Abstract: Methods of sample adaptive offset (SAO) for high dynamic range (HDR) video compression are disclosed. For band offset (BO), the sample range of each component is unequally divided into a number of bands based on the distribution of samples, the electro-optical transfer function (EOTF) of HDR source and one perceptually uniform EOTF. Each component may have a different number of bands, different number of signaled bands, and different range value for signaled offsets in BO mode. For edge offset (EO), Cb and Cr may use separate syntax elements. In the sample classification for EO, the difference between the current sample and its neighbor is compared with a threshold to determine whether it is a local valley, a local peak, or corners. A distortion measure for HDR source images are also disclosed.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: February 5, 2019
    Assignee: APPLE INC.
    Inventors: Mei Guo, Jun Xin, Yeping Su, Chris Y. Chung, Xiaosong Zhou, Hsi-Jung Wu
  • Publication number: 20190020876
    Abstract: Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made.
    Type: Application
    Filed: September 1, 2018
    Publication date: January 17, 2019
    Inventors: Thomas Pun, Roger Kumar, Xiaochun Nie, Hsi-Jung Wu
  • Publication number: 20190014332
    Abstract: Techniques for encoding and decoding video images based on image content types are described. Techniques include determining a plurality of image content types from metadata or an image content type recognition algorithm, where each image content type corresponding to a portion of a source video, such as a spatial or temporal portion. Encoding parameters, such as quantization parameter, may be selected for portions of source by a constrained search for encoding parameters, where the constraints are based on image content type.
    Type: Application
    Filed: July 7, 2017
    Publication date: January 10, 2019
    Inventors: Peikang Song, Xing Wen, Sudeng Hu, Hang Yuan, Jae Hoon Kim, Dazhong Zhang, Xiaosong Zhou, Hsi-Jung Wu
  • Patent number: 10178394
    Abstract: Video coding techniques are disclosed for resource-limited destination display devices. Input video data may be coded by converting a first representation of the input video to a resolution of a destination display and base layer coding the converted representation. Additionally, a region of interest may be predicted from within the input video. The predicted ROI may be converted to a resolution of the destination display, and the converted ROI may be enhancement layer coded. The base layer coded data and the enhancement layer data may be transmitted to the destination display where the coded base layer data is decoded and displayed until a zoom event occurs. When a zoom event occurs, both the coded base layer data and the coded enhancement layer data may be decoded and displayed. Thus, the switchover from a first field of view to an ROI view may be performed quickly.
    Type: Grant
    Filed: June 10, 2016
    Date of Patent: January 8, 2019
    Assignee: APPLE INC.
    Inventors: Jingteng Xue, Yeping Su, Chris Chung, Xiaosong Zhou, Hsi-Jung Wu
  • Publication number: 20190007669
    Abstract: Frame packing techniques are disclosed for multi-directional images and video. According to an embodiment, a multi-directional source image is reformatted into a format in which image data from opposing fields of view are represented in respective regions of the packed image as flat image content. Image data from a multi-directional field of view of the source image between the opposing fields of view are represented in another region of the packed image as equirectangular image content. It is expected that use of the formatted frame will lead to coding efficiencies when the formatted image is processed by predictive video coding techniques and the like.
    Type: Application
    Filed: June 30, 2017
    Publication date: January 3, 2019
    Inventors: Jae Hoon Kim, Ming Chen, Xiaosong Zhou, Hsi-Jung Wu, Dazhong Zhang, Hang Yuan, Jiefu Zhai, Chris Y. Chung
  • Publication number: 20190004414
    Abstract: Techniques are described for implementing format configurations for multi-directional video and for switching between them. Source images may be assigned to formats that may change during a coding session. When a change occurs between formats, video coders and decoder may transform decoded reference frames from the first format to the second format. Thereafter, new frames in the second configuration may be coded or decoded predictively using transformed reference frame(s) as source(s) of prediction. In this manner, video coders and decoders may use intra-coding techniques and achieve high efficiency in coding.
    Type: Application
    Filed: June 30, 2017
    Publication date: January 3, 2019
    Inventors: Jae Hoon Kim, Ming Chen, Xiaosong Zhou, Hsi-Jung Wu, Dazhong Zhang, Hang Yuan, Jiefu Zhai, Chris Y. Chung
  • Publication number: 20190005709
    Abstract: Techniques are disclosed for correcting artifacts in multi-view images that include a plurality of planar views. Image content the planar views may be projected from the planar representation to a spherical projection. Thereafter, a portion of the image content may be projected from the spherical projection to a planar representation. The image content of the planar representation may be used for display. Extensions are disclosed that correct artifacts that may arise during deblocking filtering of the multi-view images.
    Type: Application
    Filed: June 30, 2017
    Publication date: January 3, 2019
    Inventors: Jae Hoon Kim, Dazhong Zhang, Hang Yuan, Hsi-Jung Wu, Jiefu Zhai, Ming Chen, Xiaosong Zhou
  • Publication number: 20180352225
    Abstract: Methods of sample adaptive offset (SAO) for high dynamic range (HDR) video compression are disclosed. For band offset (BO), the sample range of each component is unequally divided into a number of bands based on the distribution of samples, the electro-optical transfer function (EOTF) of HDR source and one perceptually uniform EOTF. Each component may have a different number of bands, different number of signaled bands, and different range value for signaled offsets in BO mode. For edge offset (EO), Cb and Cr may use separate syntax elements. In the sample classification for EO, the difference between the current sample and its neighbor is compared with a threshold to determine whether it is a local valley, a local peak, or corners. A distortion measure for HDR source images are also disclosed.
    Type: Application
    Filed: June 2, 2017
    Publication date: December 6, 2018
    Inventors: Mei Guo, Jun Xin, Yeping Su, Chris Y. Chung, Xiaosong Zhou, Hsi-Jung Wu
  • Publication number: 20180352259
    Abstract: Techniques are disclosed for coding high dynamic range (HDR) data. According to such techniques, HDR data may be converted to a domain of uniform luminance data. The uniform domain data may be coded by motion compensated predictive coding. The HDR data also may be coded by motion compensated predictive coding, using a coding parameter that is derived from a counterpart coding parameter of the coding of the uniform domain data. In another technique, HDR data may be coded using coding parameters that are derived from HDR domain processing but distortion measurements may be performed in a uniform domain.
    Type: Application
    Filed: June 2, 2017
    Publication date: December 6, 2018
    Inventors: Mei Guo, Jun Xin, Yeping Su, Chris Chung, Dazhong Zhang, Xiaosong Zhou, Hsi-Jung Wu
  • Publication number: 20180349705
    Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.
    Type: Application
    Filed: June 2, 2017
    Publication date: December 6, 2018
    Inventors: Jae Hoon Kim, Ming Chen, Hang Yuan, Jiefu Zhai, Dazhong Zhang, Xiaosong Zhou, Chris Chung, Hsi-Jung Wu
  • Publication number: 20180352264
    Abstract: Methods of in-loop deblocking filter for high dynamic range (HDR) video compression are disclosed. HDR processing and standard dynamic range (SDR) processing adopt different electro-optical transfer function (EOTF) to convert digital code words to linear luminance. For compressing HDR video, EOTF is proposed to be involved in the selection of two deblocking parameters, ? and tC, which control the strength of deblocking filter. In local activity checking for filter decisions, the calculated local signal characteristics and the thresholds are adjusted according to EOTF. After deblocking filter, the clipping range is modified based on EOTF. The chroma deblocking filter is also extended to inter-inter block boundary.
    Type: Application
    Filed: June 2, 2017
    Publication date: December 6, 2018
    Inventors: Mei Guo, Feng Yi, Jun Xin, Chris Y. Chung, Yeping Su, Xiaosong Zhou, Jun Xu, Hsi-Jung Wu, Jingteng Xue
  • Patent number: 10148970
    Abstract: Scalable video coding and multiplexing compatible with non-scalable decoders is disclosed. In some embodiments, video data is received and encoded in a manner that renders at least a base layer to be compatible with a non-scalable video encoding standard, including by assigning for at least the base layer default values to one or more scalability parameters. In some embodiments, video data is received and encoded to produce an encoded video data that includes a base layer that conforms to a non-scalable video encoding standard and one or more subordinate non-scalable layers, which subordinate non-scalable layers do not by themselves conform to the non-scalable video encoding standard but which can he combined with the base layer to produce a result that does conform to the non-scalable video encoding standard, such that the result can be decoded by a non-scalable decoder.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: December 4, 2018
    Assignee: Apple Inc.
    Inventors: Barin Geoffry Haskell, David William Singer, Thomas Pun, Hsi-Jung Wu, James Oliver Normile
  • Publication number: 20180338161
    Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.
    Type: Application
    Filed: July 31, 2018
    Publication date: November 22, 2018
    Inventors: Jiefu Zhai, Dazhong Zhang, Xiaosong Zhou, Chris Y. Chung, Hsi-Jung Wu, Peikang Song, David R. Conrad, Jae Hoon Kim, Yunfei Zheng
  • Patent number: 10136033
    Abstract: Image and video processing techniques are disclosed for processing components of a color space individually by determining limits for each component based on the relationship between each component in a color space. These limits may then be used to clip each component such that the component values are within the determined range for that component. In this manner, more efficient processing of images and/or video may be achieved.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: November 20, 2018
    Assignee: Apple Inc.
    Inventors: Alexandros Michael Tourapis, Yeping Su, David William Singer, Hsi-Jung Wu
  • Publication number: 20180324326
    Abstract: Image and video processing techniques are disclosed for processing components of a color space individually by determining limits for each component based on the relationship between each component in a color space. These limits may then be used to clip each component such that the component values are within the determined range for that component. In this manner, more efficient processing of images and/or video may be achieved.
    Type: Application
    Filed: July 12, 2018
    Publication date: November 8, 2018
    Inventors: Alexandros Michael Tourapis, Yeping Su, David William Singer, Hsi-Jung Wu
  • Patent number: 10104375
    Abstract: Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: October 16, 2018
    Assignee: APPLE INC.
    Inventors: Thomas Pun, Roger Kumar, Xiaochun Nie, Hsi-Jung Wu