Patents by Inventor Shaw-Min Lei

Shaw-Min Lei has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9860530
    Abstract: A method and apparatus for loop processing of reconstructed video in an encoder system are disclosed. The loop processing comprises an in-loop filter and one or more adaptive filters. The filter parameters for the adaptive filter are derived from the pre-in-loop video data so that the adaptive filter processing can be applied to the in-loop processed video data without the need of waiting for completion of the in-loop filter processing for a picture or an image unit. In another embodiment, two adaptive filters derive their respective adaptive filter parameters based on the same pre-in-loop video data. In yet another embodiment, a moving window is used for image-unit-based coding system incorporating in-loop filter and one or more adaptive filters. The in-loop filter and the adaptive filter are applied to a moving window of pre-in-loop video data comprising one or more sub-regions from corresponding one or more image units.
    Type: Grant
    Filed: October 11, 2012
    Date of Patent: January 2, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Kun-Bin Lee, Yi-Hau Chen, Chi-Cheng Ju, Yu-Wen Huang, Shaw-Min Lei, Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Chih-Wei Hsu
  • Patent number: 9860528
    Abstract: A method and apparatus for scalable video coding are disclosed, wherein the video data is configured into a Base Layer (BL) and an Enhancement Layer (EL) and wherein the EL has higher spatial resolution or better video quality than the BL. According to embodiments of the present invention, information from the base layer is exploited for coding the enhancement layer. The information coding for the enhancement layer includes CU structure, motion vector predictor (MVP) information, MVP/merge candidates, intra prediction mode, residual quadtree information, texture information, residual information, context adaptive entropy coding, Adaptive Lop Filter (ALF), Sample Adaptive Offset (SAO), and deblocking filter.
    Type: Grant
    Filed: May 31, 2012
    Date of Patent: January 2, 2018
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Chih-Ming Fu, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20170374372
    Abstract: A method of video coding using palette coding mode for color video in a non-444 color format is disclosed. The non-444 video data can be converted to the 444 format so that the palette designed for the 444 format can be used for the non-444 video data. For the 4:2:0 color format, each chroma sample collocated with corresponding quad luma samples is padded with three chroma samples to form converted quad chroma samples. For the 4:2:0 color format, if a current pixel does not belong to the color palette, one or more escape values are signaled for the current pixel and the escape value associated with the chroma sample of the current pixel for each color component is not signaled for three of the quad chroma sample locations collocated with corresponding quad luma samples.
    Type: Application
    Filed: December 16, 2015
    Publication date: December 28, 2017
    Inventors: Shan LIU, Jing YE, Xiaozhong XU, Jungsun KIM, Wang-Lin LAI, Shaw-Min LEI
  • Patent number: 9843820
    Abstract: A method and apparatus for three-dimensional video coding or multi-view video coding are disclosed. Embodiments according to the present invention derive a unified disparity vector from depth information for Inter mode and Skip/Direct mode. The unified disparity vector is derived from a subset of depth samples in an associated depth block corresponding to the current block using a unified derivation method. The unified derivation method is applied in Inter mode, Skip mode, or Direct mode when a disparity vector derived from depth data is required for encoding or decoding. The unified disparity vector can also be applied to derive a disparity vector for locating a corresponding block, and thus an inter-view motion vector candidate can be determined for Skip mode or Direct mode.
    Type: Grant
    Filed: July 5, 2013
    Date of Patent: December 12, 2017
    Assignee: MEDIATEK INC
    Inventors: Jian-Liang Lin, Yi-Wen Chen, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9832461
    Abstract: A method and apparatus for deblocking of reconstructed video in a video coding system are disclosed. Embodiments according to the present invention determine boundary strength between two blocks without checking whether the block boundary is a coding unit (CU) boundary. In one embodiment according to the present invention, the method comprises determining whether any of the two blocks is Intra coded. If any of the two blocks is Intra coded, the boundary strength is assigned a first value. Otherwise, additional decision processing is performed to determine the boundary strength. In another embodiment, said determining the boundary strength for the block boundary comprises determining whether the block boundary is a TU boundary and whether any of the two blocks contains coefficients. In yet another embodiment, said determining the boundary strength for the block boundary comprises determining whether the two blocks have different reference pictures or different motion vectors.
    Type: Grant
    Filed: October 29, 2012
    Date of Patent: November 28, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Xun Guo, Jicheng An, Chih-Wei Hsu, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9817494
    Abstract: An exemplary method for determining a control output in a control domain includes: obtaining a control input of an input domain, wherein the control input includes a previous input value and a current input value; and dynamically adjusting a control resolution setting, and converting the control input of the input domain into the control output in the control domain according to the control resolution setting, wherein the control output includes a previous output value and a current output value corresponding to the previous input value and the current input value, respectively, the control resolution setting for the current input value is determined according to at least the previous input value, and the current output value is identical to the previous output value when the current input value and the previous input value are generated in response to a same user input.
    Type: Grant
    Filed: April 5, 2012
    Date of Patent: November 14, 2017
    Assignee: MEDIATEK INC.
    Inventors: Ping-Han Lee, Chia-Ping Chen, Yu-Ting Chen, Yu-Pao Tsai, Shaw-Min Lei
  • Patent number: 9813738
    Abstract: A method and apparatus for processing in-loop reconstructed video using an in-loop filter is disclosed. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process in-loop reconstruction video data, where ALF can be selectively turned ON or OFF for each block in a frame or a slice. An advanced ALF is disclosed later that allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. In the present disclosure, pixels of the in-loop reconstructed video data are divided into a plurality of to-be-filtered regions, and an in-loop filter from a filter set is determined for each to-be-filtered region based on a rate-distortion optimization procedure. According to one embodiment of the present invention, computation of cost function associated with the rate-distortion optimization procedure is related to correlation values associated with original video data and the in-loop reconstructed video data.
    Type: Grant
    Filed: August 24, 2011
    Date of Patent: November 7, 2017
    Assignee: HFI Innovation Inc.
    Inventors: Chia-Yang Tsai, Chih-Ming Fu, Ching-Yeh Chen, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9813726
    Abstract: A method for decoding of a video bitstream including receiving coded data for a 2N×2N coding unit (CU) from the video bitstream, selecting one or more first codewords according to whether asymmetric motion partition is disabled or enabled, selecting one or more second codewords when a size of the 2N×2N CU is equal to a smallest CU size, wherein none of the second codewords corresponds to INTER N×N partition when N is 4, determining a CU structure for the 2N×2N CU from the video bitstream using the first codewords or the second codewords, and decoding the video bitstream using the CU structure. A corresponding method for encoding a 2N×2N coding unit of video data is also disclosed.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: November 7, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Shan Liu, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9807415
    Abstract: A method and apparatus for deriving a motion vector predictor (MVP) for a motion vector (MV) of a current block of a current picture in Inter, or Merge, or Skip mode. The method selects a co-located block corresponding to a co-located picture, receives one or more reference motion vectors (MVs) of one or more co-located reference blocks associated with the co-located block, and determines a search set that includes one or more search MVs associated with said one or more co-located reference blocks. The method further determines a search order for the search set having an order associated with a reference list attribute for a first search MV and a second search MV associated with an identical co-located reference block. Finally, the method determines the MVP for the current block based on the search set and the search order, and provides the MVP for the current block.
    Type: Grant
    Filed: February 9, 2017
    Date of Patent: October 31, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Jian-Liang Lin, Yu-Pao Tsai, Yi-Wen Chen, Jicheng An, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9807396
    Abstract: A method and apparatus for deriving a motion vector predictor (MVP) candidate set for motion vector coding of a current block. Embodiments according to the present invention determine a redundancy-removed spatial MVP candidate set by removing any redundant MVP candidate from the spatial MVP candidate set. The redundancy-removal process does not apply to the temporal MVP candidate. In another embodiment of the present invention, a redundancy-removed spatial-temporal MVP candidate set is determined and the number of candidates in the redundancy-removed spatial-temporal MVP candidate set is checked to determine whether it is smaller than a threshold. If the number of candidates is smaller than the threshold, a zero motion vector is added to the redundancy-removed spatial-temporal MVP candidate set. The redundancy-removed spatial-temporal MVP candidate set is then provided for encoding or decoding of the motion vector of the current block.
    Type: Grant
    Filed: January 16, 2013
    Date of Patent: October 31, 2017
    Assignee: HFI Innovation Inc.
    Inventors: Liang Zhao, Xun Guo, Shaw-Min Lei
  • Patent number: 9788019
    Abstract: Transform unit (TU) partition method and apparatus depending on the coding unit (CU) partition and prediction unit (PU) partition are disclosed. In one embodiment, the maximum TU size is restricted to the minimum of PU width and height, except for a 2N×2N coding unit with the 2N×2N partition type. In another embodiment, the maximum TU size equals to maximum of PU width and height, and the minimum TU size equals to minimum of the PU width and height, except for a 2N×2N coding unit with the 2N×2N partition type. In yet another embodiment, the maximum TU size is equal to the maximum of PU width and height, and the minimum TU size is equal to the minimum of PU width and height except for a 2N×2N CU with 2N×2N partition type.
    Type: Grant
    Filed: June 9, 2011
    Date of Patent: October 10, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Shan Liu, Zhi Zhou, Shaw-Min Lei
  • Patent number: 9781414
    Abstract: An apparatus and method of deriving a motion vector predictor (MVP) for a current MV of a current block in Inter, Merge or Skip mode are disclosed based on motion vector (MV) attribute search. The system determines first MV attribute search comprising whether a given MV pointing to the target reference picture in the given reference list, or whether the given MV pointing to the target reference picture in other reference list, and determines second MV attribute search comprising whether the given MV pointing to other reference pictures in the given reference list, or whether the given MV pointing to the other reference pictures in the other reference list. The MVP for the current block is then determined from the neighboring blocks according to a search order.
    Type: Grant
    Filed: April 20, 2014
    Date of Patent: October 3, 2017
    Assignee: HFI Innovation Inc.
    Inventors: Jian-Liang Lin, Yi-Wen Chen, Yu-Pao Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9769472
    Abstract: A method and apparatus for Intra prediction of a block based on neighboring pixels around the block are disclosed. Embodiments according to the present invention use square blocks as well as non-square blocks for Intra prediction. For a 2N×2N Luma CU (coding unit), the CU can be partitioned into 2N×N, N×2N, 2N×2N or N×N PUs. The 2N×N and N×2N PUs can be further processed by either square transforms only or both non-square and square transforms. In one embodiment, the 2N×N PU or the N×2N PU is processed as two N×N TUs (transform units) and each of the N×N TU is further split into smaller N×N TUs based on quad-tree split. In another embodiment, the 2N×N and N×2N PUs are processed as two 2N×0.5N and 0.5N×2N TUs respectively.
    Type: Grant
    Filed: July 26, 2012
    Date of Patent: September 19, 2017
    Assignee: MEDIATEK SINGAPORE PTE. LTD.
    Inventors: Shan Liu, Ximin Zhang, Shaw-Min Lei
  • Patent number: 9762925
    Abstract: A video encoder that utilizes adaptive interpolation filtering for coding video data includes a prediction unit, a reconstruction unit, a reference picture buffer, a filter parameter estimator for estimating filter parameters according to the original video data and the predicted samples, and an adaptive interpolation filter for utilizing the stored filter parameters to perform filtering on the reconstructed video data.
    Type: Grant
    Filed: March 17, 2009
    Date of Patent: September 12, 2017
    Assignee: MEDIATEK INC.
    Inventors: Chih-Ming Fu, Xun Guo, Kai Zhang, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20170251213
    Abstract: Aspects of the disclosure include a method for video coding. The method includes receiving input data associated with a current block in an image frame, generating an inter predictor of the current block, and generating an intra predictor of the current block based on samples of neighboring pixels and an intra prediction mode that locates the samples of neighboring pixels. The method further includes generating a final predictor of the current block by combining the inter predictor and the intra predictor according to one or more intra weight coefficients associated with the intra prediction mode, and encoding or decoding the current block based on the final predictor to output encoded video data or a decoded block. The one or more intra weight coefficients indicate one or more ratios that corresponding one or more portions of the intra predictor are combined with the inter predictor, respectively.
    Type: Application
    Filed: February 23, 2017
    Publication date: August 31, 2017
    Applicant: MEDIATEK INC.
    Inventors: Jing YE, Shan Liu, Shaw-Min Lei
  • Patent number: 9749635
    Abstract: A method and apparatus for clipping a transform coefficient are disclosed. In one implementation, a method is implemented in a video encoder for clipping a quantization level. The method operates by generating the quantization level for a transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter, determining a clipping range in the video encoder for one or a combination of a fixed-range clipping condition and a dynamic-range clipping condition, and clipping the quantization level according to the clipping range to generate a clipping-processed quantization level. The quantization level is clipped within a fixed clipping range from ?m to m?1 for the fixed-range clipping condition and m corresponds to 128, 32768, or 2147483648.
    Type: Grant
    Filed: December 12, 2016
    Date of Patent: August 29, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Xun Guo, Shaw-Min Lei
  • Patent number: 9729897
    Abstract: The invention provides a motion prediction method. First, a plurality of candidate units corresponding to a current unit of a current frame is determined. A plurality of motion vectors of the candidate units is then obtained. A plurality of scaling factors of the candidate units is then calculated according to a plurality of respective temporal distances depending on a plurality of reference frames of the motion vectors. The motion vectors of the candidate units are then scaled according to the scaling factors to obtain a plurality of scaled motion vectors. The scaled motion vectors are ranked, and a subset of highest ranking motion vectors are identified to be included in a candidate set. Finally, a motion vector predictor for motion prediction of the current unit is then selected from the candidate units.
    Type: Grant
    Filed: April 16, 2015
    Date of Patent: August 8, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Yu-Pao Tsai, Chih-Ming Fu, Jian-Liang Lin, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9729879
    Abstract: A method and apparatus for improved deblocking filter are disclosed. In one embodiment according to the present invention, determining the non-zero transform coefficients existence for a PU-only boundary is skipped and therefore the deblocking filter for PU-only boundary is eliminated if the condition of boundary strength equal to 1 is not fulfilled to avoid unnecessary deblocking. In another embodiment of the present invention, three gradients are determined for two pixel lines and filter ON/OFF decision is made based on the three gradient values of the two pixel lines. One aspect of the invention is related to filter strength selection between strong and weak filters. According to one embodiment, the filter strength selection is based on various gradient values of a pixel line across the block boundary. Another aspect of the invention is related to the weak filter.
    Type: Grant
    Filed: March 6, 2012
    Date of Patent: August 8, 2017
    Assignee: HFI INNOVATION INC.
    Inventors: Jicheng An, Xun Guo, Qian Huang, Shaw-Min Lei
  • Publication number: 20170163982
    Abstract: A method and apparatus for processing of coded video using in-loop processing are disclosed. The method operates by receiving input data to said in-loop processing, wherein the input data corresponds to reconstructed coding units of the picture; configuring the input data into multiple filter units; selecting a filter from a candidate filter set comprising at least two candidate filters associated with said in-loop processing for one of said multiple filter units; applying said in-loop processing to said one of said multiple filter units using the selected filter to generate a processed filter unit, wherein when said one of said multiple filter units comprises at least two reconstructed coding units, the selected filter is applied to all of said at least two reconstructed coding units; and providing processed video data comprising the processed filter unit. The apparatus provide circuits to carryout the operations of the method.
    Type: Application
    Filed: February 23, 2017
    Publication date: June 8, 2017
    Inventors: Chih-Ming FU, Ching-Yeh CHEN, Chia-Yang TSAI, Yu-Wen HUANG, Shaw-Min LEI
  • Publication number: 20170155921
    Abstract: A method and apparatus for deriving a motion vector predictor (MVP) for a motion vector (MV) of a current block of a current picture in Inter, or Merge, or Skip mode. The method selects a co-located block corresponding to a co-located picture, receives one or more reference motion vectors (MVs) of one or more co-located reference blocks associated with the co-located block, and determines a search set that includes one or more search MVs associated with said one or more co-located reference blocks. The method further determines a search order for the search set having an order associated with a reference list attribute for a first search MV and a second search MV associated with an identical co-located reference block. Finally, the method determines the MVP for the current block based on the search set and the search order, and provides the MVP for the current block.
    Type: Application
    Filed: February 9, 2017
    Publication date: June 1, 2017
    Inventors: Jian-Liang Lin, Yu-Pao Tsai, Yi-Wen Chen, Jicheng An, Yu-Wen Huang, Shaw-Min Lei