Patents by Inventor Chia-Yang Tsai

Chia-Yang Tsai has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9154778
    Abstract: A method and apparatus for processing of coded video using adaptive offset (AO) are disclosed. Embodiments of the present invention divide reconstructed video data into multiple filter units and apply adaptive offset to the filter units to generate filtered video data, where boundaries of filter units correspond to boundaries of coding units and each filter unit contains at one or more coding units. Furthermore, two or more of the multiple filter units can be merged as indicated by a merge index to share filter information of the adaptive offset. A filter control flag can be used to indicate filter ON/OFF control. The luma and chroma components may also share the same filter information. In another embodiment, the filter information sharing among filter units can be applied regardless of whether the boundaries of the filter units are aligned with the boundaries of the coding units.
    Type: Grant
    Filed: May 29, 2013
    Date of Patent: October 6, 2015
    Assignee: MEDIATEK INC.
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9094658
    Abstract: In a block-based motion compensated system, coding noises may arise due to lossy operations such as quantization. Deblocking is often used to alleviate visibility of coding artifacts by applying filtering across block boundaries adaptively. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process deblocked reconstruction frames. Adaptive loop filtering is applied to reconstructed video data across multiple frames to reduce visibility of coding artifacts in the temporal domain. In a HEVC system, conventional ALF can be selectively turned ON or OFF for each block in a frame or a slice. The advanced ALF disclosed here allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. Furthermore, the advanced ALF adopts a new unit for the filtering process to apply so that more flexible and/or localized processing can be provided.
    Type: Grant
    Filed: April 25, 2011
    Date of Patent: July 28, 2015
    Assignee: MEDIATEK INC.
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20150163488
    Abstract: A method and apparatus for sharing information in a video decoding system are disclosed. The method derives reconstructed data for a picture from a bitstream, where the picture is partitioned into multiple slices. An information-sharing flag is parsed from the bitstream associated with a current reconstructed slice. If the information-sharing flag indicates information sharing, shared information is determined from a part of the bitstream not corresponding to the current reconstructed slice, and in-loop filtering process is applied to the current reconstructed slice according to the shared information. If the information-sharing flag indicates filter no information sharing, individual information is determined from a part of the bitstream corresponding to the current reconstructed slice, and in-loop filtering process is applied to the current reconstructed slice according to the individual information. A method for a corresponding encoder is also disclosed.
    Type: Application
    Filed: February 17, 2015
    Publication date: June 11, 2015
    Inventors: Chia-Yang Tsai, Chih-Wei Hsu, Yu-Wen Huang, Ching-Yeh Chen, Chih-Ming Fu, Shaw-Min Lei
  • Patent number: 9055305
    Abstract: An apparatus and method for sample adaptive offset to restore intensity shift of processed video data are described. In a video coding system, the video data are subject to various processing such as prediction, transformation, quantization, deblocking, and adaptive loop filtering. Along the processing path in the video coding system, certain characteristics of the processed video data may be altered from the original video data due to the operations applied to video data. For example, the mean value of the processed video may be shifted. Therefore, the pixel intensity shift has to be carefully compensated or restored to alleviate the artifacts. Accordingly a sample adaptive offset scheme is disclosed that can take into consideration of the dynamic characteristics within a frame using a region partition scheme. Furthermore, the sample adaptive offset scheme also supports multiple SAO types that can be tailored to the characteristics of processed video data and achieve better quality.
    Type: Grant
    Filed: June 12, 2011
    Date of Patent: June 9, 2015
    Assignee: MEDIATEK INC.
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20150139325
    Abstract: A method and apparatus for inter-layer prediction for scalable video coding are disclosed. Embodiments of the present invention utilize weighted prediction for scalable coding. The weighted prediction is based on the predicted texture data and the inter-layer Intra prediction data derived from BL reconstructed data. The inter-layer Intra prediction data corresponds to the BL reconstructed data or up-sampled BL reconstructed data. The predicted texture data corresponds to spatial Intra prediction data or motion-compensated prediction data based on the second EL video data in the same layer as the current EL picture. Embodiments of the present invention also utilize the reference picture list including an inter-layer reference picture (ILRP) corresponding to BL reconstructed texture frame or up-sampled BL reconstructed texture frame for Inter prediction of EL video data. The motion vector is limited to a range around (0,0) when the ILRP is selected as a reference picture.
    Type: Application
    Filed: June 13, 2013
    Publication date: May 21, 2015
    Applicant: MEDIATEK INC.
    Inventors: Tzu-Der Chuang, Yu-Wen Huang, Ching-Yeh Chen, Chia-Yang Tsai, Chih-Ming Fu, Shih-Ta Hsiang
  • Publication number: 20150124866
    Abstract: A method and apparatus for sample adaptive offset (SAO) compensation of reconstructed video data are disclosed. In one embodiment, the relation between the current pixel and said one or more neighboring pixels is stored so that the SAO compensated current pixel can replace the current pixel without buffering the to-be-processed pixels for classification. The SAO process may be performed on a region by region basis to adapt to the local characteristics of the picture.
    Type: Application
    Filed: January 11, 2015
    Publication date: May 7, 2015
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20150124869
    Abstract: An apparatus and method for sample adaptive offset (SAO) to restore intensity shift of processed video data are disclosed. In an encoder side, the processed video data corresponding to reconstructed video data, deblocked-reconstructed video data, or adaptive loop filtered and deblocked-reconstructed video data are partitioned into regions smaller than a picture. The region partition information is signaled in a video bitstream located in a position before intensity offset values syntax. At the decoder side, the processed video data is partitioned into regions according to the partition information parsed from the bitstream at a position before intensity offset values syntax. Region-based SAO is applied to each region based on the intensity offset for the category of the region-based SAO type selected.
    Type: Application
    Filed: January 16, 2015
    Publication date: May 7, 2015
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20150103900
    Abstract: A method and apparatus for inter-layer prediction for scalable video coding are disclosed. Embodiments according to the present invention apply inter-layer adaptive filtering to the video data derived from the reconstructed BL video data to generate inter-layer adaptive filtered data. The inter-layer adaptive filtered data is then included as prediction data to encode or decode the EL video data. The video data derived from the reconstructed BL video data is up-sampled before applying inter-layer adaptive filtering. The up-sampling may also be included in the inter-layer adaptive filtering. In another embodiment, the inter-layer adaptive filtering comprises adaptive up-sampling. For up-sampled BL video data at locations not collocated with the EL video data, the up-sampled BL video data is divided into location types according to locations of the up-sampled BL video data. Each location type may have an individual filter for up-sampling video data in the group.
    Type: Application
    Filed: May 21, 2013
    Publication date: April 16, 2015
    Inventors: Shan Liu, Mei Guo, Chia-Yang Tsai, Ching-Yeh Chen, Shaw-Min Lei
  • Patent number: 9001883
    Abstract: A method and apparatus for sharing information in a video coding system are disclosed. Embodiments according to the present invention use an information sharing flag to determine whether to share in-loop filter information in the picture level. The information sharing flag may be incorporated in the sequence level, the picture level or the slice level to indicate whether information sharing is enabled. Multiple information sharing flags may also be used to adaptively control information sharing. Furthermore, method and apparatus of using multiple Adaptation Parameter Sets (APSs) for information sharing of in-loop filters are disclosed. APS identifiers of in-loop filters may be incorporated in the slice header to allow each of the in-loop filters select respective filter information from the multiple APSs. A flag is incorporated in SPS to indicate whether multiple APS or single APS is used. Various exemplary syntax designs are disclosed to illustrate information sharing.
    Type: Grant
    Filed: November 17, 2011
    Date of Patent: April 7, 2015
    Assignee: Mediatek Inc
    Inventors: Chia-Yang Tsai, Chih-Wei Hsu, Yu-Wen Huang, Ching-Yeh Chen, Chih-Ming Fu, Shaw-Min Lei
  • Publication number: 20150016506
    Abstract: A method and apparatus for loop filter processing of video data in a video encoder or decoder are disclosed. Embodiments according to the present invention conditionally allow sharing of loop filter parameters. In one embodiment, sharing of loop filter information between the current block and a neighboring block is determined according to a condition. If the condition indicates that sharing of loop filter information is allowed, a merge flag is coded and incorporated in the video bitstream in an encoder, and a merge flag is parsed from the video bitstream and decoded in a decoder. In one embodiment, the condition depends on region partitioning of the picture, where region partitioning partitions the picture into regions and the region may correspond to a slice or a tile. The condition is set to indicate that sharing of loop filter information is allowed if the block and the neighboring block are in a same slice/tile.
    Type: Application
    Filed: February 22, 2013
    Publication date: January 15, 2015
    Inventors: Chih-Ming Fu, Chia-Yang Tsai, Chih-Wei Hsu, Ching-Yeh Chen, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20150010091
    Abstract: A method and apparatus for loop filter processing of boundary pixels across a block boundary aligned with a slice or tile boundary is disclosed. Embodiments according to the present invention use a parameter of a neighboring slice or tile for loop filter processing across slice or tile boundaries according to a flag indicating whether cross slice or tile loop filter processing is allowed not. According to one embodiment of the present invention, the parameter is a quantization parameter corresponding to a neighboring slice or tile, and the quantization parameter is used for filter decision in deblocking filter.
    Type: Application
    Filed: January 30, 2013
    Publication date: January 8, 2015
    Inventors: Chih-Wei Hsu, Chia-Yang Tsai, Yu-Wen Huang
  • Patent number: 8861617
    Abstract: In a block-based motion compensated system, coding noises may arise due to lossy operations. Adaptive loop filter (ALF) is a technique used to improve the quality. A pixel adaptive (PA) ALF method was developed that uses the Sum-modified Laplacian Measure (SLM) to classify pixels and applies a respective ALF filter to each pixel according to the SLM. While the PA ALF achieves better performance over a conventional single filter (SF) based ALF, the PA ALF causes higher complexity and consumes more power due to the high complexity and per-pixel filter switching. Accordingly region based ALF scheme is disclosed which allows adaptive filter selection on a region by region basis and does not require per-pixel filter switching. In one embodiment according to the present invention, a picture is divided into M×N regions. The region based ALF also allows region merging for the M×N regions to improve performance.
    Type: Grant
    Filed: July 6, 2011
    Date of Patent: October 14, 2014
    Assignee: Mediatek Inc
    Inventors: Ching-Yeh Chen, Chih-Ming Fu, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20140269913
    Abstract: A method and apparatus for loop processing of reconstructed video in an encoder system are disclosed. The loop processing comprises an in-loop filter and one or more adaptive filters. The filter parameters for the adaptive filter are derived from the pre-in-loop video data so that the adaptive filter processing can be applied to the in-loop processed video data without the need of waiting for completion of the in-loop filter processing for a picture or an image unit. In another embodiment, two adaptive filters derive their respective adaptive filter parameters based on the same pre-in-loop video data. In yet another embodiment, a moving window is used for image-unit-based coding system incorporating in-loop filter and one or more adaptive filters. The in-loop filter and the adaptive filter are applied to a moving window of pre-in-loop video data comprising one or more sub-regions from corresponding one or more image units.
    Type: Application
    Filed: October 11, 2012
    Publication date: September 18, 2014
    Inventors: Kun-Bin Lee, Yi-Hau Chen, Chi-Cheng Ju, Yu-Wen Huang, Shaw-Min Lei, Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Chih-Wei Hsu
  • Publication number: 20140198844
    Abstract: A method and apparatus for loop filter processing of video data are disclosed. Embodiments according to the present invention eliminate data dependency associated with loop processing across tile boundaries. According to one embodiment, loop processing is reconfigured to eliminate data dependency across tile boundaries if cross-tile loop processing is disabled. The loop filter processing corresponds to DF (deblocking filter), SAO (Sample Adaptive Offset) processing or ALF (Adaptive Loop Filter) processing. The processing can be skipped for at least one tile boundary. In another embodiment, data padding based on the pixels of the current tile or modifying pixel classification footprint are used to eliminate data dependency across the tile boundary. Whether cross-tile loop processing is disabled can be indicated by a flag coded at sequence, picture, or slice level to indicate whether the data dependency across said at least one tile boundary is allowed.
    Type: Application
    Filed: October 19, 2012
    Publication date: July 17, 2014
    Inventors: Chih-Wei Hsu, Chia-Yang Tsai, Yu-Wen Huang
  • Publication number: 20140198840
    Abstract: Methods and apparatuses for processing of coded video using ALF are disclosed. Embodiments according to the present invention apply ALF with constrained data range to reconstructed video data. The ALF parameters comprise a center coefficient, one or more non-center coefficients, and an offset term. As an example, the constrained data range for the center coefficient is selected from [0.0, 2.0) and [0.5, 1.5). In another example, the constrained data range for said one or more non-center coefficient is selected from [?1.0, 1.0) and [?0.5, 0.5). The constrained data range can also be applied to the offset term. For example the range of [?2D/N, (2D?1)/N) can be applied to the offset term, wherein D denotes pixel bit depth and N is a power-of-two integer. Alternatively, the constrained data range for the offset term can be [?2M,2M), wherein M is an integer.
    Type: Application
    Filed: August 17, 2012
    Publication date: July 17, 2014
    Inventors: Yu-Wen Huang, Chia-Yang Tsai, Ching-Yeh Chen, Chih-Ming Fu, Shaw-Min Lei
  • Publication number: 20140146891
    Abstract: A method and apparatus for scalable video coding are disclosed, wherein the video data is configured into a Base Layer (BL) and an Enhancement Layer (EL) and wherein the EL has higher spatial resolution or better video quality than the BL. According to embodiments of the present invention, information from the base layer is exploited for coding the enhancement layer. The information coding for the enhancement layer includes CU structure, motion information, motion information, MVP/merge candidates, intra prediction mode, residual quadtree information, texture information, residual information, context adaptive entropy coding, Adaptive Lop Filter (ALF), Sample Adaptive Offset (SAO), and deblocking filter.
    Type: Application
    Filed: May 31, 2012
    Publication date: May 29, 2014
    Applicant: MEDIATEK INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu-Wen Huang, Shaw-Min Lei, Chih-Ming Fu, Chia-Yang Tsai
  • Publication number: 20140072033
    Abstract: A method and apparatus for scalable video coding are disclosed, wherein the video data is configured into a Base Layer (BL) and an Enhancement Layer (EL) and wherein the EL has higher spatial resolution or better video quality than the BL. According to embodiments of the present invention, information from the base layer is exploited for coding the enhancement layer. The information coding for the enhancement layer includes CU structure, motion information, motion information, MVP/merge candidates, intra prediction mode, residual quadtree information, texture information, residual information, context adaptive entropy coding, Adaptive Lop Filter (ALF), Sample Adaptive Offset (SAO), and deblocking filter.
    Type: Application
    Filed: May 31, 2012
    Publication date: March 13, 2014
    Applicant: MEDIATEK INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu- Wen Huang, Shaw-Min Lei, Chih-Ming Fu, Chia-Yang TSai
  • Publication number: 20130322523
    Abstract: A method and apparatus for in-loop processing of reconstructed video are disclosed. The method and apparatus configure the in-loop processing so that the processing requires no pixel or reduced pixels from other side of a virtual boundary. When the in-loop processing of the to-be-processed pixel requires a pixel from the other side of the virtual boundary, the pixel from the other side of the virtual boundary is replaced by a replacement pixel. The in-loop processing can also be configured to skip the pixel when the processing requires a pixel from other side of the virtual boundary. The in-loop processing can also be configured to change ALF filter shape or filter size when the in-loop processing requires a pixel from other side of the virtual boundary. A filtered output can be combined linearly or nonlinearly with the to-be-processed pixel to generate a final filter output.
    Type: Application
    Filed: April 19, 2012
    Publication date: December 5, 2013
    Applicant: MEDIATEK INC.
    Inventors: Yu-Wen Huang, Chia-Yang Tsai, Ching-Yeh Chen, Chih-Ming Fu, Shaw-Min Lei
  • Publication number: 20130259117
    Abstract: A method and apparatus for processing of coded video using adaptive offset (AO) are disclosed. Embodiments of the present invention divide reconstructed video data into multiple filter units and apply adaptive offset to the filter units to generate filtered video data, where boundaries of filter units correspond to boundaries of coding units and each of said filter units contains at least one coding unit. Furthermore, two or more of the multiple filter units can be merged as indicated by a merge index to share the applied adaptive offset. A filter control flag can be used to indicate filter ON/OFF control. The luma and chroma components may also share the same filter information. In another embodiment, the filter information sharing among filter units can be applied regardless whether the boundaries of the filter units are aligned with the boundaries of the coding units.
    Type: Application
    Filed: May 29, 2013
    Publication date: October 3, 2013
    Applicant: MEDIATEK INC.
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang, Shaw-Min Lei
  • Publication number: 20130259118
    Abstract: Methods and apparatuses for video decoding and encoding with in-loop processing of reconstructed video are disclosed. At the decoder side, the method comprises receiving a flag from the video bitstream and according to the flag, the method receives information associated with in-loop filter parameters either from a data payload in the video bitstream to be shared by two or more coding blocks or individual coding block data in the video bitstream. At the encoder side, the method comprises incorporating information associated with the in-loop filter parameters either in a data payload in a video bitstream to be shared by two or more coding blocks or interleaved with individual coding block data in the video bitstream according to a flag. The data payload in the video bitstream is in a picture level, Adaptation Parameter Set (APS), or a slice header.
    Type: Application
    Filed: April 20, 2012
    Publication date: October 3, 2013
    Applicant: MEDIATEK INC.
    Inventors: Chih-Ming Fu, Ching-Yeh Chen, Chia-Yang Tsai, Yu-Wen Huang