Patents by Inventor Yu-Chen Sun

Yu-Chen Sun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230344891
    Abstract: A computer-implemented method for quality measurement for videoconferencing may include (i) measuring the interaction levels of a plurality of video conference attendees in a group video conference, (ii) designating, based at least in part on the interaction levels, a current dominant speaker in the group video conference, (iii) calculating a video conference quality level for the current dominant speaker in the group video conference, and (iv) providing the video conference quality level for the current dominant speaker as the video conference quality level for the group video conference. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: April 11, 2022
    Publication date: October 26, 2023
    Inventors: David Frenk, Chia-Yang Tsai, Yu-Chen Sun
  • Publication number: 20230276069
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Application
    Filed: May 5, 2023
    Publication date: August 31, 2023
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Publication number: 20230239461
    Abstract: Systems and methods are provided for implementing methods for resolution-adaptive video coding in a motion prediction coding format by obtaining a current frame of a bitstream, obtaining one or more reference pictures from a reference frame buffer, determining the obtained reference pictures that have resolutions different from a resolution of the current frame, translating an inter predictor of the one or more reference pictures, and generating a reconstructed frame from the current frame based on the one or more reference pictures and motion information of one or more blocks of the current frame, the motion information including at least one inter predictor, thereby achieving substantial reduction of network transport costs in video coding and delivery without requiring the transport of additional data that would offset or compromise these savings.
    Type: Application
    Filed: March 16, 2023
    Publication date: July 27, 2023
    Inventors: Tsuishan Chang, Yu-Chen Sun, Ling Zhu, Jian Lou
  • Patent number: 11689740
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: June 27, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Patent number: 11589041
    Abstract: A method and apparatus of video coding incorporating Deep Neural Network are disclosed. A target signal is processed using DNN (Deep Neural Network), where the target signal provided to DNN input corresponds to the reconstructed residual, output from the prediction process, the reconstruction process, one or more filtering processes, or a combination of them. The output data from DNN output is provided for the encoding process or the decoding process. The DNN can be used to restore pixel values of the target signal or to predict a sign of one or more residual pixels between the target signal and an original signal. An absolute value of one or more residual pixels can be signalled in the video bitstream and used with the sign to reduce residual error of the target signal.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: February 21, 2023
    Assignee: MEDIATEK INC.
    Inventors: Yu-Wen Huang, Yu-Chen Sun, Tzu-Der Chuang, Jian-Liang Lin, Ching-Yeh Chen
  • Publication number: 20220327797
    Abstract: A method includes optimizing a video quality of a video data stream received by a user in a video conference. A region of at least one frame of the video data stream may be sampled. The sampling rate may be variable based on the rate of change of objects in the video data stream. A video quality metric corresponding to the video quality of the video data stream may be calculated. The video quality of the video data stream may be adjusted based on the video quality metric. Another method includes retrieving a video and detecting one or more moving regions of interest (ROIs). Each of the ROIs is tagged with metadata configured to allow users to interact with the ROI, and the detected ROIs and their corresponding metadata are stored in a file. Based on the file, playback of the video and movement of the ROIs may be synchronized.
    Type: Application
    Filed: April 5, 2022
    Publication date: October 13, 2022
    Inventors: Iulian Doroftei Calinov, Marek F. Latuskiewicz, Mayank Singh Chaudhary, Meng Zhang, Sergey Sablin, Xingze He, Yu-Chen Sun, Yun Zhang, Addie Louise Marino, Miguel Angel Perez
  • Patent number: 11457237
    Abstract: A method of video coding with reduced implementation cost by reusing transform coefficient buffer palette for palette coding is disclosed. If the current prediction mode is an Intra prediction mode or the Inter prediction mode, information related to transform coefficients for prediction residual of the current block resulted from Intra prediction or Inter prediction is stored in the transform coefficient buffer. If the current prediction mode is the palette coding mode, information related to palette data associated with the current block is stored in the transform coefficient buffer. The current block is then encoded or decoded based on the information related to the transform coefficients if the current block is coded in the Intra prediction mode or the Inter prediction mode, or the information related to the palette data stored in the transform coefficient buffer if the current prediction mode is the palette coding mode.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: September 27, 2022
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu-Chen Sun, Jing Ye, Shan Liu, Xiaozhong Xu, Jungsun Kim
  • Publication number: 20220224925
    Abstract: Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole.
    Type: Application
    Filed: July 9, 2019
    Publication date: July 14, 2022
    Inventors: Yu-Chen Sun, Tsui-shan Chang, Jian Lou
  • Publication number: 20220078418
    Abstract: A method and apparatus of video coding incorporating Deep Neural Network are disclosed. A target signal is processed using DNN (Deep Neural Network), where the target signal provided to DNN input corresponds to the reconstructed residual, output from the prediction process, the reconstruction process, one or more filtering processes, or a combination of them. The output data from DNN output is provided for the encoding process or the decoding process. The DNN can be used to restore pixel values of the target signal or to predict a sign of one or more residual pixels between the target signal and an original signal. An absolute value of one or more residual pixels can be signalled in the video bitstream and used with the sign to reduce residual error of the target signal.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Applicant: MEDIATEK INC.
    Inventors: Yu-Wen HUANG, Yu-Chen SUN, Tzu-Der CHUANG, Jian-Liang LIN, Ching-Yeh CHEN
  • Publication number: 20220070486
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Application
    Filed: November 10, 2021
    Publication date: March 3, 2022
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Patent number: 11265551
    Abstract: Improved systems and methods related to decoder-side motion vector derivation (DMVD), for example, in applying one or more constraints to motion information, such as a MV derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. These techniques may be applied to any of the existing video codecs, such as HEVC (High Efficiency Video Coding), and/or may be an efficient coding tool in any future video coding standards. In one example, the block size used for DMVD can be restricted. In another example, FRUC bilateral matching can be simplified by not searching outside reference blocks indicated by the original motion vector.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: March 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Hsiao-Chiang Chuang, Marta Karczewicz
  • Patent number: 11265537
    Abstract: A method of palette management for palette coding in a video coding system receives input data associated with a current block in a high-level picture structure and initializes a palette predictor in the high-level picture structure before a corresponding palette of a first palette-coded block in the high-level picture structure is coded. If a palette mode is selected for the current block, the method applies the palette coding to the current block using a current palette and updates the palette predictor based on the current palette to generate an updated palette predictor for a next block coded in the palette mode.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: March 1, 2022
    Assignee: HFI Innovation Inc.
    Inventors: Wang-Lin Lai, Yu-Chen Sun, Shan Liu, Xiaozhong Xu, Tzu-Der Chuang, Ding-Yun Chen, Yu-Wen Huang
  • Patent number: 11218723
    Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: January 4, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Yu-Chen Sun, Li Zhang, Sungwon Lee, Xiang Li, Hsiao-Chiang Chuang, Jianle Chen, Vadim Seregin, Marta Karczewicz
  • Publication number: 20210392349
    Abstract: A client device may receive encoded data of a first video frame from a server over a network, and decode the encoded data to obtain the first frame based at least in part on one or more second frames of a second resolution that are stored in a reference frame buffer of the client device. In response to determining that the first resolution is lower than the second resolution, the client device may or may not resize the first frame from the first resolution to the second resolution and store the first frame of the first resolution and/or the resized first frame of the second resolution in the reference frame buffer, depending on which coding design that the client device employs. The client device may display the reconstructed frame to a user.
    Type: Application
    Filed: March 1, 2019
    Publication date: December 16, 2021
    Inventors: Tsuishan Chang, Yu-Chen Sun, Ling Zhu, Jian Lou
  • Patent number: 11196992
    Abstract: A method and apparatus of video coding incorporating Deep Neural Network are disclosed. A target signal is processed using DNN (Deep Neural Network), where the target signal provided to DNN input corresponds to the reconstructed residual, output from the prediction process, the reconstruction process, one or more filtering processes, or a combination of them. The output data from DNN output is provided for the encoding process or the decoding process. The DNN can be used to restore pixel values of the target signal or to predict a sign of one or more residual pixels between the target signal and an original signal. An absolute value of one or more residual pixels can be signalled in the video bitstream and used with the sign to reduce residual error of the target signal.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: December 7, 2021
    Assignee: MEDIATEK INC.
    Inventors: Yu-Wen Huang, Yu-Chen Sun, Tzu-Der Chuang, Jian-Liang Lin, Ching-Yeh Chen
  • Patent number: 11166046
    Abstract: A method and apparatus for palette coding of a block of video data using a candidate prediction mode list with syntax redundancy removed are disclosed. In one embodiment, whether a redundant prediction mode exists in the candidate prediction mode list for the current samples of the current block is determined based on the candidate prediction mode list and the previous prediction mode associated with the previous samples. If the redundant prediction mode exists in the candidate prediction mode list, the redundant prediction mode is removed from the candidate prediction mode list to generate a reduced candidate prediction mode list. In another embodiment, whether a redundant predictor exists in a candidate predictor list for a current sample of the current block is determined based on a condition related to one or more predictors for the current sample of the current block.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: November 2, 2021
    Assignee: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Yu-Chen Sun, Yi-Wen Chen, Yu-Wen Huang
  • Publication number: 20210281846
    Abstract: A method and apparatus for processing transform blocks of video data performed by a video encoder or a video decoder are disclosed. A plurality of quantization matrix sets are determined, where each quantization matrix set includes one or more quantization matrices corresponding to different block types. For a transform block corresponding to a current block in a current picture, a selected quantization matrix set is determined from the plurality of quantization matrix sets for the transform block. Quantization process or de-quantization process is applied to the transform block using a corresponding quantization matrix from the selected quantization matrix set.
    Type: Application
    Filed: September 13, 2016
    Publication date: September 9, 2021
    Inventors: Shih-Ta HSIANG, Shaw-Min LEI, Yu-Wen HUANG, Yu-Chen SUN
  • Patent number: 11089323
    Abstract: A method and apparatus for a video coding system with the current picture referencing (CPR) mode enabled are disclosed. According to one method, the luma and chroma blocks of the current image are jointly coded using a same coding unit (CU) structure if the CPR mode is selected for the luma and the chroma blocks. Alternatively, if the luma and chroma components are partitioned into the luma and the chroma blocks separately using separate CU structures, the luma and chroma blocks are encoded or decoded using a coding mode selected from a coding mode group excluding the CPR mode. According to another method, the luma and chroma blocks of the current image are coded separately using a different CU structure if the CPR mode is selected for the luma and chroma blocks. In yet another method, reconstructed reference data is disclosed for the CPR mode with CU equal to PU.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: August 10, 2021
    Assignee: MEDIATEK INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen, Yu-Chen Sun, Yu-Wen Huang, Shan Liu, Xiaozhong Xu
  • Patent number: 11082687
    Abstract: A video decoder selects a source affine block. The source affine block is an affine-coded block that spatially neighbors a current block. Additionally, the video decoder extrapolates motion vectors of control points of the source affine block to determine motion vector predictors for control points of the current block. The video decoder inserts, into an affine motion vector predictor (MVP) set candidate list, an affine MVP set that includes the motion vector predictors for the control points of the current block. The video decoder also determines, based on an index signaled in a bitstream, a selected affine MVP set in the affine MVP set candidate list. The video decoder obtains, from the bitstream, motion vector differences (MVDs) that indicate differences between motion vectors of the control points of the current block and motion vector predictors in the selected affine MVP set.
    Type: Grant
    Filed: October 14, 2019
    Date of Patent: August 3, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Li Zhang, Yu-Chen Sun, Jianle Chen, Marta Karczewicz
  • Patent number: 11044479
    Abstract: Methods for coding syntax related to palette coding generated in a video coding system are disclosed. According to one embodiment, the current block size checked against the pre-defined block size. If the current block size is larger than the pre-defined block size, a current coding mode is selected from a coding group excluding a palette coding mode. If the current block size is smaller than or equal to the pre-defined block size, the current coding mode is selected from a coding group including the palette coding mode. In another embodiment, if the current block size is greater than a maximum transform size, a current coding mode is selected from a coding group excluding a palette coding mode. If the current block size is smaller than or equal to the maximum transform size, the current coding mode is selected from a coding group including the palette coding mode.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: June 22, 2021
    Assignee: HFI Innovation Inc.
    Inventors: Tzu-Der Chuang, Jungsun Kim, Yu-Chen Sun, Wang-Lin Lai, Ching-Yeh Chen, Jing Ye, Shan Liu