Patents by Inventor Yuxin Liu

Yuxin Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200092575
    Abstract: An apparatus for decoding a current block of a video frame includes a memory and a processor. The processor is configured to execute instructions stored in the memory to identify a parameterized motion model; associate the parameterized motion model with a segment of a reference frame; and, in response to determining that the current block is encoded using the parameterized motion model, decode the current block using the parameterized motion model.
    Type: Application
    Filed: November 25, 2019
    Publication date: March 19, 2020
    Inventors: Debargha Mukherjee, Yuxin Liu, Sarah Parker
  • Patent number: 10555000
    Abstract: Coding a current block using multi-level compound predictor is disclosed. An apparatus includes a memory and a processor. The processor is configured to execute instructions stored in the memory to generate four or more prediction blocks; combine a first prediction block and a second prediction block of the four or more prediction blocks to form a first first-level compound prediction block; combine a third prediction block and a fourth prediction block of the four or more prediction blocks to form a second first-level compound prediction block; and combine, to obtain a prediction block for coding the current block, the first first-level compound prediction block and the second first-level compound prediction block.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: February 4, 2020
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Yuxin Liu
  • Patent number: 10506249
    Abstract: A method includes segmenting the video frame with respect to a reference frame resulting in a segmentation, determining a first motion vector for the current block based on the segmentation, determining a second motion vector for the current block using translational motion compensation, and encoding, for the current block, the one of the first motion vector and the second motion vector corresponding to a smaller error. The segmentation includes a segment containing the current block and a parameterized motion model for the segment. Another method includes identifying a parameterized motion model corresponding to a motion model type, associating the parameterized motion model with a segment of a reference frame, and, in response to determining that the current block is encoded using the parameterized motion model, decoding the current block using the parameterized motion model.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: December 10, 2019
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yuxin Liu, Sarah Parker
  • Patent number: 10477249
    Abstract: A video decoder system includes a video decoding engine, noise database, artifact estimator and post-processing unit. The video coder may generate recovered video from a data stream of coded video data, which may have visually-perceptible artifacts introduced as a byproduct of compression. The noise database may store a plurality of previously developed noise patches. The artifact estimator may estimate the location of coding artifacts present in the recovered video and select noise patches from the database to mask the artifacts and the post-processing unit may integrate the selected noise patches into the recovered video. In this manner, the video decoder may generate post-processed noise which may mask artifacts that otherwise would be generated by a video coding process.
    Type: Grant
    Filed: June 5, 2009
    Date of Patent: November 12, 2019
    Assignee: APPLE INC.
    Inventors: Yuxin Liu, Hsi-Jung Wu, Xiaojin Shi, Chris Yoochang Chung
  • Patent number: 10462482
    Abstract: Multi-reference compound prediction using masking for encoding and decoding blocks of video frames is described. A mask for segmenting a current block of a current frame of the video sequence into at least a first segment and a second segment is determined using a first set of reference frames. A first predictor using the first set of reference frames is generated for the first segment of the current block. A second predictor is generated for the second segment of the current block using a second set of reference frames, wherein the first set of reference frames is a subset of the second set of reference frames.
    Type: Grant
    Filed: January 31, 2017
    Date of Patent: October 29, 2019
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Yuxin Liu
  • Patent number: 10448013
    Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.
    Type: Grant
    Filed: December 22, 2016
    Date of Patent: October 15, 2019
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Paul Wilkins, Jingning Han, Yuxin Liu, Wei-Ting Lin
  • Publication number: 20190289319
    Abstract: Coding a current block using multi-level compound predictor is disclosed. An apparatus includes a memory and a processor. The processor is configured to execute instructions stored in the memory to generate four or more prediction blocks; combine a first prediction block and a second prediction block of the four or more prediction blocks to form a first first-level compound prediction block; combine a third prediction block and a fourth prediction block of the four or more prediction blocks to form a second first-level compound prediction block; and combine, to obtain a prediction block for coding the current block, the first first-level compound prediction block and the second first-level compound prediction block.
    Type: Application
    Filed: June 7, 2019
    Publication date: September 19, 2019
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Yuxin Liu
  • Patent number: 10412383
    Abstract: Groups of video frames can be compressed using reversed ordering. For a group of a video sequence having a display order, a determination is made as to whether to arrange the group in a reversed display order before a prediction process of an encoder for the group. Responsive thereto, the group is arranged in the reversed display order as an input order to the prediction process. Otherwise, the group is provided to the prediction process in the display order as the input order. In performing the prediction process, the group, received in the input order, is arranged in a coding order using a group coding structure that defines at least one backward reference frame for inclusion within a set of candidate reference frames. Multiple backward reference frames may also be defined. The group is predicted in the coding order using the set of candidate reference frames.
    Type: Grant
    Filed: August 15, 2017
    Date of Patent: September 10, 2019
    Assignee: GOOGLE LLC
    Inventors: Yuxin Liu, Di Chen, Yaowu Xu
  • Publication number: 20190261016
    Abstract: Regions for texture-based coding are identified using a spatial segmentation and a motion flow segmentation. For frames of a group of frames in a video sequence, a frame is segmented using a first classifier into at least one of a texture region or a non-texture region of an image in the frame. Then, the texture regions of the group of frames are segmented using a second classifier into a texture coding region or a non-texture coding region. The second classifier uses motion across the group of frames as input. Each of the classifiers is generated using a machine-learning process. Blocks of the non-texture region and the non-texture coding region of the current frame are coded using a block-based coding technique, while blocks of the texture coding region are coded using a coding technique that is other than the block-based coding technique.
    Type: Application
    Filed: February 17, 2018
    Publication date: August 22, 2019
    Inventors: Yuxin Liu, Adrian Grange
  • Patent number: 10362332
    Abstract: Coding a current block using multi-level compound predictor is disclosed. A method includes generating a first compound predictor by combining at least two predictor blocks for the current block, generating a second predictor for the current block, and combining the first compound predictor and the second predictor to obtain a prediction block for encoding or decoding the current block. An indicator may be sent from the encoder to the decoder to indicate when multi-level compound prediction is used to encode a block.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: July 23, 2019
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Yuxin Liu
  • Publication number: 20190132592
    Abstract: Encoding a group of frames of a video sequence can include determining a stillness of the group of frames, in response to determining that the stillness of the group of frames meets stillness conditions, encoding the group of frames using a coding structure that is a one-layer coding structure, and, in response to determining that the stillness of the group of frames does not meet the stillness conditions, encoding the group of frames using the coding structure that is a multi-layer coding structure. Instructions for decoding a group of frames include instructions to determine, from an encoded bitstream, an indication of a coding structure used to encode the group of frames, receive the group of frames in a coding order of the coding structure, and decode the group of frames using the coding structure. The indication is one of a one-layer coding structure indication or a multi-layer coding structure indication.
    Type: Application
    Filed: October 26, 2017
    Publication date: May 2, 2019
    Inventors: Yuxin Liu, Di Chen, Yaowu Xu
  • Patent number: 10271062
    Abstract: Motion vectors are predicted for a current block of a current frame using motion vectors from previous frames in the video stream. Temporal distances between a current frame and the one or more reference frames used to predict a current block and temporal distances between the previous frame and its reference frames are determined. Temporal distances for current frames and previous frames can be combined to weight the motion vectors and improve motion vector prediction.
    Type: Grant
    Filed: March 18, 2016
    Date of Patent: April 23, 2019
    Assignee: GOOGLE LLC
    Inventors: Debargha Mukherjee, Yaowu Xu, Yuxin Liu
  • Publication number: 20190058880
    Abstract: Groups of video frames can be compressed using reversed ordering. For a group of a video sequence having a display order, a determination is made as to whether to arrange the group in a reversed display order before a prediction process of an encoder for the group. Responsive thereto, the group is arranged in the reversed display order as an input order to the prediction process. Otherwise, the group is provided to the prediction process in the display order as the input order. In performing the prediction process, the group, received in the input order, is arranged in a coding order using a group coding structure that defines at least one backward reference frame for inclusion within a set of candidate reference frames. Multiple backward reference frames may also be defined. The group is predicted in the coding order using the set of candidate reference frames.
    Type: Application
    Filed: August 15, 2017
    Publication date: February 21, 2019
    Inventors: Yuxin Liu, Di Chen, Yaowu Xu
  • Publication number: 20190020888
    Abstract: Compound intra prediction is used to encode or decode blocks of video frames. First and second intra-prediction modes are selected based on motion within the video frame. For example, rate-distortion values resulting from predicting the motion can be determined for combinations of intra-prediction modes. The combination including the first and second intra-prediction modes can be selected based on it resulting in the lowest rate-distortion value. A compound prediction block is generated by combining first and second prediction blocks respectively generated using the first and second intra-prediction modes. For example, combining the first and second prediction blocks can include weighting the pixel values of the first and second prediction blocks or using each of those intra-prediction modes with different partitions of the block to be encoded or decoded. That block is then encoded or decoded using the compound prediction block.
    Type: Application
    Filed: July 11, 2017
    Publication date: January 17, 2019
    Inventors: Yuxin Liu, Hui Su
  • Publication number: 20180270502
    Abstract: Coding a current block using multi-level compound predictor is disclosed. A method includes generating a first compound predictor by combining at least two predictor blocks for the current block, generating a second predictor for the current block, and combining the first compound predictor and the second predictor to obtain a prediction block for encoding or decoding the current block. An indicator may be sent from the encoder to the decoder to indicate when multi-level compound prediction is used to encode a block.
    Type: Application
    Filed: March 14, 2017
    Publication date: September 20, 2018
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Yuxin Liu
  • Publication number: 20180270497
    Abstract: Encoding and decoding using parametrized motion models are disclosed. A method includes segmenting the video frame with respect to a reference frame resulting in a segmentation, determining a first motion vector for the current block based on the segmentation, determining a second motion vector for the current block using translational motion compensation, and encoding, for the current block, the one of the first motion vector and the second motion vector corresponding to a smaller error. The segmentation includes a segment containing the current block and a parameterized motion model for the segment. Another method includes identifying a parameterized motion model corresponding to a motion model type, associating the parameterized motion model with a segment of a reference frame, and, in response to determining that the current block is encoded using the parameterized motion model, decoding the current block using the parameterized motion model.
    Type: Application
    Filed: December 12, 2017
    Publication date: September 20, 2018
    Inventors: Debargha Mukherjee, Yuxin Liu, Sarah Parker
  • Publication number: 20180220152
    Abstract: Multi-reference compound prediction using masking for encoding and decoding blocks of video frames is described. A mask for segmenting a current block of a current frame of the video sequence into at least a first segment and a second segment is determined using a first set of reference frames. A first predictor using the first set of reference frames is generated for the first segment of the current block. A second predictor is generated for the second segment of the current block using a second set of reference frames, wherein the first set of reference frames is a subset of the second set of reference frames.
    Type: Application
    Filed: January 31, 2017
    Publication date: August 2, 2018
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Yuxin Liu
  • Publication number: 20180205964
    Abstract: Generating a compound predictor block of a current block includes generating, for the current block, predictor blocks including a first predictor block formed of first predictor pixels. Using at least a subset of the first predictor pixels, a first modulation value for modulating a first weight to be applied to a first predictor pixel of the first predictor pixels is determined.
    Type: Application
    Filed: November 9, 2017
    Publication date: July 19, 2018
    Inventors: Debargha Mukherjee, James Bankoski, Yue Chen, Yuxin Liu, Sarah Parker
  • Publication number: 20180184086
    Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.
    Type: Application
    Filed: December 22, 2016
    Publication date: June 28, 2018
    Inventors: Debargha Mukherjee, Yaowu Xu, James Bankoski, Paul Wilkins, Jingning Han, Yuxin Liu, Wei-Ting Lin
  • Patent number: 9866862
    Abstract: Encoding or decoding a video signal includes determining multiple candidate motion vectors for a current block, the candidate motion vectors including a first motion vector used to predict a collocated block within a first frame. A reference frame identifier associated with the first motion vector can be compared to a reference buffer index of a reference frame used to predict the current block of a second frame. On the condition that the reference frame identifier is the same as the reference buffer index, the first motion vector is advanced ahead of remaining ones of the multiple candidate motion vectors.
    Type: Grant
    Filed: March 18, 2016
    Date of Patent: January 9, 2018
    Assignee: GOOGLE LLC
    Inventors: Yuxin Liu, Debargha Mukherjee