Patents by Inventor Marco Paniconi

Marco Paniconi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240089435
    Abstract: A computer-implemented method includes setting, by a participant computing device participating in a videoconference, a maximum quantization parameter (QP) value for encoding a predetermined type of video frame to a value which is the lesser of: a first QP value determined based on an average value of QP values used to encode video frames before the predetermined type of video frame, or a second QP value corresponding to an application-specified maximum QP value. The computer-implemented method further includes encoding the predetermined type of video frame using the set maximum QP value.
    Type: Application
    Filed: September 13, 2022
    Publication date: March 14, 2024
    Inventors: Michael Horowitz, Danil Chapovalov, Marco Paniconi
  • Publication number: 20240089436
    Abstract: A computer-implemented method includes setting, by a computing device, a maximum quantization parameter (QP) value for encoding an input video frame to a value which is the maximum of: a first QP value corresponding to a first proportion of an application-specified maximum QP value, or a second QP value determined based on a value which is the minimum of: a third QP value determined based on an average value of QP values used to encode a plurality of video frames before the input video frame, or a fourth QP value corresponding to a second proportion of the application-specified maximum QP value. The computer-implemented method further includes using the set maximum QP value as a quality bound for encoding the input video frame.
    Type: Application
    Filed: September 13, 2022
    Publication date: March 14, 2024
    Inventors: Michael Horowitz, Marco Paniconi
  • Patent number: 10893283
    Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: January 12, 2021
    Assignee: Google LLC
    Inventors: Jing Chen, Marco Paniconi, Michael Horowitz
  • Patent number: 10721482
    Abstract: Object-based intra-prediction encoding may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, an encoded block of a current frame of a video stream by encoding a current block from the current frame, including the encoded block in an output bitstream, and outputting or storing the output bitstream. Encoding the current block may include identifying a first spatial portion of the current block, wherein the first spatial portion includes a first pixel from the current block and omits a second pixel from the current block, encoding the first pixel using a first intra-prediction mode, and encoding the second pixel using a second intra-prediction mode, wherein the second intra-prediction mode differs from the first intra-prediction mode.
    Type: Grant
    Filed: June 9, 2017
    Date of Patent: July 21, 2020
    Assignee: GOOGLE LLC
    Inventors: Marco Paniconi, Qunshan Gu
  • Publication number: 20200099944
    Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.
    Type: Application
    Filed: November 26, 2019
    Publication date: March 26, 2020
    Applicant: Google LLC
    Inventors: Jing CHEN, Marco PANICONI, Michael HOROWITZ
  • Patent number: 10511846
    Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.
    Type: Grant
    Filed: September 1, 2016
    Date of Patent: December 17, 2019
    Assignee: Google LLC
    Inventors: Jing Chen, Marco Paniconi, Michael Horowitz
  • Patent number: 10382773
    Abstract: Encoding is accomplished using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.
    Type: Grant
    Filed: March 9, 2017
    Date of Patent: August 13, 2019
    Assignee: GOOGLE LLC
    Inventors: Qunshan Gu, Marco Paniconi
  • Patent number: 10049436
    Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Video captured is analyzed on a frame by frame basis to determine whether denoising of the frame should be performed prior to providing the source frame to an encoder. If the frame is to be denoised, the frame is divided into a plurality of blocks and a local denoising process is performed on a block per block basis.
    Type: Grant
    Filed: August 9, 2016
    Date of Patent: August 14, 2018
    Assignee: GOOGLE LLC
    Inventors: Jing Chen, Marco Paniconi
  • Patent number: 10034023
    Abstract: Disclosed herein are implementations of systems, methods, and apparatuses for extended protection of digital video streams. The disclosed implementations include a method for transmitting a video stream over a network with forward error correction protection including encoding a current frame of the plurality of frames, producing a plurality of data packets from the encoded frame, generating a plurality of protection packets including data usable for restoring one or more lost data packets of the plurality of data packets, wherein at least one of the plurality of protection packets also includes data usable for restoring a lost protection packet of the protection packets, and wherein a protection packet of the plurality of protection packets includes a packet mask that indicates which of the plurality of data packets and plurality of protection packets are protected by the protection packet, and transmitting the data packets and the protection packets over the network.
    Type: Grant
    Filed: July 30, 2012
    Date of Patent: July 24, 2018
    Assignee: GOOGLE LLC
    Inventor: Marco Paniconi
  • Patent number: 9894381
    Abstract: Encoding and decoding is accomplished herein using a multi-reference picture buffer. Decoding includes receiving an encoded video stream, determining an expected error value representing possible frame errors, decoding a plurality of reference frames from the video stream, adding each of the plurality of reference frames to the reference picture buffers up to a maximum number of reference picture buffers, and determining an encoded video stream error value representing actual frame errors based on the decoded plurality of reference frames. If the encoded video stream error value is greater than the decoded expected error value, an error is signaled.
    Type: Grant
    Filed: July 25, 2016
    Date of Patent: February 13, 2018
    Assignee: GOOGLE INC.
    Inventors: Qunshan Gu, Marco Paniconi
  • Publication number: 20170280142
    Abstract: Object-based intra-prediction encoding may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, an encoded block of a current frame of a video stream by encoding a current block from the current frame, including the encoded block in an output bitstream, and outputting or storing the output bitstream. Encoding the current block may include identifying a first spatial portion of the current block, wherein the first spatial portion includes a first pixel from the current block and omits a second pixel from the current block, encoding the first pixel using a first intra-prediction mode, and encoding the second pixel using a second intra-prediction mode, wherein the second intra-prediction mode differs from the first intra-prediction mode.
    Type: Application
    Filed: June 9, 2017
    Publication date: September 28, 2017
    Inventors: Marco Paniconi, Qunshan Gu
  • Patent number: 9693066
    Abstract: Object-based intra-prediction decoding may include generating a reconstructed block by decoding an encoded block, which may include identifying a first intra-prediction mode for a first portion of the reconstructed block and identifying a second intra-prediction mode for a second portion of the reconstructed block. Decoding the encoded block may include generating a first portion of a prediction block using the first intra-prediction mode, generating a second portion of the prediction block using the second intra-prediction mode, generating the first portion of the reconstructed block based on the first portion of the prediction block, such that the first portion of the reconstructed block corresponds to a first object represented in the reconstructed block, and generating the second portion of the reconstructed block based on the second portion of the prediction block, such that the second portion of the reconstructed block corresponds to a second object represented in the reconstructed block.
    Type: Grant
    Filed: June 27, 2016
    Date of Patent: June 27, 2017
    Assignee: GOOGLE INC.
    Inventors: Marco Paniconi, Qunshan Gu
  • Patent number: 9609341
    Abstract: Encoding and decoding is accomplished herein using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.
    Type: Grant
    Filed: April 18, 2013
    Date of Patent: March 28, 2017
    Assignee: GOOGLE INC.
    Inventors: Qunshan Gu, Marco Paniconi
  • Publication number: 20170063497
    Abstract: A method for decoding a packetized video signal including at least one encoded frame. In one case, the method includes receiving at least one FEC packet at a receiving station. The receiving station uses embedded data associated with the FEC packet to obtain more accurate knowledge of the packet loss state of the media packets. This improved knowledge can allow the receiver to make better use of packet retransmission requests. The embedded data associated with the FEC packet can include in some cases a base sequence number and a packet mask.
    Type: Application
    Filed: November 7, 2016
    Publication date: March 2, 2017
    Applicant: GOOGLE INC.
    Inventors: Marco Paniconi, Mikhal Shemer
  • Patent number: 9490850
    Abstract: A method for decoding a packetized video signal including at least one encoded frame. In one case, the method includes receiving at least one FEC packet at a receiving station. The receiving station uses embedded data associated with the FEC packet to obtain more accurate knowledge of the packet loss state of the media packets. This improved knowledge can allow the receiver to make better use of packet retransmission requests. The embedded data associated with the FEC packet can include in some cases a base sequence number and a packet mask.
    Type: Grant
    Filed: November 28, 2011
    Date of Patent: November 8, 2016
    Assignee: GOOGLE INC.
    Inventors: Marco Paniconi, Mikhal Shemer
  • Patent number: 9426459
    Abstract: Encoding and decoding is accomplished herein using a multi-reference picture buffer. Reference frames are assigned to reference picture buffers when used for encoding and are identified with picture IDs unique relative to other picture IDs currently associated with the reference picture buffers. The maximum picture number used as the picture ID can be based on a number of reference picture buffers available to encode and decode the frames plus a value based on an expected error rate. The picture IDs can be assigned based on a least recently used policy. When a reference frame is no longer needed for encoding and decoding, a picture ID number associated with the reference frame can be released for re-assignment to a new reference frame.
    Type: Grant
    Filed: April 18, 2013
    Date of Patent: August 23, 2016
    Assignee: GOOGLE INC.
    Inventors: Qunshan Gu, Marco Paniconi
  • Patent number: 9380298
    Abstract: A method and apparatus for performing object-based intra-prediction encoding and decoding is disclosed. Implementations of object-based intra-prediction encoding and decoding include segmenting a current block into a first portion and at least a second portion; generating, for at least some of a plurality of pixels in the first portion, corresponding predicted values according to at least a first intra-prediction mode; generating, for at least some of a plurality of pixels in the second portion, corresponding predicted values according to at least a second intra-prediction mode; and encoding the current block using the predicted values of the first portion and the predicted values of the second portion.
    Type: Grant
    Filed: August 10, 2012
    Date of Patent: June 28, 2016
    Assignee: GOOGLE INC.
    Inventors: Qunshan Gu, Marco Paniconi
  • Patent number: 9094663
    Abstract: Adaptive media optimization is described. Aspects of the invention modify video encoding and network transmission settings to optimize the user viewing experience. The system and method sample video content to determine various content features of the video. The system and method use the identified content features in conjunction with network statistics to modify encoding settings and network transmission options to ensure a minimum of interruption in the transmitted video. Previously generated lookup tables ensure efficient mapping of video content and network conditions to encoding and transmission settings.
    Type: Grant
    Filed: June 30, 2014
    Date of Patent: July 28, 2015
    Assignee: GOOGLE INC.
    Inventors: Marco Paniconi, Ermin Kozica
  • Patent number: 8856624
    Abstract: A method and apparatus for dynamically selecting forward error correction codes to accompany transmitted packet data on a network is taught. Source content parameter(s) and network state parameter(s) are analyzed to select either equal protection (EP) error correction or unequal correction (UEP) error correction. Selection of UEP error correction versus EP error correction improves the perceived quality of transmitted data without requiring additional error correction overhead.
    Type: Grant
    Filed: October 27, 2011
    Date of Patent: October 7, 2014
    Assignee: Google Inc.
    Inventor: Marco Paniconi
  • Patent number: 8767821
    Abstract: A method and system for providing adaptive media optimization are described. Aspects of the invention modify video encoding and network transmission settings to optimize the user viewing experience. The system and method sample video content to determine various content features of the video. The system and method use the identified content features in conjunction with network statistics to modify encoding settings and network transmission options to ensure a minimum of interruption in the transmitted video. Previously generated lookup tables ensure efficient mapping of video content and network conditions to encoding and transmission settings.
    Type: Grant
    Filed: May 9, 2011
    Date of Patent: July 1, 2014
    Assignee: Google Inc.
    Inventors: Marco Paniconi, Ermin Kozica