Patents by Inventor Dane P. Kottke

Dane P. Kottke has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11350105
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: May 31, 2022
    Assignee: Euclid Discoveries, LLC
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Patent number: 11228766
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: January 18, 2022
    Assignee: EUCLID DISCOVERIES, LLC
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Patent number: 11159801
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Grant
    Filed: July 10, 2020
    Date of Patent: October 26, 2021
    Assignee: EUCLID DISCOVERIES, LLC
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Publication number: 20210203950
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Application
    Filed: January 7, 2021
    Publication date: July 1, 2021
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Publication number: 20210203951
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Application
    Filed: January 8, 2021
    Publication date: July 1, 2021
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Publication number: 20200413067
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Application
    Filed: July 10, 2020
    Publication date: December 31, 2020
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Patent number: 10757419
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: August 25, 2020
    Assignee: Euclid Discoveries, LLC
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Publication number: 20190289296
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Application
    Filed: May 23, 2019
    Publication date: September 19, 2019
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Patent number: 10097851
    Abstract: Perceptual statistics are used to compute importance maps that indicate which regions of a video frame are important to the human visual system. Importance maps may be generated from encoders that produce motion vectors and employ motion estimation for inter-prediction. The temporal contrast sensitivity function (TCSF) may be computed from the encoder's motion vectors. Quality metrics may be used to construct a true motion vector map (TMVM), which refines the TCSF. Spatial complexity maps (SCMs) can be calculated from simple metrics (e.g. block variance, block luminance, SSIM, and edge detection). Importance maps with TCSF, TMVM, and SCM may be used to modify the standard rate-distortion optimization criterion for selecting the optimum encoding solution. Importance maps may modify encoder quantization. The spatial information for the importance maps may be provided by a lookup table based on block variance, where negative and positive spatial QP offsets for block variances are provided.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: October 9, 2018
    Assignee: Euclid Discoveries, LLC
    Inventors: Nigel Lee, Sangseok Park, Myo Tun, Dane P. Kottke, Jeyun Lee, Christopher Weed
  • Patent number: 10091507
    Abstract: Perceptual statistics may be used to compute importance maps that indicate which regions of a video frame are important to the human visual system. Importance maps may be applied to the video encoding process to enhance the quality of encoded bitstreams. The temporal contrast sensitivity function (TCSF) may be computed from the encoder's motion vectors. Motion vector quality metrics may be used to construct a true motion vector map (TMVM) that can be used to refine the TCSF. Spatial complexity maps (SCMs) can be calculated from metrics such as block variance, block luminance, SSIM, and edge strength, and the SCMs can be combined with the TCSF to obtain a unified importance map. Importance maps may be used to improve encoding by modifying the criterion for selecting optimum encoding solutions or by modifying the quantization for each target block to be encoded.
    Type: Grant
    Filed: September 3, 2015
    Date of Patent: October 2, 2018
    Assignee: Euclid Discoveries, LLC
    Inventors: Nigel Lee, Sangseok Park, Myo Tun, Dane P. Kottke, Jeyun Lee, Christopher Weed
  • Patent number: 9621917
    Abstract: Continuous block tracking (CBT) tracks macroblock locations over reference frames to produce better inter-predictions than conventional block-based motion estimation/compression. CBT includes frame-to-frame tracking, estimating motion from a frame to a previous frame, and continuous tracking, related frame-to-frame motion vectors to block tracks. Frame-to-frame tracking may include block based or hierarchical motion estimations. CBT combined with enhanced predictive zonal search may create unified motion estimation. Accumulated CBT results may form trajectories for trajectory-based CBT predictions. Metrics measuring continuous track and motion vector quality can assess relative priority of CBT prediction against non-tracker-based predictions and to modify encoding choices. Continuous tracks can be analyzed for goodness-of-fit to translational motion models, with outliers removed from encoding. Translational motion models can be extended to entire frames in adaptive picture type selection.
    Type: Grant
    Filed: November 4, 2014
    Date of Patent: April 11, 2017
    Assignee: EUCLID DISCOVERIES, LLC
    Inventors: Dane P. Kottke, John J. Guo, Jeyun Lee, Sangseok Park, Christopher Weed, Justin Kwan, Nigel Lee
  • Publication number: 20170070745
    Abstract: Perceptual statistics are used to compute importance maps that indicate which regions of a video frame are important to the human visual system. Importance maps may be generated from encoders that produce motion vectors and employ motion estimation for inter-prediction. The temporal contrast sensitivity function (TCSF) may be computed from the encoder's motion vectors. Quality metrics may be used to construct a true motion vector map (TMVM), which refines the TCSF. Spatial complexity maps (SCMs) can be calculated from simple metrics (e.g. block variance, block luminance, SSIM, and edge detection). Importance maps with TCSF, TMVM, and SCM may be used to modify the standard rate-distortion optimization criterion for selecting the optimum encoding solution. Importance maps may modify encoder quantization. The spatial information for the importance maps may be provided by a lookup table based on block variance, where negative and positive spatial QP offsets for block variances are provided.
    Type: Application
    Filed: November 18, 2016
    Publication date: March 9, 2017
    Inventors: Nigel Lee, Sangseok Park, Myo Tun, Dane P. Kottke, Jeyun Lee, Christopher Weed
  • Publication number: 20160073111
    Abstract: Perceptual statistics may be used to compute importance maps that indicate which regions of a video frame are important to the human visual system. Importance maps may be applied to the video encoding process to enhance the quality of encoded bitstreams. The temporal contrast sensitivity function (TCSF) may be computed from the encoder's motion vectors. Motion vector quality metrics may be used to construct a true motion vector map (TMVM) that can be used to refine the TCSF. Spatial complexity maps (SCMs) can be calculated from metrics such as block variance, block luminance, SSIM, and edge strength, and the SCMs can be combined with the TCSF to obtain a unified importance map. Importance maps may be used to improve encoding by modifying the criterion for selecting optimum encoding solutions or by modifying the quantization for each target block to be encoded.
    Type: Application
    Filed: September 3, 2015
    Publication date: March 10, 2016
    Inventors: Nigel Lee, Sangseok Park, Myo Tun, Dane P. Kottke, Jeyun Lee, Christopher Weed
  • Publication number: 20150256850
    Abstract: Continuous block tracking (CBT) tracks macroblock locations over reference frames to produce better inter-predictions than conventional block-based motion estimation/compression. CBT includes frame-to-frame tracking, estimating motion from a frame to a previous frame, and continuous tracking, related frame-to-frame motion vectors to block tracks. Frame-to-frame tracking may include block based or hierarchical motion estimations. CBT combined with enhanced predictive zonal search may create unified motion estimation. Accumulated CBT results may form trajectories for trajectory-based CBT predictions. Metrics measuring continuous track and motion vectors quality can assess relative priority of CBT predictions against non-tracker-based predictions and to modify encoding choices. Continuous tracks can be analyzed for goodness-of-fit to translational motion models, with outliers removed from encoding. Translational motion models can be extended to entire frames in adaptive picture type selection.
    Type: Application
    Filed: November 4, 2014
    Publication date: September 10, 2015
    Inventors: Dane P. Kottke, John J. Guo, Jeyun Lee, Sangseok Park, Christopher Weed, Justin Kwan, Nigel Lee
  • Publication number: 20130083855
    Abstract: Intraframe video compression schemes are optimized for compression of high quality media, such as media encoded in RGB 4:4:4 format. The optimization uses an encoder that applies a 2D spatial linear transform to subframe portions of image data to generate coefficients, adaptively selects a favored color space representation for representing the coefficients, and signals the selected color space representation in the compressed video stream. The selection of color space for each subframe image portion is performed by comparing the compression efficiency of the portion in each of a plurality of color spaces. To minimize computational cost, efficiencies are estimated by applying rate-distortion models for the applied compression scheme to coefficients of each portion.
    Type: Application
    Filed: September 30, 2011
    Publication date: April 4, 2013
    Inventor: Dane P. Kottke
  • Patent number: 7729423
    Abstract: High quality intraframe-only compression of video can be achieved using rate distortion optimization and without resizing or bit depth modification. The compression process involves transforming portions of the image to generate frequency domain coefficients for each portion. A bit rate for each transformed portion using a plurality of scale factors is determined. Distortion for each portion is estimated according to the plurality of scale factors. A scale factor is selected for each portion to minimize the total distortion in the image to achieve a desired bit rate. A quantization matrix is selected according to the desired bit rate. The frequency domain coefficients for each portion are quantized using the selected plurality of quantizers as scaled by the selected scale factor for the portion. The quantized frequency domain coefficients are encoded using a variable length encoding to provide compressed data for each of the defined portions.
    Type: Grant
    Filed: June 26, 2008
    Date of Patent: June 1, 2010
    Assignee: Avid Technology, Inc.
    Inventors: Dane P. Kottke, Katherine H. Cornog
  • Publication number: 20090003438
    Abstract: High quality intraframe-only compression of video can be achieved using rate distortion optimization and without resizing or bit depth modification. The compression process involves transforming portions of the image to generate frequency domain coefficients for each portion. A bit rate for each transformed portion using a plurality of scale factors is determined. Distortion for each portion is estimated according to the plurality of scale factors. A scale factor is selected for each portion to minimize the total distortion in the image to achieve a desired bit rate. A quantization matrix is selected according to the desired bit rate. The frequency domain coefficients for each portion are quantized using the selected plurality of quantizers as scaled by the selected scale factor for the portion. The quantized frequency domain coefficients are encoded using a variable length encoding to provide compressed data for each of the defined portions.
    Type: Application
    Filed: June 26, 2008
    Publication date: January 1, 2009
    Inventors: Dane P. Kottke, Katherine H. Cornog
  • Patent number: 7403561
    Abstract: High quality intraframe-only compression of video can be achieved using rate distortion optimization and without resizing or bit depth modification. The compression process involves transforming portions of the image to generate frequency domain coefficients for each portion. A bit rate for each transformed portion using a plurality of scale factors is determined. Distortion for each portion is estimated according to the plurality of scale factors. A scale factor is selected for each portion to minimize the total distortion in the image to achieve a desired bit rate. A quantization matrix is selected according to the desired bit rate. The frequency domain coefficients for each portion are quantized using the selected plurality of quantizers as scaled by the selected scale factor for the portion. The quantized frequency domain coefficients are encoded using a variable length encoding to provide compressed data for each of the defined portions.
    Type: Grant
    Filed: April 2, 2004
    Date of Patent: July 22, 2008
    Assignee: Avid Technology, Inc.
    Inventors: Dane P. Kottke, Katherine H. Cornog
  • Publication number: 20040196903
    Abstract: High quality intraframe-only compression of video can be achieved using rate distortion optimization and without resizing or bit depth modification. The compression process involves transforming portions of the image to generate frequency domain coefficients for each portion. A bit rate for each transformed portion using a plurality of scale factors is determined. Distortion for each portion is estimated according to the plurality of scale factors. A scale factor is selected for each portion to minimize the total distortion in the image to achieve a desired bit rate. A quantization matrix is selected according to the desired bit rate. The frequency domain coefficients for each portion are quantized using the selected plurality of quantizers as scaled by the selected scale factor for the portion. The quantized frequency domain coefficients are encoded using a variable length encoding to provide compressed data for each of the defined portions.
    Type: Application
    Filed: April 2, 2004
    Publication date: October 7, 2004
    Inventors: Dane P. Kottke, Katherine H. Cornog