Patents by Inventor AARON STARANOWICZ

AARON STARANOWICZ has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11151704
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
    Type: Grant
    Filed: November 22, 2019
    Date of Patent: October 19, 2021
    Assignee: GoPro, Inc.
    Inventors: Aaron Staranowicz, Ryan Lustig, Desmond Chik
  • Publication number: 20200160495
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
    Type: Application
    Filed: November 22, 2019
    Publication date: May 21, 2020
    Inventors: Aaron Staranowicz, Ryan Lustig, Desmond Chik
  • Patent number: 10489897
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
    Type: Grant
    Filed: May 1, 2017
    Date of Patent: November 26, 2019
    Assignee: GoPro, Inc.
    Inventors: Aaron Staranowicz, Ryan Lustig, Desmond Chik
  • Patent number: 10134114
    Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: November 20, 2018
    Assignee: GOPRO, INC.
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, Aaron Staranowicz
  • Publication number: 20180315174
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
    Type: Application
    Filed: May 1, 2017
    Publication date: November 1, 2018
    Inventors: Aaron Staranowicz, Ryan Lustig, Desmond Chik
  • Patent number: 10057538
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.
    Type: Grant
    Filed: January 16, 2017
    Date of Patent: August 21, 2018
    Assignee: GOPRO, INC.
    Inventors: Aaron Staranowicz, Ryan Lustig
  • Publication number: 20180205909
    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.
    Type: Application
    Filed: January 16, 2017
    Publication date: July 19, 2018
    Inventors: Aaron Staranowicz, Ryan Lustig
  • Publication number: 20180082404
    Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.
    Type: Application
    Filed: September 20, 2016
    Publication date: March 22, 2018
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, Aaron Staranowicz
  • Publication number: 20180061012
    Abstract: Apparatus and methods for video image post-processing for correcting, e.g., spatial and/or temporal artifacts. Embodiments described herein obtain frames of video data from a native source and perform super resolution on these captured frames of video data in order to increase the size of these frames. Forward and backward pixel motion calculations are then performed on these calculated super resolution frames. Additionally, superpixel calculations are performed on various objects contained within these super resolution frames and occlusion masks are generated. Interpolated frames of data are then generated by taking into consideration, for example, these generated occlusion masks and the super resolution interpolated frames of data are down sampled back down to their original size.
    Type: Application
    Filed: August 30, 2016
    Publication date: March 1, 2018
    Inventors: AARON STARANOWICZ, RYAN LUSTIG, BALINEEDU CHOWDARY ADSUMILLI
  • Publication number: 20180063551
    Abstract: Apparatus and methods for generating interpolated frames in digital image or video data. In one embodiment, the interpolation is based on a hierarchical tree sequence. At each level of the tree, an interpolated frame may be generated using original or interpolated frames of the video, such as those closest in time to the desired time of the frame to be generated. The sequence proceeds through lower tree levels until a desired number of interpolated frames, a desired video length, a desired level, or a desired visual quality for the video is reached. In some implementations, the sequence may use different interpolation algorithms (e.g., of varying computational complexity or types) at different levels of the tree. The interpolation algorithms can include for example those based on frame repetition, frame averaging, motion compensated frame interpolation, and motion blending.
    Type: Application
    Filed: August 30, 2016
    Publication date: March 1, 2018
    Inventors: Balineedu Chowdary Adsumilli, Ryan Lustig, Aaron Staranowicz