Patents by Inventor Matthias Grundmann

Matthias Grundmann has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190005334
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Application
    Filed: September 7, 2018
    Publication date: January 3, 2019
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Patent number: 10157638
    Abstract: A computer-implemented method includes determining interesting moments in a video. The method further includes generating video segments based on the interesting moments, wherein each of the video segments includes at least one of the interesting moments from the video. The method further includes generating a collage from the video segments, where the collage includes at least two windows and wherein each window includes one of the video segments.
    Type: Grant
    Filed: June 24, 2016
    Date of Patent: December 18, 2018
    Assignee: Google LLC
    Inventors: Sharadh Ramaswamy, Matthias Grundmann, Kenneth Conley
  • Publication number: 20180350131
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video segmentation. One of the methods includes receiving a digital video; performing hierarchical graph-based video segmentation on at least one frame of the digital video to generate a boundary representation for the at least one frame; generating a vector representation from the boundary representation for the at least one frame of the digital video, wherein generating the vector representation includes generating a polygon composed of at least three vectors, wherein each vector comprises two vertices connected by a line segment, from a boundary in the boundary representation; linking the vector representation to the at least one frame of the digital video; and storing the vector representation with the at least one frame of the digital video.
    Type: Application
    Filed: December 31, 2014
    Publication date: December 6, 2018
    Inventors: Irfan Essa, Vivek Kwatra, Matthias Grundmann
  • Patent number: 10074015
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Grant
    Filed: April 13, 2016
    Date of Patent: September 11, 2018
    Assignee: Google LLC
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Patent number: 9888180
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: February 6, 2018
    Assignee: GOOGLE LLC
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20170372749
    Abstract: A computer-implemented method includes determining interesting moments in a video. The method further includes generating video segments based on the interesting moments, wherein each of the video segments includes at least one of the interesting moments from the video. The method further includes generating a collage from the video segments, where the collage includes at least two windows and wherein each window includes one of the video segments.
    Type: Application
    Filed: June 24, 2016
    Publication date: December 28, 2017
    Applicant: Google Inc.
    Inventors: Sharadh RAMASWAMY, Matthias GRUNDMANN, Kenneth CONLEY
  • Publication number: 20170195575
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: March 20, 2017
    Publication date: July 6, 2017
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9646222
    Abstract: Systems and methods are disclosed for tracking and distorting regions within a media item. A method includes identifying a region in a first frame of a media item using a first user specified position, calculating based on tracking data an estimated position of the region within a second frame of the media item and an estimated position of the region within a third frame of the media item, adjusting based on user input the estimated position of the region within the second frame to a second user specified position, blending the estimated position within the third frame based on the user specified position of the second frame to generate a blended position within the third frame, and modifying the third frame to distort the region underlying the blended position.
    Type: Grant
    Filed: February 23, 2015
    Date of Patent: May 9, 2017
    Assignee: Google Inc.
    Inventors: Amanda Conway, Matthias Grundmann, Christian Ingemar Falk
  • Patent number: 9635261
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: April 25, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9619732
    Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.
    Type: Grant
    Filed: July 6, 2015
    Date of Patent: April 11, 2017
    Assignee: Google Inc.
    Inventors: Erik Murphy-Chutorian, Matthew Steiner, Vivek Kwatra, Shengyang Dai, John Spiegel, Nicholas Butko, Falk Sticken, Florian Kriener, Tom Binder, John Flynn, Troy Chinen, Steven Vandebogart, Nikolaos Trogkanis, Ingo Wehmeyer, Matthias Grundmann
  • Patent number: 9600760
    Abstract: Described herein are methods, systems, apparatuses and products for utilizing motion fields to predict evolution in dynamic scenes. One aspect provides for accessing active object position data including positioning information of a plurality of individual active objects; extracting a plurality of individual active object motions from the active object position data; constructing a motion field using the plurality of individual active object motions; and using the motion field to predict one or more points of convergence at one or more spatial locations that active objects are proceeding towards at a future point in time. Other embodiments are disclosed.
    Type: Grant
    Filed: March 30, 2011
    Date of Patent: March 21, 2017
    Assignee: Disney Enterprises, Inc.
    Inventors: Irfan Aziz Essa, Matthias Grundmann, Jessica Kate Hodgins, Kihwan Kim, Iain Alexander Matthews, Ariel Shamir
  • Patent number: 9554043
    Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.
    Type: Grant
    Filed: July 15, 2014
    Date of Patent: January 24, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20160269642
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: May 9, 2016
    Publication date: September 15, 2016
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20160238321
    Abstract: A condensing vessel is shown generally at 100, and comprises a stationary outer chamber 102, and a rotating portion in the form of an inner rotating drum or chamber 104, both of which are generally cylindrical, and arranged concentrically. A steam inlet 128 is provided to the inner chamber 104, and a water outlet 130 is provided from the outer chamber 102. Water level sensors 132 are provided on the outer chamber 102 to provide a control signal to a water pump (not shown). The water pump withdraws water to a de-aerator, prior to returning the water to a hot well (not shown). The pump is regulated by a three-way valve which determines how much (if any) water is returned to chamber 102 and how much is directed to the de-aerator, in dependence upon the water level in chamber 102. In use, steam enters the inlet 128 from an exhaust of a steam turbine (not shown).
    Type: Application
    Filed: October 1, 2014
    Publication date: August 18, 2016
    Inventors: Duncan BULMER, Matthias GRUNDMANN
  • Publication number: 20160216848
    Abstract: A computer-implemented method, computer program product, and computing system is provided for interacting with images having similar content. In an embodiment, a method may include identifying a plurality of photographs as including a common characteristic. The method may also include generating a flipbook media item including the plurality of photographs. The method may further include associating one or more interactive control features with the flipbook media item.
    Type: Application
    Filed: April 6, 2016
    Publication date: July 28, 2016
    Applicant: Google Inc.
    Inventors: Sergey Ioffe, Vivek Kwatra, Matthias Grundmann
  • Patent number: 9374532
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: April 1, 2013
    Date of Patent: June 21, 2016
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9357129
    Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.
    Type: Grant
    Filed: September 26, 2014
    Date of Patent: May 31, 2016
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20160150160
    Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.
    Type: Application
    Filed: September 26, 2014
    Publication date: May 26, 2016
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9311310
    Abstract: A computer-implemented method, computer program product, and computing system is provided for interacting with images having similar content. In an embodiment, a method may include identifying a plurality of photographs as including a common characteristic. The method may also include generating a flipbook media item including the plurality of photographs. The method may further include associating one or more interactive control features with the flipbook media item.
    Type: Grant
    Filed: October 26, 2012
    Date of Patent: April 12, 2016
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Vivek Kwatra, Matthias Grundmann
  • Publication number: 20160034785
    Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.
    Type: Application
    Filed: July 6, 2015
    Publication date: February 4, 2016
    Applicant: GOOGLE INC.
    Inventors: Erik MURPHY-CHUTORIAN, Matthew STEINER, Vivek KWATRA, Shengyang DAI, John SPIEGEL, Nicholas BUTKO, Falk STICKEN, Florian KRIENER, Tom BINDER, John FLYNN, Troy CHINEN, Steven VANDEBOGART, Nikolaos TROGKANIS, Ingo WEHMEYER, Matthias GRUNDMANN