Patents by Inventor Matthias Grundmann

Matthias Grundmann has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190228031
    Abstract: A computing device is described that includes a camera configured to capture an image of a user of the computing device, a memory configured to store the image of the user, at least one processor, and at least one module. The at least one module is operable by the at least one processor to obtain, from the memory, an indication of the image of the user of the computing device, determine, based on the image, a first emotion classification tag, and identify, based on the first emotion classification tag, at least one graphical image from a database of pre-classified images that has an emotional classification that is associated with the first emotion classification tag. The at least one module is further operable by the at least one processor to output, for display, the at least one graphical image.
    Type: Application
    Filed: January 28, 2019
    Publication date: July 25, 2019
    Applicant: Google LLC
    Inventors: Matthias GRUNDMANN, Karthik RAVEENDRAN, Daniel Castro CHIN
  • Publication number: 20190205654
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Application
    Filed: March 11, 2019
    Publication date: July 4, 2019
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Publication number: 20190189161
    Abstract: A computer-implemented method includes determining interesting moments in a video. The method further includes generating video segments based on the interesting moments, wherein each of the video segments includes at least one of the interesting moments from the video. The method further includes generating a collage from the video segments, where the collage includes at least two windows and wherein each window includes one of the video segments.
    Type: Application
    Filed: December 17, 2018
    Publication date: June 20, 2019
    Applicant: Google LLC
    Inventors: Sharadh RAMASWAMY, Matthias GRUNDMANN, Kenneth CONLEY
  • Patent number: 10262420
    Abstract: Systems and methods are disclosed for tracking regions within a media item. A method includes identifying a region in a first frame of a media item using a first user specified position; calculating, based on the first user specified position and on tracking data, an estimated position of the region within a second frame of the media item and an estimated position of the region within a third frame of the media item; adjusting the estimated position of the region within the second frame to a second user specified position; blending, by a processing device, the estimated position within the third frame based on the second user specified position of the second frame to generate a blended position within the third frame; and storing, in a data store, the blended position within the third frame.
    Type: Grant
    Filed: May 3, 2017
    Date of Patent: April 16, 2019
    Assignee: GOOGLE LLC
    Inventors: Amanda Conway, Matthias Grundmann, Christian Ingemar Falk
  • Patent number: 10229326
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: March 12, 2019
    Assignee: Google LLC
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Patent number: 10191920
    Abstract: A computing device is described that includes a camera configured to capture an image of a user of the computing device, a memory configured to store the image of the user, at least one processor, and at least one module. The at least one module is operable by the at least one processor to obtain, from the memory, an indication of the image of the user of the computing device, determine, based on the image, a first emotion classification tag, and identify, based on the first emotion classification tag, at least one graphical image from a database of pre-classified images that has an emotional classification that is associated with the first emotion classification tag. The at least one module is further operable by the at least one processor to output, for display, the at least one graphical image.
    Type: Grant
    Filed: August 24, 2015
    Date of Patent: January 29, 2019
    Assignee: Google LLC
    Inventors: Matthias Grundmann, Karthik Raveendran, Daniel Castro Chin
  • Publication number: 20190013047
    Abstract: A plurality of videos is analyzed (in real time or after the videos are generated) to identify interesting portions of the videos. The interesting portions are identified based on one or more of the people depicted in the videos, the objects depicted in the videos, the motion of objects and/or people in the videos, and the locations where people depicted in the videos are looking. The interesting portions are combined to generate a content item.
    Type: Application
    Filed: March 31, 2015
    Publication date: January 10, 2019
    Inventors: Arthur Wait, Krishna Bharat, Caroline Rebecca Pantofaru, Christian Frueh, Matthias Grundmann, Jay Yagnik, Ryan Michael Hickman
  • Publication number: 20190005334
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Application
    Filed: September 7, 2018
    Publication date: January 3, 2019
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Patent number: 10157638
    Abstract: A computer-implemented method includes determining interesting moments in a video. The method further includes generating video segments based on the interesting moments, wherein each of the video segments includes at least one of the interesting moments from the video. The method further includes generating a collage from the video segments, where the collage includes at least two windows and wherein each window includes one of the video segments.
    Type: Grant
    Filed: June 24, 2016
    Date of Patent: December 18, 2018
    Assignee: Google LLC
    Inventors: Sharadh Ramaswamy, Matthias Grundmann, Kenneth Conley
  • Publication number: 20180350131
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video segmentation. One of the methods includes receiving a digital video; performing hierarchical graph-based video segmentation on at least one frame of the digital video to generate a boundary representation for the at least one frame; generating a vector representation from the boundary representation for the at least one frame of the digital video, wherein generating the vector representation includes generating a polygon composed of at least three vectors, wherein each vector comprises two vertices connected by a line segment, from a boundary in the boundary representation; linking the vector representation to the at least one frame of the digital video; and storing the vector representation with the at least one frame of the digital video.
    Type: Application
    Filed: December 31, 2014
    Publication date: December 6, 2018
    Inventors: Irfan Essa, Vivek Kwatra, Matthias Grundmann
  • Patent number: 10074015
    Abstract: Methods, systems, and media for summarizing a video with video thumbnails are provided.
    Type: Grant
    Filed: April 13, 2016
    Date of Patent: September 11, 2018
    Assignee: Google LLC
    Inventors: Matthias Grundmann, Alexandra Ivanna Hawkins, Sergey Ioffe
  • Patent number: 9888180
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: February 6, 2018
    Assignee: GOOGLE LLC
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20170372749
    Abstract: A computer-implemented method includes determining interesting moments in a video. The method further includes generating video segments based on the interesting moments, wherein each of the video segments includes at least one of the interesting moments from the video. The method further includes generating a collage from the video segments, where the collage includes at least two windows and wherein each window includes one of the video segments.
    Type: Application
    Filed: June 24, 2016
    Publication date: December 28, 2017
    Applicant: Google Inc.
    Inventors: Sharadh RAMASWAMY, Matthias GRUNDMANN, Kenneth CONLEY
  • Publication number: 20170195575
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: March 20, 2017
    Publication date: July 6, 2017
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9646222
    Abstract: Systems and methods are disclosed for tracking and distorting regions within a media item. A method includes identifying a region in a first frame of a media item using a first user specified position, calculating based on tracking data an estimated position of the region within a second frame of the media item and an estimated position of the region within a third frame of the media item, adjusting based on user input the estimated position of the region within the second frame to a second user specified position, blending the estimated position within the third frame based on the user specified position of the second frame to generate a blended position within the third frame, and modifying the third frame to distort the region underlying the blended position.
    Type: Grant
    Filed: February 23, 2015
    Date of Patent: May 9, 2017
    Assignee: Google Inc.
    Inventors: Amanda Conway, Matthias Grundmann, Christian Ingemar Falk
  • Patent number: 9635261
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: April 25, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9619732
    Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.
    Type: Grant
    Filed: July 6, 2015
    Date of Patent: April 11, 2017
    Assignee: Google Inc.
    Inventors: Erik Murphy-Chutorian, Matthew Steiner, Vivek Kwatra, Shengyang Dai, John Spiegel, Nicholas Butko, Falk Sticken, Florian Kriener, Tom Binder, John Flynn, Troy Chinen, Steven Vandebogart, Nikolaos Trogkanis, Ingo Wehmeyer, Matthias Grundmann
  • Patent number: 9600760
    Abstract: Described herein are methods, systems, apparatuses and products for utilizing motion fields to predict evolution in dynamic scenes. One aspect provides for accessing active object position data including positioning information of a plurality of individual active objects; extracting a plurality of individual active object motions from the active object position data; constructing a motion field using the plurality of individual active object motions; and using the motion field to predict one or more points of convergence at one or more spatial locations that active objects are proceeding towards at a future point in time. Other embodiments are disclosed.
    Type: Grant
    Filed: March 30, 2011
    Date of Patent: March 21, 2017
    Assignee: Disney Enterprises, Inc.
    Inventors: Irfan Aziz Essa, Matthias Grundmann, Jessica Kate Hodgins, Kihwan Kim, Iain Alexander Matthews, Ariel Shamir
  • Patent number: 9554043
    Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.
    Type: Grant
    Filed: July 15, 2014
    Date of Patent: January 24, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Publication number: 20160269642
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Application
    Filed: May 9, 2016
    Publication date: September 15, 2016
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa