Patents by Inventor Marius Renn

Marius Renn has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230292005
    Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.
    Type: Application
    Filed: February 27, 2023
    Publication date: September 14, 2023
    Inventors: Wei Hong, Radford Ray Juang, Marius Renn
  • Publication number: 20230230325
    Abstract: An example method includes outputting, by a computing device for display, one or more digital images that include a face of a user, receiving, by the computing device and based on a facial recognition process, an indication of a match between facial data associated with the face of the user and reference facial data associated with a face of an enrolled user of the computing device, and retrieving, by the computing device, digital makeup enhancement data that is associated with the reference facial data. The example method further includes applying, by the computing device, the digital makeup enhancement data to the facial data, of tire face of the user to generate one or more modified digital images that indicate at least one corresponding digital makeup enhancement to the face of the user, and outputting, by the computing device for display, the one or more modified digital images.
    Type: Application
    Filed: June 18, 2021
    Publication date: July 20, 2023
    Inventors: Shengyi Lin, Leslie Tsu-Hwa Shaw, Marius Renn, Nisha Masharani, Sushil Nath
  • Publication number: 20230222628
    Abstract: Systems and methods for training a restoration model can leverage training for two sub-tasks to train the restoration model to generate realistic and identity-preserved outputs. The systems and methods can balance the training of the generation task and the reconstruction task to ensure the generated outputs preserve the identity of the original subject while generating realistic outputs. The systems and methods can further leverage a feature quantization model and skip connections to improve the model output and overall training.
    Type: Application
    Filed: January 11, 2022
    Publication date: July 13, 2023
    Inventors: Yang Zhao, Yu-Chuan Su, Chun-Te Chu, Yandong Li, Marius Renn, Yukun Zhu, Xuhui Jia, Bradley Ray Green
  • Patent number: 11625840
    Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.
    Type: Grant
    Filed: February 25, 2021
    Date of Patent: April 11, 2023
    Assignee: Google LLC
    Inventors: Wei Hong, Marius Renn, Rodrigo Carceroni
  • Patent number: 11595580
    Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: February 28, 2023
    Assignee: GOOGLE LLC
    Inventors: Wei Hong, Marius Renn, Radford Ray Juang
  • Publication number: 20220286610
    Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.
    Type: Application
    Filed: May 23, 2022
    Publication date: September 8, 2022
    Inventors: Wei Hong, Marius Renn, Radford Ray Juang
  • Patent number: 11350068
    Abstract: Techniques described herein include receiving a first video frame including a first color map, receiving at least one second video frame, receiving a third video frame including a second color map, generating at least one color map based on the first color map and the second color map, associating the at least one third color map with the at least one second frame, the associated at least one second frame being sequentially positioned between the first frame and the second frame, tone correcting the associated at least one second frame based on the at least one generated third color map and color correcting the at least one second frame based on the at least one generated third color map.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: May 31, 2022
    Assignee: Google LLC
    Inventors: Li Wei, Wei Hong, Marius Renn
  • Patent number: 11343429
    Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.
    Type: Grant
    Filed: July 12, 2018
    Date of Patent: May 24, 2022
    Assignee: GOOGLE LLC
    Inventors: Wei Hong, Radford Ray Juang, Marius Renn
  • Publication number: 20210183077
    Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.
    Type: Application
    Filed: February 25, 2021
    Publication date: June 17, 2021
    Inventors: Wei Hong, Marius Renn, Rodrigo Carceroni
  • Patent number: 10957054
    Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: March 23, 2021
    Assignee: Google LLC
    Inventors: Wei Hong, Marius Renn, Rodrigo Carceroni
  • Publication number: 20210084271
    Abstract: Techniques described herein include receiving a first video frame including a first color map, receiving at least one second video frame, receiving a third video frame including a second color map, generating at least one color map based on the first color map and the second color map, associating the at least one third color map with the at least one second frame, the associated at least one second frame being sequentially positioned between the first frame and the second frame, tone correcting the associated at least one second frame based on the at least one generated third color map and color correcting the at least one second frame based on the at least one generated third color map.
    Type: Application
    Filed: January 24, 2020
    Publication date: March 18, 2021
    Inventors: Li Wei, Wei Hong, Marius Renn
  • Publication number: 20200228708
    Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.
    Type: Application
    Filed: July 12, 2018
    Publication date: July 16, 2020
    Inventors: Wei Hong, Radford Ray Juang, Simon Safar, Marius Renn
  • Publication number: 20190037611
    Abstract: Embodiments of the invention provide client devices, servers, systems, and methods for establishing, managing, and utilizing inter-device connectivity environments that enable inter-device data and resource sharing through intuitive user commands. The invention does not require client devices having specialized hardware necessary for forming direct client connections, such as NFC readers or RFID antennas. Embodiments of the invention utilize an environment wherein multiple client devices communicate with a server to enable the transfer of files from one client device to another. The server manages the transfer of data between clients and the sharing of client resources between clients. Specifically, the server determines whether inter-device sharing events detected and reported by client devices are valid inter-device sharing events. If such events are valid, the server further facilitates the data and resource sharing process.
    Type: Application
    Filed: December 23, 2013
    Publication date: January 31, 2019
    Inventors: Marius RENN, Wei HUA
  • Publication number: 20180293741
    Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.
    Type: Application
    Filed: June 11, 2018
    Publication date: October 11, 2018
    Inventors: Wei Hong, Marius Renn, Rodrigo Carceroni
  • Patent number: 10002435
    Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: June 19, 2018
    Assignee: Google LLC
    Inventors: Wei Hong, Marius Renn, Rodrigo Carceroni
  • Patent number: 9854160
    Abstract: Implementations of the disclosed technology include techniques for autonomously collecting image data, and generating photo summaries based thereon. In some implementations, a plurality of images may be autonomously sampled from an available stream of image data. For example, a camera application of a smartphone or other mobile computing device may present a live preview based on a stream of data from an image capture device. The live stream of image capture data may be sampled and the most interesting photos preserved for further filtering and presentation. The preserved photos may be further winnowed as a photo session continues and an image object generated summarizing the remaining photos. Accordingly, image capture data may be autonomously collected, filtered, and formatted to enable a photographer to see what moments they missed manually capturing during a photo session.
    Type: Grant
    Filed: October 21, 2016
    Date of Patent: December 26, 2017
    Assignee: Google LLC
    Inventors: Rodrigo Lima Carceroni, Marius Renn, Alan Newberger, Sascha Häberling, Jacob Mintz, Andrew Huibers
  • Publication number: 20170221217
    Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.
    Type: Application
    Filed: January 29, 2016
    Publication date: August 3, 2017
    Inventors: Wei Hong, Marius Renn, Rodrigo Carceroni
  • Publication number: 20170041532
    Abstract: Implementations of the disclosed technology include techniques for autonomously collecting image data, and generating photo summaries based thereon. In some implementations, a plurality of images may be autonomously sampled from an available stream of image data. For example, a camera application of a smartphone or other mobile computing device may present a live preview based on a stream of data from an image capture device. The live stream of image capture data may be sampled and the most interesting photos preserved for further filtering and presentation. The preserved photos may be further winnowed as a photo session continues and an image object generated summarizing the remaining photos. Accordingly, image capture data may be autonomously collected, filtered, and formatted to enable a photographer to see what moments they missed manually capturing during a photo session.
    Type: Application
    Filed: October 21, 2016
    Publication date: February 9, 2017
    Inventors: Rodrigo Lima Carceroni, Marius Renn, Alan Newberger, Sascha Häberling, Jacob Mintz, Andrew Huibers
  • Patent number: 9479694
    Abstract: Implementations of the disclosed technology include techniques for autonomously collecting image data, and generating photo summaries based thereon. In some implementations, a plurality of images may be autonomously sampled from an available stream of image data. For example, a camera application of a smartphone or other mobile computing device may present a live preview based on a stream of data from an image capture device. The live stream of image capture data may be sampled and the most interesting photos preserved for further filtering and presentation. The preserved photos may be further winnowed as a photo session continues and an image object generated summarizing the remaining photos. Accordingly, image capture data may be autonomously collected, filtered, and formatted to enable a photographer to see what moments they missed manually capturing during a photo session.
    Type: Grant
    Filed: October 28, 2014
    Date of Patent: October 25, 2016
    Assignee: Google Inc.
    Inventors: Rodrigo Lima Carceroni, Marius Renn, Alan Newberger, Sascha Häberling, Jacob Mintz, Andrew Huibers
  • Patent number: 9471679
    Abstract: The disclosed technology includes techniques for improved content coverage in automatically-generated content summaries. The technique may include clustering a set of input content, determining diffusion for each cluster, and selecting representatives of each cluster to optimize other secondary metrics. Various types of input content may be used, including groups of images, video clips, or other multimedia content. Contiguous content may be manually or programmatically divided into discrete portions before clustering, for example, a lengthy video divided into a number of short clips. In some implementations, the disclosed technique may be implemented effectively on a mobile device. In other words, the processing required may be computationally feasible for execution on a smartphone or similar device.
    Type: Grant
    Filed: February 28, 2014
    Date of Patent: October 18, 2016
    Assignee: Google Inc.
    Inventors: Rodrigo Carceroni, Pannag Raghunath Sanketi, Marius Renn, Ruei-sung Lin, Wei Hua