Patents by Inventor Michael Krainin

Michael Krainin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250356562
    Abstract: Systems and methods for converting two-dimensional (2D) static images to three-dimensional (3D) animated images are provided. Such a method includes: receiving, by a server device, one or more 2D static images, each 2D static image of the one or more 2D static images depicting a respective environment; generating a 3D mesh based on a 2D static image of the one or more 2D static images; determining a visual perspective trajectory along the 3D mesh, the visual perspective trajectory indicative of simulated movement within a 3D animated image at least partially along an axis associated with depth in the respective environment depicted by the 2D static image; and generating the 3D animated image based on the 3D mesh and the visual perspective trajectory such that the 3D animated image replicates the simulated movement.
    Type: Application
    Filed: May 16, 2024
    Publication date: November 20, 2025
    Inventors: Yuchen Zhang, Xiaohang Li, Michael Krainin, Dongdong Wang
  • Publication number: 20250310646
    Abstract: This document describes systems and techniques directed at fusing optically zoomed images into one digitally zoomed image. In aspects, a computing device having at least two cameras and an image-processing manager is configured to receive, from a first camera, a first image at a first optical zoom and, from a second camera, a second image at a second optical zoom different from the first optical zoom. The first and second cameras capture a same scene from different fields of view and different points of view. The image-processing manager receives a desired digital zoom between the first optical zoom and the second optical zoom. Based on the first and second images, the image-processing manager determines an overlap region of the first image in which the second image overlaps the first image.
    Type: Application
    Filed: May 17, 2022
    Publication date: October 2, 2025
    Inventors: Xiaotong Wu, Chia-Kai Liang, Wei-Sheng Lai, Yichang Shih, Deqing Sun, Michael Krainin, Lun-Cheng Chu
  • Publication number: 20250191206
    Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.
    Type: Application
    Filed: February 24, 2025
    Publication date: June 12, 2025
    Inventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
  • Patent number: 12260572
    Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.
    Type: Grant
    Filed: August 5, 2021
    Date of Patent: March 25, 2025
    Assignee: Google LLC
    Inventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
  • Publication number: 20240249422
    Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.
    Type: Application
    Filed: August 5, 2021
    Publication date: July 25, 2024
    Inventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
  • Patent number: 11483463
    Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: October 25, 2022
    Assignee: Google LLC
    Inventors: Julia Winn, Abraham Stephens, Daniel Pettigrew, Aaron Maschinot, Ce Liu, Michael Krainin, Michael Rubinstein, Jingyu Cui
  • Publication number: 20200282811
    Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.
    Type: Application
    Filed: May 26, 2020
    Publication date: September 10, 2020
    Applicant: Google LLC
    Inventors: Julia WINN, Abraham STEPHENS, Daniel PETTIGREW, Aaron MASCHINOT, Ce LIU, Michael KRAININ, Michael RUBINSTEIN, Jingyu CUI
  • Patent number: 10675955
    Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: June 9, 2020
    Assignee: Google LLC
    Inventors: Julia Winn, Abraham Stephens, Daniel Pettigrew, Aaron Maschinot, Ce Liu, Michael Krainin, Michael Rubinstein, Jingyu Cui
  • Patent number: 10375381
    Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: August 6, 2019
    Assignee: GOOGLE LLC
    Inventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin
  • Patent number: 10244226
    Abstract: Systems and methods are related to a camera rig and generating stereoscopic panoramas from captured images for display in a virtual reality (VR) environment.
    Type: Grant
    Filed: May 27, 2016
    Date of Patent: March 26, 2019
    Assignee: Google LLC
    Inventors: Joshua Weaver, Robert Anderson, Changchang Wu, Michael Krainin, David Gallup, Steven Maxwell Seitz, Carlos Hernandez Esteban, Matthew Thomas Valente, Christopher Edward Hoover, Erik Hubert Dolly Goossens
  • Publication number: 20180160106
    Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.
    Type: Application
    Filed: December 15, 2017
    Publication date: June 7, 2018
    Inventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin
  • Patent number: 9877016
    Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.
    Type: Grant
    Filed: May 27, 2015
    Date of Patent: January 23, 2018
    Assignee: Google LLC
    Inventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin
  • Publication number: 20160352982
    Abstract: Systems and methods are related to a camera rig and generating stereoscopic panoramas from captured images for display in a virtual reality (VR) environment.
    Type: Application
    Filed: May 27, 2016
    Publication date: December 1, 2016
    Inventors: Joshua Weaver, Robert Anderson, Changchang Wu, Michael Krainin, David Gallup, Steven Maxwell Seitz, Carlos Hernandez Esteban, Matthew Thomas Valente, Christopher Edward Hoover, Erik Hubert Dolly Goossens
  • Publication number: 20160353090
    Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.
    Type: Application
    Filed: May 27, 2015
    Publication date: December 1, 2016
    Inventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin