Patents by Inventor Michael Krainin
Michael Krainin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250356562Abstract: Systems and methods for converting two-dimensional (2D) static images to three-dimensional (3D) animated images are provided. Such a method includes: receiving, by a server device, one or more 2D static images, each 2D static image of the one or more 2D static images depicting a respective environment; generating a 3D mesh based on a 2D static image of the one or more 2D static images; determining a visual perspective trajectory along the 3D mesh, the visual perspective trajectory indicative of simulated movement within a 3D animated image at least partially along an axis associated with depth in the respective environment depicted by the 2D static image; and generating the 3D animated image based on the 3D mesh and the visual perspective trajectory such that the 3D animated image replicates the simulated movement.Type: ApplicationFiled: May 16, 2024Publication date: November 20, 2025Inventors: Yuchen Zhang, Xiaohang Li, Michael Krainin, Dongdong Wang
-
Publication number: 20250310646Abstract: This document describes systems and techniques directed at fusing optically zoomed images into one digitally zoomed image. In aspects, a computing device having at least two cameras and an image-processing manager is configured to receive, from a first camera, a first image at a first optical zoom and, from a second camera, a second image at a second optical zoom different from the first optical zoom. The first and second cameras capture a same scene from different fields of view and different points of view. The image-processing manager receives a desired digital zoom between the first optical zoom and the second optical zoom. Based on the first and second images, the image-processing manager determines an overlap region of the first image in which the second image overlaps the first image.Type: ApplicationFiled: May 17, 2022Publication date: October 2, 2025Inventors: Xiaotong Wu, Chia-Kai Liang, Wei-Sheng Lai, Yichang Shih, Deqing Sun, Michael Krainin, Lun-Cheng Chu
-
Publication number: 20250191206Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.Type: ApplicationFiled: February 24, 2025Publication date: June 12, 2025Inventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
-
Patent number: 12260572Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.Type: GrantFiled: August 5, 2021Date of Patent: March 25, 2025Assignee: Google LLCInventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
-
Publication number: 20240249422Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.Type: ApplicationFiled: August 5, 2021Publication date: July 25, 2024Inventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
-
Patent number: 11483463Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.Type: GrantFiled: May 26, 2020Date of Patent: October 25, 2022Assignee: Google LLCInventors: Julia Winn, Abraham Stephens, Daniel Pettigrew, Aaron Maschinot, Ce Liu, Michael Krainin, Michael Rubinstein, Jingyu Cui
-
Publication number: 20200282811Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.Type: ApplicationFiled: May 26, 2020Publication date: September 10, 2020Applicant: Google LLCInventors: Julia WINN, Abraham STEPHENS, Daniel PETTIGREW, Aaron MASCHINOT, Ce LIU, Michael KRAININ, Michael RUBINSTEIN, Jingyu CUI
-
Patent number: 10675955Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.Type: GrantFiled: November 14, 2017Date of Patent: June 9, 2020Assignee: Google LLCInventors: Julia Winn, Abraham Stephens, Daniel Pettigrew, Aaron Maschinot, Ce Liu, Michael Krainin, Michael Rubinstein, Jingyu Cui
-
Patent number: 10375381Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.Type: GrantFiled: December 15, 2017Date of Patent: August 6, 2019Assignee: GOOGLE LLCInventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin
-
Patent number: 10244226Abstract: Systems and methods are related to a camera rig and generating stereoscopic panoramas from captured images for display in a virtual reality (VR) environment.Type: GrantFiled: May 27, 2016Date of Patent: March 26, 2019Assignee: Google LLCInventors: Joshua Weaver, Robert Anderson, Changchang Wu, Michael Krainin, David Gallup, Steven Maxwell Seitz, Carlos Hernandez Esteban, Matthew Thomas Valente, Christopher Edward Hoover, Erik Hubert Dolly Goossens
-
Publication number: 20180160106Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.Type: ApplicationFiled: December 15, 2017Publication date: June 7, 2018Inventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin
-
Patent number: 9877016Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.Type: GrantFiled: May 27, 2015Date of Patent: January 23, 2018Assignee: Google LLCInventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin
-
Publication number: 20160352982Abstract: Systems and methods are related to a camera rig and generating stereoscopic panoramas from captured images for display in a virtual reality (VR) environment.Type: ApplicationFiled: May 27, 2016Publication date: December 1, 2016Inventors: Joshua Weaver, Robert Anderson, Changchang Wu, Michael Krainin, David Gallup, Steven Maxwell Seitz, Carlos Hernandez Esteban, Matthew Thomas Valente, Christopher Edward Hoover, Erik Hubert Dolly Goossens
-
Publication number: 20160353090Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.Type: ApplicationFiled: May 27, 2015Publication date: December 1, 2016Inventors: Carlos Hernandez Esteban, Robert Anderson, Changchang Wu, Michael Krainin