Patents by Inventor Nicholas Butko

Nicholas Butko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230206565
    Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.
    Type: Application
    Filed: November 7, 2022
    Publication date: June 29, 2023
    Inventors: Erik Murphy-Chutorian, Nicholas Butko, Rigel Gareth Benton, Dat Chu, Scott Pollack, Alvin Portillo
  • Publication number: 20230147561
    Abstract: Implementations generally relate to metaverse content modality mapping. In some implementations, a method includes obtaining functionality developed for a first modality of a virtual environment. The method further includes mapping the functionality to a second modality of the virtual environment. The method further includes executing the functionality developed for the first modality based on user interaction associated with the second modality.
    Type: Application
    Filed: November 7, 2022
    Publication date: May 11, 2023
    Inventors: Erik Murphy-Chutorian, Nicholas Butko, Thomas Emrich, Joel Udwin, Rigel Gareth Benton, Christoph Michael Bartschat
  • Patent number: 11494987
    Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.
    Type: Grant
    Filed: September 6, 2018
    Date of Patent: November 8, 2022
    Inventors: Erik Murphy-Chutorian, Nicholas Butko, Rigel Benton, Dat Chu, Scott Pollack, Alvin Portillo
  • Patent number: 10977810
    Abstract: Implementations generally relate to determining camera motion. In one implementation, a method includes capturing a first image and a second image of a physical scene with a camera in respective first and second positions. The method further includes determining first and second image points from the respective first and second image points. The method further includes determining first and second directions of gravity relative to the camera in the respective first and second positions. The method further includes determining a motion of the camera between the capturing of the first image and the capturing of the second image, wherein the determining of the motion of the camera is based at least in part on the first image points, the second image points, the first direction of gravity, and the second direction of gravity.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: April 13, 2021
    Inventors: Erik Murphy-Chutorian, Nicholas Butko
  • Patent number: 10909764
    Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) marker-based tracking. The method further includes determining positions of markers relative to the camera using 6DoF marker-based tracking. The method further includes overlaying virtual content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: February 2, 2021
    Inventors: Erik Murphy-Chutorian, Nicholas Butko
  • Publication number: 20200410759
    Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) marker-based tracking. The method further includes determining positions of markers relative to the camera using 6DoF marker-based tracking. The method further includes overlaying virtual content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.
    Type: Application
    Filed: June 25, 2019
    Publication date: December 31, 2020
    Applicant: 8th Wall Inc.
    Inventors: Erik Murphy-Chutorian, Nicholas Butko
  • Publication number: 20200184656
    Abstract: Implementations generally relate to determining camera motion. In one implementation, a method includes capturing a first image and a second image of a physical scene with a camera in respective first and second positions. The method further includes determining first and second image points from the respective first and second image points. The method further includes determining first and second directions of gravity relative to the camera in the respective first and second positions. The method further includes determining a motion of the camera between the capturing of the first image and the capturing of the second image, wherein the determining of the motion of the camera is based at least in part on the first image points, the second image points, the first direction of gravity, and the second direction of gravity.
    Type: Application
    Filed: December 6, 2018
    Publication date: June 11, 2020
    Inventors: Erik Murphy-Chutorian, Nicholas Butko
  • Publication number: 20200082624
    Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.
    Type: Application
    Filed: September 6, 2018
    Publication date: March 12, 2020
    Inventors: Erik Murphy-Chutorian, Nicholas Butko, Rigel Benton, Dat Chu, Scott Pollack, Alvin Portillo
  • Patent number: 10347001
    Abstract: Implementations generally relate to localizing and mapping. In one implementation, a method includes determining one or more map points in a point cloud space, where the point cloud space corresponds to a real physical environment. The method further includes determining movement information of one or more of the map points, where the determining of the movement information is performed by a neural network. The method further includes determining a self-position in the point cloud space based on the determined movement information.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: July 9, 2019
    Inventors: Erik Murphy-Chutorian, Nicholas Butko
  • Patent number: 10257291
    Abstract: Various embodiments for event-based information sharing are disclosed. In one example embodiment, an event definition describing an event is determined. An event geofence associated with a location of the event is generated and content is shared between invitees attending the event and located within an area of the event geofence.
    Type: Grant
    Filed: June 9, 2014
    Date of Patent: April 9, 2019
    Assignee: Google LLC
    Inventors: Brian Matiash, Nicholas Butko, David M. Cohen, Emily Chang
  • Publication number: 20180315209
    Abstract: Implementations generally relate to localizing and mapping. In one implementation, a method includes determining one or more map points in a point cloud space, where the point cloud space corresponds to a real physical environment. The method further includes determining movement information of one or more of the map points, where the determining of the movement information is performed by a neural network. The method further includes determining a self-position in the point cloud space based on the determined movement information.
    Type: Application
    Filed: April 28, 2017
    Publication date: November 1, 2018
    Inventors: Erik Murphy-Chutorian, Nicholas Butko
  • Patent number: 9619732
    Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.
    Type: Grant
    Filed: July 6, 2015
    Date of Patent: April 11, 2017
    Assignee: Google Inc.
    Inventors: Erik Murphy-Chutorian, Matthew Steiner, Vivek Kwatra, Shengyang Dai, John Spiegel, Nicholas Butko, Falk Sticken, Florian Kriener, Tom Binder, John Flynn, Troy Chinen, Steven Vandebogart, Nikolaos Trogkanis, Ingo Wehmeyer, Matthias Grundmann
  • Patent number: 9582731
    Abstract: Implementations relate to detecting spherical images. In some implementations, a computer-executed method includes obtaining an image, examining at least one characteristic of the image, and determining that the image is a spherical image based on the at least one examined characteristic. The method modifies metadata associated with the image to designate the image for spherical display.
    Type: Grant
    Filed: April 14, 2015
    Date of Patent: February 28, 2017
    Assignee: Google Inc.
    Inventors: Nicholas Butko, Erik Murphy-Chutorian, Evan Rapoport, Scott Ettinger
  • Publication number: 20160283483
    Abstract: Implementations relate to providing selected images from a set of images. In some implementations, a computer-executed method includes receiving a request from a device for one or more images, where the request specifies one or more specified time periods at each of one or more specified time scales. One or more groups of selected images are determined from a set of images, each group being within one of the one or more specified time periods at one of the one or more specified time scales. One or more of the selected images from the one or more groups are caused to be sent to the device.
    Type: Application
    Filed: March 26, 2016
    Publication date: September 29, 2016
    Applicant: Google Inc.
    Inventors: Ruirui JIANG, Nicholas BUTKO, Nan WANG, Wingchi POON, Jingyu CUI, Gurshamnjot SINGH, Loren Frank PUCHALLA FIORE, Shengyang DAI, Aravind KRISHNASWAMY, David LIEB, Anil SABHARWAL
  • Patent number: 9449256
    Abstract: In some implementations, a method provides image candidates for a user. The method can include applying a plurality of different image adjustment types to an image to produce a plurality of different adjusted images. A score is determined for each of the adjusted images, where each score is based on previous selections by a plurality of persons of other images having one or more characteristics similar to the adjusted images. The method determines one or more candidate images for presentation to a particular user, where each candidate image is obtained from one of the different image adjustment types. The candidate images are determined based on the scores of the adjustment types.
    Type: Grant
    Filed: October 31, 2014
    Date of Patent: September 20, 2016
    Assignee: Google Inc.
    Inventors: Aravind Krishnaswamy, Nicholas Butko, Timothy S. St Clair
  • Patent number: 9286710
    Abstract: Implementations generally relate to generating photo animations. In some implementations, a method includes receives a plurality of photos from a user. The method also includes selecting photos from the plurality of photos that meet one or more predetermined similarity criteria. The method also includes generating an animation using the selected photos.
    Type: Grant
    Filed: May 14, 2013
    Date of Patent: March 15, 2016
    Assignee: Google Inc.
    Inventors: Erik Murphy-Chutorian, Josh Wills, Nicholas Butko, Matthew Steiner, Vivek Kwatra, Dave Cohen
  • Patent number: 9280804
    Abstract: In some implementations, a method rotates images based on image content to correct image orientation. In some implementations, a method includes obtaining one or more identifications of content depicted in an image and determining a current orientation of the content depicted in the image. The current orientation is determined based on the one or more identifications of the content. An amount of rotation for the image is determined that orients the content closer to a predetermined reference orientation than to the current orientation. The image is rotated by the determined amount.
    Type: Grant
    Filed: November 16, 2012
    Date of Patent: March 8, 2016
    Assignee: Google Inc.
    Inventors: Aravind Krishnaswamy, Nicholas Butko
  • Publication number: 20160034785
    Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.
    Type: Application
    Filed: July 6, 2015
    Publication date: February 4, 2016
    Applicant: GOOGLE INC.
    Inventors: Erik MURPHY-CHUTORIAN, Matthew STEINER, Vivek KWATRA, Shengyang DAI, John SPIEGEL, Nicholas BUTKO, Falk STICKEN, Florian KRIENER, Tom BINDER, John FLYNN, Troy CHINEN, Steven VANDEBOGART, Nikolaos TROGKANIS, Ingo WEHMEYER, Matthias GRUNDMANN
  • Patent number: 9247106
    Abstract: In some implementations, a method provides color corrections based on multiple images. In some implementations, a method includes determining one or more characteristics of each of a plurality of source images and determining one or more similarities between the one or more characteristics of different source images. The source images are grouped into one or more groups of one or more target images based on the determined similarities. The method determines and applies one or more color corrections to the one or more target images in at least one of the groups.
    Type: Grant
    Filed: March 23, 2015
    Date of Patent: January 26, 2016
    Assignee: Google Inc.
    Inventors: Aravind Krishnaswamy, Nicholas Butko, David Cohen
  • Publication number: 20150304525
    Abstract: In some implementations, a method provides color corrections based on multiple images. In some implementations, a method includes determining one or more characteristics of each of a plurality of source images and determining one or more similarities between the one or more characteristics of different source images. The source images are grouped into one or more groups of one or more target images based on the determined similarities. The method determines and applies one or more color corrections to the one or more target images in at least one of the groups.
    Type: Application
    Filed: March 23, 2015
    Publication date: October 22, 2015
    Applicant: GOOGLE INC.
    Inventors: Aravind KRISHNASWAMY, Nicholas BUTKO, David COHEN