Patents by Inventor Nicholas Butko
Nicholas Butko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230206565Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.Type: ApplicationFiled: November 7, 2022Publication date: June 29, 2023Inventors: Erik Murphy-Chutorian, Nicholas Butko, Rigel Gareth Benton, Dat Chu, Scott Pollack, Alvin Portillo
-
Publication number: 20230147561Abstract: Implementations generally relate to metaverse content modality mapping. In some implementations, a method includes obtaining functionality developed for a first modality of a virtual environment. The method further includes mapping the functionality to a second modality of the virtual environment. The method further includes executing the functionality developed for the first modality based on user interaction associated with the second modality.Type: ApplicationFiled: November 7, 2022Publication date: May 11, 2023Inventors: Erik Murphy-Chutorian, Nicholas Butko, Thomas Emrich, Joel Udwin, Rigel Gareth Benton, Christoph Michael Bartschat
-
Patent number: 11494987Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.Type: GrantFiled: September 6, 2018Date of Patent: November 8, 2022Inventors: Erik Murphy-Chutorian, Nicholas Butko, Rigel Benton, Dat Chu, Scott Pollack, Alvin Portillo
-
Patent number: 10977810Abstract: Implementations generally relate to determining camera motion. In one implementation, a method includes capturing a first image and a second image of a physical scene with a camera in respective first and second positions. The method further includes determining first and second image points from the respective first and second image points. The method further includes determining first and second directions of gravity relative to the camera in the respective first and second positions. The method further includes determining a motion of the camera between the capturing of the first image and the capturing of the second image, wherein the determining of the motion of the camera is based at least in part on the first image points, the second image points, the first direction of gravity, and the second direction of gravity.Type: GrantFiled: December 6, 2018Date of Patent: April 13, 2021Inventors: Erik Murphy-Chutorian, Nicholas Butko
-
Patent number: 10909764Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) marker-based tracking. The method further includes determining positions of markers relative to the camera using 6DoF marker-based tracking. The method further includes overlaying virtual content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.Type: GrantFiled: June 25, 2019Date of Patent: February 2, 2021Inventors: Erik Murphy-Chutorian, Nicholas Butko
-
Publication number: 20200410759Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) marker-based tracking. The method further includes determining positions of markers relative to the camera using 6DoF marker-based tracking. The method further includes overlaying virtual content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.Type: ApplicationFiled: June 25, 2019Publication date: December 31, 2020Applicant: 8th Wall Inc.Inventors: Erik Murphy-Chutorian, Nicholas Butko
-
Publication number: 20200184656Abstract: Implementations generally relate to determining camera motion. In one implementation, a method includes capturing a first image and a second image of a physical scene with a camera in respective first and second positions. The method further includes determining first and second image points from the respective first and second image points. The method further includes determining first and second directions of gravity relative to the camera in the respective first and second positions. The method further includes determining a motion of the camera between the capturing of the first image and the capturing of the second image, wherein the determining of the motion of the camera is based at least in part on the first image points, the second image points, the first direction of gravity, and the second direction of gravity.Type: ApplicationFiled: December 6, 2018Publication date: June 11, 2020Inventors: Erik Murphy-Chutorian, Nicholas Butko
-
Publication number: 20200082624Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.Type: ApplicationFiled: September 6, 2018Publication date: March 12, 2020Inventors: Erik Murphy-Chutorian, Nicholas Butko, Rigel Benton, Dat Chu, Scott Pollack, Alvin Portillo
-
Patent number: 10347001Abstract: Implementations generally relate to localizing and mapping. In one implementation, a method includes determining one or more map points in a point cloud space, where the point cloud space corresponds to a real physical environment. The method further includes determining movement information of one or more of the map points, where the determining of the movement information is performed by a neural network. The method further includes determining a self-position in the point cloud space based on the determined movement information.Type: GrantFiled: April 28, 2017Date of Patent: July 9, 2019Inventors: Erik Murphy-Chutorian, Nicholas Butko
-
Patent number: 10257291Abstract: Various embodiments for event-based information sharing are disclosed. In one example embodiment, an event definition describing an event is determined. An event geofence associated with a location of the event is generated and content is shared between invitees attending the event and located within an area of the event geofence.Type: GrantFiled: June 9, 2014Date of Patent: April 9, 2019Assignee: Google LLCInventors: Brian Matiash, Nicholas Butko, David M. Cohen, Emily Chang
-
Publication number: 20180315209Abstract: Implementations generally relate to localizing and mapping. In one implementation, a method includes determining one or more map points in a point cloud space, where the point cloud space corresponds to a real physical environment. The method further includes determining movement information of one or more of the map points, where the determining of the movement information is performed by a neural network. The method further includes determining a self-position in the point cloud space based on the determined movement information.Type: ApplicationFiled: April 28, 2017Publication date: November 1, 2018Inventors: Erik Murphy-Chutorian, Nicholas Butko
-
Patent number: 9619732Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.Type: GrantFiled: July 6, 2015Date of Patent: April 11, 2017Assignee: Google Inc.Inventors: Erik Murphy-Chutorian, Matthew Steiner, Vivek Kwatra, Shengyang Dai, John Spiegel, Nicholas Butko, Falk Sticken, Florian Kriener, Tom Binder, John Flynn, Troy Chinen, Steven Vandebogart, Nikolaos Trogkanis, Ingo Wehmeyer, Matthias Grundmann
-
Patent number: 9582731Abstract: Implementations relate to detecting spherical images. In some implementations, a computer-executed method includes obtaining an image, examining at least one characteristic of the image, and determining that the image is a spherical image based on the at least one examined characteristic. The method modifies metadata associated with the image to designate the image for spherical display.Type: GrantFiled: April 14, 2015Date of Patent: February 28, 2017Assignee: Google Inc.Inventors: Nicholas Butko, Erik Murphy-Chutorian, Evan Rapoport, Scott Ettinger
-
Publication number: 20160283483Abstract: Implementations relate to providing selected images from a set of images. In some implementations, a computer-executed method includes receiving a request from a device for one or more images, where the request specifies one or more specified time periods at each of one or more specified time scales. One or more groups of selected images are determined from a set of images, each group being within one of the one or more specified time periods at one of the one or more specified time scales. One or more of the selected images from the one or more groups are caused to be sent to the device.Type: ApplicationFiled: March 26, 2016Publication date: September 29, 2016Applicant: Google Inc.Inventors: Ruirui JIANG, Nicholas BUTKO, Nan WANG, Wingchi POON, Jingyu CUI, Gurshamnjot SINGH, Loren Frank PUCHALLA FIORE, Shengyang DAI, Aravind KRISHNASWAMY, David LIEB, Anil SABHARWAL
-
Patent number: 9449256Abstract: In some implementations, a method provides image candidates for a user. The method can include applying a plurality of different image adjustment types to an image to produce a plurality of different adjusted images. A score is determined for each of the adjusted images, where each score is based on previous selections by a plurality of persons of other images having one or more characteristics similar to the adjusted images. The method determines one or more candidate images for presentation to a particular user, where each candidate image is obtained from one of the different image adjustment types. The candidate images are determined based on the scores of the adjustment types.Type: GrantFiled: October 31, 2014Date of Patent: September 20, 2016Assignee: Google Inc.Inventors: Aravind Krishnaswamy, Nicholas Butko, Timothy S. St Clair
-
Patent number: 9286710Abstract: Implementations generally relate to generating photo animations. In some implementations, a method includes receives a plurality of photos from a user. The method also includes selecting photos from the plurality of photos that meet one or more predetermined similarity criteria. The method also includes generating an animation using the selected photos.Type: GrantFiled: May 14, 2013Date of Patent: March 15, 2016Assignee: Google Inc.Inventors: Erik Murphy-Chutorian, Josh Wills, Nicholas Butko, Matthew Steiner, Vivek Kwatra, Dave Cohen
-
Patent number: 9280804Abstract: In some implementations, a method rotates images based on image content to correct image orientation. In some implementations, a method includes obtaining one or more identifications of content depicted in an image and determining a current orientation of the content depicted in the image. The current orientation is determined based on the one or more identifications of the content. An amount of rotation for the image is determined that orients the content closer to a predetermined reference orientation than to the current orientation. The image is rotated by the determined amount.Type: GrantFiled: November 16, 2012Date of Patent: March 8, 2016Assignee: Google Inc.Inventors: Aravind Krishnaswamy, Nicholas Butko
-
Publication number: 20160034785Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.Type: ApplicationFiled: July 6, 2015Publication date: February 4, 2016Applicant: GOOGLE INC.Inventors: Erik MURPHY-CHUTORIAN, Matthew STEINER, Vivek KWATRA, Shengyang DAI, John SPIEGEL, Nicholas BUTKO, Falk STICKEN, Florian KRIENER, Tom BINDER, John FLYNN, Troy CHINEN, Steven VANDEBOGART, Nikolaos TROGKANIS, Ingo WEHMEYER, Matthias GRUNDMANN
-
Patent number: 9247106Abstract: In some implementations, a method provides color corrections based on multiple images. In some implementations, a method includes determining one or more characteristics of each of a plurality of source images and determining one or more similarities between the one or more characteristics of different source images. The source images are grouped into one or more groups of one or more target images based on the determined similarities. The method determines and applies one or more color corrections to the one or more target images in at least one of the groups.Type: GrantFiled: March 23, 2015Date of Patent: January 26, 2016Assignee: Google Inc.Inventors: Aravind Krishnaswamy, Nicholas Butko, David Cohen
-
Publication number: 20150304525Abstract: In some implementations, a method provides color corrections based on multiple images. In some implementations, a method includes determining one or more characteristics of each of a plurality of source images and determining one or more similarities between the one or more characteristics of different source images. The source images are grouped into one or more groups of one or more target images based on the determined similarities. The method determines and applies one or more color corrections to the one or more target images in at least one of the groups.Type: ApplicationFiled: March 23, 2015Publication date: October 22, 2015Applicant: GOOGLE INC.Inventors: Aravind KRISHNASWAMY, Nicholas BUTKO, David COHEN