Patents by Inventor Edward James Rosten
Edward James Rosten has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11854231Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.Type: GrantFiled: January 31, 2022Date of Patent: December 26, 2023Assignee: Snap Inc.Inventors: Maria Jose Garcia Sopo, Qi Pan, Edward James Rosten
-
Publication number: 20230410461Abstract: A method for detecting a marker in a camera image is described. In one aspect, a method includes accessing a camera image generated by an optical sensor of an augmented reality (AR) device, accessing a query image from a storage of the AR device, and identifying, using a feature detector program, the query image in the camera image without scaling the camera image.Type: ApplicationFiled: June 15, 2023Publication date: December 21, 2023Inventors: Nithin Gollahalli Ananda, Thomas Muttenthaler, Edward James Rosten, Daniel Wolf
-
Publication number: 20230368476Abstract: An augmented reality device generates an updated position and orientation (pose) value by initially determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose. An IMU pose is then obtained from data generated by an inertial measurement unit including motion sensors, and transformation between the pose estimate and the IMU pose is determined. The transformation is applied to the pose estimate to generate a pose update. Media content is applied to a position within an image, the position being based on the pose update.Type: ApplicationFiled: July 12, 2023Publication date: November 16, 2023Inventors: Qi Pan, Edward James Rosten, Andrew Tristan Spek, Supannee Tanathong
-
Patent number: 11810316Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.Type: GrantFiled: April 6, 2022Date of Patent: November 7, 2023Assignee: Snap Inc.Inventors: Patrick Fox-Roberts, Richard McCormack, Qi Pan, Edward James Rosten
-
Patent number: 11748954Abstract: An augmented reality device generates an updated position and orientation (pose) value by initially determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose. An IMU pose is then obtained from data generated by an inertial measurement unit including motion sensors, and transformation between the pose estimate and the IMU pose is determined. The transformation is applied to the pose estimate to generate a pose update. Media content is applied to a position within an image, the position being based on the pose update.Type: GrantFiled: October 29, 2020Date of Patent: September 5, 2023Assignee: Snap Inc.Inventors: Qi Pan, Edward James Rosten, Andrew Tristan Spek, Supannee Tanathong
-
Publication number: 20230177708Abstract: A depth estimation system to perform operations that include: receiving image data generated by a client device, the image data comprising a depiction of an environment; identifying a set of image features based on the image data; determining a pose of the client device based on the set of features; generating a depth estimation based on the image data and the pose of the client device; and generating a mesh model of the environment based on the depth estimation.Type: ApplicationFiled: December 5, 2022Publication date: June 8, 2023Inventors: Erick Mendez Mendez, Isac Andreas Müller Sandvik, Qi Pan, Edward James Rosten, Andrew Tristan Spek, Daniel Wagner, Jakob Zillner
-
Publication number: 20220230351Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.Type: ApplicationFiled: April 6, 2022Publication date: July 21, 2022Inventors: Patrick Fox-Roberts, Richard McCormack, Qi Pan, Edward James Rosten
-
Publication number: 20220156976Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.Type: ApplicationFiled: January 31, 2022Publication date: May 19, 2022Inventors: Maria Jose Garcia Sopo, Qi Pan, Edward James Rosten
-
Patent number: 11335022Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.Type: GrantFiled: June 10, 2020Date of Patent: May 17, 2022Assignee: Snap Inc.Inventors: Patrick Fox-Roberts, Richard McCormack, Qi Pan, Edward James Rosten
-
Patent number: 11276201Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.Type: GrantFiled: June 1, 2020Date of Patent: March 15, 2022Assignee: Snap Inc.Inventors: Maria Jose Garcia Sopo, Qi Pan, Edward James Rosten
-
Publication number: 20210390729Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.Type: ApplicationFiled: June 10, 2020Publication date: December 16, 2021Inventors: Patrick Fox-Roberts, Richard McCormack, Qi Pan, Edward James Rosten
-
Publication number: 20210375054Abstract: An augmented reality device generates an updated position and orientation (pose) value by initially determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose. An IMU pose is then obtained from data generated by an inertial measurement unit including motion sensors, and transformation between the pose estimate and the IMU pose is determined. The transformation is applied to the pose estimate to generate a pose update. Media content is applied to a position within an image, the position being based on the pose update.Type: ApplicationFiled: October 29, 2020Publication date: December 2, 2021Inventors: Qi Pan, Edward James Rosten, Andrew Tristan Spek, Supannee Tanathong