Patents by Inventor Qi Pan

Qi Pan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Location based augmented-reality system
    Patent number: 11335060
    Abstract: A location-based augmented-reality system to generate and cause display of augmented-reality content that includes three-dimensional typography, based on a perspective, and location of a client device.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: May 17, 2022
    Assignee: Snap Inc.
    Inventors: Piers George Cowburn, David Li, Isac Andreas Müller Sandvik, Qi Pan
  • Augmented reality system
    Patent number: 11335067
    Abstract: An augmented reality system to generate and cause display of a presentation of a space at a first client device, receive one or more selections of points within the presentation of the space at the first client device, and render graphical elements at the one or more points within the presentation of the space at the first client device. The augmented reality system is further configured to receive a display request to display the space at a second client device, and in response, may render a second presentation of the space at the second client device, wherein the second presentation of the space includes the graphical elements at the one or more points.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: May 17, 2022
    Assignee: Snap Inc.
    Inventors: Piers Cowburn, Qi Pan, Isac Andreas Müller Sandvik
  • 3D reconstruction using wide-angle imaging devices
    Patent number: 11335022
    Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.
    Type: Grant
    Filed: June 10, 2020
    Date of Patent: May 17, 2022
    Assignee: Snap Inc.
    Inventors: Patrick Fox-Roberts, Richard McCormack, Qi Pan, Edward James Rosten
  • SHARED AUGMENTED REALITY SYSTEM
    Publication number: 20220148309
    Abstract: An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.
    Type: Application
    Filed: January 26, 2022
    Publication date: May 12, 2022
    Inventors: David Li, Isac Andreas Müller Sandvik, Qi Pan, Rastan Boroujerdi, Kevin Yimeng Hong, Peng Deng, Piers George Cowburn, Jonathan Tang, Junjie Wei
  • Localizing an augmented reality device
    Patent number: 11276201
    Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: March 15, 2022
    Assignee: Snap Inc.
    Inventors: Maria Jose Garcia Sopo, Qi Pan, Edward James Rosten
  • AUGMENTED REALITY TYPOGRAPHY PERSONALIZATION SYSTEM
    Publication number: 20220076017
    Abstract: Disclosed are augmented reality (AR) personalization systems to enable a user to edit and personalize presentations of real-world typography in real-time. The AR personalization system captures an image depicting a physical location via a camera coupled to a client device. For example, the client device may include a mobile device that includes a camera configured to record and display images (e.g., photos, videos) in real-time. The AR. personalization system causes display of the image at the client device, and scans the image to detect occurrences of typography within the image (e.g., signs, billboards, posters, graffiti).
    Type: Application
    Filed: November 17, 2021
    Publication date: March 10, 2022
    Inventors: Piers Cowburn, Qi Pan, Eitan Pilipski
  • Shared augmented reality system
    Patent number: 11263459
    Abstract: An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: March 1, 2022
    Assignee: Snap Inc.
    Inventors: David Li, Isac Andreas Müller Sandvik, Qi Pan, Rastan Boroujerdi, Kevin Yimeng Hong, Peng Deng, Piers George Cowburn, Jonathan Tang, Junjie Wei
  • Complex query optimization
    Patent number: 11243961
    Abstract: Disclosed is a computer implemented method and related system to improve the efficiency of querying remote databases. The method includes receiving, from a host, a query, wherein the query is configured to retrieve a set of data from a remote database. The method also includes, generating an access plan, the access plan comprising a plurality of nodes wherein each node of the plurality of nodes includes a command. The method further includes determining capabilities of the remote database. The method includes executing the query and returning the set of data to the host.
    Type: Grant
    Filed: November 25, 2019
    Date of Patent: February 8, 2022
    Assignee: International Business Machines Corporation
    Inventors: Ya Qiong Liu, Xue Huang, Ping Liu, Lei Cui, Ying Qi Pan
  • AUGMENTED REALITY SPEECH BALLOON SYSTEM
    Publication number: 20210407533
    Abstract: Disclosed is an augmented reality system to generate and cause display of an augmented reality interface at a client device. Various embodiments may detect speech, identify a source of the speech, transcribe the speech to a text string, generate a speech bubble based on properties of the speech and that includes a presentation of the text string, and cause display of the speech bubble at a location in the augmented reality interface based on the source of the speech.
    Type: Application
    Filed: September 14, 2021
    Publication date: December 30, 2021
    Inventors: Piers Cowburn, Qi Pan, Eitan Pilipski
  • 3D RECONSTRUCTION USING WIDE-ANGLE IMAGING DEVICES
    Publication number: 20210390729
    Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.
    Type: Application
    Filed: June 10, 2020
    Publication date: December 16, 2021
    Inventors: Patrick Fox-Roberts, Richard McCormack, Qi Pan, Edward James Rosten
  • Augmented reality typography personalization system
    Patent number: 11195018
    Abstract: Disclosed are augmented reality (AR) personalization systems to enable a user to edit and personalize presentations of real-world typography in real-time. The AR personalization system captures an image depicting a physical location via a camera coupled to a client device. For example, the client device may include a mobile device that includes a camera configured to record and display images (e.g., photos, videos) in real-time. The AR personalization system causes display of the image at the client device, and scans the image to detect occurrences of typography within the image (e.g., signs, billboards, posters, graffiti).
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: December 7, 2021
    Assignee: Snap Inc.
    Inventors: Piers Cowburn, Qi Pan, Eitan Pilipski
  • TRACKING AN AUGMENTED REALITY DEVICE
    Publication number: 20210375054
    Abstract: An augmented reality device generates an updated position and orientation (pose) value by initially determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose. An IMU pose is then obtained from data generated by an inertial measurement unit including motion sensors, and transformation between the pose estimate and the IMU pose is determined. The transformation is applied to the pose estimate to generate a pose update. Media content is applied to a position within an image, the position being based on the pose update.
    Type: Application
    Filed: October 29, 2020
    Publication date: December 2, 2021
    Inventors: Qi Pan, Edward James Rosten, Andrew Tristan Spek, Supannee Tanathong
  • Processing uncertain content in a computer graphics system
    Patent number: 11188739
    Abstract: An example method includes: obtaining, from computer memory, information from a three-dimensional (3D) graphical model that represents an object; identifying, based on the information, a first part of the object having an attribute; performing a recognition process on the object based on features of the object, where the recognition process attaches more importance to a second part of the object than to the first part, with the second part either not having the attribute or having less of the attribute than the first part; and providing data for rendering content on a graphical user interface based, at least in part, on recognition of the object performed by the recognition process.
    Type: Grant
    Filed: January 21, 2020
    Date of Patent: November 30, 2021
    Assignee: PTC INC.
    Inventors: Stephen Prideaux-Ghee, Andre Gosselin, Per Nielsen, Vincent Del Castillo, Qi Pan, Michael Gervautz
  • Augmented reality speech balloon system
    Patent number: 11189299
    Abstract: Disclosed is an augmented reality system to generate and cause display of an augmented reality interface at a client device. Various embodiments may detect speech, identify a source of the speech, transcribe the speech to a text string, generate a speech bubble based on properties of the speech and that includes a presentation of the text string, and cause display of the speech bubble at a location in the augmented reality interface based on the source of the speech.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: November 30, 2021
    Assignee: Snap Inc.
    Inventors: Piers Cowburn, Qi Pan, Eitan Pilipski
  • INTERACTIVE AUGMENTED REALITY SYSTEM
    Publication number: 20210343050
    Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.
    Type: Application
    Filed: July 12, 2021
    Publication date: November 4, 2021
    Inventors: David Li, Piers George Cowburn, Isac Andreas Müller Sandvik, Qi Pan
  • OCCLUSION DETECTION SYSTEM
    Publication number: 20210326635
    Abstract: An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.
    Type: Application
    Filed: June 29, 2021
    Publication date: October 21, 2021
    Inventors: Piers Cowburn, David Li, Isac Andreas Müller Sandvik, Qi Pan
  • Occlusion detection system
    Patent number: 11151408
    Abstract: An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.
    Type: Grant
    Filed: September 10, 2019
    Date of Patent: October 19, 2021
    Assignee: Snap Inc.
    Inventors: Piers Cowburn, David Li, Isac Andreas Müller Sandvik, Qi Pan
  • GESTURE-BASED SHARED AR SESSION CREATION
    Publication number: 20210303075
    Abstract: Method of creating shared AR session based on a gesture starts with server receiving observed motion data from first device associated with first user. First device generating observed motion data based on an analysis of data stream comprising images of second user performing a gesture. Second user being associated with second device. Server receiving from second device captured motion data that corresponds to the gesture. Captured motion data being recorded by a sensor included in second device. Server determines whether there is a match between observed motion data from first device and captured motion data from second device. In response to determining that there is the match, server generates shared AR session between first device and second device and causes shared AR session to be displayed by first device and second device. Other embodiments are described herein.
    Type: Application
    Filed: August 3, 2020
    Publication date: September 30, 2021
    Inventors: Piers George Cowburn, David Li, Isac Andreas Müller Sandvik, Qi Pan
  • DEPTH ESTIMATION USING BIOMETRIC DATA
    Publication number: 20210304429
    Abstract: Method of generating depth estimate based on biometric data starts with server receiving positioning data from first device associated with first user. First device generates positioning data based on analysis of a data stream comprising images of second user that is associated with second device. Server then receives a biometric data of second user from second device. Biometric data is based on output from a sensor or a camera included in second device. Server then determines a distance of second user from first device using positioning data and biometric data of the second user. Other embodiments are described herein.
    Type: Application
    Filed: August 3, 2020
    Publication date: September 30, 2021
    Inventors: Piers George Cowburn, David Li, Isac Andreas Muller Sandvik, Qi Pan
  • SHARED AUGMENTED REALITY SYSTEM
    Publication number: 20210303859
    Abstract: An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.
    Type: Application
    Filed: December 11, 2020
    Publication date: September 30, 2021
    Inventors: David Li, Isac Andreas Müller Sandvik, Qi Pan, Rastan Boroujerdi, Kevin Yimeng Hong, Peng Deng, Piers George Cowburn, Jonathan Tang, Junjie Wei