Patents by Inventor Jean Luo

Jean Luo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11308327
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.
    Type: Grant
    Filed: January 14, 2021
    Date of Patent: April 19, 2022
    Assignee: Snap Inc.
    Inventors: Virginia Drummond, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
  • Publication number: 20220101419
    Abstract: The subject technology receives information for a product. The subject technology generates a 3D model file of the product in a first format. The subject technology converts the 3D model file to a 3D object file in a second format. The subject technology associates the 3D object file to the product in a product catalog service. The subject technology publishes an augmented reality (AR) content generator corresponding to the product.
    Type: Application
    Filed: September 29, 2021
    Publication date: March 31, 2022
    Inventors: Jean Luo, Ibram Uppal
  • Publication number: 20220101418
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving, by a messaging application running on a device of a user, a request to present augmented reality content in association with an image captured by a device camera, the image depicting a face of the user; accessing an augmented reality content item configured to generate a plurality of completed looks with respect to applying makeup to the face; presenting the augmented reality content item, including the plurality of completed looks, in association with the face depicted in the image; receiving user input selecting a completed look of the plurality of completed looks; and displaying, in response to receiving the user input, an interface with a set of makeup products associated with the selected completed look.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 31, 2022
    Inventors: Serhii Dehtiarov, Yuliia Khoryshko, Jean Luo, Bogdan Maksymchuk, Vincent Sung, Evelina Yatselenko
  • Publication number: 20220103969
    Abstract: In one or more implementations, a user of a client application may share the location of the user in relation to an avatar of the user. In various examples, an avatar-based location sharing user interface element may be selectable to execute an augmented reality content item that is executable to make the location of the user accessible to one or more additional users of the client application. In one or more examples, a message may be generated that includes user content captured at a location of the user, an avatar of the user, and location information related to the location of the user. In one or more additional examples, the location of the user may be accessible via a map user interface that displays the avatar of the user at the location of the user within a geographic region.
    Type: Application
    Filed: March 16, 2021
    Publication date: March 31, 2022
    Inventors: Virginia Drummond, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
  • Publication number: 20220100812
    Abstract: The subject technology causes, at a client device, display of a graphical interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective content item associated with a different geolocation. The subject technology receives, at the client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item corresponding to a particular geolocation. The subject technology causes display, at the client device, a second plurality of selectable graphical items, each of the second plurality of selectable graphical items corresponding to a particular second geolocation of an activity or place of business within a geographical area associated with the particular geolocation.
    Type: Application
    Filed: January 12, 2021
    Publication date: March 31, 2022
    Inventors: Kaveh Anvaripour, Virginia Drummond, Erika Michele Kehrwald, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
  • Publication number: 20220101404
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing make-up based augmented reality content. The program and method provide for receiving a request to present augmented reality content in association with a captured image depicting a face of the user; accessing an augmented reality content item associated with applying makeup to the face and configured to generate a mesh for tracking plural regions of the face; receiving user input selecting a region; determining at least one of a range of color values or a range of contrast values relating to available makeup products for the selected region; and presenting an interface element in association with the face, the interface element for user selection of at least one of a color value within the range of color values or a contrast value within the range of contrast values.
    Type: Application
    Filed: August 4, 2021
    Publication date: March 31, 2022
    Inventors: Riccardo Boscolo, Jean Luo, Vincent Sung, Ibram Uppal
  • Publication number: 20220101349
    Abstract: The subject technology determines monthly active users (MAU) and penetration for global users and users in a specific country. The subject technology predicts monetization values for the users in the specific country. The subject technology determines a lifetime value of the users in the specific country based at least in part on the monetization values. The subject technology selects at least one augmented reality (AR) content generator based at least in part on the determined lifetime value of the users in the specific country. The subject technology causes, at a client device, display of the at least one AR content generator.
    Type: Application
    Filed: September 29, 2021
    Publication date: March 31, 2022
    Inventors: Jean Luo, Zhehao Zhou
  • Publication number: 20220101416
    Abstract: Augmented reality content item templates may be used to generate augmented reality content items that are executable to display content corresponding to products offered for purchase to users of a client application. The augmented reality content item templates may include regions that may be populated according to information related to individual products. In this way an augmented reality content item template may be used to generate augmented reality content items that are customized based on the information about the individual products. The augmented reality content item templates may be classified according to a classification system such that augmented reality content item templates corresponding to a respective classification may be used to generate augmented reality content items for products that also correspond to the respective classification.
    Type: Application
    Filed: August 13, 2021
    Publication date: March 31, 2022
    Inventors: Riccardo Boscolo, Stiven Deleur, Alona Kotliar, Jean Luo, Vincent Sung, Ashley Michelle Wayne
  • Publication number: 20220101614
    Abstract: The subject technology identifies a set of graphical elements in an augmented reality (AR) facial pattern. The subject technology determines at least one primitive shape based on the set of graphical elements. The subject technology generates a JavaScript Object Notation (JSON) file using at least one primitive shape. The subject technology generates internal facial makeup format (IFM) data using the JSON file. The subject technology publishes the IFM data to a product catalog service.
    Type: Application
    Filed: September 29, 2021
    Publication date: March 31, 2022
    Inventors: Jean Luo, Ibram Uppal
  • Publication number: 20220101565
    Abstract: The subject technology causes display, at the client device, a set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the particular augmented reality content item corresponding to the destination geolocation. The subject technology causes display, at the client device, a second set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the second set of augmented reality content items. The subject technology causes display, at the client device, a third set of augmented reality content items generated by the first augmented reality content generator, the third set of augmented reality content items comprising at least one activity or location associated with the destination geolocation and a selected period of time.
    Type: Application
    Filed: April 20, 2021
    Publication date: March 31, 2022
    Inventors: Kaveh Anvaripour, Virginia Drummond, Jean Luo, Alek Matthiessen, Charles Melbye, Celia Nicole Mourkogiannis
  • Publication number: 20220100336
    Abstract: Usage metrics for augmented reality content may be identified and analyzed to determine measures of fitness for respective usage metrics. The measures of fitness may indicate a level of correlation with an outcome specified by an augmented reality content creator and an amount of interaction with an augmented reality content item by users of a client application. Recommendations may be provided to augmented reality content creators indicating modifications to augmented reality content items that have at least a threshold probability of increasing the level of interaction between users of the client application and the augmented reality content item.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 31, 2022
    Inventors: Jean Luo, Per Sandell, Vincent Sung
  • Publication number: 20220101361
    Abstract: The amount of user activity performed in relation to a promotion may be tracked based on user content captured via the client application. At least a portion of user content captured via the client application may be scanned and analyzed to identify user activity related to the user content. Augmented reality content items may be executable to generate content that is displayed in relation to the user content and that indicates an amount of user activity related to the promotion. In addition, the augmented reality content items may be executable to generate content in relation to the user content that indicates one or more redemption options for the promotion based on an amount of user activity performed by a user of the client application that captured the user content.
    Type: Application
    Filed: January 20, 2021
    Publication date: March 31, 2022
    Inventors: Virginia Drummond, Erika Michele Kehrwald, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
  • Publication number: 20220101610
    Abstract: The subject technology receives, at a client device, a selection of a first selectable graphical item, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, of a graphical interface comprising a plurality of selectable augmented reality content items, each selectable augmented reality content item corresponding to a particular activity based at in part on the particular geolocation. The subject technology receives, at the client device, a second selection of a particular selectable augmented reality content item from the plurality of selectable augmented reality content items.
    Type: Application
    Filed: January 12, 2021
    Publication date: March 31, 2022
    Inventors: Kaveh Anvaripour, Ilteris Kaan Canberk, Virginia Drummond, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
  • Publication number: 20220101566
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving a request to present augmented reality content in association with an image captured by a device camera, the image depicting a user's face; accessing an augmented reality content item applying makeup to the face, the augmented reality content configured to generate a mesh for tracking plural regions of the face and to present available makeup products with respect to the plural regions; presenting the augmented reality content item in association with the face depicted in the image; receiving user input selecting a region of the plural regions; determining a set of available makeup products corresponding to the selected region; and updating presentation of the augmented reality content item based on the set of available makeup products.
    Type: Application
    Filed: August 4, 2021
    Publication date: March 31, 2022
    Inventors: Riccardo Boscolo, Jean Luo, Vincent Sung, Ibram Uppal
  • Publication number: 20220101417
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content for clothing. The program and method provide for receiving a request to present augmented reality content in association with an image depicting a body part of a user; accessing an augmented reality content item corresponding to an article of clothing, the augmented reality content being configured to track plural points of the body part and to generate a transform based on the plural points, the transform corresponding to the article of clothing and defining plural regions for the article of clothing; presenting the augmented reality content item in association with the body part; receiving user input selecting a region; determining a set of options corresponding to the region; and updating presentation of the augmented reality content item based on the set of options.
    Type: Application
    Filed: September 15, 2021
    Publication date: March 31, 2022
    Inventors: Riccardo Boscolo, Jean Luo, Vincent Sung, Ibram Uppal
  • Publication number: 20220101355
    Abstract: The subject technology determines a transaction recency and frequency distribution. The subject technology determines a future monetary value. The subject technology determines monthly active users (MAU) and penetration for global users and users in a specific country. The subject technology predicts monetization values for the users in the specific country. The subject technology determines a lifetime value of the users in the specific country based at least in part on the monetization values.
    Type: Application
    Filed: September 29, 2021
    Publication date: March 31, 2022
    Inventors: Jean Luo, Zhehao Zhou
  • Publication number: 20220101606
    Abstract: The subject technology selects a set of augmented reality content generators from a plurality of augmented reality content generators. The subject technology causes display, at a client device, of a graphical interface comprising a plurality of selectable graphical items. The subject technology receives, at the client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, at least one augmented content reality item generated by the first augmented reality content generator.
    Type: Application
    Filed: April 20, 2021
    Publication date: March 31, 2022
    Inventors: Ilteris Kaan Canberk, Virginia Drummond, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
  • Patent number: 11237702
    Abstract: The subject technology retrieves, by a client device from a storage device, first image data previously captured by the client device. The subject technology selects a set of media overlays, each respective media overlay including a category indicator and the set of media overlays is selected based on matching of the category indicator among respective media overlays from the set of media overlays. The subject technology causes display of a carousel interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective media overlay of the set of media overlays. The subject technology receives a selection of a first selectable graphical item from the plurality of selectable graphical items. The subject technology applies, to the first image data, a first media overlay corresponding to the selected first selectable graphical item.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: February 1, 2022
    Assignee: Snap Inc.
    Inventors: Jean Luo, Oleksandr Grytsiuk, Yichuan Wang, Shannon Ward
  • Publication number: 20220020194
    Abstract: Systems and methods described herein provide for retrieving, from a storage device, first image data previously captured by a client device. The systems and methods further detect a selection of a first image processing operation and perform the first image processing operation on the first image data to generate second image data. The systems and methods further detect a selection of a second image processing operation and perform the second image processing operation on the second image data to generate third image data. The systems and methods generate a message comprising the third image data.
    Type: Application
    Filed: September 29, 2021
    Publication date: January 20, 2022
    Inventors: Jean Luo, Oleksandr Grytsiuk, Chenguang Liu, Oleksii Gordiienko
  • Publication number: 20210406543
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.
    Type: Application
    Filed: January 14, 2021
    Publication date: December 30, 2021
    Inventors: Virginia Drummond, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis