Patents by Inventor STEPHAN LEROUX

STEPHAN LEROUX has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240119503
    Abstract: When a person visits a physical retail store, the merchant often does not have enough information about the person to make meaningful product recommendations. Also, a physical retail store typically has products physically distributed throughout the store. It may be desirable to have some sort of relationship between where the customer is and the location of the product being recommended. In some embodiments, when a person visits the store, a computer determines an identity of the person and generates a product recommendation based on user-specific information for that person. In some embodiments, generating the product recommendation includes detecting that a field of view of a camera of the device has changed, and in response determining a plurality of products within or proximate to a current field of view of the camera. At least one of the plurality of products is then identified as the recommended product.
    Type: Application
    Filed: December 18, 2023
    Publication date: April 11, 2024
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP
  • Publication number: 20240080529
    Abstract: A computer-implemented is disclosed. The method includes: obtaining video data for a video stream; detecting a first object in at least one video frame of the video stream, the first object being one of a first set of defined objects associated with the video stream; and in response to detecting the first object: identifying the first object as a current target object associated with the video stream; and causing display of the current target object as an object of interest in at least one subsequent video frame of the video stream.
    Type: Application
    Filed: September 2, 2022
    Publication date: March 7, 2024
    Applicant: Shopify Inc.
    Inventor: Stephan LEROUX
  • Publication number: 20240071015
    Abstract: Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.
    Type: Application
    Filed: October 25, 2023
    Publication date: February 29, 2024
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP, MAAS MANSOOR ALI LALANI
  • Patent number: 11908159
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: February 20, 2024
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Patent number: 11893693
    Abstract: Generating and storing digital media can be resource intensive processes. Some systems and methods disclosed herein relate to generating digital media using a pre-existing three-dimensional (3D) model of an object and feature points of the object. According to an embodiment, a method includes an e-commerce platform receiving a request for digital media depicting an object. In response to the request, the e-commerce platform may obtain a 3D model corresponding to the object and data pertaining to one or more feature points of the object. The one or more feature points may correspond to respective views of the 3D model. The e-commerce platform may then generate the digital media based on the 3D model and the one or more feature points, where the digital media could include renders of the 3D model depicting the one or more feature points.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: February 6, 2024
    Inventors: Jonathan Wade, Juho Mikko Haapoja, Stephan Leroux, Daniel Beauchamp
  • Patent number: 11887173
    Abstract: When a person visits a physical retail store, the merchant often does not have enough information about the person to make meaningful product recommendations. Also, a physical retail store typically has products physically distributed throughout the store. It may be desirable to have some sort of relationship between where the customer is and the location of the product being recommended. In some embodiments, when a person visits the store, a computer determines an identity of the person and generates a product recommendation based on user-specific information for that person. In some embodiments, generating the product recommendation includes detecting that a field of view of a camera of the device has changed, and in response determining a plurality of products within or proximate to a current field of view of the camera. At least one of the plurality of products is then identified as the recommended product.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: January 30, 2024
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20240029294
    Abstract: An image processing system accesses an image depicting a particular object. The system identifies a location of the particular object within the image and defines, based on the identified location of the particular object within the image, a focal region of the image. The focal region can be used to modify the image for delivery and presentation on a webpage or software application.
    Type: Application
    Filed: July 21, 2022
    Publication date: January 25, 2024
    Inventor: Stephan LEROUX
  • Publication number: 20240020914
    Abstract: A system and method are provided for generating 2D electronic images of virtual 3D models using imaging parameters determined from 2D images of other objects. The method includes determining, based on one or more 2D images of a first object arranged in a particular manner, a viewpoint capable of generating the one or more 2D images of the first object arranged in the particular manner. The method also includes generating a set of one or more 2D images of a second object, the generating including rendering a virtual 3D model of the second object according to the viewpoint. Related computer-readable media are also disclosed.
    Type: Application
    Filed: July 12, 2022
    Publication date: January 18, 2024
    Applicant: Shopify Inc.
    Inventor: Stephan LEROUX
  • Patent number: 11847716
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Grant
    Filed: November 8, 2022
    Date of Patent: December 19, 2023
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Patent number: 11847736
    Abstract: The consistent use of lighting in different instances of digital media may help ensure that objects are depicted in a similar manner in the digital media. However, in some cases, a three-dimensional (3D) model may depict an object under lighting conditions that differ from the lighting conditions depicted in other digital media. The present disclosure provides systems and methods for generating 3D models to include lighting that is consistent with the lighting used in other digital media. According to an embodiment, a lighting template is determined based on digital media depicting a first physical object. A modified 3D model of a second physical object is then generated based on the lighting template to light the second physical object according to the lighting template.
    Type: Grant
    Filed: April 22, 2021
    Date of Patent: December 19, 2023
    Assignee: SHOPIFY INC.
    Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20230394131
    Abstract: The present disclosure provides a system and method for object verification. The method comprises obtaining sensor data, from one or more sensors, the sensor data including measurements of one or more physical properties of a given three-dimensional (3D) object, wherein the sensor data comprises a first measurement of the one or more physical properties from a first perspective and a second measurement of the one or more physical properties from a second perspective, the second perspective being different from the first perspective. The method further comprises comparing the sensor data with reference data, the reference data including measurements of one or more corresponding physical properties of a reference 3D object, and generating, based on the comparing, a verification signal indicating a determined match between the given 3D object and the reference 3D object.
    Type: Application
    Filed: June 3, 2022
    Publication date: December 7, 2023
    Inventors: Jonathan WADE, Stephan LEROUX, Daniel BEAUCHAMP, Andrew NGO
  • Patent number: 11836877
    Abstract: Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.
    Type: Grant
    Filed: June 21, 2022
    Date of Patent: December 5, 2023
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp, Maas Mansoor Ali Lalani
  • Patent number: 11810218
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: November 7, 2023
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20230260241
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Application
    Filed: April 27, 2023
    Publication date: August 17, 2023
    Inventors: Byron LEONEL DELGADO, Stephan LEROUX, Daniel BEAUCHAMP
  • Publication number: 20230214909
    Abstract: A merchant may operate a retail store that users are able to visit in person in order to view and purchase products. When a user visits the store, the user might not know where a desired product (“target product”) is located. Computer technology may help direct the user to the target product in real-time. In some embodiments, a model of passable areas and the location of products in the retail store may be determined, e.g. by a merchant device. In some embodiments, when the user visits the retail store, a computer generates a product recommendation, e.g. based on user-specific information, and a route in the retail store is determined for the user. In some embodiments, the route in the retail store may be determined using the model based on the target product, the user's location in the store, and one or more recommended products.
    Type: Application
    Filed: March 15, 2023
    Publication date: July 6, 2023
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp, Maas Mansoor Ali Lalani
  • Patent number: 11670065
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Grant
    Filed: February 3, 2022
    Date of Patent: June 6, 2023
    Assignee: SHOPIFY INC.
    Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Patent number: 11631122
    Abstract: A merchant may operate a retail store that users are able to visit in person in order to view and purchase products. When a user visits the store, the user might not know where a desired product (“target product”) is located. Computer technology may help direct the user to the target product in real-time. In some embodiments, a model of passable areas and the location of products in the retail store may be determined, e.g. by a merchant device. In some embodiments, when the user visits the retail store, a computer generates a product recommendation, e.g. based on user-specific information, and a route in the retail store is determined for the user. In some embodiments, the route in the retail store may be determined using the model based on the target product, the user's location in the store, and one or more recommended products.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 18, 2023
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp, Maas Mansoor Ali Lalani
  • Patent number: 11593870
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: February 28, 2023
    Assignee: SHOPIFY INC.
    Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20230056867
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Application
    Filed: November 8, 2022
    Publication date: February 23, 2023
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP
  • Publication number: 20220398809
    Abstract: Generating and storing digital media can be resource intensive processes. Some systems and methods disclosed herein relate to generating digital media using a pre-existing three-dimensional (3D) model of an object and feature points of the object. According to an embodiment, a method includes an e-commerce platform receiving a request for digital media depicting an object. In response to the request, the e-commerce platform may obtain a 3D model corresponding to the object and data pertaining to one or more feature points of the object. The one or more feature points may correspond to respective views of the 3D model. The e-commerce platform may then generate the digital media based on the 3D model and the one or more feature points, where the digital media could include renders of the 3D model depicting the one or more feature points.
    Type: Application
    Filed: June 14, 2021
    Publication date: December 15, 2022
    Inventors: JONATHAN WADE, JUHO MIKKO HAAPOJA, STEPHAN LEROUX, DANIEL BEAUCHAMP