Patents by Inventor STEPHAN LEROUX

STEPHAN LEROUX has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11810218
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: November 7, 2023
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20230260241
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Application
    Filed: April 27, 2023
    Publication date: August 17, 2023
    Inventors: Byron LEONEL DELGADO, Stephan LEROUX, Daniel BEAUCHAMP
  • Publication number: 20230214909
    Abstract: A merchant may operate a retail store that users are able to visit in person in order to view and purchase products. When a user visits the store, the user might not know where a desired product (“target product”) is located. Computer technology may help direct the user to the target product in real-time. In some embodiments, a model of passable areas and the location of products in the retail store may be determined, e.g. by a merchant device. In some embodiments, when the user visits the retail store, a computer generates a product recommendation, e.g. based on user-specific information, and a route in the retail store is determined for the user. In some embodiments, the route in the retail store may be determined using the model based on the target product, the user's location in the store, and one or more recommended products.
    Type: Application
    Filed: March 15, 2023
    Publication date: July 6, 2023
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp, Maas Mansoor Ali Lalani
  • Patent number: 11670065
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Grant
    Filed: February 3, 2022
    Date of Patent: June 6, 2023
    Assignee: SHOPIFY INC.
    Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Patent number: 11631122
    Abstract: A merchant may operate a retail store that users are able to visit in person in order to view and purchase products. When a user visits the store, the user might not know where a desired product (“target product”) is located. Computer technology may help direct the user to the target product in real-time. In some embodiments, a model of passable areas and the location of products in the retail store may be determined, e.g. by a merchant device. In some embodiments, when the user visits the retail store, a computer generates a product recommendation, e.g. based on user-specific information, and a route in the retail store is determined for the user. In some embodiments, the route in the retail store may be determined using the model based on the target product, the user's location in the store, and one or more recommended products.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 18, 2023
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp, Maas Mansoor Ali Lalani
  • Patent number: 11593870
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: February 28, 2023
    Assignee: SHOPIFY INC.
    Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20230056867
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Application
    Filed: November 8, 2022
    Publication date: February 23, 2023
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP
  • Publication number: 20220398809
    Abstract: Generating and storing digital media can be resource intensive processes. Some systems and methods disclosed herein relate to generating digital media using a pre-existing three-dimensional (3D) model of an object and feature points of the object. According to an embodiment, a method includes an e-commerce platform receiving a request for digital media depicting an object. In response to the request, the e-commerce platform may obtain a 3D model corresponding to the object and data pertaining to one or more feature points of the object. The one or more feature points may correspond to respective views of the 3D model. The e-commerce platform may then generate the digital media based on the 3D model and the one or more feature points, where the digital media could include renders of the 3D model depicting the one or more feature points.
    Type: Application
    Filed: June 14, 2021
    Publication date: December 15, 2022
    Inventors: JONATHAN WADE, JUHO MIKKO HAAPOJA, STEPHAN LEROUX, DANIEL BEAUCHAMP
  • Patent number: 11527045
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: December 13, 2022
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20220383397
    Abstract: Disclosed herein are methods and systems for customizing a virtual store based on buyer preferences and movement. A computing system is structured to transmit, to a user device, a 3D virtual environment of a virtual store configured for presenting at least one product from a set of products positioned on a virtual structure simulating a corresponding physical store; determine, based on information received from the user device, a subset of the set of products relevant to a virtual user; and transmit a visual modifier to the user device. The visual modifier is configured to distinguish the subset of the set of products from remaining products in the set of products positioned in the 3D virtual environment.
    Type: Application
    Filed: May 27, 2021
    Publication date: December 1, 2022
    Inventors: Juho Mikko HAAPOJA, Byron Leonel DELGADO, Stephan LEROUX
  • Publication number: 20220383396
    Abstract: Disclosed herein are methods and systems for building and updating a virtual store based on a physical store. A computing system is structured to receive captured images of a physical space having a set of products. The physical space is simulated by a three-dimensional (3D) model of the physical space. A corresponding representation of the set of products is positioned relative to the 3D model. The computing system is structured to detect, based on the captured images, product information for products in the physical space and generate, based on the product information, an updated representation of the set of products based on the product information. The updated representation of the set of products corresponds to the products in the physical space as shown in the captured images.
    Type: Application
    Filed: May 27, 2021
    Publication date: December 1, 2022
    Inventors: Juho Mikko HAAPOJA, Byron Leonel DELGADO, Stephan LEROUX
  • Patent number: 11494153
    Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: November 8, 2022
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
  • Publication number: 20220343592
    Abstract: The consistent use of lighting in different instances of digital media may help ensure that objects are depicted in a similar manner in the digital media. However, in some cases, a three-dimensional (3D) model may depict an object under lighting conditions that differ from the lighting conditions depicted in other digital media. The present disclosure provides systems and methods for generating 3D models to include lighting that is consistent with the lighting used in other digital media. According to an embodiment, a lighting template is determined based on digital media depicting a first physical object. A modified 3D model of a second physical object is then generated based on the lighting template to light the second physical object according to the lighting template.
    Type: Application
    Filed: April 22, 2021
    Publication date: October 27, 2022
    Inventors: BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP
  • Publication number: 20220319133
    Abstract: Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.
    Type: Application
    Filed: June 21, 2022
    Publication date: October 6, 2022
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP, MAAS MANSOOR ALI LALANI
  • Patent number: 11398079
    Abstract: Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: July 26, 2022
    Assignee: SHOPIFY INC.
    Inventors: Juho Mikko Haapoja, Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp, Maas Mansoor Ali Lalani
  • Publication number: 20220157035
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Application
    Filed: February 3, 2022
    Publication date: May 19, 2022
    Inventors: BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP
  • Publication number: 20220129974
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Application
    Filed: October 28, 2020
    Publication date: April 28, 2022
    Inventors: BYRON LEONEL DELGADO, STEPHAN LEROUX, Daniel Beauchamp
  • Publication number: 20220092681
    Abstract: A merchant may operate a retail store that users are able to visit in person in order to view and purchase products. When a user visits the store, the user might not know where a desired product (“target product”) is located. Computer technology may help direct the user to the target product in real-time. In some embodiments, a model of passable areas and the location of products in the retail store may be determined, e.g. by a merchant device. In some embodiments, when the user visits the retail store, a computer generates a product recommendation, e.g. based on user-specific information, and a route in the retail store is determined for the user. In some embodiments, the route in the retail store may be determined using the model based on the target product, the user's location in the store, and one or more recommended products.
    Type: Application
    Filed: September 23, 2020
    Publication date: March 24, 2022
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP, MAAS MANSOOR ALI LALANI
  • Publication number: 20220092857
    Abstract: Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.
    Type: Application
    Filed: September 23, 2020
    Publication date: March 24, 2022
    Inventors: JUHO MIKKO HAAPOJA, BYRON LEONEL DELGADO, STEPHAN LEROUX, DANIEL BEAUCHAMP, MAAS MANSOOR ALI LALANI
  • Patent number: 11276247
    Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: March 15, 2022
    Assignee: SHOPIFY INC.
    Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp