Patents by Inventor Brennan LETKEMAN
Brennan LETKEMAN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240338902Abstract: Described herein are systems and methods for generating AR-enriched media feeds for comparing attributes of objects. A user operates an AR device to collect or extract object information in a media feed including a current object. The AR device identifies a comparison object using attributes of the current baseline object. After the comparison object has been identified, the AR device generates and presents an AR overlay in the graphical user interface that shows the selected attribute of the comparison object nearby or on top of the attribute of the current object in the real time media feed containing the current object.Type: ApplicationFiled: April 10, 2023Publication date: October 10, 2024Applicant: Shopify Inc.Inventors: Russ Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp
-
Patent number: 12111973Abstract: The present disclosure provides AR systems and methods. The computer-implemented method comprises displaying, on a mobile device, a rendered virtual object in an augmented reality (AR) scene, and detecting, using an input device of the mobile device, a gesture having a detected speed. The method further includes identifying the gesture, wherein the gesture is identified as a first command to implement a first function related to the virtual object responsive to the detected speed of the gesture being less than a speed threshold, and the gesture is identified as a second command to implement a second function related to the virtual object responsive to the detected speed of the gesture being greater than the speed threshold. The second command and second function are different from the first command and the first function, respectively. The identified gesture is then processed.Type: GrantFiled: September 2, 2022Date of Patent: October 8, 2024Assignee: SHOPIFY INC.Inventors: Brennan Letkeman, Bradley Joseph Aldridge
-
Publication number: 20240272711Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.Type: ApplicationFiled: April 22, 2024Publication date: August 15, 2024Inventors: Russ Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp
-
Publication number: 20240257474Abstract: A computer-implemented is disclosed. The method includes: obtaining identifying information for an object, the object being in a field of view of an AR device, wherein the identifying information comprises implicit signals representing contextual data associated with the object; determining that the object is associated with a first object record based on comparing the identifying information with stored identifiers associated with the first object record; and responsive to the determination that the object is associated with the first object record, presenting, via the AR device, AR content that is specific to the first object record.Type: ApplicationFiled: May 11, 2023Publication date: August 1, 2024Applicant: Shopify Inc.Inventors: Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Diego Macario BELLO, Daniel BEAUCHAMP
-
Publication number: 20240249442Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. However, issues such as the AR content and the proxy object not being aligned, or occlusion of the proxy object leading to glitching of the AR content, may decrease user enjoyment. In some embodiments, an AR system for the overlay of AR content may be implemented. The system may anchor a virtual model to the proxy object based on detected features on the proxy object. The anchoring may include aligning elements of the virtual model and proxy object. In response to an occluding object occluding some features on the proxy object, the system may anchor the virtual model to the occluding object, or to both the proxy object and the occluding object, based on detected features on the occluding object.Type: ApplicationFiled: March 21, 2023Publication date: July 25, 2024Inventors: Russ Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp
-
Publication number: 20240249443Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.Type: ApplicationFiled: March 21, 2023Publication date: July 25, 2024Inventors: Russ Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp
-
Publication number: 20240242424Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.Type: ApplicationFiled: February 23, 2024Publication date: July 18, 2024Applicant: Shopify Inc.Inventors: Russ Maschmeyer, Adam Debreczeni, Eric Andrew Florenzano, Brennan Letkeman, Sarah Hurtgen, James Harold Hall, JR.
-
Publication number: 20240241503Abstract: A computer-implemented is disclosed. The method includes: obtaining image data from a plurality of cameras providing views of a designated assembly zone; updating a three-dimensional model of an assembly of a structure based on the obtained image data; and determining a location of a first component of the structure based on the updated three-dimensional model of the assembly.Type: ApplicationFiled: March 23, 2023Publication date: July 18, 2024Applicant: Shopify Inc.Inventors: Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Diego Macario BELLO, Daniel BEAUCHAMP, Neil Leonard PADGETT, Hettige Ray Perera JAYATUNGA, James LEPP, Andrew Nhat-Nam NGO
-
Publication number: 20240192770Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.Type: ApplicationFiled: February 10, 2023Publication date: June 13, 2024Inventors: Russ Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp
-
Patent number: 11995232Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.Type: GrantFiled: February 10, 2023Date of Patent: May 28, 2024Assignee: SHOPIFY INC.Inventors: Russ Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp
-
Publication number: 20240161258Abstract: A computer-implemented is disclosed. The method includes: obtaining a first set of a plurality of images of products that are associated with a same product category; selecting a subset of the first set based on interaction data of customer interactions with a merchant's online storefront; and providing, to a deep learning generative model, the subset of the first set and a second set of training images depicting a first product for training a customized generative model associated with the first product.Type: ApplicationFiled: December 22, 2022Publication date: May 16, 2024Applicant: Shopify Inc.Inventors: Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Diego Macario BELLO, Daniel BEAUCHAMP, Neil Leonard PADGETT
-
Patent number: 11948244Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.Type: GrantFiled: February 11, 2022Date of Patent: April 2, 2024Assignee: SHOPIFY INC.Inventors: Russ Maschmeyer, Adam Debreczeni, Eric Andrew Florenzano, Brennan Letkeman, Sarah Hurtgen, James Harold Hall, Jr.
-
Patent number: 11941750Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises identifying, by a processor, a first surface in a first view of a camera feed from a customer device; obtaining, by the processor, a three-dimensional model of a product that corresponds to the first surface; providing, by the processor, an augmented media containing an overlay of a first augmented reality representation of the three-dimensional model of the product in the first view; and responsive to the processor identifying a second surface in a second view of the camera feed from the customer device, revising, by the processor, the augmented media to contain a second augmented reality representation of the three-dimensional model of the product on the second surface in the second view.Type: GrantFiled: February 11, 2022Date of Patent: March 26, 2024Assignee: Shopify Inc.Inventors: Russ Maschmeyer, Adam Debreczeni, Eric Andrew Florenzano, Brennan Letkeman, Sarah Hurtgen, James Harold Hall, Jr.
-
Publication number: 20240087267Abstract: A computer-implemented is disclosed. The method includes: generating an augmented reality (AR) scene that includes a virtual 3D representation of a product and a view of a first graphical user interface; monitoring user interactions with the virtual 3D representation of the product based on detected gestures of the user; determining modifications to the virtual 3D representation of the product based on the monitored user interactions; presenting, in the AR scene, a modified 3D representation of the product; converting the modified 3D representation of the product to a 2D image; and causing the 2D image to be displayed at a defined location of the first graphical user interface in AR.Type: ApplicationFiled: November 28, 2022Publication date: March 14, 2024Applicant: Shopify Inc.Inventors: Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Diego Macario BELLO, Daniel BEAUCHAMP
-
Publication number: 20240087251Abstract: A computer-implemented is disclosed. The method includes: determining a first position of a real display device in a real-world environment; receiving a request to display virtual information at a second relative position with respect to the first position in an AR version of the real-world environment; responsive to receiving the request: determining a displayable area associated with the second relative position; and causing the virtual information to be overlaid on the displayable area in the AR version of the real-world environment.Type: ApplicationFiled: December 16, 2022Publication date: March 14, 2024Applicant: Shopify Inc.Inventors: Neil Leonard PADGETT, Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Andrew Nhat-Nam NGO, Hettige Ray Perera JAYATUNGA, James LEPP, Diego Macario BELLO
-
Patent number: 11899833Abstract: To interact with and manipulate a virtual object associated with an AR experience displayed on the screen of a user device (e.g., a smartphone), the user must first learn or discover the particular gestures that correspond with a given function, but such gestures may not always be intuitive. The user may find it difficult or bothersome to learn/remember the specific gesture(s) needed to achieve a specific result. Moreover, there are only a limited number of gestures that can be performed using the screen of the device, often leading to gestural conflict. In some embodiments, a dual-interface AR system may be implemented to provide an AR experience for a user. The dual-interface AR system utilizes two user interfaces and distributes the input gestures between them, allowing the user to dynamically switch between the two and to use the interface that may be most intuitive to the user.Type: GrantFiled: May 9, 2022Date of Patent: February 13, 2024Inventor: Brennan Letkeman
-
Publication number: 20240046329Abstract: A computer-implemented is disclosed. The method includes: obtaining a three-dimensional (3D) representation of a first real-world environment; identifying a real-world object of interest in a second real-world environment, the first real-world environment different from the second real-world environment; determining a first position in the 3D representation of the first real-world environment corresponding to the real-world object of interest; and generating an augmented reality (AR) version of the first real-world environment for presentation in the second real-world environment using the 3D representation of the first real-world environment and based on positioning the real-world object of interest in the first position in the AR version of the first real-world environment.Type: ApplicationFiled: September 22, 2022Publication date: February 8, 2024Applicant: Shopify Inc.Inventors: Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Diego Macario BELLO, Daniel BEAUCHAMP
-
Publication number: 20240029279Abstract: A computer-implemented is disclosed.Type: ApplicationFiled: September 30, 2022Publication date: January 25, 2024Applicant: Shopify Inc.Inventors: Russ MASCHMEYER, Eric Andrew FLORENZANO, Brennan LETKEMAN, Diego Macario BELLO, Daniel BEAUCHAMP
-
Publication number: 20240012485Abstract: The present disclosure provides AR systems and methods. The computer-implemented method comprises displaying, on a mobile device, a rendered virtual object in an augmented reality (AR) scene, and detecting, using an input device of the mobile device, a gesture having a detected speed. The method further includes identifying the gesture, wherein the gesture is identified as a first command to implement a first function related to the virtual object responsive to the detected speed of the gesture being less than a speed threshold, and the gesture is identified as a second command to implement a second function related to the virtual object responsive to the detected speed of the gesture being greater than the speed threshold. The second command and second function are different from the first command and the first function, respectively. The identified gesture is then processed.Type: ApplicationFiled: September 2, 2022Publication date: January 11, 2024Inventors: Brennan LETKEMAN, Bradley Joseph ALDRIDGE
-
Patent number: D1029678Type: GrantFiled: July 11, 2022Date of Patent: June 4, 2024Assignee: SHOPIFY INC.Inventor: Brennan Letkeman