Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: A computer-implemented is disclosed. The method includes: obtaining a first set of a plurality of images of products that are associated with a same product category; selecting a subset of the first set based on interaction data of customer interactions with a merchant's online storefront; and providing, to a deep learning generative model, the subset of the first set and a second set of training images depicting a first product for training a customized generative model associated with the first product.

Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.

Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises identifying, by a processor, a first surface in a first view of a camera feed from a customer device; obtaining, by the processor, a three-dimensional model of a product that corresponds to the first surface; providing, by the processor, an augmented media containing an overlay of a first augmented reality representation of the three-dimensional model of the product in the first view; and responsive to the processor identifying a second surface in a second view of the camera feed from the customer device, revising, by the processor, the augmented media to contain a second augmented reality representation of the three-dimensional model of the product on the second surface in the second view.

Abstract: A computer-implemented is disclosed. The method includes: determining a first position of a real display device in a real-world environment; receiving a request to display virtual information at a second relative position with respect to the first position in an AR version of the real-world environment; responsive to receiving the request: determining a displayable area associated with the second relative position; and causing the virtual information to be overlaid on the displayable area in the AR version of the real-world environment.

Abstract: A computer-implemented is disclosed. The method includes: generating an augmented reality (AR) scene that includes a virtual 3D representation of a product and a view of a first graphical user interface; monitoring user interactions with the virtual 3D representation of the product based on detected gestures of the user; determining modifications to the virtual 3D representation of the product based on the monitored user interactions; presenting, in the AR scene, a modified 3D representation of the product; converting the modified 3D representation of the product to a 2D image; and causing the 2D image to be displayed at a defined location of the first graphical user interface in AR.

Abstract: A computer-implemented is disclosed. The method includes: obtaining a three-dimensional (3D) representation of a first real-world environment; identifying a real-world object of interest in a second real-world environment, the first real-world environment different from the second real-world environment; determining a first position in the 3D representation of the first real-world environment corresponding to the real-world object of interest; and generating an augmented reality (AR) version of the first real-world environment for presentation in the second real-world environment using the 3D representation of the first real-world environment and based on positioning the real-world object of interest in the first position in the AR version of the first real-world environment.

Abstract: A computer-implemented is disclosed.

Abstract: A system and method are provided for updating electronic content by selectively replacing virtual 3D objects being displayed in an electronic environment. The method includes in one example, presenting augmented reality (AR) content, the presented AR content showing a set of objects, at least some of the objects of the set of objects being rendered 3D objects; receiving an input identifying one of the objects of the set of objects; and responsive to the input, providing updated AR content, the updated AR content replacing at least one of the objects with a different rendered 3D object, wherein the replaced at least one of the objects is determined based on the identified one of the objects of the set of objects.

Abstract: A system and method are provided for displaying objects in electronic user interfaces. The method includes receiving, via a user interface, a first input defining a rotation to be applied to each of a plurality of three-dimensional (3D) objects displayed in the user interface. The method also includes manipulating, in the user interface, each of the plurality of 3D objects in tandem according to the first input, the manipulating comprising rotating each of the plurality of 3D objects individually in tandem according to the rotation to be applied.

Abstract: In an augmented reality (AR) experience, virtual content may be rendered at a particular position within a 3D spatial map and overlaid onto a view of the real-world space. There may be scenarios in which the user wants to limit a 3D model to being rendered within a particular subspace of the space defined by the 3D spatial map. Computer-implemented methods are disclosed that include receiving input defining a subspace of a 3D spatial map of a real-world space. A set of 3D models may then be filtered to identify a subset of the 3D models that fit within the subspace defined by the input. AR content including a render of a particular 3D model from the subset and overlaid onto a view of the real-world space in a position within the subspace may be output for display.

Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.

Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises identifying, by a processor, a first surface in a first view of a camera feed from a customer device; obtaining, by the processor, a three-dimensional model of a product that corresponds to the first surface; providing, by the processor, an augmented media containing an overlay of a first augmented reality representation of the three-dimensional model of the product in the first view; and responsive to the processor identifying a second surface in a second view of the camera feed from the customer device, revising, by the processor, the augmented media to contain a second augmented reality representation of the three-dimensional model of the product on the second surface in the second view.

Abstract: Methods and systems are disclosed for generating an augmented reality (AR) video. A set of products is obtained, where each product is associated with a respective virtual model and a respective object class. An AR video segment is generated for each product in the set of products. In a real-world video segment, a real-world object belonging to a relevant object class that is relevant to the object class of the given product is detected. A render of the virtual model associated with the given product is overlaid in the real-world video segment to obtain the AR video segment. The render of the virtual model is overlaid relative to the detected real-world object belonging to the relevant object class. A continuous AR video is generated from the AR video segments and outputted to be viewable by a user device.

Abstract: Methods, hardware, and software establish surfaces for graphics processing by setting a position of the capture device fixed on or relative to that surface. A user may hold the device against the surface or through other means. Ambient setting, potentially including the surface itself, is visually captured at the position. Using that position the surface is established—readily known by position, size, shape, etc. within the surroundings. Stable positioning can be determined in any way, using any data. Motion of the device may be known via internal or external sensors, and stable surface touching can be detected with a lack of motion. A user may input when the device is steady. Abutment can be measured from visual input or impact sensors. All such input may determine and/or verify a stable position. Visual input from the stable position may thus be used to establish the surface for graphical processing.