Abstract: A system and method are provided for displaying objects in electronic user interfaces. The method includes receiving, via a user interface, a first input defining a rotation to be applied to each of a plurality of three-dimensional (3D) objects displayed in the user interface. The method also includes manipulating, in the user interface, each of the plurality of 3D objects in tandem according to the first input, the manipulating comprising rotating each of the plurality of 3D objects individually in tandem according to the rotation to be applied.

Abstract: Described herein are systems and methods for generating AR-enriched media feeds for comparing attributes of objects. A user operates an AR device to collect or extract object information in a media feed including a current object. The AR device identifies a comparison object using attributes of the current baseline object. After the comparison object has been identified, the AR device generates and presents an AR overlay in the graphical user interface that shows the selected attribute of the comparison object nearby or on top of the attribute of the current object in the real time media feed containing the current object.

Abstract: A computer-implemented method is disclosed. The method includes: obtaining at least one output of a generative model based on input of a first text prompt; presenting the at least one output via a user interface; receiving, via the user interface, user selection of a desired portion of the at least one output; modifying the first text prompt based on the user selection to obtain a second text prompt; and providing the second text prompt as input to the generative model for obtaining a second output.

Abstract: A textual description that includes a body of unstructured text is received. Using a rating model configured to output a rating based on a degree of similarity of the received textual description and each of a set of selected textual descriptions, a rating is generated based on the received textual description. The rating model to also used to generate a suggested modification of the received textual description that, when applied to the received textual descriptions, changes the rating of the received textual description. An indication of the suggested modification can be output to a user.

Abstract: Methods and systems for prompting a large language model (LLM) to generate a revised text passage with formatting are described. A text-editing instruction is received that is related to at least a portion of a text passage having at least one formatting tag. The text passage is processed to identify the at least one formatting tag in the text passage. A prompt to the LLM is generated, to cause the LLM to generate a revised text passage. The prompt includes the text-editing instruction related to at least the portion of the text passage and also includes a formatting-specific instruction to format the revised text passage using the at least one formatting tag in the revised text passage. The revised text passage is received and caused to be displayed based on the formatting tag.

Abstract: Methods and systems for indicating a resource usage parameter for prompting a large language model (LLM) are described. A user input is received, from an electronic device, for generating a prompt to a LLM. A prompt resource usage parameter is computed based on the user input. A trained resource prediction model is used to generate a predicted response resource usage parameter for a response from the LLM, based on the user input. A total resource usage parameter is computed, based on the prompt resource usage parameter and the predicted response resource usage parameter. A representation of the total resource usage parameter is communicated to the electronic device, to cause the electronic device to provide an output of the representation of the total resource usage parameter.

Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: Methods and systems for prompting a large language model (LLM) to generate a stylistic description of an image are disclosed. One or more visual attributes are extracted from an image using a first trained machine learning model. The visual attributes are mapped to one or more emotion attributes using a second trained machine learning model. A LLM prompt is generated based on the one or more emotion attributes and provided to the LLM. A generated description of the image is obtained from the LLM and displayed with the image.

Abstract: Methods and systems for prompting a large language model (LLM) to generate a description of an object with indications of any unsubstantiated information are disclosed. A prompt is generated to a LLM to generate a description of an object, where the prompt includes one or more object attributes to include in the generated description. The prompt also includes an instruction for the LLM to annotate any portions of the generated description that are, involve, and/or include unsubstantiated information according to a defined format. The prompt is provided to the LLM and the generated description is received. The generated description is parsed to identify, based on the defined format, one or more annotated portions indicating unsubstantiated information. The generated description is presented for display via a user device.

Abstract: A computer-implemented is disclosed. The method includes: obtaining identifying information for an object, the object being in a field of view of an AR device, wherein the identifying information comprises implicit signals representing contextual data associated with the object; determining that the object is associated with a first object record based on comparing the identifying information with stored identifiers associated with the first object record; and responsive to the determination that the object is associated with the first object record, presenting, via the AR device, AR content that is specific to the first object record.

Abstract: Methods and systems for automatically prompting a LLM to generate a personalized text, such as a personalized textual description, in which portions of the text are customized based on user attributes. In various examples, responsive to a request for a textual description, a user record is retrieved for a user associated with the request and one or more user attributes are obtained based on the user record. In examples, a prompt to a large language model (LLM) for generating a user-specific textual description is generated, the prompt including the one or more user attributes to include in the generated user-specific textual description and a source text. The prompt is provided to the LLM to receive a generated user-specific textual description. The generated user-specific textual description is provided for display via a user device.

Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. However, issues such as the AR content and the proxy object not being aligned, or occlusion of the proxy object leading to glitching of the AR content, may decrease user enjoyment. In some embodiments, an AR system for the overlay of AR content may be implemented. The system may anchor a virtual model to the proxy object based on detected features on the proxy object. The anchoring may include aligning elements of the virtual model and proxy object. In response to an occluding object occluding some features on the proxy object, the system may anchor the virtual model to the occluding object, or to both the proxy object and the occluding object, based on detected features on the occluding object.

Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.

Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.

Abstract: A computer-implemented is disclosed. The method includes: obtaining image data from a plurality of cameras providing views of a designated assembly zone; updating a three-dimensional model of an assembly of a structure based on the obtained image data; and determining a location of a first component of the structure based on the updated three-dimensional model of the assembly.

Abstract: A system and method are provided for displaying objects in electronic user interfaces. The method includes receiving, via a user interface, a first input defining a rotation to be applied to each of a plurality of three-dimensional (3D) objects displayed in the user interface. The method also includes manipulating, in the user interface, each of the plurality of 3D objects in tandem according to the first input, the manipulating comprising rotating each of the plurality of 3D objects individually in tandem according to the rotation to be applied.

Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: A computer-implemented is disclosed. The method includes: obtaining a first set of a plurality of images of products that are associated with a same product category; selecting a subset of the first set based on interaction data of customer interactions with a merchant's online storefront; and providing, to a deep learning generative model, the subset of the first set and a second set of training images depicting a first product for training a customized generative model associated with the first product.

Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.