Abstract: In an augmented reality (AR) experience, virtual content may be rendered at a particular position within a 3D spatial map and overlaid onto a view of the real-world space. There may be scenarios in which the user wants to limit a 3D model to being rendered within a particular subspace of the space defined by the 3D spatial map. Computer-implemented methods are disclosed that include receiving input defining a subspace of a 3D spatial map of a real-world space. A set of 3D models may then be filtered to identify a subset of the 3D models that fit within the subspace defined by the input. AR content including a render of a particular 3D model from the subset and overlaid onto a view of the real-world space in a position within the subspace may be output for display.

Abstract: Described herein are systems and methods for generating and transmitting media data feeds location-based privacy settings. Embodiments generate, store, and reference location-based privacy settings that instruct the computing device to generate obfuscations in the media data. The obfuscations may include computer-generated or user gesture-generated obfuscation regions that instruct the computing device to apply the obfuscations to portions of the video feed. The computing device may be pre-configured to recognize certain objects or regions (or portions thereof) and remove, blur, or substitute them from the live video stream or 3D data according to privacy settings. The privacy settings may be relative to the location in which the user and computing device are situated. In operation, the computing device may determine the location and then apply the location-specific privacy settings to obfuscate a portion of the video feed while being generated and transmitted.

Abstract: A computer-implemented method is disclosed. The method includes: receiving an indication of a first point on a three-dimensional (3D) model; determining a second point in a texture map of the 3D model that corresponds to the first point; performing segmentation of the texture map for identifying portions of the texture map that are related to the second point; and outputting a 3D representation of the identified related portions of the texture map.

Abstract: A textual description that includes a body of unstructured text is received. Using a rating model configured to output a rating based on a degree of similarity of the received textual description and each of a set of selected textual descriptions, a rating is generated based on the received textual description. The rating model to also used to generate a suggested modification of the received textual description that, when applied to the received textual descriptions, changes the rating of the received textual description. An indication of the suggested modification can be output to a user.

Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: A computer-implemented is disclosed. The method includes: obtaining image data from a plurality of cameras providing views of a designated assembly zone; updating a three-dimensional model of an assembly of a structure based on the obtained image data; and determining a location of a first component of the structure based on the updated three-dimensional model of the assembly.

Abstract: The present disclosure describes a technical solution that enables a trained large language model (LLM) to generate a revised text in a manner that enables the LLM to preserve formatting that was present in the original text. When a text-editing instruction is received for a text passage having a formatting tag, the text passage is processed to identify the formatting tag in the text passage. The LLM is prompted to generate a revised text passage, using a prompt that includes the text-editing instruction and that also includes a formatting-specific instruction to format the revised text passage using the formatting tag in the revised text passage. The revised text passage is received and caused to be displayed based on the formatting tag, such that the formatting of the original text is maintained.

Abstract: Methods and systems for prompting a large language model (LLM) to generate a description of an object with indications of any unsubstantiated information are disclosed. A prompt is generated to a LLM to generate a description of an object, where the prompt includes one or more object attributes to include in the generated description. The prompt also includes an instruction for the LLM to annotate any portions of the generated description that are, involve, and/or include unsubstantiated information according to a defined format. The prompt is provided to the LLM and the generated description is received. The generated description is parsed to identify, based on the defined format, one or more annotated portions indicating unsubstantiated information. The generated description is presented for display via a user device.

Abstract: The present disclosure is related to a system and method for generating a three-dimensional (3D) model of an object. The method includes: determining that a first portion of an object has a lower priority; obtaining a plurality of images of the object; and training a three-dimensional model of the object using a training algorithm that processes the plurality of images as training data to generate and refine Gaussian splats defining the three-dimensional model. Obtaining the plurality of images includes obtaining images including views of the first portion of the object from a first concentration of viewpoints; and obtaining images including views of the another portion of the object from a second concentration of viewpoints, the first concentration being less than the second concentration.

Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: Methods and systems for prompting a large language model (LLM) to generate a revised text passage with formatting are described. A text-editing instruction is received that is related to at least a portion of a text passage having at least one formatting tag. The text passage is processed to identify the at least one formatting tag in the text passage. A prompt to the LLM is generated, to cause the LLM to generate a revised text passage. The prompt includes the text-editing instruction related to at least the portion of the text passage and also includes a formatting-specific instruction to format the revised text passage using the at least one formatting tag in the revised text passage. The revised text passage is received and caused to be displayed based on the formatting tag.

Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.

Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. However, issues such as the AR content and the proxy object not being aligned, or occlusion of the proxy object leading to glitching of the AR content, may decrease user enjoyment. In some embodiments, an AR system for the overlay of AR content may be implemented. The system may anchor a virtual model to the proxy object based on detected features on the proxy object. The anchoring may include aligning elements of the virtual model and proxy object. In response to an occluding object occluding some features on the proxy object, the system may anchor the virtual model to the occluding object, or to both the proxy object and the occluding object, based on detected features on the occluding object.

Abstract: A computer-implemented is disclosed. The method includes: generating an augmented reality (AR) scene that includes a virtual 3D representation of a product and a view of a first graphical user interface; monitoring user interactions with the virtual 3D representation of the product based on detected gestures of the user; determining modifications to the virtual 3D representation of the product based on the monitored user interactions; presenting, in the AR scene, a modified 3D representation of the product; converting the modified 3D representation of the product to a 2D image; and causing the 2D image to be displayed at a defined location of the first graphical user interface in AR.

Abstract: Methods and systems for prompting a large language model (LLM) to process inputs from multiple user elements to generate a revised block of text are described. One or more text-editing instructions related to respective one or more selected text portions in a block of text are received. A prompt is generated for a LLM to generate a revised block of text, the prompt including at least a portion of an annotated block of text, the annotated block of text including each text-editing instruction inserted into the block of text relative to each respective selected text portion. The prompt is provided to the LLM and a revised block of text is received and outputted.

Abstract: A computer method for encoding structured data, the encoding comprising substituting one or more data elements within the structured data with corresponding one or more aliases, thereby producing encoded structured data, wherein the corresponding one or more aliases have a shorter tokenized representation than the one or more data elements; providing the encoded structured data to a Large Language Model (LLM); receiving an output from the LLM; and decoding the output to substitute the corresponding one or more aliases with the one or more data elements.

Abstract: Methods and systems for prompting a large language model (LLM) to generate a description of an object with indications of any unsubstantiated information are disclosed. A prompt is generated to a LLM to generate a description of an object, where the prompt includes one or more object attributes to include in the generated description. The prompt also includes an instruction for the LLM to annotate any portions of the generated description that are, involve, and/or include unsubstantiated information according to a defined format. The prompt is provided to the LLM and the generated description is received. The generated description is parsed to identify, based on the defined format, one or more annotated portions indicating unsubstantiated information. The generated description is presented for display via a user device.

Abstract: Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.

Abstract: A computer-implemented is disclosed. The method includes: obtaining a three-dimensional (3D) representation of a first real-world environment; identifying a real-world object of interest in a second real-world environment, the first real-world environment different from the second real-world environment; determining a first position in the 3D representation of the first real-world environment corresponding to the real-world object of interest; and generating an augmented reality (AR) version of the first real-world environment for presentation in the second real-world environment using the 3D representation of the first real-world environment and based on positioning the real-world object of interest in the first position in the AR version of the first real-world environment.

Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.