Abstract: An object in 3D extended reality (XR), such as a virtual reality (VR) environment, is dynamically labelled based on the viewpoint of a main camera for a user. Labels may be created based on the viewing axis of the user from the camera with respect to the object, the size of the object, and the distance of the object from the camera. The dynamically labelled object can be rotated or walked around with labels of information dynamically being generated around visible points of interest that are referenced to the user in an organized and non-overlapping manner.

Abstract: Systems, methods and apparatuses may provide for technology to reduce rendering overhead associated with light field displays. The technology may conduct data formatting, re-projection, foveation, tile binning and/or image warping operations with respect to a plurality of display planes in a light field display.

Abstract: Described herein are devices, systems, media, and methods using an augmented reality smartphone application to capture measurements of an interior or exterior space in real-time and generate a floorplan of the space and/or a 3D model of the space from the captured measurements in less than 5 minutes.

Abstract: A graphics processing system includes a tiling unit for performing tiling calculations and a hidden surface removal (HSR) unit for performing HSR on fragments of the primitives. Primitive depth information is calculated in the tiling unit and forwarded for use by the HSR unit in performing HSR on the fragments. This takes advantage of the tiling unit having access to the primitive data before the HSR unit performs the HSR on the primitives, to determine some depth information which can simplify the HSR performed by the HSR unit. Therefore, the final values of a depth buffer determined in the tiling unit can be used in the HSR unit to determine that a particular fragment will subsequently be hidden by a fragment of a primitive which is yet to be processed in the HSR unit, such that the particular fragment can be culled.

Abstract: A mechanism is described for facilitating sharing of data and compression expansion of models at autonomous machines. A method of embodiments, as described herein, includes detecting a first processor processing information relating to a neural network at a first computing device, where the first processor comprises a first graphics processor and the first computing device comprises a first autonomous machine. The method further includes facilitating the first processor to store one or more portions of the information in a library at a database, where the one or more portions are accessible to a second processor of a computing device.

Abstract: Methods and systems are disclosed for performing operations comprising: receiving video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; determining that a first portion of the external mesh is associated with movement information of the 3D body mesh; determining that a second portion of the external mesh is associated with movement information of an external force model; deforming the first and second portions of the external mesh separately based on movement information of the 3D body mesh and movement information of the external force model; and modifying the video to include a display of the AR element based on the deformed first and second portions of the external mesh.

Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

Abstract: A method for generating or enhancing a shell for a printed three-dimensional (3D) object includes converting a 3D print file representing the 3D object to at least one vector file representing the 3D object; using a vector trapping algorithm on the at least one vector file to generate or enhance the shell in the at least one vector file; processing the at least one vector file with the shell to produce at least one rasterized vector file; and printing, using the at least one rasterized vector file, the 3D object with the shell.

Abstract: Embodiments include systems and methods for determining a 6D pose estimate associated with an image of a physical 3D object captured in a video stream. An initial 6D pose estimate is inferred and then further iteratively refined. The video stream may be frozen to allow the user to tap or touch a display to indicate a location of the user-input keypoints. The resulting 6D pose estimate is used to assist in replacing or superimposing the physical 3D object with digital or virtual content in an augmented reality (AR) frame.

Abstract: A method includes generating, based on user images, a user 3-D model. The method proceeds with obtaining, via a user interface, a request to graphically represent an accessory on to a user graphical representation. This user graphical representation is generated using the user 3-D model. In response to this request, an accessory 3-D model is obtained. Further, the method includes positioning, via the user interface and based on parameters of the user 3-D model and of the accessory 3-D model, an accessory graphical representation on to the user graphical representation. The method further includes updating, in response to detecting user movement, the user 3-D model and the accessory 3-D model and presenting, via the user interface and based on these updated 3-D models, the accessory graphical representation and the user graphical representation in accordance with the user movement.

Abstract: Aspects of the invention are directed towards a system and a method for applying augmented reality technique to audits related to a device. One or more embodiments of the invention describe a method comprising steps of receiving audits from a first device by a second device over a communication channel, the audits associated with one or more components of the first device. The method further comprises steps of analyzing the audits by the second device to generate an audit report of a status of each of the one or more components and generating an augmented reality image for the one or more components by the second device based on a pre-generated image, the augmented reality image exhibiting as a status in the audit report of the one or more components of the first device.

Abstract: In one embodiment, a computing system may update a first 3D model of a region of an environment based on comparisons between the first 3D model and first depth measurements of the region generated during a first time period. The computing system may determine that the region is static by comparing the first 3D model to second depth measurements of the region generated during a second time period. The computing system may in response to determining that the region is static, detect whether the region changed after the second time period based on comparisons between a second 3D model of the region and third depth measurements of the region generated after the second time period, the second 3D model having a lower resolution than the first 3D model. The computing system may in response to detecting a change in the region, update the first 3D model of the region.

Abstract: A display apparatus including: light source(s) per eye, first tracking means, and processor(s) configured to: process first tracking data, collected by first tracking means, to determine location of display apparatus in real-world environment; obtain software application(s) that is available for location of display apparatus along with metainformation indicative of location in real-world environment with which software application(s) is/are associated; determine relative location of display apparatus with respect to location with which software application(s) is/are associated; execute software application(s) to create and overlay virtual content on image(s) representing real-world environment, based on relative location of display apparatus with respect to location with which software application(s) is/are associated; and display image(s) via light source(s).

Abstract: A method of adjusting a three-dimensional representation of an object to be manufactured in an additive manufacturing process comprises determining a processing operation to be applied to the object, and adjusting the three-dimensional representation of the object based on adjustment parameters associated with the processing operation.

Abstract: A virtual local presence display apparatus, system and method is disclosed.

Abstract: A system form localizing an electronic device with dynamic buffering identifies, from the buffer, a first set of features that is extracted from a first image captured by the electronic device and receives, at the system, a second set of features that is extracted from a second image captured by the electronic device. The system further determines a first characteristic for the first set of features and a second characteristic for the second set of features and determines whether a triggering condition for dynamically changing a size of the buffer is satisfied based at least in part upon the first characteristic for the first set of features and the second characteristic for the second set of features.

Abstract: In the disclosed systems and methods for competitive scene completion, in conjunction with a scene completion challenge, an image of an initial scene and a plurality of markers are displayed. For each user marker selection, virtual furnishing units corresponding to the unit type are displayed. User unit selection results in display of a three-dimensional graphic of the selected virtual furnishing unit at the corresponding coordinates within the scene, thereby creating an augmented scene that comprises the initial scene with three-dimensional graphics of selected virtual furnishing units. The augmented scene is submitted to a remote server. The user is provided with a reward that consists of credits. Responsive to user selection to access the store, a user interface for the store is displayed within the application. Visual representations of tangible products are displayed. The credits are configured for use towards purchase of the tangible products.

Abstract: An information processing apparatus (2000) acquires a shelf rack image (12) in which a product shelf rack on which a product is displayed is imaged. The information processing apparatus (2000) performs image analysis on the shelf rack image (12), and generates information (actual display information) relevant to a display situation of the product on a product shelf rack (20). The information processing apparatus (2000) acquires reference display information representing a reference for display of the product on the product shelf rack (20). The information processing apparatus (2000) compares the actual display information generated by performing the image analysis on the shelf rack image (12) with the acquired reference display information, and generates comparison information representing a result.

Abstract: In some implementations, a method of sketch-based placement of computer-generated graphical objects is performed at a device including one or more cameras and non-transitory memory coupled to one or more processors. The method includes obtaining an input directed to a content creation interface (e.g., a sketchpad), wherein the input corresponds to a sketch of a candidate object, and wherein the content creation interface facilitates creation of computer-generated graphical objects presentable using the device. The method also includes: obtaining a three-dimensional (3D) model using the input that corresponds to the sketch of the candidate object; generating a computer-generated graphical object using the obtained 3D model; and causing presentation of the computer-generated graphical object together with imagery obtained using the one or more cameras of the device.

Abstract: An electronic device is disclosed. The present electronic device includes a display, a processor electronically connected to the display so as to control the display, and a memory electronically connected to the processor. The memory stores instructions causing the processor to control the display to display a 3D modeling image acquired by applying an input 2D image to a learning network model configured to convert the input 2D image into a 3D modeling image, and the learning network model is obtained by learning using a 3D pose acquired by rending virtual 3D modeling data and a 2D image corresponding to the 3D pose.