Abstract: Provided is an electronic device and a method of controlling thereof. The electronic device includes a display, a communicator, a memory, and a processor configured to obtain a plurality of images corresponding to content being provided to the display, based on information corresponding to a preferred content of a user being obtained based on the plurality of images transmitted to a server through the communicator, control the display to provide a user interface (UI) for entering a metaverse space corresponding to the preferred content, and based on a user command for entering the metaverse space being input through the UI, control the display to display a screen based on data corresponding to the metaverse space received from the server through the communicator.

Abstract: An information processing apparatus receives, while a first virtual viewpoint image generated based on first three-dimensional shape data corresponding to a structure is displayed on a user display unit, a user operation on a first virtual camera corresponding to the first virtual viewpoint image, and generates, based on the user operation, camera parameters indicating a position and an orientation of a second virtual camera corresponding to a second virtual viewpoint image generated based on second three-dimensional shape data indicating a shape of the structure different from a shape indicated by the first three-dimensional shape data.

Abstract: A method and system receives a 3D digital dental model representing at least a portion of a patient's dentition, automatically determines a virtual dental preparation site in the 3D digital dental model using a first neural network, automatically generates a 3D digital dental prosthesis model in the 3D digital dental model using a second trained generative deep neural network and automatically routes the 3D digital dental model comprising the virtual 3D dental prosthesis model to a quality control (“QC”) user.

Abstract: Apparatuses, system, and techniques to process resources used to perform a neural network to generate one or more images. In at least one embodiment, a processor comprising circuitry uses one or more neural networks to generate one or more second images based, at least in part, on noise within a first image.

Abstract: A mobile device includes a display, a camera to capture an image of a space in which an image device can be installed, a user interface, and a controller. The controller can identify a plane from the image captured by the camera, control the display so as to display a grid on a virtual plane corresponding to the plane, adjust the grid based on an input of a user received via the user interface, and control the display so as to display, on the grid, the virtual image of the image device.

Abstract: Systems and techniques are described herein for processing image data. For instance, a method for processing image data is provided. The method may include receiving a first plurality of rows of first image data, the first image data representing a field of view at a first resolution; receiving a second plurality of rows of second image data, the second image data representing a portion of the field of view at a second resolution, wherein the first resolution is less than the second resolution; generating processed first image data based on the first plurality of rows of the first image data and a first kernel; generating processed second image data based on the second plurality of rows of the second image data, a second kernel, and the processed first image data; and outputting the processed first image data and the processed second image data.

Abstract: The present disclosure provides a virtual reality-based control method, apparatus, terminal, and storage medium, wherein the virtual reality-based control method includes: displaying a virtual entity and a suspended bubble associated with the virtual entity in a virtual reality space, the suspended bubble being configured to indicate a function of the virtual entity; and controlling, in response to a movement event of the virtual entity in the virtual reality space, the suspended bubble to follow the virtual entity to move.

Abstract: In one embodiment, a method of intermingling stereoscopic and conforming virtual content to a bounded surface is performed at a device that includes one or more processors, non-transitory memory, and one or more displays. The method includes displaying a bounded surface within a native user computer-generated reality (CGR) environment, wherein the bounded surface is displayed based on a first set of world coordinates characterizing the native user CGR environment. The method further includes displaying a first stereoscopic virtual object within a perimeter of a first side of the bounded surface, wherein the first stereoscopic virtual object is displayed in accordance with a second set of world coordinates that is different from the first set of world coordinates characterizing the native user CGR environment.

Abstract: The invention relates to a computer-implemented method and an associated device for modelling a joint of a patient for real-time assistance in performing at least one bone tunnel by arthroscopy in said joint, said method comprising: receiving a stream of intraoperative monocular two-dimensional images obtained using an imaging device, each of the intraoperative monocular two-dimensional images being obtained at a time t and comprising at least a region of interest of the joint; for each intraoperative monocular two-dimensional image, calculating a depth map associated with time t by implementing a first previously trained learning model, said first learning model being configured to receive as input at least said intraoperative monocular two-dimensional image obtained at time t; calculating a current partial three-dimensional model of the patient's joint associated with a current time tc, on the basis of at least one depth map associated with the current time tc, at least one depth map associated with a previ

Abstract: Hardware tessellation units include a sub-division logic block that comprises hardware logic arranged to perform a sub-division of a patch into two (or more) sub-patches. The hardware tessellation units also include a decision logic block that is configured to determine whether a patch is to be sub-divided or not and one or more hardware elements that control the order in which tessellation occurs. In various examples, this hardware element is a patch stack that operates a first-in-last-out scheme and in other examples, there are one or more selection logic blocks that are configured to receive patch data for more than one patch or sub-patch and output the patch data for a selected one of the received patches or sub-patches.

Abstract: The subject technology receives information for a product. The subject technology generates a 3D model file of the product in a first format. The subject technology converts the 3D model file to a 3D object file in a second format. The subject technology associates the 3D object file to the product in a product catalog service. The subject technology publishes an augmented reality (AR) content generator corresponding to the product.

Abstract: A computing device is configured to obtain gridline information for a three-dimensional drawing file and generate a two-dimensional view of the three-dimensional drawing file that includes (1) at least one gridline corresponding to the obtained gridline information, (2) at least one intersection between two meshes, and (3) initial dimensioning information involving (a) the at least one gridline and (b) at least one of the two meshes. Based on a user request to adjust a perspective of the two-dimensional view, the computing device adjusts the perspective of the two-dimensional view and thereby generates an updated two-dimensional view that includes updated dimensioning information corresponding to one or more meshes displayed in the updated two-dimensional view.

Abstract: A method of facilitating a virtual conference includes determining that a first object is non-directional, the first object being presented within an original image on a first display within the virtual conference; based on determining that the first object is non-directional, reversing an appearance and a location of the first object to generate a reversed first object; determining that a second object is directional, the second object being presented within the original image on the first display within the virtual conference; based on determining that the second object is directional, transferring a location of the second object while maintaining an orientation of the second object to generate a transferred second object; and causing a second display to generate a transformed image, the transformed image including the reversed first object and the transferred second object.

Abstract: A method, system, and computer-readable medium for executing a task is disclosed. The method includes receiving input data and computing instructions, launching a workgroup including wavefronts to execute the task, wherein the launching causes the wavefronts to process the input data by sharing intermediate results and resources, and adjusting the operation based on characteristics of the wavefronts. The characteristics include data dependencies, computational load, memory usage, and execution timing requirements. The wavefronts execute the task in stages, where each stage processes portions of input data and data generated by other wavefronts.

Abstract: Three-dimensional object edit and visualization techniques and systems are described. In a first example, a content navigation control is implemented by a content editing system to aid navigation through a history of how a three-dimensional environment and a three-dimensional object included in the environment is created. In a second example, the content editing system is configured to streamline placement of a three-dimensional object within a three-dimensional environment. The content editing system, for instance, generates a manipulation visualization in support of corresponding editing operations to act as a guide, e.g., as an alignment guide or an option guide. In a third example, the content editing system implements a shadow control that is usable as part of an editing and as a visualization to control rendering of illumination within a three-dimensional environment.

Abstract: A system for rendering an augmented image frame includes a sensor, an interface, a memory, a processor, and a display. The sensor captures an environment image of an external environment of a vehicle that includes a physical object. The interface receives an augmentation class to be applied to the environment image frame. The memory stores an augmentation engine that causes the processor to receive the environment image frame and the augmentation class. The augmentation engine further causes the processor to determine an identity and location of the physical object, and retrieve a digital object associated with the physical object and the augmentation class. Subsequently, an augmented image frame is rendered including the digital object disposed at the location of the physical object in the external environment. Finally, the display depicts the augmented image frame to present the user with an aesthetically appealing synthetic view of the external environment.

Abstract: An information processing device includes a control unit that performs control to output information regarding an image of a user viewpoint in a virtual space to a user terminal, in which the control unit acquires a characteristic of at least one user related to an event performed in the virtual space and controls movement of a position of an indicator corresponding to a performer in the virtual space based on a position of an indicator corresponding to at least one user whose characteristic satisfies a condition.

Abstract: Methods and systems related to processing multiple data streams are disclosed. For example, a computing device may receive a data stream corresponding to a content item, and generate additional data streams by sampling the data stream, for example, using different sampling regions. Another data stream at a higher resolution than each of the additional data streams may then be generated by combining elements (e.g., pixels) of the additional data streams.

Abstract: Example implementations are directed to recapturing or realigning a room or scene in an artificial reality (XR) environment as a three dimensional (3D) space. To initially capture a room, a user manually annotates, using an XR system, one or more walls around the XR system. The XR system then aligns or localizes itself relative to the room. Once a room is captured and stored, and the user in the future enters the room again, the XR system may not be able to align itself in the room due to, for example, lighting conditions. Rather than require the user to manually recapture every wall captured during the initial room capture, the XR system can select one wall for recapture and, after receiving an annotation or marking of the one wall from the user, use the selection to realign the XR system relative to the room.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that detects shadows, removes shadows, and synthesizes shadows in a joint-framework. In particular, the disclosed systems access an object mask of an object and a digital image depicting the object and a shadow of the object. Furthermore, the disclosed systems perform object-centered shadow detection and removal to generate a modified digital image without the shadow by utilizing a shadow analyzer model. Moreover, the disclosed systems receive a user interaction to manipulate an object and generate a modified shadow utilizing a shadow synthesis model where the shadow synthesis model is conditioned on a shadow mask generated by the shadow analyzer model.