Abstract: Systems, methods, devices, and non-transitory media of the various embodiments may include encoding localized terrain modifications into one or more heightmaps, which are used to modify the vertices of the world-wide terrain map at runtime using a Graphics Processing Unit (GPU). Various embodiments apply displacement to dynamic terrain surfaces, such as time dynamic surfaces, animated surfaces, Hierarchical Level-of-Detail (HLOD) surfaces, and surfaces suitable for interactive user editing, at a global scale.

Abstract: An approach is provided in which the approach establishes a communication link between a virtual reality device and a hologram system. The hologram system projects a hologram in a physical world and the virtual reality device projects a corresponding virtual hologram in a virtual world. The virtual reality device adjusts the virtual hologram based on request from a user operating the virtual reality device and the approach instructs the hologram system to adjust the hologram in a manner similar to the adjustments to the virtual hologram.

Abstract: Systems, apparatus and methods for limiting information on an augmented reality (AR) display based on various speeds of an AR device are presented. Often information forms a distraction when the wearer is driving, running or even walking. Therefore, the described systems, devices and methods aim to limit information displayed on an AR display based on three or more levels movement (e.g., stationary, walking, driving) such that the wearer is less distracted when higher levels of concentration are needed for real world activities.

Abstract: A method and apparatus for generating a series of frames with aid of a synthesizer to offload graphics processing unit (GPU) rendering within an electronic device are provided. The method may include: utilizing a GPU to perform full-rendering to generate a first frame in a color buffer, for being output to a display panel and displayed on the display panel; utilizing the GPU to generate a set of metadata of at least one subsequent frame in a metadata buffer; and utilizing the synthesizer to synthesize said at least one subsequent frame according to previous frame information and the set of metadata of said at least one subsequent frame, to generate said at least one subsequent frame in the color buffer, for being output to the display panel and displayed on the display panel.

Abstract: An artificial reality system includes a head mounted display (HMD) and a physical overlay engine that generates overlay image data, referred to herein as a physical overlay image, corresponding to the physical objects in a three-dimensional (3D) environment. In response to an activation condition, a rendering engine of the artificial reality system renders the overlay image data to overlay artificial reality content for display on the HMD, thereby apprising a user of the HMD of their position with respect to the physical objects in the 3D environment.

Abstract: A representation of a surface in a three-dimensional space is obtained. A first input representing a starting point and a second input representing a next point are obtained. A representation of a surface-aware spline comprising vertices is generated, with the representation of the surface-aware spline including a starting vertex corresponding to the starting point and a next vertex corresponding to the next point. First and second projection points corresponding to projections of a first vertex and a second vertex onto the surface are determined. New points corresponding to equal distance points for the first and second vertices aligned with the first and second projection points are determined, and a rigid transformation is determined from the new points. The representation of the surface-aware spline is adjusted based on a transformation of the new points using the rigid transformation.

Abstract: The techniques disclosed herein include a first device for receiving a communication signal from a second device, the first device including one or more processors configured to receive, in the communication signal, packets that represent a virtual image as part of a virtual teleportation of one or more visual objects embedded in the virtual image. The one or more processors may be configured to decode the packets that represent the virtual image, and output the virtual image at a physical location within a fixed environment. The first device may also include a memory configured to store the packets that represent the virtual image as part of the virtual teleportation of one or more visual objects embedded in the virtual image.

Abstract: Methods and coarse depth test logic perform coarse depth testing in a graphics processing system in which a rendering space is divided into a plurality of tiles. A depth range for a tile is obtained, which identifies a depth range based on primitives previously processed for the tile. A determination is made based on the depth range for the tile as to whether all or a portion of a primitive is hidden in the tile. If at least a portion of the primitive is not hidden in the tile, a determination is as to whether the primitive, or one or more primitive fragments thereof has better depth than the primitives previously processed for the tile according to a depth compare mode. If so, the primitive or the primitive fragment is identified as not requiring a read of a depth buffer to perform full resolution depth testing, such that a determination that at least a portion of the primitive is hidden in the tile causes full resolution depth testing not to be performed on at least that portion of the primitive.

Abstract: An XR device for providing an augmented reality (AR) mode and a virtual reality (VR) mode and a method for controlling the same are disclosed. The XR device is applicable to 5G communication technology, robot technology, autonomous driving technology, and Artificial Intelligence (AI) technology. It is disclosed that the XR device that displays a virtual clothes item to the user's appearance in the mirror when the user selects the virtual item among the fitting items displayed while the user wears the XR device in front of a mirror.

Abstract: In general, techniques are described regarding selective allocation of processing resources for processing image data. Processing circuitry may warp a frame of image data around variously indicated areas of the frame to create a warped frame of image data. The processing circuitry may allocate more pixels to the indicated areas by virtue of the frame warping operation. The warped frame may then be output for further processing in accordance with proportions of the warped frame resulting in better image or video quality in the indicated areas.

Abstract: A display method for a wheel rotation imaging device includes: acquiring operation information, the operation information comprising ambient light intensity, wheel speed, vehicle acceleration, current time, current location, and current power; identifying a situational mode of vehicle driving according to the operation information, the situational mode being in one-to-one correspondence with a power consumption mode; and selecting a power consumption mode of the wheel rotation imaging device according to the situational mode, so that the wheel rotation imaging device completes display according to the power consumption mode. The wheel rotation imaging device is mounted on a wheel and can display texts, images or videos as the wheel rotates.

Abstract: A method dynamically selects one of a first sampling order and a second sampling order for a ray trace of pixels in a tile where the selection is based on a motion vector for the tile. The sampling order may be a bowtie pattern or an hourglass pattern. Subframes generated based on the sampling order are communicated over a bus along with motion vectors for tiles of the subframes.

Abstract: A method for compositing display data at a remote device to form an image for display involves the remote device receiving (S62) elements of the image, where the image includes display data forming a background layer, display elements forming a foreground layers and an overlay data layer. The remote device receives (S63) sensor information indicating one or more of a position of an eye of a viewer, a direction of focus of the eye of the viewer, and/or a position of a display. It then determines (S64) movement of a line of sight between the eye of the viewer and the display, determines an estimate of a future position of the line of sight at a future time based on the determined movement of the line of sight, and determines (S65) an adjustment to be made to the image based on the future position of the line of sight.

Abstract: In one embodiment, a computing system may access a dead pixel position corresponding to a dead pixel of a display. The system may access an image and modify the image by applying a mask to a pixel region of the image containing a particular pixel value with a position that corresponds to the dead pixel position. The mask may include an array of first scaling factors for scaling pixels values in the pixel region. The array of first scaling factors may be configured to brighten one or more of the pixel values surrounding the particular pixel value. The system may cause the modified image to be output by the display.

Abstract: A toy, for use with a viewing device, may include a plurality of component parts at least two of which include at least one augmented reality marker of a plurality of augmented reality markers enabling digital content associated with the at least one augmented reality marker to be unlocked and influencing at least one of an appearance and function of the toy on the viewing device. The plurality of augmented reality markers, each of which may be a physically independent augmented reality image marker, may be combined and converted into a composite augmented reality marker to produce a single, unique physical item and a composite digital representation.

Abstract: In a measurement method, a processor selects one first image included in a plurality of two-dimensional images of a subject. The processor sets one of the selected first image and one second image extracted from the plurality of two-dimensional images on the basis of the selected first image as a measurement image. The processor extracts at least one third image from the plurality of two-dimensional images. The processor generates a three-dimensional shape of the subject on the basis of a position and a posture of a camera when each image is generated. The processor determines whether or not an image is suitable for measurement with respect to at least one of the first image, the measurement image, and the third image.

Abstract: The methods and systems described herein provide for depth-aware image editing and interactive features. In particular, a computer application may provide image-related features that utilize a combination of a (a) the depth map, and (b) segmentation data to process one or more images, and generate an edited version of the one or more images.

Abstract: Systems and methods relate to receiving a plurality of video streams captured of a subject by a plurality of video cameras, each video stream including video frames time-synchronized according to a shared frame rate, each video camera having a known vantage point in a predetermined coordinate system; obtaining at least one three-dimensional (3D) mesh of the subject at the shared frame rate, the 3D mesh time-synchronized with the video frames of the video streams, the at least one mesh including a plurality of vertices with known locations in the predetermined coordinate system; calculating one or more lists of visible-vertices at the shared frame rate, each list including a subset of the plurality of vertices of the at least one 3D mesh of the subject, the subset being a function of the location of the known vantage point associated with at least one of the plurality of video cameras; generating one or more time-synchronized data streams at the shared frame rate, the one or more time-synchronized data streams

Abstract: In an example, an apparatus comprises logic, at least partially comprising hardware logic, to receive an input from one or more detectors proximate a display to present an output from a graphics pipeline, determine that a user is not interacting with the display, and in response to a determination that the user is not interacting with the display, to reduce a frame rendering rate of the graphics pipeline. Other embodiments are also disclosed and claimed.

Abstract: An augmented reality system and a color compensation method thereof are proposed. The method is applicable to an augmented reality system having a display and an image sensor and include the following steps. A preset object position of a virtual object with respect to an actual scene is set. An image of the actual scene is captured by using the image sensor, and the image of the actual scene is mapped to a field of view of the display to generate a background image with respect to the field of view of the display. Color compensation is performed on the virtual object according to a background overlapping region corresponding to the preset object position in the background image to generate an adjusted virtual object, and the adjusted virtual object is displayed on the display according to the preset object position.