Abstract: Systems, apparatuses and methods may provide away to render edges of an object defined by multiple tessellation triangles. More particularly, systems, apparatuses and methods may provide a way to perform anti-aliasing at the edges of the object based on a coarse pixel rate, where the coarse pixels may be based on a coarse Z value indicate a resolution or granularity of detail of the coarse pixel. The systems, apparatuses and methods may use a shader dispatch engine to dispatch raster rules to a pixel shader to direct the pixel shader to include, in a tile and/or tessellation triangle, one more finer coarse pixels based on a percent of coverage provided by a finer coarse pixel of a tessellation triangle at or along the edge of the object.

Abstract: An online system presents a content item to users and receives selections of reaction icons from the users. The online system generates a background animation with the selected reaction icons and a foreground animation to be layered on top of the background animation. The online system sends the background and foreground animations to a client device to be cached. Further, the online system presents the content item to a viewing user associated with the client device and receives a selection of a reaction icon from the viewing user. The online system selects a subset of the users based on the viewing user's affinity to the users, retrieves images of the selected users, and send the images to the client device. The client device customizes the background and foreground animations based on the images and the viewing user's reaction icon to generate a compound animation for display to the viewing user.

Abstract: In general, this disclosure describes an artificial reality system that provides asymmetric user experiences to users associated with user devices that operate according to different modes of engagement with the artificial reality system. Different user devices may have different capabilities, be used by users having different roles for an artificial reality application, or otherwise be configured to interact in a variety of ways with an artificial reality system.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: A periphery monitoring device includes: an image generation unit configured to generate a display image in which a gaze point in a virtual space is viewed from a virtual viewpoint, the virtual space being based on a model image formed by projecting a captured image obtained by imagining a periphery of a vehicle with an imaging unit mounted in the vehicle onto a model representing a three-dimensional virtual plane configured around the vehicle; and an image output unit configured to output the display image to a display unit, in which the image generation unit moves at least one of the virtual viewpoint and the gaze point in a direction including a component in a vehicle width direction of the vehicle according to an operation of a steering unit for changing a steering angle of the vehicle.

Abstract: Embodiments of the present disclosure disclose a method and apparatus for augmenting reality. A specific embodiment of the method includes: acquiring outline data of a plurality of building blocks satisfying a preset selection condition, the outline data being used to describe an outline of a building block in three-dimensional space; generating reference information based on projected line segments of the plurality of building blocks; determining, based on the reference information, a target building block in the plurality of building blocks and a superimposed region in an image acquired by the terminal, labeling information of the target building block being superimposed on the superimposed region; and superimposing the labeling information of the target building block on the determined superimposed region, to obtain an augmented reality image.

Abstract: Techniques involve rendering computing graphics from decoupled inputs. Content updates (e.g., geometry, textures, lighting, audio, etc.) for 3D objects and/or a 3D scene can provided to a compositor at different rates. The compositor buffers the inputs, interpolates between buffered values, binds data for each of the content updates, and triggers drawing the data to render a frame. If buffered data fails to satisfy some criteria, previous buffered values can be used instead of the buffered data, or a different function can be performed (e.g., extrapolation instead of interpolation). User inputs from one or more I/O components (e.g., a gamepad, keyboard, mouse, etc.) can be fed directly into the compositor, which can generate and use a 3D camera from the inputs to draw frames faster than the content updates occur. As such, the present compositor improves power efficiency, and reduces latency and increases smoothness of the input response.

Abstract: Systems, methods, and non-transitory computer-readable media can detect a trigger to initiate at least one of a pixelation animation or a depixelation animation for a media content item. A set of pixelated images can be generated based on a source image associated with the media content item. Variable durations for presenting the set of pixelated images can be determined. The set of pixelated images can be presented, based on the variable durations, to produce the at least one of the pixelation animation or the depixelation animation.

Abstract: Apparatus and method for context-aware compression. For example, one embodiment of an apparatus comprises: ray traversal/intersection circuitry to traverse rays through a hierarchical acceleration data structure to identify intersections between rays and primitives of a graphics scene; matrix compression circuitry/logic to compress hierarchical transformation matrices to generate compressed hierarchical transformation matrices by quantizing N-bit floating point data elements associated with child transforms of the hierarchical transformation matrices to variable-bit floating point numbers or integers comprising offsets from a parent transform of the child transform; and an instance processor to generate a plurality of instances of one or more base geometric objects in accordance with the compressed hierarchical transformation matrices.

Abstract: A near-eye display system includes display panel to display a near-eye lightfield frame comprising an array of elemental images and a lenslet array to present the integral lightfield frame to a user's eye. The system further includes a rendering component to generate an array of elemental images based at least in part on a sparse sampling of a source image to decrease an overlap of image data contained within each individual elemental of the array of elemental images. A method of operation of the near-eye display system includes generating an array of elemental images forming the integral lightfield frame based on a sparse sampling of the current viewpoint of the subject object to decrease an overlap of image data contained within each individual elemental image of the array.

Abstract: An apparatus and method to execute ray tracing instructions. For example, one embodiment of an apparatus comprises execution circuitry to execute a dequantize instruction to convert a plurality of quantized data values to a plurality of dequantized data values, the dequantize instruction including a first source operand to identify a plurality of packed quantized data values in a source register and a destination operand to identify a destination register in which to store a plurality of packed dequantized data values, wherein the execution circuitry is to convert each packed quantized data value in the source register to a floating point value, to multiply the floating point value by a first value to generate a first product and to add the first product to a second value to generate a dequantized data value, and to store the dequantized data value in a packed data element location in the destination register.

Abstract: An image processing method and an image processing device are provided. The image processing method includes the following steps. A light source is projected onto a 3D model via a plurality of projecting locations to generate a plurality of facial shadow pictures. The facial shadow pictures are superimposed to generate a composite shadow picture. An eye-eyebrow location, a nose location and a mouth location in a 2D facial map are obtained by way of analyzing according to the composite shadow picture. A plurality of characteristic points are calculated according to the eye-eyebrow location, the nose location and the mouth location in the 2D facial map.

Abstract: Examples of a multisource augmented reality model are defined. In an example, the system receives a query from a user. The system obtains representative data corresponding to an environment associated with the query and identifies at least one context therein. The system obtains product parameter data and identifies a parameter set therein to process the query. The system implements an artificial intelligence component to sort the product parameter data, the representative data, and the context for identifying pertinent data domains associated with the query. The system may establish a product augmented reality model corresponding to the product by performing a first cognitive learning operation on a domain from the updated pertinent data domains and the identified parameter set. The system may a list of related products for guided selling facilitating a shopping decision of the user. The system may generate an augmented reality result for the user.

Abstract: An interactive camera system with virtual reality technology is provided. The system includes an augmented reality module, an accessory database, a voice database, and an integration module. The augmented reality module generates a virtual environment, and a user can combine a three-dimensional avatar substrate with a character image to form a three-dimensional avatar that displayed in the virtual environment. The accessory database and the voice database allow the user to select different accessory patterns and different voice modules for different types of three-dimensional avatar substrates. The integration module allows professional personnel to provide technical presentations, thesis introductions, or background introductions in the virtual environment, so that the presentations or the introductions can be performed with three-dimensional augmented reality effect.

Abstract: Embodiments of the present application provide a method, apparatus, electronic device for displaying an image and a storage medium. The method and apparatus are applied to an electronic device. The method comprises: determining a display angle of a 3D wallpaper containing elements, wherein the 3D wallpaper is obtained by pasting an overall spherical panoramic image containing all the elements onto one 3D model; determining a graphic to be displayed corresponding to the display angle in the overall spherical panoramic image; and rendering the graphic to be displayed and displaying the rendered graphic. In the embodiments, when the graphic to be displayed corresponding to the display angle of the 3D wallpaper is rendered, the operation on unnecessary occluded parts is avoided, thereby reducing the amount of computation in displaying the 3D wallpaper and saving the computing resources.

Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that integrate (or embed) a non-photorealistic rendering (“NPR”) generator with a style-transfer-neural network to generate stylized images that both correspond to a source image and resemble a stroke style. By integrating an NPR generator with a style-transfer-neural network, the disclosed methods, non-transitory computer readable media, and systems can accurately capture a stroke style resembling one or both of stylized edges or stylized shadings. When training such a style-transfer-neural network, the integrated NPR generator can enable the disclosed methods, non-transitory computer readable media, and systems to use real-stroke drawings (instead of conventional paired-ground-truth drawings) for training the network to accurately portray a stroke style.

Abstract: A control surface tracks an individual cacheline in the original surface for frequent data values. If so, control surface bits are set. When reading a cacheline from memory, first the control surface bits are read. If they happen to be set, then the original memory read is skipped altogether and instead the bits from the control surface provide the value for the entire cacheline.

Abstract: Examples of systems and methods for augmented facial animation are generally described herein. A method for mapping facial expressions to an alternative avatar expression may include capturing a series of images of a face, and detecting a sequence of facial expressions of the face from the series of images. The method may include determining an alternative avatar expression mapped to the sequence of facial expressions, and animating an avatar using the alternative avatar expression.

Abstract: A mixed reality (MR) simulation system includes a console and a head mounted device (HMD). The MR system captures stereoscopic images from a real-world environment using outward-facing stereoscopic cameras mounted to the HMD. The MR system preprocesses the stereoscopic images to maximize contrast and then extracts a set of features from those images, including edges or corners, among others. For each feature, the MR system generates one or more two-dimensional (2D) polylines. Then, the MR system triangulates between 2D polylines found in right side images and corresponding 2D polylines found in left side images to generate a set of 3D polylines. The MR system interpolates between 3D vertices included in the 3D polylines or extrapolates additional 3D vertices, thereby generating a geometric reconstruction of the real-world environment. The MR system may map textures derived from the real-world environment onto the geometric representation faster than the geometric reconstruction is updated.

Abstract: A multi-layer display may include a first screen and a second screen arranged in a substantially parallel manner, with the first screen and the second screen including an array of pixels and the second screen overlapping the first screen, a light configured to provide light to the first screen and the second screen of the multi-layer display system, and a processing system comprising at least one processor and memory. The processing system may be configured to apply perspective distortion to automatically bake the desired aspects of perspective into a physically thin object. To achieve this, the object's vertices are moved along lines drawn through a fixed point in space (a primary viewpoint). From this viewpoint, regardless of any perspective distortion applied, the object will appear to not change.