Abstract: A machine is configured to generate a representation of a rectangular image, which may depict a projection of a spherical image. The machine generates a first triangular array of pixels based on an upper rectangular region of the rectangular image. The machine generates a second triangular array of pixels based on a lower rectangular region of the rectangular image, and the machine generates a rectangular array of pixels based on a middle rectangular region of the rectangular image. The machine then generates an output image that includes the first triangular array of pixels, the second triangular array of pixels, and the rectangular array of pixels. After the output image is generated, the machine may provide the generated output image for use as a representation of rearranged image data of the spherical image.

Abstract: Systems and methods of using augmented reality (AR) with object recognition (OR) in a physical environment to advance a narrative may be provided. For example, the system may access narrative data representing the narrative. The system may, for a first node of the one or more nodes: generate a user interface associated with the narrative for the first node and access a first decision rule specifying a first physical object to be recognized to advance past the first node in the narrative. The system may further perform image recognition on an image of the physical environment, determine that the first physical object is in the physical environment based on the image recognition, transition from the first node in the narrative based on the first decision rule and the determination, and update the user interface to a second node in the narrative based on the transition from the first node.

Abstract: A computer-implemented method is provided. The computer-implemented method includes inputting a low-resolution image and a plurality of high-resolution images into a feature extractor, the low-resolution image and the plurality of high-resolution images including images of a target object; obtaining, by the feature extractor, feature maps of the low-resolution image and the plurality of high-resolution images; comparing similarities between the feature maps of the low-resolution image and the plurality of high-resolution images; obtaining selected feature maps of one or more selected high-resolution images of the plurality of high-resolution images most similar to the low-resolution image; inputting the selected feature maps into a generator to output a repair image; enhancing the low-resolution image using a pre-processing image enhancing process to generate an enhanced image; and morphing the repair image with the enhanced image.

Abstract: The mixed reality high-simulation battlefield first aid training platform includes a hardware part and a software part; the hardware part includes a data processing system, a real-time monitoring system, a head-mounted display device, an intelligent shooting instrument, a wearable sensing instrument, and a manipulation handle; the software part includes a 3D battlefield scene simulation system, a 3D wounded simulation system, a wounded rescue decision system, and a movable large space team cooperation and virtual interaction system; the 3D battlefield scene simulation system includes a geographic environment 3D model and a battle scene 3D model; the data processing system includes a PC terminal having a wireless communication module. A battlefield environment can be highly simulated; a full-process experience including battles with enemies, wounded arising, rescue implementation, and tactical mission completion is provided; battlefield rescue decision and team cooperation training are highlighted.

Abstract: Before a network jitter occurs, a server receives operation instructions from an electronic device, generates a plurality of first rendering instruction streams based on the operation instructions, sends the plurality of first rendering instruction streams to the electronic device, and generates and stores one or more first rendering contexts for one or more first rendering instruction streams in the plurality of first rendering instruction streams. When the network jitter occurs, the server generates a second rendering instruction stream based on received operation instructions, and generates and stores a second rendering context based on the second rendering instruction stream. After the recovery from the network jitter, the server sends a set of rendering context differences to the electronic device. In this way, network transmission traffic after the recovery from the network jitter is reduced, transmission and processing delays are also reduced, and user experience is improved.

Abstract: A graphics pipeline cache reconstruction operation is implemented to reconstruct one or more graphics pipeline caches for a current client gaming session based on one or more pipeline structures. The pipeline structures each represent a graphical object rendered during a respective previous client gaming session and are used to reconstruct one or more graphics pipeline caches that include graphics pipeline cache objects related to the graphical objects of the pipeline structures. These graphics pipeline cache objects are used to initialize one or more graphics pipelines used to render the graphical objects in a gaming application for a current client gaming session.

Abstract: An apparatus comprising a sorting unit to sort primitives of a graphics image, the primitives to be grouped, each group to form a first level node of a hierarchical acceleration structure; a parallel reconfigurable clustering array to construct the hierarchical acceleration structure, the parallel reconfigurable clustering array comprising a plurality of processing clusters, each cluster comprising: parallel efficiency analysis circuitry to evaluate different groupings of the first level nodes for a next level of the hierarchical acceleration structure to determine efficiency values for the different groupings; and node merge circuitry to merge the first level nodes based on the efficiency values to form second level nodes.

Abstract: A shooting method executed by a shooting device includes: shooting first images of a target space; generating a first three-dimensional point cloud of the target space, based on the first images and a first shooting position and a first shooting orientation of each of the first images; and determining a first region of the target space for which generating a second three-dimensional point cloud which is denser than the first three-dimensional point cloud is difficult, using the first three-dimensional point cloud and without generating the second three-dimensional point cloud. The determining includes generating a mesh using the first three-dimensional point cloud, and determining the region other than a second region of the target space for which the mesh is generated.

Abstract: The present disclosure provides a color correction method, including: in response to original color data of a pixel, converting the original color data into original color coordinates in an original color space; mapping the original color coordinates to a sampling point space to obtain a mapped point corresponding to the original color coordinates in the sampling point space, and determining, according to mapped coordinates of the mapped point, a plurality of reference point coordinates corresponding to the mapped coordinates; obtaining reference point addresses of the reference point coordinates, and simultaneously reading color data of the reference point coordinates according to the reference point addresses; and obtaining corrected color data of the pixel through an interpolation algorithm according to the color data of the reference point coordinates. The present disclosure further provides a Field Programmable Gate Array, a chip and a display device.

Abstract: Apparatuses, systems, and techniques to generate blue noise masks for real-time image rendering and enhancement. In at least one embodiment, a vector-valued noise mask is generated and applied to one or more images to generate one or more enhanced images for image processing (e.g., real-time image rendering). In at least one embodiment, the noise mask includes vector values per pixel and is able to handle the temporal domain (e.g., add time to the spatial domain) to improve image quality when rendering images over multiple frames.

Abstract: Devices and methods for node traversal for ray tracing are provided, which comprise casting a first ray in a space comprising objects represented by geometric shapes, traversing, for the first ray, at least one first node of an accelerated hierarchy structure representing an approximate volume of a group of the geometric shapes and a second node representing a volume of one of the geometric shapes, casting a second ray in the space, selecting, for the second ray, a starting node of traversal based on locations of intersection of the first ray and the second ray and an identifier which identifies one or more nodes intersected by the first ray and traversing, for the second ray, the accelerated hierarchy structure beginning at the starting node of traversal.

Abstract: Disclosed herein are system, method, and computer program product embodiments for utilizing non-RAM memory to implement large digital display emulations. An embodiment operates by generating, by an emulator device, a pixel map of a digital display, wherein the pixel map comprises a plurality of pixels representative of a plurality of light emitting elements arranged on a viewable surface of the large digital display. A distance and orientation of a virtual viewer to the viewable surface of the large digital display is generated and the emulator device emulates the large digital display based on the pixel map and the distance and the orientation of the virtual viewer and renders the digital content based on the emulated large digital display.

Abstract: A projection method is provided. The method includes acquiring an image of a real scene using the camera. A target object is identified from the image of the real scene, and a target area is determined according to the target object. In response to a projection command, a projection content of a virtual scene is acquired. The projection content or a part of the projection content is projected outside the target area using a projection device.

Abstract: Implementations can provide a virtual separate space with respect to a virtual venue hosting a virtual reality (VR) experience, such as a concert, a sports game, a meeting, etc., e.g., to replicate the feeling of a side conversation to discuss the VR experience. Some implementations can create a more intimate experience for users viewing a VR experience by providing a quiet, curated space that can be customized, e.g., by changing the look of users' avatars and their virtual environment, without their interactions being observed by others viewing the VR experience at the virtual venue. The virtual separate space can include a moderated version of the VR experience, such as a smaller version of the VR experience with the sounds of the VR experience muffled. Thus, users within the virtual separate space can step away from the VR experience to enter a more controlled environment, while still enjoying the VR experience.

Abstract: Provided is an image rendering method performed by a computer device, including: selecting, from a plurality of pre-compiled shaders associated with a rendering engine, a target shader corresponding to a graphic interface of an application program; acquiring scene data corresponding to a render target according to a rendering instruction triggered by the application program, and writing the scene data into a cache block; determining a plurality of render passes corresponding to the render target; merging, in the cache block, the plurality of render passes into a merged render pass based on the target shader; and performing image rendering on the scene data in the cache block in the merged render pass to obtain an image rendering result in the cache block.

Abstract: The present disclosure provides a method of processing an information, a method of rending an image, and an electronic device. A specific implementation solution may include: acquiring a target image obtained by rendering, wherein the target image contains one or more target parameter information corresponding to one or more rendering indexes respectively; generating a rendering code according to the target parameter information of the target image, wherein the rendering code is for rendering an image to be rendered; and transmitting the rendering code to a second electronic device.

Abstract: A three-dimensional (3D) animation system automatically assigns accurate animation physics to points of a point cloud to realistically simulate motion of the points in response to different applied forces. The 3D animation system receives the points that are defined with positions in a 3D space and with visual characteristics. The 3D animation system analyzes one or more of the positions and the visual characteristics of the points, classifies the points based on a commonality in the positions or the visual characteristics of the points being associated with a particular classification, and maps a set of animation physics that is defined for the particular classification to the points. The 3D animation system may then animate the points based on the set of animation physics generating an effect in response to a force that is applied to the points.

Abstract: Embodiments are disclosed for optimizing a material graph for replicating a material of the target image. Embodiments include receiving a target image and a material graph to be optimized for replicating a material of the target image. Embodiments include identifying a non-differentiable node of the material graph, the non-differentiable node including a set of input parameters. Embodiments include selecting a differentiable proxy from a library of the selected differentiable proxy is trained to replicate an output of the identified non-differentiable node. Embodiments include generating an optimized input parameters for the identified non-differentiable node using the corresponding trained neural network and the target image. Embodiments include replacing the set of input parameters of the non-differentiable node of the material graph with the optimized input parameters.

Abstract: In one example, an apparatus comprises: a buffer memory; and a memory access circuit configured to: fetch, from a first memory, a set of first groups of data elements of a first matrix, each first group of data elements being stored at consecutive memory addresses at the first memory; based on a first configuration, store the set of first groups of data elements at consecutive memory addresses or at non-consecutive memory addresses at the buffer memory; based on a second configuration that defines a memory address offset, fetch a set of second groups of the data elements from the buffer memory, each second group of the data elements being stored at consecutive memory addresses of the buffer memory, each second group being separated by the memory address offset in the buffer memory; and store each fetched second group at consecutive addresses of a destination memory to form a second matrix.

Abstract: Methods and apparatus relating to scalar core integration in a graphics processor. In an example, an apparatus comprises a processor to receive a set of workload instructions for a graphics workload from a host complex, determine a first subset of operations in the set of operations that is suitable for execution by a scalar processor complex of the graphics processing device and a second subset of operations in the set of operations that is suitable for execution by a vector processor complex of the graphics processing device, assign the first subset of operations to the scalar processor complex for execution to generate a first set of outputs, assign the second subset of operations to the vector processor complex for execution to generate a second set of outputs. Other embodiments are also disclosed and claimed.