Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for dynamic wave pairing. A graphics processor may allocate one or more GPU workloads to one or more wave slots of a plurality of wave slots. The graphics processor may select a first execution slot of a plurality of execution slots for executing the one or more GPU workloads. The selection may be based on one of a plurality of granularities. The graphics processor may execute, at the selected first execution slot, the one or more GPU workloads at the one of the plurality of granularities.

Abstract: Methods and coarse depth test logic perform coarse depth testing in a graphics processing system in which a rendering space is divided into a plurality of tiles. A depth range for a tile identifies a depth range based on primitives previously processed. A determination is made based on the depth range for the tile as to whether all or a portion of a primitive is hidden in the tile. If at least a portion of the primitive is not hidden in the tile, a determination is made as to whether the primitive or a primitive fragment thereof has better depth than the primitives previously processed for the tile. If so, the primitive or the primitive fragment is identified as not requiring a read of a depth buffer to perform full resolution depth testing, such that a determination that at least a portion of the primitive is hidden in the tile causes full resolution depth testing not to be performed on at least that portion of the primitive.

Abstract: An apparatus and method for merging primitives and coordinating between vertex and ray transformations on a shared transformation unit. For example, one embodiment of a graphics processor comprises: a queue comprising a plurality of entries; ordering circuitry/logic to order triangles front to back within the queue; pairing circuitry/logic to identify triangles in the queue sharing an edge and to merge the triangles sharing an edge to produce merged triangle pairs; and shared transformation circuitry to alternate between performing vertex transformations on vertices of the merged triangle pairs and to performing ray transformations on ray direction/origin data.

Abstract: Efficient 3D geospatial mapping is disclosed. A 3D geospatial map of an area of interest is generated from 2D satellite imagery. The 2D imagery is preprocessed to generate a point cloud of the area of interest. The point cloud is optimized by removing atmospheric clouds and shadows. A 3D geographical information system (GIS) map with multiple levels of details (LOD) is generated.

Abstract: Provided is a method for generating high-quality isosurface mesh in real time, which takes the Marching Cubes algorithm as a baseline to efficiently generate a high-quality mesh of a 3D model, re-examines the case table in the MC algorithm, and puts forward the concept of equivalent edges. By combining with the remeshing technology, the MC algorithm is optimized from three aspects: deleting equivalent edges with the worst performance from the case table by using connectivity modification and vertex insertion technology; changing the geometric shape of the active edge to make it more perpendicular to the isosurface; and moving the shared cut points of cube cells. According to the present application, the mesh with a higher quality is generated at the running speed close to the standard MC algorithm, and the mesh quality is close to the post-processing remeshing algorithm with extremely high time consumption.

Abstract: The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor.

Abstract: Systems and methods are provided for performing operations including: receiving, via a messaging application, input that selects a collection of augmented reality items; obtaining an identifier of the collection of the augmented reality items; searching, based on the identifier, a plurality of augmented reality items to identify a subset of augmented reality items associated with the identifier; causing the messaging application to present the subset of augmented reality items; and causing the messaging application to modify an image based on a first augmented reality item in the subset.

Abstract: An illumination system for monitoring and illuminating an operating region includes at least one light assembly including at least one illumination source configured to selectively direct a light emission in a portion of the operating region. At least one imager is configured to capture image data in a field of view in the operating region. A controller is in communication with the light assembly and the imager. The controller is configured to process image data captured in the field of view and identify a plurality of objects detected in the image data based on an object library. Track a location of each of the plurality of objects and store the location of each of the objects.

Abstract: A method and a system for rendering a boundary of a map area within a game map, a computer readable storage medium, and a method for rendering includes: obtaining a boundary of a map area within a game map, and expanding the boundary toward the inside of the boundary along a normal direction of the boundary to form a fuzzy boundary; obtaining each boundary vertex of the fuzzy boundary, and linearly extending a preset distance from the boundary vertex along the normal direction of the fuzzy boundary to form a boundary grid; rendering a boundary color within a first range between the fuzzy boundary and the boundary grid, and rendering a boundary transparency within a second range that expands a preset distance from the fuzzy boundary to the inside of the boundary; rendering the boundary color from the first range with convolutional incremental expansion until the second range is covered.

Abstract: Provided is an image processing method wherein a computer: generates an estimation model for estimating the colorized image from the line-drawing image for each element through machine learning using the learning data of that element; identifies the element corresponding to the subject line-drawing image; generates the colorized image that is to be paired with the subject line-drawing image, on the basis of the estimation model corresponding to the identified element and the subject line-drawing image; generates a colorization layer of an image file including a line-drawing layer and the colorization layer by using the subject colorized image; extracts the modified colorization layer and the corresponding line-drawing layer as the image pair for learning; and stores a pair of the line-drawing image of the extracted line-drawing layer and the colorized image of the extracted colorization layer, as the learning data, in association with the element corresponding to the estimation model.

Abstract: Computer generated (CG) hair for a virtual character can include strand-based (instanced) hair in which many thousands of digital strands represent real human hair strands. Strand-based hair can appear highly realistic, but rendering strand-based hair in real-time presents challenges. Techniques for generating textured polygon strip (poly strip) hair for a virtual character can use as an input previously-generated strand-based hair for the virtual character. Poly strips can be generated for a sampled set of strands in the strand-based hair. Additional poly strips may be generated near hairlines or part lines. Hair textures from a hair texture library can be matched to the poly strips. The matched textures can be scaled and packed into a region of texture space (e.g., a square region), which provides improved computer access, efficiency, and speed. A rendering engine can use the poly strips and the packed hair textures to render the character's hair in real-time.

Abstract: A method and a virtual dressing system (VDS) for rendering a representation of a user in outfits from a virtual wardrobe are provided. The VDS acquires images of outfits via scanning using a camera or from a user device to store the images in a virtual wardrobe. The VDS acquires and displays on an interactive full-length display panel weather information of predetermined locations. The VDS scans the body of the user to generate a user image and selects outfits appropriate to the acquired weather and dimensions of the generated user image from images of outfits in the virtual wardrobe or in preselected locations on a computer network. The VDS displays the images of the selected outfits. On receiving a choice of an outfit from the user, the VDS renders a representation of the user in the chosen outfit on the full-length interactive display panel, updating the rendition on request.

Abstract: Disclosed is a system and associated methods that account for the change in coloring or tint that some wavelengths of light have on materials of an object, and that generate an object model with the accounted for change in coloring or tint removed from the pixels or constructs of that model. The system receives spectral data in different electromagnetic spectrum bands for a particular surface of the object. The system measures a first quality of the light that illuminates the object, and determines a reactivity of the particular surface to the first quality of the light based on the spectral data matching a spectral signature of a material having that reactivity. The system removes the light effects on the particular surface by adjusting the spectral data according to the reactivity to the first quality of the light and measuring the first quality in the light illuminating the object.

Abstract: A messaging system performs image processing to relight objects with neural networks for images provided by users of the messaging system. A method of relighting objects with neural networks includes receiving an input image with first lighting properties comprising an object with second lighting properties and processing the input image using a convolutional neural network to generate an output image with the first lighting properties and comprising the object with third lighting properties, where the convolutional neural network is trained to modify the second lighting properties to be consistent with lighting conditions indicated by the first lighting properties to generate the third lighting properties.

Abstract: Systems, methods, and computer-readable media are provided for graph data modeling. In accordance with one implementation, a method is provided that includes operations performed by at least one processor. The operations of the method include receiving raw data and determining a model for the raw data, wherein the model defines the graph structure for the raw data. The method also includes converting the raw data to fit the model, and generating at least a portion of a graph based on the raw data and the model, wherein the graph produces modeled data. The method also includes archiving the graph.

Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

Abstract: A pose estimation apparatus (110) obtains a plurality of images captured by a plurality of image capturing apparatuses (100) from different directions, specifies an image that is to be used for generating a three-dimensional pose model indicating a plurality of joint positions of an object, from the plurality of images, and generates a three-dimensional pose model of the object based on the specified image.

Abstract: An apparatus for mounting on a head including a frame, A face-wearable near-ocular optics and a micro-display for displaying data in front of the eyes is provided. A computing device is coupled to the micro-display. At least one sensor is coupled to the computing device for receiving biometric human information.

Abstract: A system and method for providing neurological function analysis and treatment to a person using virtual reality systems. The system and methods comprise a data capture system that receives, fuses, and integrates sensor data from various sensors, a virtual reality engine which uses the integrated sensor information to generate an environmental model and a tracking model, and a therapeutic engine which can assess both the cognitive and physical condition the person, determine a training regime based on the assessment, and apply therapies while the person is engaged in a virtual reality environment. The training regimen can comprise brainwave entrainment and/or dual-task stimulation via virtual elements. In some embodiments, a medical professional may engage with the person in the virtual reality environment.

Abstract: A method for generating a three-dimensional image of an object, comprising receiving a set of input point cloud data from an imaging system, the set of input point cloud data comprising two or more input point clouds, determining, for each point in the respective input point clouds, a value of a quality parameter that reflects a degree of uncertainty in the three dimensional coordinates as specified for that point, generating an output point cloud for generating a three-dimensional representation of the object surface, wherein, for each point in the output point cloud, the coordinates of the respective point are computed based on the coordinate values of the points in the input point clouds, wherein the extent to which the coordinate values in the respective input point clouds are taken into consideration in the computation is determined based on the values of the quality parameter associated with those respective points.