Abstract: A photo filter (e.g., artistic) light field effect system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the photo filter light field effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The photo filter light field effect system generates, a photo filter light field effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.

Abstract: Methods and apparatus for merging tasks in a graphics pipeline in which, subsequent to a trigger to flush a tag buffer, one or more tasks from the flushed tag buffer are generated, each task comprising a reference to a program and plurality of fragments on which the program is to be executed, wherein a fragment is an element of a primitive at a sample position. It is then determined whether merging criteria are satisfied and if satisfied, one or more fragments from a next tag buffer flush are added to a last task of the one or more tasks generated from the flushed tag buffer.

Abstract: An example device is described for facilitating polygon localization. In various aspects, the device can comprise a processor. In various instances, the device can comprise a non-transitory machine-readable memory that can store machine-readable instructions. In various cases, the processor can execute the machine-readable instructions, which can cause the processor to localize a polygon depicted in an image, based on execution of a deep learning pipeline. In various aspects, the deep learning pipeline can comprise a circular-softmax block.

Abstract: The present invention relates to a method of streaming interactive computer graphics from a server to a client device. The method includes the steps of: intercepting graphics instructions transmitted from an application destined for a graphical processing unit (GPU) at the server; processing the graphics instructions to generate graphics data at the server; generating index information for, at least, some of the graphics data at the server; transmitting the index information in place of the graphics data to a client device; extracting corresponding graphics data stored at the client device utilizing the index information; and rendering computer graphics at a graphical processing unit (GPU) at the client device using the corresponding graphics data. A system for streaming interactive computer graphics is also disclosed.

Abstract: An information processing apparatus includes a processor and a memory connected to or incorporated in the processor. The processor acquires reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device, and generates the virtual viewpoint image by using the reference imaging device information as a reference, on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given.

Abstract: Incompatible graphics frameworks present a barrier to emulating applications of one operating system (guest OS) upon a computer system employing a different operating system (host OS) such as occurs with virtual machines. Accordingly, in order to address limitations of emulating guest OS graphic pipelines upon the host OS the inventors have established methodologies for cross-platform graphics pipeline emulation, thus enabling efficient implementations of cross-platform virtualization solutions, through the establishment of emulation keys to support generic and specific graphics pipelines together with caching sets of graphical pipelines for subsequent retrieval and execution.

Abstract: Embodiments are disclosed for a machine learning-based chroma keying process. The method may include receiving an input including an image depicting a chroma key scene and a color value corresponding to a background color of the image. The method may further include generating a preprocessed image by concatenating the image and the color value. The method may further include providing the preprocessed image to a trained neural network. The method may further include generating, using the trained neural network, an alpha matte representation of the image based on the preprocessed image.

Abstract: Systems and methods are provided for dynamically adjusting a personal boundary of an avatar in an XR environment. The system identifies a first avatar in an extended reality (XR) environment based on rule data stored in a storage. In response to the system detecting that the first avatar has entered a portion of the XR environment at a communicable distance from a second avatar, the system does the following steps. The system determines an offensiveness rating of the first avatar. The system retrieves, from the storage, an offensiveness tolerance of the second avatar. The system compares the offensiveness rating of the first avatar and offensiveness tolerance of the second avatar. In response to determining, based on the comparing, that the offensiveness rating of the first avatar exceeds the offensiveness tolerance of the second avatar, the system automatically censors one or more messages from the first avatar to the second avatar.

Abstract: A method is described for processing commands for a client computing device using a remote graphics processing unit server. The method includes receiving, by a display driver of the client computing device, a command from an application operating on the client computing device and compressing, by the display driver, the command to generate a compressed command. Compressing the command includes determining whether a resource associated with the command is available in a cache of the remote graphics processing unit server and replacing the resource with a reference to the resource, when the resource is available. The display driver transmits the compressed command to the remote graphics processing unit server for processing by a remote graphics processing unit (GPU) and receives data generated by the remote GPU based on processing the compressed command.

Abstract: An apparatus, method, and computer-readable medium for rendering a 3D image using a neural network for implicit representation of the image. UV coordinates of a texture map corresponding to a point on the image are calculated using a texture neural network. The image is rendered by applying a color value located at the UV coordinates of the texture map to the point.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for fast incremental shared constants. In aspects, a CPU may determine/update shared constant data for a first draw call of a plurality of draw calls. The shared constant data, which may correspond to at least one shader, may be updated based on a draw call update for the first draw call. The CPU may communicate the updated shared constant data for the first draw call to a GPU. The GPU may receive, in at least one register, the updated shared constant data from the CPU and configure the at least one register based on the updated shared constant data corresponding to the draw call update of the first draw call of the plurality of draw calls.

Abstract: A computer-automated separation rules compliance method is disclosed. Separation rules that establish separation distance requirements between objects in a three-dimensional (3D) virtual environment are defined. Sample locations associated with at least some of the objects in the 3D virtual environment are specified. One or more of proximity and/or collision analysis is performed on the sample locations to determine separation distances between the objects. The determined separation distances are compared to the separation distance requirements. Objects in the 3D virtual environment that violate the separation rules based on said comparing are identified.

Abstract: There is provided an image processing device that processes a projection image presented to a plurality of persons at the same time. The image processing device specifies an overlapping area in which fields of view of two or more users overlap based on information on each user, classifies objects included in the overlapping area into a first object group and a second object group, generates a common image common to all users, made up of the first object group, generates individual images different for each user, made up of the second object group, and determines an output protocol for displaying the individual images.

Abstract: Aspects of this disclosure provide techniques for generating a viseme and corresponding intensity pair. In some embodiments, the method includes generating, by a server, a viseme and corresponding intensity pair based at least on one of a clean vocal track or corresponding transcription. The method may include generating, by the server, a compressed audio file based at least on one of the viseme, the corresponding intensity, music, or visual offset. The method may further include generating, by the server or a client end application, a buffer of raw pulse-code modulated (PCM) data based on decoding at least a part of the compressed audio file, where the viseme is scheduled to align with a corresponding phoneme.

Abstract: Certain aspects of the present disclosure provide techniques for determining a pose of a three-dimensional deformable object. Embodiments include providing one or more inputs to a machine learning model based on a computer-generated three-dimensional deformable object that has a known pose. Embodiments include determining, based on one or more outputs from the machine learning model in response to the one or more inputs, a two-dimensional signature of the computer-generated three-dimensional deformable object. Embodiments include associating the two-dimensional signature with the known pose of the computer-generated three-dimensional deformable object. Embodiments include determining a respective pose of an actual three-dimensional deformable object based on an image of the actual three-dimensional deformable object and the associating.

Abstract: Systems and methods configured to facilitate animation generation are disclosed. Exemplary implementations may: capture via one or more sensors motion and/or sound made by one or more subjects in physical space and generate output signals conveying information related to the motion and/or the sound made by individual ones of the one or more subjects; store, in electronic storage, final compiled animation scenes, initial compiled animation scenes corresponding to the final compiled animation scenes, preliminary animation information associated with the final compiled animation scenes, and input refinement information; and train, from the final compiled animation scenes, the initial compiled animation scenes corresponding to the final compiled animation scenes, the preliminary animation information, and the input refinement information, an animation prediction model.

Abstract: An information processing apparatus includes at least one memory storing instructions and at least one processor that, upon execution of the instructions, is configured to operate as an instruction acquisition unit configured to acquire an instruction with respect to a virtual object in a mixed reality space from a user who is one of a plurality of users in the mixed reality space, a mode determination unit configured to determine, based on the acquired instruction, a display mode of the virtual object for another user in the mixed reality space, a viewpoint determination unit configured to determine, based on the determined display mode, a viewpoint with respect to the virtual object in the mixed reality space, and an image generation unit configured to generate an image of the mixed reality space including the virtual object viewed from the determined viewpoint.

Abstract: A graphics processor performs graphics processing in respect of a region of a render output. The graphics processing comprises obtaining a scaling factor corresponding to a desired resolution for the region. The graphics processing further comprises, in accordance with the desired resolution, obtaining scaled graphics geometry to be rendered for the region and selecting a subregion of the region to be rendered in respect of the region. The selected subregion is then rendered using the scaled graphics geometry, thereby providing a subregion of data elements rendered in accordance with the desired resolution. The graphics processor can provide efficient and flexible graphics processing when performing variable resolution rendering.

Abstract: An image signal processor for generating a converted image based on a raw image includes processing circuitry configured to store data corresponding to a plurality of lines of a received image in a line buffer, perform an image processing operation by filtering the data stored in the line buffer based on at least one filter, and divide the raw image into a plurality of sub-images and request the plurality of sub-images from a memory in which the raw image is stored, such that the plurality of sub-images are sequentially received by the line buffer, a width of each of the plurality of sub-images being less than a width of the line buffer, and the plurality of sub-images being parallel to each other.

Abstract: An animation file processing method and apparatus, a computer-readable storage medium, and a computer device are provided. The method includes: obtaining a bitmap image sequence corresponding to an original animation file; encoding a differential pixel region between a bitmap image in the bitmap image sequence and a corresponding key bitmap image when the bitmap image is a non-key bitmap image, to obtain an encoded picture corresponding to the bitmap image; and generating an animation export file corresponding to the original animation file according to encoded pictures corresponding to bitmap images in the bitmap image sequence.