Abstract: Systems and methods related to priority-based and performance-based selection of a render mode, such as a two-level binning mode, in which to execute workloads with a graphics processing unit (GPU) of a system are provided. A user mode driver (UMD) or kernel mode driver (KMD) executed at a central processing unit (CPU) configures low and medium priority workloads to be executed in a two-level binning mode and selects a binning mode for high priority workloads based on whether performance heuristics indicate that one or more binning conditions or override conditions have been met. High priority workloads are maintained in a high priority queue, while low and medium priority workloads are maintained in a low/medium priority queue, such that execution of low and medium priority workloads at the GPU can be preempted in favor of executing high priority workloads.

Abstract: A graphics processing system for performing tile-based rendering of a scene that comprises safety-related primitives. The system comprises a plurality of graphics processing units (GPUs), each configured to i) receive tile data identifying one or more protected tiles comprising at least part of a safety-related primitive, ii) process two respective sets of protected tiles, and iii) based on said processing, generate two respective checksums for each respective set of protected tiles. The two respective sets of protected tiles are mutually exclusive, and each respective set and each protected tile being processed by two different GPUs. The system comprises a comparison unit configured to compare one or more pairs of checksums, each pair comprising a respective checksum generated based on a same respective set of protected tiles and generated by different GPUs. The graphics processing system is configured to perform one or more actions based on an outcome of said comparison.

Abstract: A data processing system implements a receiving a textual input comprising a query for a first image. The data processing system also implements analyzing the textual input to determine a predicted color palette associated with a subject matter of the query; and procedurally generating the first image using the predicted color palette. Another implementation of the data processing system implements providing the textual input to a first machine learning model to obtain the first image, the first machine learning model being trained using a dataset comprising abstract imagery and analyzing the textual input using the first machine learning model to obtain the first image in response to receiving the textual input.

Abstract: A system and method for dental image file capture and manipulation for the purpose of dental, orthodontic, and periodontic tracking, diagnostics, and dental prosthetic and implant design. Augmented intelligence in dental file segmentation using descriptor matrixes with a common centroid or reference locus as a reference point describing related dental surface structures reduces the data size of dental image files such that dental images can be manipulated and compared to other dental files and can be used in machine learning and matching systems. This expedites the design and manufacture of dental prosthetics, appliances, and in dental monitoring and treatment.

Abstract: A technique for improving progressive encoded JPEG includes displaying an oversmoothed version of an image as the image data is being received. The oversmoothed image may be smoothed according to a smoothing kernel, e.g., a convolution kernel (such as a Gaussian). The oversmoothed image is a first layer over which other image layers are displayed. It is noted that the oversmoothed image may present a recognizable version of the image to a user, including recognizable versions of various image features (e.g., persons, objects). As the other layers are rendered on the display, these image features remain visible to the user. That is, the image features are not artifacts that may disappear with the rendering of final image layers; this may occur with the conventional progressive encoded images and interferes with the user experience.

Abstract: In various examples, a virtually animated and interactive agent may be rendered for visual and audible communication with one or more users with an application. For example, a conversational artificial intelligence (AI) assistant may be rendered and displayed for visual communication in addition to audible communication with end-users. As such, the AI assistant may leverage the visual domain—in addition to the audible domain—to more clearly communicate with users, including interacting with a virtual environment in which the AI assistant is rendered. Similarly, the AI assistant may leverage audio, video, and/or text inputs from a user to determine a request, mood, gesture, and/or posture of a user for more accurately responding to and interacting with the user.

Abstract: A graphics processing unit (GPU) or other apparatus includes a plurality of shader engines. The apparatus also includes a first front end (FE) circuit and one or more second FE circuits. The first FE circuit is configured to schedule geometry workloads for the plurality of shader engines in a first mode. The first FE circuit is configured to schedule geometry workloads for a first subset of the plurality of shader engines and the one or more second FE circuits are configured to schedule geometry workloads for a second subset of the plurality of shader engines in a second mode. In some cases, a partition switch is configured to selectively connect the first FE circuit or the one or more second FE circuits to the second subset of the plurality of shader engines depending on whether the apparatus is in the first mode or the second mode.

Abstract: A method including defining, in a buffer, particles having initial positions in an absolute coordinate system independent of a graphical user interface (GUI) in which the particles are renderable. The method also includes assigning memory ranges within the buffer to corresponding ones of the particles. The method also includes generating, in the memory ranges, updated positions for the particles. The method also includes determining, in the memory ranges and from a combination of the initial positions and the updated positions, corresponding vertices for each of the particles. The method also includes creating, from the corresponding vertices, corresponding particle trails for the particles. The method also includes storing the corresponding particle trails in the memory ranges associated with the particles.

Abstract: An apparatus including circuitry configured for: in a first-person perspective mediated reality state, rendering mediated reality content as content distributed across a first area of a user's field of view, wherein a point of view of a user determines a point of view within a three-dimensional virtual space and determines at least part of the content distributed across the first area of a user's field of view as a virtual scene; responding to at least one user gesture to enter a spatially consolidated state; and in the spatially consolidated state, rendering the mediated reality content as content distributed across a second area of a user's field of view, wherein the second area is smaller than the first area and the point of view of the user does not determine the content distributed across the second area of a user's field of view.

Abstract: An embodiment user terminal includes an image acquisition part, a user interface configured to display an image photographed through the image acquisition part, a position detection sensor configured to detect a position of the user terminal, and a controller configured to determine a recommended point of interest (POI) among a plurality of POIs located around the user terminal, based on operation information about each of the plurality of POIs, a user's search history for a POI, and the user's POI scrap, and to control the user interface to display an augmented reality (AR) image corresponding to the recommended POI by superimposing the AR image on the image photographed through the image acquisition part.

Abstract: An electronic device includes a camera, a display, and a processor. The processor displays a user interface including menu items supporting entry into an edit mode for a body part of an emoji displayed on the display. The processor captures a user face image using the camera, upon a user requesting facial expression edit mode from the interface. The processor generates a facial expression motion file from the user face image. The processor captures a user body image using the camera upon the user requesting body motion edit mode. The processor generates a body motion file from the user body image. The processor adjusts sync for combining the generated facial expression motion file and body motion file. The processor generates a customized emoji sticker on which user facial expression and body movement are reflected by combining the sync-adjusted facial expression motion file and body motion file.

Abstract: A floor plan image generating methodology is provided. The methodology includes: acquiring a boundary of a target building and a layout constraint of the target building; outputting multiple first floor plan images according to the layout constraint of the target building; selecting multiple second floor plan images from the multiple first floor plan images; applying a layout constraint of each of the second floor plan images to the boundary of the target building, and obtaining a layout of the target building corresponding to each of the multiple second floor plan images; inputting the layout of the target building and the boundary of the target building into a floor plan image generating network; and obtaining a predicted floor plan image of the target building outputted by the floor plan image generating network.

Abstract: Techniques for executing computing work by a plurality of chiplets are provided. The techniques include assigning workgroups of a kernel dispatch packet to the chiplets; by each chiplet, executing the workgroups assigned to that chiplet; for each chiplet, upon completion of all workgroups assigned to that chiplet for the kernel dispatch packet, notifying the other chiplets of such completion; and upon completion of all workgroups of the kernel dispatch packet, notifying a client of such completion and proceeding to a subsequent kernel dispatch packet.

Abstract: A photo filter (e.g., artistic) light field effect system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the photo filter light field effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The photo filter light field effect system generates, a photo filter light field effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.

Abstract: Methods and apparatus for merging tasks in a graphics pipeline in which, subsequent to a trigger to flush a tag buffer, one or more tasks from the flushed tag buffer are generated, each task comprising a reference to a program and plurality of fragments on which the program is to be executed, wherein a fragment is an element of a primitive at a sample position. It is then determined whether merging criteria are satisfied and if satisfied, one or more fragments from a next tag buffer flush are added to a last task of the one or more tasks generated from the flushed tag buffer.

Abstract: An example device is described for facilitating polygon localization. In various aspects, the device can comprise a processor. In various instances, the device can comprise a non-transitory machine-readable memory that can store machine-readable instructions. In various cases, the processor can execute the machine-readable instructions, which can cause the processor to localize a polygon depicted in an image, based on execution of a deep learning pipeline. In various aspects, the deep learning pipeline can comprise a circular-softmax block.

Abstract: The present invention relates to a method of streaming interactive computer graphics from a server to a client device. The method includes the steps of: intercepting graphics instructions transmitted from an application destined for a graphical processing unit (GPU) at the server; processing the graphics instructions to generate graphics data at the server; generating index information for, at least, some of the graphics data at the server; transmitting the index information in place of the graphics data to a client device; extracting corresponding graphics data stored at the client device utilizing the index information; and rendering computer graphics at a graphical processing unit (GPU) at the client device using the corresponding graphics data. A system for streaming interactive computer graphics is also disclosed.

Abstract: An information processing apparatus includes a processor and a memory connected to or incorporated in the processor. The processor acquires reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device, and generates the virtual viewpoint image by using the reference imaging device information as a reference, on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given.

Abstract: Incompatible graphics frameworks present a barrier to emulating applications of one operating system (guest OS) upon a computer system employing a different operating system (host OS) such as occurs with virtual machines. Accordingly, in order to address limitations of emulating guest OS graphic pipelines upon the host OS the inventors have established methodologies for cross-platform graphics pipeline emulation, thus enabling efficient implementations of cross-platform virtualization solutions, through the establishment of emulation keys to support generic and specific graphics pipelines together with caching sets of graphical pipelines for subsequent retrieval and execution.

Abstract: Embodiments are disclosed for a machine learning-based chroma keying process. The method may include receiving an input including an image depicting a chroma key scene and a color value corresponding to a background color of the image. The method may further include generating a preprocessed image by concatenating the image and the color value. The method may further include providing the preprocessed image to a trained neural network. The method may further include generating, using the trained neural network, an alpha matte representation of the image based on the preprocessed image.