Abstract: There is provided a method and apparatus to generate audio data for a user, the apparatus comprising: an input device to receive one or more inputs derived from an environment in which the user is located; and a processor configured to obtain an acoustic profile for the environment based on or in response to the one or more inputs, synthesize audio data having audio characteristics corresponding to a sound source in the environment in accordance with the acoustic profile, and output the synthesized audio data for use by the user.

Abstract: An image processing system for an extended reality, XR, device comprising an eye-tracking subsystem, for determining a focus region of the eye, and a processor. The processor is configured to process application data to render image content for an application for display on the XR device, and obtain metadata indicating that a virtual object is to be generated as a hologram as part of the image content for display. Based on a determination that the virtual object belongs to a predetermined class of objects and is to be displayed in the focus region, the processor performs, using a neural network corresponding to the predetermined class of objects, foveated processing of the image content, including at least part of the hologram, such that relatively high-quality image content is generated for display in the focus region and relatively low-quality image content is generated for display outside the focus region.

Abstract: A device has a content processing component operable in a content processing state, and a content transducer configured to provide augmented reality data to a user of the device based on an output of the content processing component. The device has a receiver operable to receive captured data indicative of a health condition of a user of the device. The device has a processor configured to process the captured data to identify a trigger indicative of a possible change in the health condition of a user, and in response to the trigger, modify the content processing state of the content processing component such that at least one characteristic of the augmented reality data is modified.

Abstract: A method of compressing kernels comprising detecting a plurality of replicated kernels. The plurality of replicated kernels comprise kernels. The method also comprises generating a composite kernel from the replicated kernels. The composite kernel comprises kernel data and meta data indicative of the rotations applied to the composite kernel data. The method also comprises storing a composite kernel.

Abstract: Example methods, apparatuses, and/or articles of manufacture are disclosed that may implement, in whole or in part, techniques to process portions of an image frame according to a level of diminished signal information. Portions of an image frame experiencing diminished signal information may be sampled a lower rate/more sparsely to reduce impacts to downstream image processing resources.

Abstract: A data processor is disclosed in which groups of execution threads comprising a thread group can execute a set of instructions in lockstep, and in which a plurality of execution lanes can perform processing operations for the execution threads. In response to an execution thread issuing circuit determining whether a portion of active threads of a first thread group and a portion of active threads of a second thread group use different execution lanes of the plurality of execution lanes, the execution thread issuing circuit issuing both the portion of active threads of a first thread group and a portion of active threads of a second thread group for execution. This can have the effect of increasing data processor efficiency, thereby increasing throughput and reducing latency.

Abstract: Disclosed herein is a graphics processor that comprises a programmable execution unit operable to execute programs to perform graphics processing operations. The graphics processor further comprises a dedicated machine learning processing circuit operable to perform processing operations for machine learning processing tasks. The machine learning processing circuit is in communication with the programmable execution unit internally to the graphics processor. In this way, the graphics processor can be configured such that machine learning processing tasks can be performed by the programmable execution unit, the machine learning processing circuit, or a combination of both, with the different units being able to message each other accordingly to control the processing.

Abstract: There is provided an apparatus configured to operate as a shader core, the shader core configured to perform a complex rendering process comprising a rendering process and a machine learning process, the shader core comprising: one or more tile buffers configured to store data locally to the shader core, wherein during the rendering process, the one or more tile buffers are configured to store rendered fragment data relating to a tile; and during the machine learning process, the one or more tile buffers are configured to store an input feature map, kernel weights or an output feature map relating to the machine learning process.

Abstract: A method to operate a head-mountable processing system, is provided. The head-mountable processing system comprising generating one or more control signals based upon a visual motion of a sequence of images for display by the head-mountable processing system, and transmitting the generated one or more control signals to a plurality of transducers to stimulate a wearer's vestibular system.

Abstract: There is provided a processor configured to transfer data to a plurality of processor circuits. The apparatus includes broadcast circuitry that broadcasts first machine learning data to at least a subset of the plurality of processor circuits.

Abstract: A method of controlling an imaging system for a Head Mounted Display (HMD) device. The method comprises capturing an external scene, for example using a camera, determining an attenuation pattern, for rendering a filter area. The method also comprises determining, based on the captured external scene, a compensation pattern to for compensating at least part of the filter area, attenuating the external scene using the attenuation pattern and generating a holographic image of a virtual object, the holographic image including the compensation pattern.

Abstract: A method of reducing kernel computations; the method comprising ordering a plurality of kernel channels. A first of the ordered kernel channels is then convolved with input data to produce a convolution output, and it is determined whether to convolve one or more subsequent kernel channels of the ordered kernel channels. Determining whether to convolve subsequent kernel channels comprises considering a potential contribution of at least one of the one or more subsequent kernel channels in combination with the convolution output.

Abstract: Circuitry comprises processing circuitry to access a hierarchy of at least two levels of cache memory storage; memory circuitry comprising plural storage elements, at least some of the storage elements being selectively operable as cache memory storage in respective different cache functions; and control circuitry to allocate storage elements of the memory circuitry for operation according to a given cache function.

Abstract: A fault detection scheme for a data processor that comprises a programmable execution unit operable to execute programs to perform processing operations, and in which when executing a program, the execution unit executes the program for respective execution threads, each execution thread corresponding to a respective work item. In order to detect faults, a set of two or more identical execution threads is generated. The identical execution threads when executed perform identical processing for the same work item and a result of the processing of the same work item can thus be compared to determine whether there is a fault associated with the data processor.

Abstract: A data processing system including storage. The data processing system also includes at least one processor to generate output data using at least a portion of a first neural network layer and generate a key associated with at least the portion of the first neural network layer. The at least one processor is further operable to obtain the key from the storage and obtain a version of the output data for input into a second neural network layer. Using the key, the at least one processor is further operable to determine whether the version of the output data differs from the output data.

Abstract: A system includes a fixed-point accumulator for storing numbers in an anchored fixed-point number format, a data interface arranged to receive a plurality of weight values and a plurality of data values represented in a floating-point number format, and logic circuitry. The logic circuitry is configured to: determine an anchor value indicative of a value of a lowest significant bit of the anchored fixed-point number format; convert at least a portion of the plurality of data values to the anchored fixed-point number format; perform MAC operations between the converted at least portion and respective weight values, using fixed-point arithmetic, to generate an accumulation value in the anchored fixed-point number format; and determine an output element of a later of a neural network in dependence on the accumulation value.

Abstract: In a graphics processing system comprising a graphics processor, a main memory, and a memory management unit, when rendering a frame that represents a view of a scene comprising one or more objects using a ray tracing process and the ray tracing process requires a traversal of a ray tracing acceleration data structure indicative of the distribution of geometry for the scene being rendered to determine geometry for the scene that may be intersected by a ray, at least part of the traversal of the ray tracing acceleration data structure is performed by the memory management unit (MMU).

Abstract: An input data array is subjected to neural network processing to generate a result of the neural network processing for the input data array. A perturbation is applied to a part (but not all of) the input data array, with neural network processing then performed using the so-perturbed version of the input data array. However only some (and not all) of the perturbed version is subjected to neural network processing, based on the part of the input data array to which the perturbation has been applied. The result of the neural network processing of the perturbed version of the input data array is compared with the result of the neural network processing of the input data array without the perturbation, to determine whether the perturbation of the input data array has an effect on the result of the neural network processing.

Abstract: When processing regions of interest in frames in a data processing system that can execute a plurality of neural networks that are each configured to more optimally process a region of interest of a respective size, a region of interest is first identified within a frame, the size of the region of interest is determined, and one of the plurality of available neural networks is selected to use to process the region of interest based on the determined size. The region of interest is scaled to produce a scaled version of the region of interest, where the scaling is determined based on the selected neural network. The scaled version of the region of interest is then processed using the selected neural network.

Abstract: There is provided a method and apparatus to generate audio data for a user, the apparatus comprising: an input device to receive one or more inputs derived from an environment in which the user is located; and a processor configured to obtain an acoustic profile for the environment based on or in response to the one or more inputs, synthesize audio data having audio characteristics corresponding to a sound source in the environment in accordance with the acoustic profile, and output the synthesized audio data for use by the user.