Abstract: A head-mounted display (HMD) comprising a first side for facing a user of the HMD, a second side opposite to the first side, and a reflective layer for at least partially reflecting incident light incident on the second side. At least one processor of the HMD is configured to obtain luminance data indicative of a luminance of the incident light and control a display device, based on the luminance data, to control a luminance of a portion of emitted light directed towards the user of the HMD during the display of the image. Further examples relate to an HMD with a display device configured to emit light of at least one predetermined wavelength range during display of an image by the display device, and a layer arranged to at least partially prevent transmission of the light of the at least one predetermined wavelength range outward from the HMD.

Abstract: A method is described for operating on a frame of a video to generate a feature map of a neural network. The method determines if a block of the frame is an inter block or an intra block, and performs an inter block process in the event that the block is an inter block and/or an intra block process in the event that the block is an intra block. The inter block process determines a measure of differences between the block of the frame and a reference block of a reference frame of the video, and performs either a first process or a second process based on the measure to generate a segment of the feature map. The intra block process determines a measure of flatness of the block of the frame, and performs either a third process or a fourth process based on the measure to generate a segment of the feature map.

Abstract: A data processing system includes: a processor; a data interface for communication with a control unit, the processor being on one side of the data interface; internal storage accessible by the processor, the internal storage being on the same side of the data interface as the processor; and a register array accessible by the processor and comprising a plurality of registers, each register having a plurality of vector lanes. The storage is arranged to store control data indicating an ordered selection of vector lanes of one or more of the registers. The processor is arranged to, in response to receiving instruction data from a control unit, perform a swizzle operation in which data is selected from one or more source registers in the register array, and transferred to a destination register. The data is selected from vector lanes in accordance with control data stored in the internal storage.

Abstract: A computing device 2, such as a general-purpose smartphone or general-purpose tablet computing device, comprises one or more inertial sensors and an image sensor. The device 2 produces stereoscopic images of a virtual environment on the display during a virtual reality (VR) session controlled by a user of the computing device. The device conducts visual odometry using at least image data received from the image sensor, and selectively activates and deactivates the visual odometry according to activity of the user during the virtual reality session. When the visual odometry is activated, the device controls the virtual reality session by at least position information from the visual odometry. When the visual odometry is deactivated, the device controls the virtual reality session by at least orientation information from the one or more inertial sensors.

Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

Abstract: A device has a content processing component operable in a content processing state, and a content transducer configured to provide augmented reality data to a user of the device based on an output of the content processing component. The device has a receiver operable to receive captured data indicative of a health condition of a user of the device. The device has a processor configured to process the captured data to identify a trigger indicative of a possible change in the health condition of a user, and in response to the trigger, modify the content processing state of the content processing component such that at least one characteristic of the augmented reality data is modified.

Abstract: When a programmable execution unit of a graphics processor is executing a graphics processing program to render a frame that represents a view of a scene using a ray tracing process, and the ray tracing process requires the determination of geometry that will be intersected by a ray, the programmable execution unit sends a message to a ray tracing acceleration data structure traversal circuit of the graphics processor, for the ray tracing acceleration data structure traversal circuit to perform a traversal of a ray tracing acceleration data structure for the scene to determine geometry for the scene that may be intersected by the ray. The ray tracing acceleration data structure traversal circuit then returns to the programmable execution unit an indication of geometry that may be intersected by the ray, and the programmable execution unit uses the indicated geometry to determine any geometry that is intersected by the ray.

Abstract: A method apparatus and computer readable medium for processing input data using a neural network comprising at least a first layer and a second layer. The method comprising the steps of applying a partitioning scheme to the input data, to partition the input data into a plurality of blocks, each block representing a portion of the input data. At the first layer of the neural network, the blocks of the input data are processed in a first order to generate intermediary data, wherein the intermediary data is partitioned into a plurality of intermediary blocks. At the second layer of the neural network, the intermediary blocks are processed in a second order, wherein the second order differs from the first order.

Abstract: Herein described is a method of operating an accumulation process in a data processing apparatus. The accumulation process comprises a plurality of accumulations which output a respective plurality of accumulated values, each based on a stored value and a computed value generated by a data processing operation. The method comprises storing a first accumulated value, the first accumulated value being one of said plurality of accumulated values, into a first storage device comprising a plurality of single-bit storage elements; determining that a predetermined trigger has been satisfied with respect to the accumulation process; and in response to the determining, storing at least a portion of a second accumulated value, the second accumulated value being one of said plurality of accumulated values, into a second storage device.

Abstract: A device has a content processing component operable in first and second content processing states, a display, at least one sensor operable to output sensor data indicative of at least one eye positional characteristic of a user, and a processor. The processor is configured to process the data, and in the first processing state, determine a region of the display corresponding to a foveal region of an eye of a user, and perform foveated processing of content to be displayed on the display such that a relatively high-quality video content is generated for display in the region and a relatively low-quality video content is generated for display outside the region. The second processing state is entered in response to a trigger. In the second processing state, the foveated processing used is overridden such that relatively low-quality video content is generated for display in at least a portion of the region.

Abstract: A user-mountable extended reality (XR) device capable of receiving and storing at least one of a plurality of user vision capability profiles. The user-mountable XR device comprises a data processing system configured to process input data representative of an input image to perform a modification of the input image based on performing a selection of a given profile of the at least one of the plurality of user vision capability profiles, thereby generating output data representative of an output image for display by the user-mountable XR device. Also described is a method of controlling such a device.

Abstract: A voice assistant device comprises an input to receive data defining an audio command; and processing circuitry to perform an operation defined by the audio command responsive to an activation of the voice assistant device; wherein the activation comprises determining presence of an activation source within an activation region from one or more sensors.

Abstract: When providing augmented reality display to users in an environment, two or more electronic devices operable to analyse the environment for augmented reality display purposes that are near to each other share data and/or processing relating to the analysis of the environment for augmented reality display purposes, with each device then using the data it receives from the other device when providing an augmented reality display to a user.

Abstract: A data processing system comprising a processor operable to execute a neural network, and associated methods for operating data processing systems. The data processing system comprises the processor and a memory for storing data relating to neural network processing being performed by the processor. The data processor is operable to write to the memory and to read from the memory blocks of data corresponding to regions of a data array generated by the neural network. The writing (or reading) is performed based on a signature comparison between the block of data that is to be written to (or read from) memory and a block of data that is already stored in memory.

Abstract: A method of data processing for an augmented reality system. The method comprises obtaining augmented reality data output by an augmented reality application operating at a second trust level. The augmented reality data is for modifying a representation of a real-world environment for a user of the augmented reality system. The method also comprises obtaining object recognition data determined by an object recognition system operating at a first trust level. The object recognition data comprises an indication of an object belonging to a predetermined class of objects being present in the real-world environment. The method also comprises triggering modification of the augmented reality data in response to the object recognition data, based on prioritization of the first trust level over the second trust level.

Abstract: A method of data processing for an object identification system comprising a neural network. The method comprises, in a secure environment, obtaining first sensed data representative of a physical quantity measured by a sensor. The first sensed data is processed, using the neural network in the secure environment, to identify an object in the first sensed data. The method includes determining that the identified object belongs to a predetermined class of objects. In response to the determining, a first portion of the first sensed data is classified as data to be secured, and a second portion of the first sensed data is classified as data which is not to be secured. The second sensed data, derived from at least the second portion, is outputted as non-secure data.

Abstract: A method of producing a full resolution frame, comprising generating a tile representation of the frame. The tile representation comprises a plurality of tiles each associated with an area of the frame. The method also includes eliminating one or more predetermined portions of each tile and rendering retained portions of each tile to produce rendered tiles. The method also transforms the rendered tiles into processed tiles. The full resolution frame is then constructed from the processed tiles.

Abstract: When rendering a new frame using a hybrid ray tracing process, a graphics processor transforms vertex position data for models representing objects in the new frame into camera space for use in a rasterisation process of the hybrid ray tracing process irrespective of whether the object has moved between frames or whether the geometry of the model representing object has changed, but only transforms vertex position data for a model for an object into world space for use in a ray tracing process of the hybrid ray tracing process when the object has moved between frames or where the geometry of the model representing the object has changed.

Abstract: A device comprising a first side for facing a user of the device, a second side opposite to the first side, a sensor operable to output gaze data representative of a gaze direction of the user, a display device and at least one processor. The at least one processor is configured to control the display device to control display of an image intended to be displayed on the second side of the device on the basis of the gaze data in order to reduce light being directed towards a pupil of the user from the first side of the device by the display of the image. Also described is a method of controlling such a device.