Abstract: A system for estimating a current camera pose corresponding to a current point in time using a previous camera pose corresponding to a previous point in time, of a camera configured to generate a sequence of image frames. The system performs operations, including: generating, using one or more neural networks, a neural network pose prediction for the current image frame; and adjusting a previous camera pose using inertial measurement unit data representing a motion of the camera between the previous point in time and the current point in time, to provide an inertial measurement unit pose prediction for the current point in time. The inertial measurement unit pose prediction, and the neural network pose prediction are combined in order to estimate the current camera pose.

Abstract: An AR system includes one or more image sensors arranged to capture image data representing a scene located within a field of view of the one or more image sensors, a display arranged to enable a user of the AR system to observe a representation or view of the scene, and an augmentation engine. The augmentation engine is arranged to process the captured image data to determine one or more visual characteristics for the captured image data and to determine, in dependence on the determined one or more visual characteristics, one or more properties for an image element to be presented on the display. The augmentation engine is arranged to present the image element, with the determined one or more properties, on the display to overlay the representation or view of the scene.

Abstract: A graphics processing system and method of operating a graphics processing system that generates “spacewarped” frames for display is disclosed. Motion vectors are used to determine the motion of objects appearing in rendered application frames. The so-determined motion is then used to generate “spacewarped” versions of the rendered application frames.

Abstract: A navigation system uses markers that are identifiable in images of an environment being navigated to determine the location of a portable device in the environment. The portable device takes images of the environment, and those images are analysed to identify markers in the images and the pose of the portable device based on the image of the marker. The identified marker and the determined pose of the portable device are then used to determine the location and orientation of the portable device in the environment being navigated.

Abstract: An extended-reality system is described which determines extended-reality data to be obtained from the remote network-connected storage based on a location of the extended-reality system. The extended-reality system determines a communication method by which to obtain the extended-reality data, wherein the extended-reality data may be obtained by one or more requests to the remote network-connected storage or by one or more requests to a local device outside of the extended-reality system. A request is sent to at least one of the local device via a peer-to-peer network and the remote network-connected storage in dependence upon the determination by the extended-reality system.

Abstract: A device comprising a first side for facing a user of the device, a second side opposite to the first side, a sensor operable to output gaze data representative of a gaze direction of the user, a display device and at least one processor. The at least one processor is configured to control the display device to control display of an image intended to be displayed on the second side of the device on the basis of the gaze data in order to reduce light being directed towards a pupil of the user from the first side of the device by the display of the image. Also described is a method of controlling such a device.

Abstract: Briefly, example methods, apparatuses, and/or articles of manufacture are disclosed that may be implemented, in whole or in part, using one or more processing devices to facilitate and/or support one or more operations and/or techniques for authenticating an identity of a subject. In particular, some embodiments are directed to techniques for authentication of an identity of a subject as being an identity of a particular unique individual based, at least in part, on involuntary responses by the subject to sensory stimuli.

Abstract: A method and apparatus for measuring depth using a time-of-flight (ToF) depth sensor is described. The apparatus includes an emitter configured to emit a signal towards a scene comprising one or more regions with light or sound, this emitter being controllable to adjust at least one of an intensity and a modulation frequency of the signal output from the emitter. The apparatus also includes a signal sensor, configured to detect an intensity of the signal from the emitter that has been reflected by the scene. A controller is configured to receive context information about the scene for depth capture by the time-of-flight depth sensor and to adjust at least one of the intensity and modulation frequency of the signal output by the emitter in dependence on the context information.

Abstract: A method of operating a graphics processing system that generates “spacewarped” frames for display is disclosed. Primitive motion vectors are used to determine the motion of objects appearing in rendered application frames. The so-determined motion is then used to generate “spacewarped” versions of the rendered application frames.

Abstract: A computer-implemented method for an augmented-reality system is provided. The computer-implemented method comprises obtaining sensed data, representing an environment in which the AR system is located, determining that the AR system is in a location associated with a first authority characteristic, and controlling access to the sensed data for one or more applications operating in the AR system. Each of the one or more applications is associated with a respective authority characteristic. Controlling access to the sensed data for a said application is performed in dependence on the first authority characteristic and a respective authority characteristic associated with the said application. An AR system comprising one or more sensors, storage for storing sensed data, one or more application modules, and one or more processors arranged to perform the computer-implemented method is provided.

Abstract: A user-mountable extended reality (XR) device capable of receiving and storing at least one of a plurality of user vision capability profiles. The user-mountable XR device comprises a data processing system configured to process input data representative of an input image to perform a modification of the input image based on performing a selection of a given profile of the at least one of the plurality of user vision capability profiles, thereby generating output data representative of an output image for display by the user-mountable XR device. Also described is a method of controlling such a device.

Abstract: A system for estimating a current camera pose corresponding to a current point in time using a previous camera pose corresponding to a previous point in time, of a camera configured to generate a sequence of image frames. The system performs operations, including: generating, using one or more neural networks, a neural network pose prediction for the current image frame; and adjusting a previous camera pose using inertial measurement unit data representing a motion of the camera between the previous point in time and the current point in time, to provide an inertial measurement unit pose prediction for the current point in time. The inertial measurement unit pose prediction, and the neural network pose prediction are combined in order to estimate the current camera pose.

Abstract: An AR system is provided, the AR system including one or more sensors, storage, one or more communications modules, and one or more processors. The one or more sensors generate sensed data representing at least part of an environment in which the AR system is located. The one or more communications modules transmit localization data to be used in determining the location and orientation of the AR system. The one or more processors are arranged to obtain sensed data representing an environment in which the AR system is located, process the sensed data to identify a first portion of the sensed data which represents redundant information, derive localization data, wherein the localization data is derived from the sensed data and the first portion is obscured during the derivation of the localization data, and transmit at least a portion of the localization data using the one or more communication modules.

Abstract: A head-mounted display (HMD) comprising a first side for facing a user of the HMD, a second side opposite to the first side, and a reflective layer for at least partially reflecting incident light incident on the second side. At least one processor of the HMD is configured to obtain luminance data indicative of a luminance of the incident light and control a display device, based on the luminance data, to control a luminance of a portion of emitted light directed towards the user of the HMD during the display of the image. Further examples relate to an HMD with a display device configured to emit light of at least one predetermined wavelength range during display of an image by the display device, and a layer arranged to at least partially prevent transmission of the light of the at least one predetermined wavelength range outward from the HMD.

Abstract: A computing device 2, such as a general-purpose smartphone or general-purpose tablet computing device, comprises one or more inertial sensors and an image sensor. The device 2 produces stereoscopic images of a virtual environment on the display during a virtual reality (VR) session controlled by a user of the computing device. The device conducts visual odometry using at least image data received from the image sensor, and selectively activates and deactivates the visual odometry according to activity of the user during the virtual reality session. When the visual odometry is activated, the device controls the virtual reality session by at least position information from the visual odometry. When the visual odometry is deactivated, the device controls the virtual reality session by at least orientation information from the one or more inertial sensors.

Abstract: The present disclosure provides a system and method for locating terminals within a facility. One or more of a plurality of primary terminals send a location signal which may comprise location data for the respective primary terminal. A secondary terminal, of a plurality of secondary terminals may receive one or more of these location signals. In response, the secondary terminal sends a confirmation message to each primary terminal from which it has received a location signal. The confirmation message may comprise a unique identifier for the secondary terminal. In response to receiving one or more confirmation messages, a primary terminal sends a location reporting message to a location processing server. The location reporting message comprises the location data for that primary terminal and the contents of the received confirmation message(s). The data held on the location processing server can be used to determine the location and movement of each of the primary terminals and the secondary terminals.

Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

Abstract: A user-mountable extended reality (XR) device capable of receiving and storing at least one of a plurality of user vision capability profiles. The user-mountable XR device comprises a data processing system configured to process input data representative of an input image to perform a modification of the input image based on performing a selection of a given profile of the at least one of the plurality of user vision capability profiles, thereby generating output data representative of an output image for display by the user-mountable XR device. Also described is a method of controlling such a device.

Abstract: When providing augmented reality display to users in an environment, two or more electronic devices operable to analyse the environment for augmented reality display purposes that are near to each other share data and/or processing relating to the analysis of the environment for augmented reality display purposes, with each device then using the data it receives from the other device when providing an augmented reality display to a user.