Abstract: A method and system for improving a resolution of an image frame is described. The image frame is part of a data stream. The data stream may be a video game, for example. The method comprising the following steps. Sending an encoded version of the image frame from a server to a client device via a first communication channel between the server and the client device. Detecting a reduced bandwidth of the first communication channel. In response to detecting the reduced bandwidth, determining data to be sent to the client device via a second communication channel. The second communication channel is separate to the first communication channel and the data relates to the image frame. The determined data is sent via the second communication channel.

Abstract: A method for identifying a cutscene in gameplay footage, the method comprising: receiving a first video signal and a second video signal each comprising a plurality of images; creating a first video fingerprint comprising a plurality of signatures, each signature of the plurality of signatures based on at least one image of the plurality of images in the first video signal; creating a second video fingerprint comprising a plurality of signatures, each signature of the plurality of signatures based on at least one image of the plurality of images in the second video signal; comparing the first video fingerprint with the second video fingerprint; and identifying a cutscene when at least a portion of the first video fingerprint has at least a threshold level of similarity with at least a portion of the second video fingerprint.

Abstract: A controller for a multimedia entertainment system is provided. The controller comprises a weighted component connected to the controller, wherein the weighted component is rotationally movable relative to the controller. The controller is configured to rotate the weighted component from a start position to an end position to shift the centre of mass of the controller in response to a trigger event; wherein the weighted component stops moving at the end position. This movement of the weighted component provides directional haptic feedback to a user of the controller.

Abstract: Methods and apparatus provide for generating an image by way of acquiring information relating to at least one of a position and a rotation of a camera. The image is generated for display on a display unit. A rate at which the image is generated is at a first frequency, which is lower than a second frequency corresponding to a frame rate of the display unit.

Abstract: A system for generating a personalised Head-Related Transfer Function, HRTF, for a user, the system comprising: a sound source at a first position; a user device comprising: a left microphone arranged to be at a left ear of the user, when the user device is worn; a right microphone arranged to be at a right ear of the user, when the user device is worn; and a controller configured to: prompt the user to move to series of different second positions; control the sound source to emit a predetermined sound signal when the user is at each second position; obtain a detected sound signal from each of the left and right microphones when the user is at each second position; generate a personalised HRTF based on the predetermined sound signal and the detected sound signal for each microphone and each second position.

Abstract: An audio personalisation method for simulating perception of a vertical displacement of a sound source, the method comprising the steps of: obtaining an input head related transfer function, HRTF, associated with a user; determining an intended vertical displacement for the sound source; selecting at least one frequency region in the input HRTF; and adjusting the amplitude of the selected frequency region(s) to simulate the intended vertical displacement for the sound source. This provides improvements to the generation and/or manipulation of HRTFs to allow adjustment of the perceived location of a sound source.

Abstract: A computer-implemented method for detecting a display screen using an extended reality display device, comprising receiving, at the extended reality display device, an image, or data defining an image, corresponding to a predetermined frame of a video stream, the predetermined frame comprising a plurality of specified feature points, monitoring a display screen that is displaying the video stream, detecting at least some of the plurality of specified feature points in the predetermined frame of the video stream as displayed on the display screen, and determining, based on the detected specified feature points, the physical boundaries of the display screen.

Abstract: A method for configuring a start-up display screen of a multimedia entertainment system, the method comprising: storing time related reference usage data of each application from a plurality of applications configured to run on the multimedia entertainment system; comparing the reference usage data of each application with a current system start up time to identify at least one identified application based on the reference data; and configuring the start-up display screen based on said identified at least one application.

Abstract: A computer-implemented method for image upscaling at a client device is provided. The method comprising: receiving, from a server device, an image which is one of a plurality of images forming an image stream, wherein the image comprises a plurality of image portions; determining a first group of one or more image portions from the plurality of image portions to apply a first image upscaling process to from a plurality of available image upscaling processes; selecting the first group of image portions based on the determination; and applying the first image upscaling process to the first group of image portions. The upscaling process may be an image upscaling process such as super resolution.

Abstract: A method of generating an image of a scene from a target viewpoint is provided. The method comprises capturing a plurality of multi-plane images of a virtual scene, and determining for each multi-plane image, whether a frontmost clipping plane pair defined for that multi-plane image intersects a virtual object in the virtual scene. Responsive to a positive determination for a respective clipping plane pair, the corresponding image data in the corresponding image plane is identified and assigned an identifier, thus generating a modified version of the corresponding multi-plane image. Camera information is obtained for the one or more virtual cameras that captured the multi-plane images and the target virtual camera. An output image is then generated by combining at least one of the modified multi-plane images with another of the multi-plane images in accordance with the obtained camera information. A corresponding system is also provided.

Abstract: A method for generating feedback in a multimedia entertainment system, the method comprising: obtaining an output stream to be output by the multimedia entertainment system; performing feature analysis to identify a feature in the output stream; determining a feedback based on the identified feature; controlling a main audiovisual display to output the output stream; and controlling a peripheral device to output the determined feedback.

Abstract: A computer-implemented system and method of providing a positioning system for a virtual environment hosted on a platform to enable sharing of content, comprising assigning each location in the virtual environment a unique location ID, receiving a request to retrieve a unique location ID and sharing the unique location ID with an application or an electronic device, wherein each unique location ID is a data string having a standardized format across different platforms comprising a platform identifier, a title identifier, a level identifier and a position identifier.

Abstract: The invention provides techniques for intelligently positioning speech in a virtual environment. Factors such as user preferences, the location of virtual environment audio and/or visual events, avatar location, and others can be taken into account when selecting a suitable location for the speech. The virtual environment can be a game environment, a meeting environment, an augmented reality environment, a virtual reality environment, and the like. The invention can be implemented by an audio processing unit which may be part of a game console.

Abstract: A data processing apparatus comprises receiving circuitry to receive tracking data indicative of at least one of a tracked position and orientation of a head-mountable display (HMD), image processing circuitry to generate a sequence of images frames for display in dependence upon the tracking data, detection circuitry to detect an image feature in a first image frame and to detect a corresponding image feature in a second image frame, and correlation circuitry to: calculate a difference between the image feature in the first image frame and the corresponding image feature in the second image frame; generate difference data indicative of a difference between a viewpoint for the first image frame and a viewpoint for the second image frame in dependence upon the difference between the image feature in the first image frame and the corresponding image feature in the second image frame; and generate output data in dependence upon a difference between the difference data and the tracking data associated with the fi

Abstract: A system configured to track the location of one or more peripherals operated by a user, the system comprising a tracking unit configured to determine a location of the one or more peripherals in dependence upon images captured by a camera associated with an HMD worn by the user, a generation unit configured to generate, in response to a determination by the tracking unit that one or more of the peripherals is not visible in the images, an array of home points behind the user, the home points being locations defined in dependence upon constraints upon the user's motion, an estimation unit configured to estimate the respective locations of non-visible peripherals in dependence upon the output of one or more inertial measurement units associated with each peripheral, and a selection unit configured to select a home point, from amongst the array of home points, for each of the non-visible peripherals, wherein the tracking unit is configured to generate a location for each non-visible peripheral such that the loc

Abstract: A method of point tracking comprises the steps of receiving successive input image frames from a sequence of input image frames comprising an object to track; for each input frame, detecting a plurality of feature points; mapping a 3D morphable model to the plurality of feature points; performing optical flow tracking of flow points between successive input frames; and correcting optical flow tracking for at least a first flow point position responsive to the mapped 3D morphable model.

Abstract: Methods and apparatus provide for an acquisition process to acquire information relating to at least one of a position and a rotation of a camera and an image generation process to generate an image to be displayed on a display unit in a first frequency lower than a second frequency corresponding to a frame rate of the display unit using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process.

Abstract: The present disclosure relates to a computer-implemented method for completing an image, the method comprising the steps of dividing data of an image to be completed into a plurality of image portions. The method entails applying a first filling process to fill a first image portion comprising a first hole, the first hole associated with a first quantity and/or a first quality; and applying a second filling process to fill a second image portion comprising a second hole, the second hole associated with a second quantity different to the first quantity and/or a second quality different to the first quality, the second process being different to first process. The method then includes combining the filled first and second image portions to complete the image.

Abstract: A method of generating audio assets, comprising the steps of: receiving an input multi-layered audio asset comprising a plurality of audio layers, generating an input multi-channel image, wherein each channel of the input multi-channel image comprises an input image representative of one of the audio layers, training a generative model on the input multi-channel image and implementing the trained generative model to generate an output multi-channel image, wherein each channel of the output multi-channel image comprises an output image representative of an output audio layer, and generating an output multi-layered audio asset based on a combination of output audio layers derived from the output images.

Abstract: A method of generating audio assets, comprising the steps of: receiving a plurality of input audio assets, converting each input audio asset into an input graphical representation, generating an input multi-channel image by stacking each input graphical representation in a separate channel of the image, feeding the input multi-channel image into a generative model to train the generative model and generate one or more output multi-channel images, each output multi-channel image comprising an output graphical representation, extracting the output graphical representations from each output multi-channel image and converting each output graphical representation into an output audio asset.