Abstract: A method of incorporating an augmented reality video image into a virtual environment comprises detecting a state of a real-world control object captured in a video image and augmenting the video image responsive to the state of the control object. The method further includes calculating trajectory parameters for an action with respect to a local coordinate system of the video image, responsive to the state of the control object, and embedding the augmented video image within a 3D virtual environment. The method also includes calculating the trajectory parameters for the action with respect to a local co-ordinate system of the 3D virtual environment, and rendering a graphical effect corresponding to the action within the 3D virtual environment.

Abstract: A head mountable display (HMD) is operable to detect the HMD's overall motion relative to its current orientation, and to display extra image material so that the extra image material moves in the same general direction as real objects would be seen by the user to move if the user were not wearing the HMD.

Abstract: A method generates a three-dimensional map of a region from successive images captured from different camera poses. The method includes a camera capturing images of the region; designating a subset of captured images as a set of keyframes each having respective sets of image position data representing image positions of landmark points detected as feature points in that image; for a newly captured image, generating a camera pose prediction; selecting an ordering of the landmark points; detecting whether an image region of the new image approximately matches an expected image position of a landmark point based on the predicted camera pose by detecting whether the image region is substantially identical to the image information associated with that landmark point; and refining the pose prediction from the detecting step. The selecting includes performing a statistical test on the landmark points and selecting the ordering according to the statistical test results.

Abstract: A method generates a three-dimensional map of a region from successive images of that region captured from different positions. The method includes detecting feature points within the captured images; designating a subset of the captured images as a set of keyframes each having respective sets of measurement data representing image positions of landmark points detected as feature points in that image, where each keyframe is connected to at least one other keyframe in the set; and detecting whether candidate measurement data associated with a keyframe may be removed from the set of measurement data for that keyframe by detecting whether each keyframe, in the set of keyframes without the candidate measurement data, is still directly or indirectly connected to all of the other keyframes in the set of keyframes by a sequence of one or more connections. And in this case, the method includes removing that candidate measurement data.

Abstract: A method of assisting a first player of a videogame is provided. The method includes making a game state of the first player accessible to a second player. The game state describes a state of the videogame as played by the first player. The method also includes executing the videogame for the second player using the game state of the first player to define the initial state of the videogame for the second player, allowing the second player to play the videogame based upon the game state of the first player until a first predetermined criterion is met, and providing to the first player data for updating their game state in response to the play of the second player.

Abstract: A head mountable display (HMD) system comprises an eye position detector comprising one or more cameras configured to detect the position of each of the HMD user's eyes; a dominant eye detector configured to detect a dominant eye of the HMD user; and an image generator configured to generate images for display by the HMD in dependence upon the HMD user's eye positions, the image generator being configured to apply a greater weight to the detected position of the dominant eye than to the detected position of the non-dominant eye.

Abstract: A portable electronic device comprises a video camera for capturing a sequence of video images and an image processor operable to compress a first region of a current video image to a first extent and a second region of the current video image to a second, greater, extent to generate a processed current video image. The device includes a network communications interface operable to send processed video images to a server, and to receive control data from the server. The image processor is operable to augment the current video image with one or more computer graphic elements. Control data received from the server comprises image region information indicating a region of a video image estimated to comprise a predetermined marker and optionally augmentation instructions. Furthermore, the image processor is operable to define the first region of the current video image responsive to the image region information from the server.

Abstract: A book for use with augmented reality applications includes a plurality of stiff leaves, each side of which forms a page of the book. On each page a respective fiduciary marker is positioned substantially in the middle of the page. Each fiduciary marker comprises a different respective asymmetric pattern capable of indicating the scale and orientation of the book to an augmented reality application and of indicating the respective page, and a non-alphanumeric pattern positioned closer to an outside edge of the page of the book than the fiduciary marker. The non-alphanumeric pattern on a respective page is capable of indicating at least the opposing page pair comprising the respective page on which the non-alphanumeric pattern is positioned, when used in conjunction with the scale and orientation of the book as indicated by a fiduciary marker on a different page to that of the respective non-alphanumeric pattern.

Abstract: A method of encoding an input image captured using a wide-angle lens is provided. The method includes, for at least some of a set of image regions, increasing or decreasing the size of those image regions relative to other ones of the set of image regions according to an encoder mapping between image region size in the input image and image region size in an encoded image. And a method of decoding the encoded image includes rendering a given image according to a decoder mapping between selected regions of the encoded image and selected regions of a rendered image.

Abstract: A method of stereoscopic panoramic image capture of a virtual environment is provided. The method includes pausing the state of a virtual environment being implemented by an application. For each of a plurality of positions in the virtual environment, the method includes rendering in turn plural images collectively encompassing a panoramic view. The method also includes capturing in turn each of the plural rendered images and capturing distance data describing the distance between a respective position in the virtual environment and surfaces in the virtual environment visible at that respective position. The plural positions in the virtual environment form vertices of a bounding space within which left and right viewpoints of a stereoscopic image can be formed.

Abstract: A method of capturing the state of a target program that is running within the environment of an operating system is provided. The method includes identifying threads associated with the target program, suspending threads associated with the target program, preserving data characterizing the threads, and preserving data accessible by the threads when in operation. A method of changing the state of a target program that is running within the environment of an operating system is also provided. This method includes identifying threads associated with the target program, suspending threads associated with the target program, replacing data characterizing the threads with previously preserved data, and replacing data accessible by the threads when in operation with previously preserved data. In either case, the threads are then resumed to allow the target program to continue operation.

Abstract: A method of determining the performance of a processor when processing a unit of data is described. The method comprises the steps of: receiving, at a first sample rate, information indicating the performance of the processor when processing the unit of data; generating an identifier that identifies the unit of data being processed; comparing the identifier with previous identifiers at a second sample rate; and outputting the identifier of the unit of data being processed and the performance information when, during the comparing step, a predetermined condition is met.

Abstract: A method of rendering an image based upon a first stereoscopic image comprising a pair of images is provided. The method includes generating a virtual three-dimensional model of the scene depicted in the first stereoscopic image responsive to distances derived from the first stereoscopic image, detecting one or more free edges in the three dimensional model, and generating one or more textures for the virtual three-dimensional model from at least one of the pair of images of the first stereoscopic image. The method also includes applying at least one texture to a respective part of the three dimensional model, and rendering the virtual three dimensional model from a different viewpoint to that of the first stereoscopic image. Rendering the virtual three dimensional model comprises modifying a transparency of rendered pixels of an applied texture as a function of the pixel's distance from that free edge.

Abstract: An image encoding method includes, for each of left and right images of an image stereo pair, identifying a region of interest (ROI) in an input image, generating multiple representations of that input image such that one representation is a high field of view (FOV) representation including substantially all of the input image and another representation is a low FOV representation having a lower FOV than the high FOV representation and including at least the ROI. The relationship between pixel resolution and image size for the high and low FOV representations is such that, in relation to the ROI, the low FOV representation provides more image detail than the high FOV representation. The method also includes generating one or more multiplexed images by juxtaposing portions of the left and right, high and low FOV representations so as to include all image content thereof in fewer than four multiplexed images.

Abstract: An image transfer apparatus comprises an input operable to receive a signal comprising two images for different respective non-stereoscopic viewpoints of a virtual environment, a first output operable to transmit a signal comprising the two images formatted as a stereoscopic image to at least a first display, and a transmitter operable to transmit control signals to at least two active shutter glasses, the control signals arranged to allow respective wearers of the glasses to only view a respective one of the two images.

Abstract: Aspects of the technology encompass image encoding, which includes generating image content according to a viewpoint defined by image viewpoint data. Successive output images are generated such that each output image includes image content generated according to one or more viewpoints, and encoding metadata associated with each output image which indicates each viewpoint relating to image content contained in that output image, and which defines which portions of that output image were generated according to each of those viewpoints. An image display method for generating successive display images from successive input images is also provided, which includes re-projecting portions of each input image to form a respective display image, according to any differences between a desired display viewpoint and a particular viewpoint defined for that portion by metadata associated with a respective input image. The metadata indicating viewpoints relating to image content contained in the respective input images.

Abstract: An imaging system includes a video camera having a wide field of view lens, an imaging sensor operable to form a first image having a first pixel area, and an interface operable to receive commands from a host entertainment device. The video camera is operable to receive a command requesting at least one secondary image having a second pixel area for a 3D mapping of a portion of the first image. The system includes a graphics processor operable to perform the 3D mapping to generate the at least one each secondary image from the first image. The 3D mapping transforms a section of the first image depicting a surface having a normal in a first direction to form a secondary image in which the normal of that surface faces directly out of the secondary image.

Abstract: A head-mountable display device includes a head-mountable frame defining an eye display position which, in use, is positioned in front of an eye of the user. The device also includes a reflective element mounted with respect to the eye display position and comprising a reflective surface which, in use, is visible to the user's eye. The device further includes a mobile device holder configured to hold a mobile device at a location and orientation on the frame. The reflective surface is configured to reflect light incident thereupon to form a reflected image. The location and orientation in which the mobile device is held relative to a location and orientation of the reflective surface are such that light arriving from the mobile device screen held in the holder is reflected by the surface so that a reflected image of at least a portion of the screen is visible to the user.

Abstract: A method of image reconstruction is provided. The method includes capturing a stereoscopic pair of images of a scene, generating a disparity map for the pair of images, and defining a series of value ranges corresponding to disparity with each value range in the series having an end point corresponding to a greater disparity than an end point of preceding value ranges in the series. For each value range in the series, and progressing in order through the series from the first value range in the series, the method includes selecting points in the disparity map falling within the respective value range and generating a mesh responsive to those selected points. The method also includes subsequently merging the series of generated meshes to form a 3D model of the scene.

Abstract: An entertainment device comprises a display generator arranged to generate for display a representation of an on-line virtual environment corresponding to a first instance of a plurality of substantially similar on-line virtual environments and to generate for display within the representation of the on-line virtual environment an avatar controlled by the user of the entertainment device and one or more software-controlled avatars; a data communications arrangement operable to transmit an alert signal in response to a predetermined action of the user of the entertainment device within the first instance of the on-line virtual environment, said signal serving to request interaction with a human operator, the data communications arrangement being further operable to receive a notification signal; the display generator being arranged to respond to the notification signal by changing the mode of a software controlled avatar to represent an additional user of another entertainment device in data communication with