Abstract: An image encoding method includes, for each of left and right images of an image stereo pair, identifying a region of interest (ROI) in an input image, generating multiple representations of that input image such that one representation is a high field of view (FOV) representation including substantially all of the input image and another representation is a low FOV representation having a lower FOV than the high FOV representation and including at least the ROI. The relationship between pixel resolution and image size for the high and low FOV representations is such that, in relation to the ROI, the low FOV representation provides more image detail than the high FOV representation. The method also includes generating one or more multiplexed images by juxtaposing portions of the left and right, high and low FOV representations so as to include all image content thereof in fewer than four multiplexed images.

Abstract: An image transfer apparatus comprises an input operable to receive a signal comprising two images for different respective non-stereoscopic viewpoints of a virtual environment, a first output operable to transmit a signal comprising the two images formatted as a stereoscopic image to at least a first display, and a transmitter operable to transmit control signals to at least two active shutter glasses, the control signals arranged to allow respective wearers of the glasses to only view a respective one of the two images.

Abstract: Aspects of the technology encompass image encoding, which includes generating image content according to a viewpoint defined by image viewpoint data. Successive output images are generated such that each output image includes image content generated according to one or more viewpoints, and encoding metadata associated with each output image which indicates each viewpoint relating to image content contained in that output image, and which defines which portions of that output image were generated according to each of those viewpoints. An image display method for generating successive display images from successive input images is also provided, which includes re-projecting portions of each input image to form a respective display image, according to any differences between a desired display viewpoint and a particular viewpoint defined for that portion by metadata associated with a respective input image. The metadata indicating viewpoints relating to image content contained in the respective input images.

Abstract: A head-mountable display device includes a head-mountable frame defining an eye display position which, in use, is positioned in front of an eye of the user. The device also includes a reflective element mounted with respect to the eye display position and comprising a reflective surface which, in use, is visible to the user's eye. The device further includes a mobile device holder configured to hold a mobile device at a location and orientation on the frame. The reflective surface is configured to reflect light incident thereupon to form a reflected image. The location and orientation in which the mobile device is held relative to a location and orientation of the reflective surface are such that light arriving from the mobile device screen held in the holder is reflected by the surface so that a reflected image of at least a portion of the screen is visible to the user.

Abstract: A method of image reconstruction is provided. The method includes capturing a stereoscopic pair of images of a scene, generating a disparity map for the pair of images, and defining a series of value ranges corresponding to disparity with each value range in the series having an end point corresponding to a greater disparity than an end point of preceding value ranges in the series. For each value range in the series, and progressing in order through the series from the first value range in the series, the method includes selecting points in the disparity map falling within the respective value range and generating a mesh responsive to those selected points. The method also includes subsequently merging the series of generated meshes to form a 3D model of the scene.

Abstract: A position and rotation information acquisition unit 730 acquires information relating to a position and a rotation of the head of a user who wears a head-mounted display unit 100. A coordinate transformation unit 740 and a panorama image processing unit 750 generate an image to be displayed on the head-mounted display unit using the information relating to the position and the rotation acquired at a certain point of time by the position and rotation information acquisition unit 730. A correction processing unit 780 corrects the generated image using updated information relating to the position and the rotation at a different point of time.

Abstract: An image transfer apparatus comprises an input operable to receive a signal comprising two non-stereoscopic images for different respective viewpoints of a virtual environment, a first output and a second output, and a signal splitter logic, and in which the signal splitter logic is operable to extract and separate the two non-stereoscopic images from the received signal, to format each of the two separated images for reception by a respective conventional 2D display, and to output to the first output and the second output a respective signal comprising one of the two separate images.

Abstract: A display method is provided using a display that is operable to display an image to a viewer. The display method includes detecting one or both of an initial position and/or orientation of the viewer's head, and generating an image for display according to the detected position and/or orientation. A current position and/or orientation of the viewer's head are detected at a time at which the image is to be displayed. The method also includes re-projecting the generated image according to any differences between the initial position and/or orientation and the current position and/or orientation of the viewer's head, and displaying the re-projected image using the display.

Abstract: A head mountable display (HMD) comprises an infrared light source operable to illuminate foreground objects but not background objects greater than a threshold distance from the HMD; one or more cameras operable to capture infrared illuminated images and visible light illuminated images; and an image processor operable to detect, from the infrared illuminated images, foreground objects in the visible light illuminated images.

Abstract: A method of operation of a head mountable display (HMD) system, in which stereoscopic images are displayed with respect to a virtual display screen (VDS) position, is provided. The method includes setting a VDS position for a stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display. The method also includes generating the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

Abstract: An image processing method includes capturing an image of the head of a user of a head mountable display device. The position of the head mountable display device is detected in the image captured by a camera. A region of the user's face that is occluded by the head mountable display device is identified. The portion of the captured image corresponding to the head mountable display device is at least partially replaced with a corresponding portion of a 3D facial model, to provide a modified version of the captured image.

Abstract: A display method using a display operable to display an image to a viewer is provided. The method includes detecting an initial position and/or orientation of an image view. Foreground portions of an image are rendered according to the detected initial position and/or orientation. Background portions of the image are rendered according to the detected initial position and/or orientation, at an image rendering rate. The following are performed at an image display rate higher than the image rendering rate: (i) detecting a current position and/or orientation of the image view; (ii) re-projecting the background portions of a most recent image according to any differences between the initial position and/or orientation and the current position and/or orientation of the image view; and (iii) combining the foreground portions and the re-projected background portions to generate an image for display.

Abstract: An angular detection arrangement for a head mountable display (HMD) comprising a light source or reflective marking and an optical detector, one of the light source or reflective marking and the optical detector being disposed at the HMD and the other being disposed at a fixed point, the light source or reflective marking comprising a directional light source or reflective marking and a substantially non-directional light source or reflective marking such that the separation between the directional and non-directional light sources or reflective markings as detected at the optical detector is dependent upon the relative orientation of the HMD and the fixed point.

Abstract: A method generates an image for display by deriving an expected depth of field for the image and by generating the image for display by the display device by applying a blurring function. The expected depth of field is derived with respect to a point of focus in the image, in response to lighting conditions of the environment represented by the image. The blurring function is applied to simulate the expected depth of field of the image by blurring as a function of apparent spatial depth within the image. The degree of blurring applied to a closer depth region, in an apparent depth direction, to the point of focus is lower than the degree applied to a further depth region from the point of focus. Variation of the blurring function with respect to depth separation from the point of focus depends upon the expected depth of field.

Abstract: A head mountable display (HMD) is provided that has an upward facing camera associated with a wide angle (such as a fisheye) lens arranged to capture images of the environment of the HMD. The HMD also includes an image comparator arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time. The image comparator may be configured to perform two or more detection techniques to detect HMD yaw, and to combine the results of the two or more detection techniques. The HMD may also include a tilt detector. Here, the image comparator may be configured to ignore one or more portions of a captured image in dependence upon a current tilt of the HMD as detected by the tilt detector.

Abstract: A head mountable display (HMD) includes a camera operable to capture images of a peripheral and/or control device in use by a wearer of the HMD. A detector of the HMD is configured to detect occlusions in a captured image of the peripheral and/or control device. And an image renderer of the HMD is configured to render a virtual version of the peripheral and/or control device for display to the HMD wearer and to render a representation of a user's hand at a position of a detected occlusion.

Abstract: A method of augmenting a first stereoscopic image, comprising a pair of images, is provided. The method includes generating a disparity map from the pair of images of the first stereoscopic image. The disparity map is indicative of distances in the first stereoscopic image. The method further includes generating a virtual three-dimensional model responsive to the distances indicated by the disparity map, modeling an interaction of a virtual object with that three dimensional model, and outputting, for display, an image corresponding to the first stereoscopic image that comprises a visible effect of the interaction of the virtual object with the three dimensional model.

Abstract: A head-mountable display system comprises a head mountable display having a frame to be mounted onto an observer's head, the frame defining one or two eye display positions which, in use, are positioned for viewing by the observer. The frame comprises one or more shutters for obscuring the observer's view of the surrounding real environment and a display element mounted with respect to each of the eye display positions. The display element provides a virtual image of a video display of a video signal from a video signal source to the observer. An object detector detects the presence of an object within a detection range of the observer's head. And a controller controls operation of the head mountable display so as to allow the observer to view at least a portion of the surrounding real environment in response to detection of the presence of an object within the detection range.

Abstract: A head mountable display (HMD) system comprises an eye position detector comprising one or more cameras configured to detect the position of each of the HMD user's eyes; a dominant eye detector configured to detect a dominant eye of the HMD user; and an image generator configured to generate images for display by the HMD in dependence upon the HMD user's eye positions, the image generator being configured to apply a greater weight to the detected position of the dominant eye than to the detected position of the non-dominant eye.

Abstract: An audio system comprises a headset comprising a pair of earpieces positionable with respect to the user's ears so that, in use, the user is inhibited from hearing sounds from the user's environment, at least one of the earpieces having a transducer for reproducing sounds from an input audio signal; a microphone for generating a captured audio signal representing captured sounds from the user's environment; a detector for detecting the presence of any of a set of one or more characteristic sounds in the captured audio signal; and a controller operable to transmit sounds from the user's environment to the user in response to a detection that one or more of the set of characteristic sounds is present in the captured audio signal.