Abstract: A data processing apparatus comprises receiving circuitry to receive tracking data indicative of at least one of a tracked position and orientation of a head-mountable display (HMD), image processing circuitry to generate a sequence of images frames for display in dependence upon the tracking data, detection circuitry to detect an image feature in a first image frame and to detect a corresponding image feature in a second image frame, and correlation circuitry to: calculate a difference between the image feature in the first image frame and the corresponding image feature in the second image frame; generate difference data indicative of a difference between a viewpoint for the first image frame and a viewpoint for the second image frame in dependence upon the difference between the image feature in the first image frame and the corresponding image feature in the second image frame; and generate output data in dependence upon a difference between the difference data and the tracking data associated with the fi

Abstract: A system configured to track the location of one or more peripherals operated by a user, the system comprising a tracking unit configured to determine a location of the one or more peripherals in dependence upon images captured by a camera associated with an HMD worn by the user, a generation unit configured to generate, in response to a determination by the tracking unit that one or more of the peripherals is not visible in the images, an array of home points behind the user, the home points being locations defined in dependence upon constraints upon the user's motion, an estimation unit configured to estimate the respective locations of non-visible peripherals in dependence upon the output of one or more inertial measurement units associated with each peripheral, and a selection unit configured to select a home point, from amongst the array of home points, for each of the non-visible peripherals, wherein the tracking unit is configured to generate a location for each non-visible peripheral such that the loc

Abstract: A method of point tracking comprises the steps of receiving successive input image frames from a sequence of input image frames comprising an object to track; for each input frame, detecting a plurality of feature points; mapping a 3D morphable model to the plurality of feature points; performing optical flow tracking of flow points between successive input frames; and correcting optical flow tracking for at least a first flow point position responsive to the mapped 3D morphable model.

Abstract: A system for tracking one or more peripherals operable by a user in a real environment includes: a camera, mountable upon the user, operable to capture images of the real environment, a feature identification unit operable to identify features in images belonging to a first set of images captured by the camera, a peripheral identification unit operable to identify the image position of one or more peripherals in one or more images belonging to a second set of images captured by the camera, and a position determining unit operable to generate first position information for the camera in the real environment in dependence upon one or more of the identified features, and to generate respective second position information for the one or more peripherals relative to the camera in dependence upon the identified image position of the one or more peripherals.

Abstract: A system for displaying a mobile device screen comprises a head mounted display for displaying a first content to a user, a video camera mounted on the head mounted display, the video camera operable to capture a video image of a scene in front of the user, a region detection processor operable to detect a region of the captured video image comprising a mobile device screen, and an image processor operable to replace a corresponding region of the displayed first content in the head mounted display with the detected region of the captured video image comprising the mobile device screen.

Abstract: A data processing device comprises an analyser to analyse successive images captured by a camera and to detect an optically detectable marker in the captured images, a first location detector to detect a location of the optically detectable marker with respect to a location of the camera according to a first detection mode and to generate a first detection result, a second location detector to detect the location of the optically detectable marker with respect to the location of the camera according to a second detection mode different to the first detection mode and to generate a second detection result, and a processor to select at least one of the first detection result and the second detection result and to generate data indicative of the location of the optically detectable marker with respect to the location of the camera based on the selection.

Abstract: Data processing apparatus includes a camera to capture successive images according to an image capture period; an optically detectable indicator having multiple optically detectable states and configured to transition between the multiple optically detectable states according to a transition pattern having interspersed periods in the multiple optically detectable states; the transition pattern including a reference period and two or more second periods which are shorter than the image capture period and which are separated by a separation period different to the image capture period; and a processor to detect timing information from images captured by the camera of the optically detectable indicator.

Abstract: A data processing device includes a plurality of cameras arranged according to a predetermined configuration, where each camera is configured to capture successive images and to detect a current location of one or more elements in the captured images with respect to a coordinate system of the camera, a processor to generate a common camera coordinate system in dependence upon the respective coordinate systems of the plurality of cameras, the common camera coordinate system comprising a set of locations in a three-dimensional space included within the field of view of the plurality of cameras, and a detector to detect a current location of a given element with respect to the common camera coordinate system based on images captured by the plurality of cameras, wherein for each camera, the processor is configured, in response to a detection by the detector that the current location of the given element corresponds to a location in the set of locations of the common camera coordinate system, to generate first dat

Abstract: A system for tracking motion of a user includes one or more peripherals associated with the user, a first camera operable to be mounted upon the user's head, a second camera operable to capture images of the user and the first camera, a first tracking unit operable to determine the position of the one or more peripherals in images captured by the first camera, a second tracking unit operable to determine the position of the first camera and the one or more peripherals in images captured by the second camera, a location generating unit operable to identify the location of the one or more peripherals and the first camera in dependence upon the respective determinations by the first and second tracking units, a tracking validation unit operable to compare the locations of at least one peripheral as determined using the first and second tracking units and determine whether a difference in the locations exceeds a threshold value, and a location output unit operable to output location information for at least the o

Abstract: A controller for determining a displacement of a control stick and an applied pressure on the control stick comprises at least a first control stick, one or more sensors configured to sense a pressure applied to at least one control stick and to generate corresponding pressure information, first circuitry configured to receive displacement information associated with a physical displacement of the control stick, second circuitry configured to receive from one or more of the sensors pressure information associated with the pressure applied to the control stick, and third circuitry configured to determine the displacement of the control stick and the applied pressure on the control stick; wherein at least a first sensor is configured to sense the pressure applied when the physical displacement of the control stick reaches a displacement limit.

Abstract: A data processing device includes a camera configured to capture successive images, each image being captured during a respective image capture period such that respective different portions of the captured image are captured at respective different capture times within the image capture period; a detector to detect, from images captured by the camera, information indicating a relative location of a remote marker with respect to the data processing device, and to associate a timestamp with a detected relative location indicating a time at which the relative location was detected; and a motion sensor to detect motion of the data processing device and to control operation of the detector in response to the detected motion.

Abstract: A system includes a data processing apparatus; and a position detector to detect a position of a trackable object at successive sampling time points, the position detector being configured to provide, by a first data communication path, position data indicative of the position of the trackable object to the data processing apparatus at each sampling time point along with data indicating a time of that sampling time point according to a clock signal at the position detector, and to send synchronisation data to the data processing apparatus by a second, different, data communication path indicative of the clock signal at the position detector; in which the data processing apparatus comprises: a detector to detect a difference between a clock signal at the data processing apparatus and the clock signal at the position detector in dependence upon the synchronisation data; and a processor to perform a data processing operation in dependence upon the position indicated by the position data, the time of a sampling t

Abstract: Virtual reality apparatus includes a display generator to generate images of a virtual environment, including a virtual representation of a display object and at least part of an avatar, for display to a user; a haptic interface including one or more actuators to provide a physical interaction with the user in response to a haptic interaction signal; a detector arrangement configured to detect two or more haptic detections applicable to a current configuration of the avatar relative to the object in the virtual environment; and a haptic generator to generate the haptic interaction signal in dependence upon the two or more haptic detections.

Abstract: Data processing apparatus comprises a camera to capture successive images according to an image capture period; an optically detectable indicator having multiple optically detectable states and configured to transition between the multiple optically detectable states according to a transition pattern having interspersed periods in the multiple optically detectable states; the transition pattern including a reference period and two or more second periods which are shorter than the image capture period and which are separated by a separation period different to the image capture period; and a processor to detect timing information from images captured by the camera of the optically detectable indicator.

Abstract: A data processing device includes a camera configured to capture successive images, each image being captured during a respective image capture period such that respective different portions of the captured image are captured at respective different capture times within the image capture period; a detector to detect, from images captured by the camera, information indicating a relative location of a remote marker with respect to the data processing device, and to associate a timestamp with a detected relative location indicating a time at which the relative location was detected; and a motion sensor to detect motion of the data processing device and to control operation of the detector in response to the detected motion.

Abstract: A data processing device includes a camera to capture successive images of an optically detectable indicator of a second data processing device; a location detector configured to detect a location of the data processing device; a data receiver to receive location information from the second data processing device; and a processor to detect a mapping between the image location, in images captured by the camera, of the optically detectable indicator of the second data processing device, the communicated location of the second data processing device and the detected location of the data processing device.

Abstract: A controller for determining a displacement of a control stick and an applied pressure on the control stick comprises at least a first control stick, one or more sensors configured to sense a pressure applied to at least one control stick and to generate corresponding pressure information, first circuitry configured to receive displacement information associated with a physical displacement of the control stick, second circuitry configured to receive from one or more of the sensors pressure information associated with the pressure applied to the control stick, and third circuitry configured to determine the displacement of the control stick and the applied pressure on the control stick; wherein at least a first sensor is configured to sense the pressure applied when the physical displacement of the control stick reaches a displacement limit.

Abstract: A data processing device comprises an analyser to analyse successive images captured by a camera and to detect an optically detectable marker in the captured images, a first location detector to detect a location of the optically detectable marker with respect to a location of the camera according to a first detection mode and to generate a first detection result, a second location detector to detect the location of the optically detectable marker with respect to the location of the camera according to a second detection mode different to the first detection mode and to generate a second detection result, and a processor to select at least one of the first detection result and the second detection result and to generate data indicative of the location of the optically detectable marker with respect to the location of the camera based on the selection.

Abstract: A system for displaying a mobile device screen comprises a head mounted display for displaying a first content to a user, a video camera mounted on the head mounted display, the video camera operable to capture a video image of a scene in front of the user, a region detection processor operable to detect a region of the captured video image comprising a mobile device screen, and an image processor operable to replace a corresponding region of the displayed first content in the head mounted display with the detected region of the captured video image comprising the mobile device screen.

Abstract: A system for tracking motion of a user includes one or more peripherals associated with the user, a first camera operable to be mounted upon the user's head, a second camera operable to capture images of the user and the first camera, a first tracking unit operable to determine the position of the one or more peripherals in images captured by the first camera, a second tracking unit operable to determine the position of the first camera and the one or more peripherals in images captured by the second camera, a location generating unit operable to identify the location of the one or more peripherals and the first camera in dependence upon the respective determinations by the first and second tracking units, a tracking validation unit operable to compare the locations of at least one peripheral as determined using the first and second tracking units and determine whether a difference in the locations exceeds a threshold value, and a location output unit operable to output location information for at least the o