Abstract: A system and method of augmenting image data are described. In one embodiment, the method comprises receiving data of an image captured by a camera, the captured image including a region having a visible feature of an object, storing masking data defining a plurality of masks, each mask defining a respective masked portion of the region of the captured image, sampling pixel values at predefined locations of the captured image data, selecting at least one stored mask based on the sampled pixel values, modifying pixel values in the or each selected masked portion of the region of the captured image based on colourisation parameters, and outputting the captured image with the modified pixel values for display. In other embodiments pixel values of one or more identified regions of a face in a target image are modified based on the augmentation characteristics derived from corresponding identified regions of a face in a source image.

Abstract: A computer-implemented method and system are described for augmenting image data of an object in an image, the method comprising receiving captured image data from a camera, storing a plurality of augmentation image data defining a respective plurality of augmentation values to be applied to the captured image data, storing a plurality of augmentation representations, each representation identifying a respective portion of augmentation image data, selecting one of said augmentation image data and one of said augmentation representations based on at least one colourisation parameter, determining a portion of the augmentation image data to be applied based on the selected augmentation representation, augmenting the captured image data by applying said determined portion of the augmentation image data to the corresponding portion of the captured image data, and outputting the augmented captured image data.

Abstract: A computer-implemented method and system are described for augmenting image data of an object in an image, the method comprising receiving captured image data from a camera, storing a plurality of augmentation image data defining a respective plurality of augmentation values to be applied to the captured image data, storing a plurality of augmentation representations, each representation identifying a respective portion of augmentation image data, selecting one of said augmentation image data and one of said augmentation representations based on at least one colorization parameter, determining a portion of the augmentation image data to be applied based on the selected augmentation representation, augmenting the captured image data by applying said determined portion of the augmentation image data to the corresponding portion of the captured image data, and outputting the augmented captured image data.

Abstract: A computer-implemented method and system are described for locating fingernails of a person's hand in an image. An approximate location of each fingernail in the image is determined. An approximate location of each of a plurality of digit-shape objects in the image is initialized based on the approximate locations of the fingernails, and initially refined based on respective digit-shape object models and corresponding functions. The approximate location of each fingernail sub-shape is further refined based on a respective fingernail model and its corresponding function.

Abstract: A system and method are described for tracking the location and orientation of a user's feet for an augmented reality display. A depth sensor generates a depth map of a scene within the field of view of the depth sensor, the field of view containing at least a portion of the user. A processor is configured to identify a portion of the depth map as a candidate object for foot tracking, determine a central skeleton representation of the identified portion, determine a location of a toe of the user's foot and a location of an ankle of the user's foot, based on the central skeleton representation, and calculate an orientation of the user's foot based on the determine locations of the toe and the ankle.

Abstract: There is described an image processing method in which a scene is repeatedly imaged to form a series of input images. For at least a subset of the input images, a color calibration procedure is conducted which populates a foreground color histogram with the frequency of occurrence of color values in a stencil area of the input image, and populates a background color histogram with the frequency of occurrence of color values outside of the stencil portion of the input image.

Abstract: A system and method are described for tracking the location and orientation of a user's feet for an augmented reality display. A depth sensor generates a depth map of a scene within the field of view of the depth sensor, the field of view containing at least a portion of the user. A processor is configured to identify a portion of the depth map as a candidate object for foot tracking, determine a central skeleton representation of the identified portion, determine a location of a toe of the user's foot and a location of an ankle of the user's foot, based on the central skeleton representation, and calculate an orientation of the user's foot based on the determine locations of the toe and the ankle.