Abstract: A system and method of generating augmented image data with a simulated foundation makeup effect are described. Source image data is captured by a camera, the image data including at least one region of skin pixels. Augmented image data is generated based on augmentation parameters associated with the foundation makeup including one or more appearance parameters and one or more colourisation parameters. The augmentation process includes generating modified image data by processing the captured image data to highlight skin detail features based on one or more of the appearance parameters, computing optical components of the modified image data, computing optical components of the foundation makeup based on one or more of said augmentation parameters, and rendering augmented image data by combining the foundation makeup optical components and the modified image optical components. Other embodiments are also described and claimed.

Abstract: A system and method of augmenting image data are described. In one embodiment, the method comprises receiving data of an image captured by a camera, the captured image including a region having a visible feature of an object, storing masking data defining a plurality of masks, each mask defining a respective masked portion of the region of the captured image, sampling pixel values at predefined locations of the captured image data, selecting at least one stored mask based on the sampled pixel values, modifying pixel values in the or each selected masked portion of the region of the captured image based on colourisation parameters, and outputting the captured image with the modified pixel values for display. In other embodiments pixel values of one or more identified regions of a face in a target image are modified based on the augmentation characteristics derived from corresponding identified regions of a face in a source image.

Abstract: A system and method of augmenting image data are described. In one embodiment, the method comprises receiving data of an image captured by a camera, the captured image including a region having a visible feature of an object, storing masking data defining a plurality of masks, each mask defining a respective masked portion of the region of the captured image, sampling pixel values at predefined locations of the captured image data, selecting at least one stored mask based on the sampled pixel values, modifying pixel values in the or each selected masked portion of the region of the captured image based on colourisation parameters, and outputting the captured image with the modified pixel values for display. In other embodiments pixel values of one or more identified regions of a face in a target image are modified based on the augmentation characteristics derived from corresponding identified regions of a face in a source image.

Abstract: A computer-implemented method and system are described for locating fingernails of a person's hand in an image. An approximate location of each fingernail in the image is determined. An approximate location of each of a plurality of digit-shape objects in the image is initialized based on the approximate locations of the fingernails, and initially refined based on respective digit-shape object models and corresponding functions. The approximate location of each fingernail sub-shape is further refined based on a respective fingernail model and its corresponding function.

Abstract: A system and method are described for tracking the location and orientation of a user's feet for an augmented reality display. A depth sensor generates a depth map of a scene within the field of view of the depth sensor, the field of view containing at least a portion of the user. A processor is configured to identify a portion of the depth map as a candidate object for foot tracking, determine a central skeleton representation of the identified portion, determine a location of a toe of the user's foot and a location of an ankle of the user's foot, based on the central skeleton representation, and calculate an orientation of the user's foot based on the determine locations of the toe and the ankle.

Abstract: A computer-implemented method and system are described for locating fingernails of a person's hand in an image. An approximate location of each fingernail in the image is determined. An approximate location of each of a plurality of digit-shape objects in the image is initialized based on the approximate locations of the fingernails, and initially refined based on respective digit-shape object models and corresponding functions. The approximate location of each fingernail sub-shape is further refined based on a respective fingernail model and its corresponding function.

Abstract: There is described an image processing method in which a scene is repeatedly imaged to form a series of input images. For at least a subset of the input images, a color calibration procedure is conducted which populates a foreground color histogram with the frequency of occurrence of color values in a stencil area of the input image, and populates a background color histogram with the frequency of occurrence of color values outside of the stencil portion of the input image.

Abstract: There is described an image processing method in which a scene is repeatedly imaged to form a series of input images. For at least a subset of the input images, a colour calibration procedure is conducted which populates a foreground colour histogram with the frequency of occurrence of colour values in a stencil area of the input image, and populates a background colour histogram with the frequency of occurrence of colour values outside of the stencil portion of the input image.

Abstract: A system and method are described for tracking the location and orientation of a user's feet for an augmented reality display. A depth sensor generates a depth map of a scene within the field of view of the depth sensor, the field of view containing at least a portion of the user. A processor is configured to identify a portion of the depth map as a candidate object for foot tracking, determine a central skeleton representation of the identified portion, determine a location of a toe of the user's foot and a location of an ankle of the user's foot, based on the central skeleton representation, and calculate an orientation of the user's foot based on the determine locations of the toe and the ankle.

Abstract: An augmented reality system is described for providing a user with a facility to try out virtual clothing or accessories. The system comprises a database storing data defining at least one augmented reality object and a set of associated audio clips, each audio clip in the set corresponding to a different characteristic, trait or parameter of an associated augmented reality object, a camera for imaging a scene containing the user, logic for detecting the motion of a feature within the scene, a display device for displaying an image of the scene in which an augmented reality object is superimposed, an audio processing module for selecting an audio clip associated with the superimposed augmented reality object, and an audio device for playing a sound associated with the augmented reality object, wherein the sound is varied in accordance with the detected motion.