Abstract: Techniques are described for modeling layered facial reflectance consisting of specular reflectance, single scattering, and shallow and deep subsurface scattering. Parameters of appropriate reflectance models can be estimated for each of these layers, e.g., from just 20 photographs recorded in a few seconds from a single view-point. Spatially-varying specular reflectance and single-scattering parameters can be extracted from polarization-difference images under spherical and point source illumination. Direct-indirect separation can be employed to decompose the remaining multiple scattering observed under cross-polarization into shallow and deep scattering components to model the light transport through multiple layers of skin. Appropriate diffusion models can be matched to the extracted shallow and deep scattering components for different regions on the face.

Abstract: A camera may capture a sequence of images of a face while the face changes. A camera support may cause the field of view of the camera to remain substantially fixed with respect to the face, notwithstanding movement of the head. A lighting system may light the face from multiple directions. A lighting system support may cause each of the directions of the light from the lighting system to remain substantially fixed with respect to the face, notwithstanding movement of the head. Sequential images of the face may be computed as it changes based on the captured images. Each computed image may include least per-pixel surface normals of the face that are calculated based on multiple, separate images of the face. Each separate image may be representative of the face being lit by the lighting system from a different one of the separate directions.

Abstract: An apparatus for generating a surface normal map of an object may include a plurality of light sources having intensities that are controllable so as to generate one or more gradient illumination patterns. The light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns. A camera may receive light reflected from the illuminated surface of the object, and generate data representative of the reflected light. A processing system may process the data so as to estimate the surface normal map of the surface of the object. A specular normal map and a diffuse normal map of the surface of the object may be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.

Abstract: A controllable lighting system may include a plurality of light source groups, a group controller for each light source group, a master controller, and a network communication system. Each group controller may be configured to control the light sources in its light source group based on a group control command. The master controller may be configured to receive a master control command relating to the light sources and to issue a group control command to each of the group controllers that collectively effectuate compliance with the master control command. The network communication system may be configured to communicate the group control commands from the master controller to the group controllers.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: A system for estimating the specular roughness of points on a surface of an object may include a lighting system, an image capture system and a computer processing system. The lighting system may be configured to illuminate the surface of the object at different times with different illumination patterns. Each illumination pattern may illuminate the surface from a plurality of different directions and form an intensity gradient having an order of no more than two. The image capture system may be configured to capture an image of the surface of the object when illuminated by each of the different illumination patterns at each of the different times. The computer processing system may be configured to compute the specular roughness of each point on the surface of the object based on the images captured by the image capture system.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: The pose of a photographic image of a portion of Earth may be estimated using human assistance. A 3D graphics engine may render a virtual image of Earth from a controllable viewpoint based on 3D data that is representative of a 3D model of at least a portion of Earth. A user may locate and display a corresponding virtual image of Earth at a viewpoint that approximately corresponds to the pose of the photographic image by manipulating user controls. The photographic image and the corresponding virtual image may be overlaid on one another so that both images can be seen at the same time. The user may adjust the pose of one of the images while overlaid on the other image by manipulating user controls so that both images appear to substantially align with one another. The settings of the user controls may be converted to pose data that is representative of the pose of the photographic image within the 3D model.

Abstract: Techniques are described for modeling layered facial reflectance consisting of specular reflectance, single scattering, and shallow and deep subsurface scattering. Parameters of appropriate reflectance models can be estimated for each of these layers, e.g., from just 20 photographs recorded in a few seconds from a single view-point. Spatially-varying specular reflectance and single-scattering parameters can be extracted from polarization-difference images under spherical and point source illumination. Direct-indirect separation can be employed to decompose the remaining multiple scattering observed under cross-polarization into shallow and deep scattering components to model the light transport through multiple layers of skin. Appropriate diffusion models can be matched to the extracted shallow and deep scattering components for different regions on the face.

Abstract: Acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps are described. An analysis phase can be included where the relationship between motion capture markers and detailed facial geometry is inferred. A synthesis phase can be included where detailed animated facial geometry is driven by a sparse set of motion capture markers. For analysis, an actor can be recorded wearing facial markers while performing a set of training expression clips. Real-time high-resolution facial deformations are captured, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, displacements are calculated between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in one or more polynomial displacement maps parameterized according to the local deformations of the motion capture dots.

Abstract: A lighting reproduction apparatus for illuminating a subject includes a reproduction light optical source that generates reproduction light. The optical source includes a plurality of light emitters, each characterized by an individual color channel. There may be nine different color channels. A driver drives the light emitter color channels with intensity values at which a substantial spectral match is achieved between the reproduction light and the desired illuminant, so that the subject appears to be illuminated by the desired illuminant. These channel intensity values may be determined by solving a minimization equation that minimizes a sum of square residuals of the reproduction light spectra to the desired illuminant spectra. The output reproduction light may be metamerically, matched with the desired illuminant, with respect to a particular camera's spectral response. One or more spectral reflectances of the subject may be measured and incorporated into the optimization process.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: An apparatus for generating a surface normal map of an object may include a plurality of light sources having intensities that are controllable so as to generate one or more gradient illumination patterns. The light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns. A camera may receive light reflected from the illuminated surface of the object, and generate data representative of the reflected light. A processing system may process the data so as to estimate the surface normal map of the surface of the object. A specular normal map and a diffuse normal map of the surface of the object may be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.

Abstract: An interactive, autostereoscopic system for displaying an object in 3D includes a mirror configured to spin around a vertical axis when actuated by a motor, a high speed video projector, and a processing system including a graphics card interfaced to the video projector. An anisotropic reflector is bonded onto an inclined surface of the mirror. The video projector projects video signals of the object from the projector onto the inclined surface of the mirror while the mirror is spinning, so that light rays representing the video signals are redirected toward a field of view of a 360 degree range. The processing system renders the redirected light rays so as to interactively generate a horizontal-parallax 3D display of the object. Vertical parallax can be included in the display by adjusting vertically the displayed views of the object, in response to tracking of viewer motion by a tracking system.

Abstract: A lighting apparatus may be configured to illuminate a subject while the subject is undergoing a motion during a time period. An imaging system may be configured to generate image data representative of a sequence of frames of the moving subject. A controller may be configured to drive the lighting apparatus and the imaging system so that the lighting apparatus sequentially illuminates the moving subject with a time-multiplexed series of lighting conditions, and so that each one of the frames shows the subject illuminated with a respective one of the lighting conditions. The controller may be further configured to process the image data to generate re-illumination data representative of novel illumination conditions under which the subject can be re-illuminated, subsequent to the time period.

Abstract: An illumination reproduction apparatus and process for illuminating a subject with the illumination at a location in a scene when the subject is not in the scene. Scene illumination data is generated that specifies the illumination at the location in the scene from a plurality of spatial directions. The subject is then illuminated with the illumination at the location in the scene by driving a plurality of light sources surrounding the subject with the scene illumination data.

Abstract: A reflectometry apparatus and method is presented that allow the diffuse and specular reflectance parameters of an object to be independently and reliably measured, and that allow the variations in surface normal and surface height to be estimated. An extended light source having an elongated configuration, for example a linear cylindrical light source such as a neon tube, is moved across the surface of an object while a digital camera detects the reflected light to acquire a series of images of the object surface. A reflectance trace table is synthesized for a range of model parameters using a virtualized rendition of the linear light source. For each pixel, the observed reflectances are compared to the synthesized reflectance trace table, to determine the reflectance parameters that most closely match the observed data.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: A reflectometry apparatus and method is presented that allow the diffuse and specular reflectance parameters of an object to be independently and reliably measured, and that allow the variations in surface normal and surface height to be estimated. An extended light source having an elongated configuration, for example a linear cylindrical light source such as a neon tube, is moved across the surface of an object while a digital camera detects the reflected light to acquire a series of images of the object surface. A reflectance trace table is synthesized for a range of model parameters using a virtualized rendition of the linear light source. For each pixel, the observed reflectances are compared to the synthesized reflectance trace table, to determine the reflectance parameters that most closely match the observed data.

Abstract: A lighting simulation process for simulating the lighting of a subject at a location in a scene. Scene illumination data is created that specifies the illumination that the scene provides at the location at which the subject is to be simulated from a plurality of spatial directions. Subject illumination data is created that specifies the appearance of the subject when illuminated from a plurality of different spatial directions. The subject is then illuminated as if at the location in the scene by combing the scene illumination data with the subject illumination data.