Abstract: The disclosed computer-implemented method includes systems for optimizing color rendition in an LED volume virtual production stage. For example, the described systems optimize or correct color rendition by applying a series of color correction matrices to color pixel values within the virtual production stage and to final captured imagery filmed within the virtual production stage. The described systems generate the color correction matrices from four calibration images taken within the virtual production stage. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method includes systems for optimizing color rendition in an LED volume virtual production stage. For example, the described systems optimize or correct color rendition by applying a series of color correction matrices to color pixel values within the virtual production stage and to final captured imagery filmed within the virtual production stage. The described systems generate the color correction matrices from four calibration images taken within the virtual production stage. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A system may almost instantly capturing high-resolution geometry and reflectance data of a portion of a human subject. The system may include multiple cameras, each oriented to controllably capture an image of the portion of the human subject from a different location in space; multiple lights, each oriented to controllably illuminate the portion of the human subject from a location in space significantly different than the location in space of the other lights; and a controller. The controller may divide the cameras into subgroups with each subgroup of cameras containing at least one camera and with each camera belonging to only one of the subgroups; cause each subgroup of cameras to sequentially capture a single image of the portion of the human subject; and cause at least one of the lights to light while each subgroup of cameras captures a single image of the portion of the human subject.

Abstract: Systems and techniques for multispectral lighting reproduction, in one aspect, include: one or more light sources having different lighting spectra; and one or more computers comprising at least one processor and at least one memory device, the one or more computers programmed to drive the one or more light sources directly using intensity coefficients that have been determined by comparing first data for a multi-color reference object photographed by a camera in a scene with second data for the multi-color reference object photographed when lit by respective ones of the different lighting spectra of the one or more light sources.

Abstract: A facial image capture system may capture images of a face of a person while the person is moving. A video camera may capture sequential images of a scene to which the video camera is directed. A marker-based location detection system may determine and generate information about the location of a marker worn on or close to the face of the person. A camera control system may automatically adjusts both the horizontal and vertical direction to which the video camera is directed so as to cause the sequential images of the camera to each be of the face of the person while the person is moving, based on the information about the location of the marker from the marker-based location detection system.

Abstract: Systems and techniques for multispectral lighting reproduction, in one aspect, include: one or more light sources having different lighting spectra; and one or more computers comprising at least one processor and at least one memory device, the one or more computers programmed to drive the one or more light sources directly using intensity coefficients that have been determined by comparing first data for a multi-color reference object photographed by a camera in a scene with second data for the multi-color reference object photographed when lit by respective ones of the different lighting spectra of the one or more light sources.

Abstract: An apparatus to measure surface orientation maps of an object may include a light source that is configured to illuminate the object with a controllable field of illumination. One or more cameras may be configured to capture at least one image of the object. A processor may be configured to process the image(s) to extract the reflectance properties of the object including an albedo, a reflection vector, a roughness, and/or anisotropy parameters of a specular reflectance lobe associated with the object. The controllable field of illumination may include limited-order Spherical Harmonics (SH) and Fourier Series (FS) illumination patterns with substantially similar polarization. The SH and FS illumination patterns are used with different light sources.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: A system may almost instantly capturing high-resolution geometry and reflectance data of a portion of a human subject. The system may include multiple cameras, each oriented to controllably capture an image of the portion of the human subject from a different location in space; multiple lights, each oriented to controllably illuminate the portion of the human subject from a location in space significantly different than the location in space of the other lights; and a controller. The controller may divide the cameras into subgroups with each subgroup of cameras containing at least one camera and with each camera belonging to only one of the subgroups; cause each subgroup of cameras to sequentially capture a single image of the portion of the human subject; and cause at least one of the lights to light while each subgroup of cameras captures a single image of the portion of the human subject.

Abstract: A facial image capture system may capture images of a face of a person while the person is moving. A video camera may capture sequential images of a scene to which the video camera is directed. A marker-based location detection system may determine and generate information about the location of a marker worn on or close to the face of the person. A camera control system may automatically adjusts both the horizontal and vertical direction to which the video camera is directed so as to cause the sequential images of the camera to each be of the face of the person while the person is moving, based on the information about the location of the marker from the marker-based location detection system.

Abstract: A multiview face capture system may acquire detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints. A lighting system may illuminate a face with polarized light from multiple directions. The light may be polarized substantially parallel to a reference axis during a parallel polarization mode of operation and substantially perpendicular to the reference axis during a perpendicular polarization mode of operation. Multiple cameras may each capture an image of the face along a materially different optical axis and have a linear polarizer configured to polarize light traveling along its optical axis in a direction that is substantially parallel to the reference axis. A controller may cause each of the cameras to capture an image of the face while the lighting system is in the parallel polarization mode of operation and again while the lighting system is in the perpendicular polarization mode of operation.

Abstract: Acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps are described. An analysis phase can be included where the relationship between motion capture markers and detailed facial geometry is inferred. A synthesis phase can be included where detailed animated facial geometry is driven by a sparse set of motion capture markers. For analysis, an actor can be recorded wearing facial markers while performing a set of training expression clips. Real-time high-resolution facial deformations are captured, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, displacements are calculated between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in one or more polynomial displacement maps parameterized according to the local deformations of the motion capture dots.

Abstract: An interactive, autostereoscopic system for displaying an object in 3D includes a mirror configured to spin around a vertical axis when actuated by a motor, a high speed video projector, and a processing system including a graphics card interfaced to the video projector. An anisotropic reflector is bonded onto an inclined surface of the mirror. The video projector projects video signals of the object from the projector onto the inclined surface of the mirror while the mirror is spinning, so that light rays representing the video signals are redirected toward a field of view of a 360 degree range. The processing system renders the redirected light rays so as to interactively generate a horizontal-parallax 3D display of the object. Vertical parallax can be included in the display by adjusting vertically the displayed views of the object, in response to tracking of viewer motion by a tracking system.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: An apparatus to measure surface orientation maps of an object may include a light source that is configured to illuminate the object with a controllable field of illumination. One or more cameras may be configured to capture at least one image of the object. A processor may be configured to process the image(s) to extract the reflectance properties of the object including an albedo, a reflection vector, a roughness, and/or anisotropy parameters of a specular reflectance lobe associated with the object. The controllable field of illumination may include limited-order Spherical Harmonics (SH) and Fourier Series (FS) illumination patterns with substantially similar polarization. The SH and FS illumination patterns are used with different light sources.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: An interactive, autostereoscopic system for displaying an object in 3D includes a mirror configured to spin around a vertical axis when actuated by a motor, a high speed video projector, and a processing system including a graphics card interfaced to the video projector. An anisotropic reflector is bonded onto an inclined surface of the mirror. The video projector projects video signals of the object from the projector onto the inclined surface of the mirror while the mirror is spinning, so that light rays representing the video signals are redirected toward a field of view of a 360 degree range. The processing system renders the redirected light rays so as to interactively generate a horizontal-parallax 3D display of the object. Vertical parallax can be included in the display by adjusting vertically the displayed views of the object, in response to tracking of viewer motion by a tracking system.

Abstract: A high dynamic range image editing system for editing an image file having pixels spanning a first range of light intensity levels in an image editing system that only displays differences in the light intensity levels of pixels within a second range of light intensity levels that is less than the first range of light intensity levels, without reducing the range of light intensity levels in the image file.

Abstract: A system for estimating the specular roughness of points on a surface of an object may include a lighting system, an image capture system and a computer processing system. The lighting system may be configured to illuminate the surface of the object at different times with different illumination patterns. Each illumination pattern may illuminate the surface from a plurality of different directions and form an intensity gradient having an order of no more than two. The image capture system may be configured to capture an image of the surface of the object when illuminated by each of the different illumination patterns at each of the different times. The computer processing system may be configured to compute the specular roughness of each point on the surface of the object based on the images captured by the image capture system.

Abstract: A multiview face capture system may acquire detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints. A lighting system may illuminate a face with polarized light from multiple directions. The light may be polarized substantially parallel to a reference axis during a parallel polarization mode of operation and substantially perpendicular to the reference axis during a perpendicular polarization mode of operation. Multiple cameras may each capture an image of the face along a materially different optical axis and have a linear polarizer configured to polarize light traveling along its optical axis in a direction that is substantially parallel to the reference axis. A controller may cause each of the cameras to capture an image of the face while the lighting system is in the parallel polarization mode of operation and again while the lighting system is in the perpendicular polarization mode of operation.