Abstract: Methods and systems for separating a picture part of interest from an arbitrary background in real time videos are presented. The background may be a moving or still frame. The picture part of interest and background frames may be in or out of focus. One separation approach employs the difference between luminance and chrominance values of the input and background frames where changes in luminance from frame to frame are compensated for. In another approach, picture part of interest separation is based solely on spatial resolution differences between the background and the picture part of interest frames. The present invention also teaches a method and system for parameter matching of the picture part of interest and the basic picture into which the picture part of interest is embedded. The invention further teaches a method and system for embedding a separated picture part of interest into a basic picture containing text.

Abstract: Digitally compositing an object from an input image onto a destination image is disclosed. The object is composited from an image having an arbitrary or non-uniform colored background containing some non-static elements onto a destination image with reduced effects from shadows cast by the object and with reduced gaps or holes within the object. The effect of shadows emanating from the object is reduced so that the composited object in the destination image contains only the object clearly outlined by the object's physical boundaries without the effect of shadows cast by the object.

Abstract: Methods and apparatus to detect an internally generated signal mode of a local media playback device are disclosed. A disclosed method comprises tuning a harmonic frequency of a chrominance signal output by a local media playback device, and determining that the local media playback device is in an internally generated signal mode if the measured harmonic frequency exceeds a predetermined threshold.

Abstract: The present invention relates to a method for composing a scene containing a plurality of objects, an object comprising chrominance and luminance components, a chrominance value being associated with a set of at least two luminance values, wherein said method comprises a step of blending a first object with a second object resulting in a blended object, said step comprising the sub-steps of:—generating a luminance component of the blended object from the corresponding luminance components of the first and second objects and from a first composition function, and—generating a chrominance component of the blended object from the corresponding chrominance components of the first and second object and from a second composition function, the second composition function depending on a set of associated values of the first composition function.

Abstract: An interactive video compositing device includes a chroma-key mixer, video switcher and control circuitry. The chroma-key mixer generates a composite image by combining a real-time image, such as one captured by a video recorder, with a prerecorded video image, such as a movie. The composite image includes the modified real-time image superimposed, or overlaid, onto the prerecorded image. The video switcher automatically selects either the composite image or the prerecorded image to be output to a display. The control circuitry controls the video switcher and other outputted signals based on data file information that corresponds to content of the prerecorded image or media. For example, the data files may contain information relating to the presence (or absence) of a particular character in a movie scene, thus allowing for the output and display, at appropriate times, of the real-time composite image instead of the prerecorded image.

Abstract: A method, system, and device for generating a clean clipping signal ? for a chromakey function or a video composition, including identifying background colors formed by a solid color background, shadows cast by still and moving subjects, a non-uniform reflection caused by spot lighting and non-flat backdrop or flaw wall, and translucent foreground objects, with a 3D volume in a 3D color space; determining parameters defining same by using a dirty alpha ?; generating a clean clipping signal ?shd background colors, and a clean clipping signal ?tsl for translucency colors; identifying foreground colors formed by the still and moving subjects with a 3D volume in a 3D color space; classifying colors into transition colors; and generating an area map for mapping each pixel into background, shadow, translucent, foreground, and transition areas.

Abstract: A visible mismatch in noise characteristics between a portion of a background scene inserted in composite image by a matte generated from a blue screen and a second portion of the same background inserted by a garbage matte is significantly reduced by adding extracted noise characteristics from the foreground image to the portion of the background scene inserted by the garbage matte. The selective addition of foreground noise characteristics to portions of the background scene significantly enhances the realistic look of a composite image.

Abstract: A method for extracting a clear frame from an image frame containing at least one or more subjects disposed before a backing, whose color and luminance vary smoothly from one backing area to another. The method replaces a subject's pixel signal levels with backing pixel signal levels. The method selects a known backing pixel and compares the RGB signal levels of an adjacent pixel with the RGB signal levels of the known backing pixel and identifies the adjacent pixel as a backing pixel when its RGB signal levels are each within an assigned tolerance of the RGB signal levels of the known backing pixel. This comparison is performed on all known backing pixels with unidentified adjacent pixels until all pixels in the image frame have been examined and all backing pixels identified.

Abstract: A chroma key color determining section is operable to determine a chroma key color in an image of a plurality of input images. A image synthesizing section is operable to overlap the images with each other by switching the images with respect to each pixel based on an output of the chroma key color determining section. The plurality of images are switched by switching all of pixels of the image input to the chroma key color determining section into the chroma key color images.

Abstract: The present invention provides an imaging unit, a portable terminal device, and a portable terminal system capable of performing a satisfactory key synthesizing process. An imaging unit mainly includes an imaging section, a conversion section, and a key signal generating section. The conversion section converts the format of the imaged image data output from the imaging section from YUV format to RGB format. The key signal generating section generates a key signal based on each pixel data configuring the imaged image data and the reference data for the imaged image data input from the imaging section. The key signal generating section also outputs foreground image data having the generated key signal and the corresponding pixel data of RGB format as minimum configuring unit.

Abstract: In an apparatus for composing image data of a main picture and image data of a sub-picture by a chroma key process, an attribute of an image contained in the sub-picture is detected, a partial area of the sub-picture is set as a chroma key mask area in accordance with the attribute detection result, and composing the image data of the main picture and the image data of the sub-picture by executing the chroma key process for an area other than the chroma key mask area without executing the chroma key process for the chroma key mask area in the sub-picture.

Abstract: An apparatus for color compensation includes a chroma deflection generation unit to calculate a chroma deflection based on an input chroma signal and a predetermined first reference value, a hue deflection generation unit to calculate a hue deflection based on an input hue signal and a predetermined second reference value, a chroma deflection function generation unit to calculate a luminance deflection based on an input luminance signal and a predetermined third value, and a tone mapping function generation unit to output the chroma signal, hue signal and luminance signal after individually compensating these signals based on the chroma deflection, hue deflection and luminance deflection. According to the present invention, when color is distorted due to transmission flaws, the color can be compensated to be an appropriate color.

Abstract: The apparatus inserts a participant realistically into familiar background media to provide similar results to a completely original movie with multi-camera studio production and editing. An automated and simplified studio has multiple cameras and traditional studio devices such as teleprompters and controlled lighting presented to the consumer as an entertainment product. Previously produced, familiar media are modified to create the background video source and synchronous audio track. The participant is inserted via chroma key and the multiple cameras are used to create traditional establishing shots intercut with close-ups. These are controlled through a video switcher to create a real-time, finished recording that is stored on a digital server for later playback.

Abstract: A system or method of automated image processing that can automatically determine a color and transparency for a pixel with an observed color when given the pixel and a background reference color. A point in a color space can be automatically found by extrapolating in the color space based on two points in the color space that respectively correspond to or that respectively approximate the observed color and the given background reference color. A color for the given pixel that corresponds to or approximates the found point in the color space can also be calculated automatically. Based on the found point and the two points in the color space that respectively correspond to the observed color and the given reference color, a transparency for the pixel can be automatically found.

Abstract: Disclosed is a system for generating a graphics window that is capable of emulating enhanced video from a combined video and interactive content stream. The set-top emulator can randomly access the combined video and interactive content stream to provide an easy manner of randomly accessing portions of the combined video and interactive stream for quality control purposes. Random access allows selective viewing of the enhanced video which saves time. Additionally, the combined video and interactive content stream can be simultaneously viewed as it is being produced to allow immediate feedback to an interactive television producer.

Abstract: An improved cinematographic system and method for multiple compositing, within a virtual studio, of an image frame or image sequence of a real/action image of an action sequence of a puppet, with another image frame or image sequence of a real/action image of the same or another puppet, within a given virtual studio space. This system and method have application to the compositing of a master camera angle image and a close-up image of the same puppet character; and, to the compositing of a master camera angle image of one action puppet character with a second image from another camera angle of another puppet action character, so as to provide an interactive image sequence of each of the characters of each image within the same image frame.

Abstract: R, G and B signals are output from individual pixels provided at an image-capturing element. Pixel output averages corresponding to the R, G and B signals are calculated for each of partition areas into which the light-receiving surface of the image-capturing element is divided. Ratios of the R and B pixel output averages to the G pixel output average are calculated for each partition area. Then, any area with the ratios of the pixel output averages within a predetermined range is extracted from the plurality of partition areas. R and B white balance gains are calculated based upon the total sums of the pixel output averages corresponding to the individual colors in the extracted area. A white balance adjustment is then executed by multiplying the values of R and B pixel outputs by the corresponding white balance gains.

Abstract: A special effect device by which an entirely new special picture effect is to be implemented in accordance with a read address control system. The device includes an address signal generating unit 3 which generates a readout address signal for picture signals stored in a frame buffer 2 so that, by rupturing a picture portion of an area at an optional position of a picture in the frame buffer, defined by a circle having a radius of an optional size, with the center of the circle as a rupturing point, a folded picture portion will be obtained which has the circumference of the circle as a topological boundary.

Abstract: A system, method and computer program product for real-time insertion of indicia (e.g., an advertisement) into a live (or taped) broadcast. Typically, the invention allow insertion with occlusion onto surfaces such as tennis courts, the wall behind home plate on a baseball field, the grass or turf on a soccer or football stadium, and the like. The occlusion processing described herein can handle multiple colors in the background image during the insertion of the indicia into a video image. The invention can thus adapt to changing light conditions in the video image. The process includes obtaining a video image from a camera. The video image is typically digitized. Next, the pixels within the video image are sampled. A plurality of background colors are then identified for the sampled pixels. An opacity value is then assigned to each pixel in the indicia based on whether the color of a positionally corresponding pixel in the video image is the same color as one of the plurality of background colors.

Abstract: Image-based lighting for use in rendering of digital objects is derived from image data collected from a real motion-picture set. The image data includes sets of correlated images at different exposure levels, each corresponding to a selected location. The image data is processed to define an extended dynamic range panoramic image for each selected set location. The image data is color and intensity corrected based on a scaled reference object. At least key lights are modeled for the set by processing a plurality of such panoramic images. Other lighting may be defined by interpolating from the panoramic images to mathematically define a location-specific set of fill lights. In the alternative, other set lighting may be modeled by projecting panoramic image data onto a dynamically sub-dividable light primitive derived from the set geometry. Any desired object may then rendered using the defined lights, and inserted into a corrected real image of the set at the desired location.

Abstract: In an apparatus for composing image data of a main picture and image data of a sub-picture by a chroma key process, an attribute of an image contained in the sub-picture is detected, a partial area of the sub-picture is set as a chroma key mask area in accordance with the attribute detection result, and composing the image data of the main picture and the image data of the sub-picture by executing the chroma key process for an area other than the chroma key mask area without executing the chroma key process for the chroma key mask area in the sub-picture.

Abstract: A method of processing a color digital image file provides a “metallic,” or a “sepia,” or an “antiqued” image file. The resulting image files may be viewed, for example, on a computer monitor, or may be printed out in hard copy form using a black-and-white or color printer. A color photocopy machine which has a digital image output may be used to produce the original image file, and such a color photocopier (if it will accept digital image files), may also be used to produce the output hard copy printouts of processed image files. Thus, such a digital photocopier may be configured internally to also process image files, and may be employed to selectively process images copied on the machine into the user's choice of a metallic, a sepia, or an antiqued image on the output hardcopy of the color photocopier.

Abstract: A system controls reproduction of a video transmission between a transmitter and a receiver. The system includes an encryptor with an offset generator adapted to receive the encrypted frame key and to generate a sequence of pseudo-random values for the color component; and an adder coupled to the offset generator and to the color component signal for providing an encoded color component signal. The system also includes a decryptor with a decryptor offset generator adapted to receive the encrypted frame key and to generate a decryptor pseudo-random value for the color component; and a subtractor coupled to the offset generator and to the color component signal for subtracting the offset signal from the color component signal.

Abstract: An improved method for enhanced puppetry or similar types of performances utilizing a virtual set having a key-color screen behind the set to do live action filming. All objects on the set, except for the performing puppet, or other objects which are to appear in the final product, are wrapped in a material which matches the color of the keycolor screen. A virtual background is generated and combined with the live action whereby only the puppet (or other object) appears on the virtual background in real time, with all other objects on the live set, including puppeteers, for example, being eliminated from the final product.

Abstract: In an apparatus for composing image data of a main picture and image data of a sub-picture by a chroma key process, an attribute of an image contained in the sub-picture is detected, a partial area of the sub-picture is set as a chroma key mask area in accordance with the attribute detection result, and composing the image data of the main picture and the image data of the sub-picturee by executing the chroma key process for an area other than the chroma key mask area without executing the chroma key process for the chroma key mask area in the sub-picture.

Abstract: A method and system for incorporating thematic content from a particular television program into product or service advertisements uses program-advancing elements of a television program in an advertisement for a sponsor of the program in order to entice viewers to watch the advertisements. Increased viewership of advertisements can result in increased revenue generated from advertisements that may be realized by television programs, television producers, networks, and advertisers.

Abstract: Upon chromakey processing, 4×4 transformation matrix is provided through which a backing color selected is transformed to the original point and monochrome color is transformed to vertically distribute at a spot away from the original point along an axis. Matrix multiplication comprising only addition and multiplication is applied to a foreground image data signal to generate a masked output image and a color-processed foreground output image without requiring complex arithmetic operations.

Abstract: Method and apparatus for combining a first video signal and a second video signal. The method comprising the act of replacing data in the second video signal with corresponding, in respect of a position within an image, data from the first video signal when said data in the second video signal represent a predefined repetitive pattern.

Abstract: A synthesized image is formed by synthesizing a main image and a background mage represented by respective image data items each having n-valued gradation values each having any one of n possible values(n is an integer which is equal to or larger than 3) and defining a density of pixels. A plurality of different data items representative of candidates for the background image are stored as background image data candidates. An arbitrary one of the background image data candidates is set to a background image data item representative of the background image. There is formed a main image data item forming a main image data item representative of the main image, the main image data item having n-valued main image gradation values commonly applied to all valid pixels of the main image, as values of the n-value gradation values.

Abstract: The present invention provides methods and apparatus to distinguish and/or separate an object from a background. The methods use backgrounds of known and/or advantageous texture. In an embodiment, a measure of image texture, namely the spatial frequency is used to distinguish and/or separate an object from its background. The use of image texture overcomes limitations of chroma keying used as a processing technique in photography for object-background separation. This is useful in the separation of image pixels belonging to the object of interest from image pixels belonging to the background.

Abstract: An apparatus for displaying a digital video signal includes a shade reflection ratio calculator and a brightness compensator. The shade reflection ratio calculator calculates a shade reflection ratio r of each pixel per display clock using a linear distance function between a center pixel and a current pixel on a screen. The brightness compensator compensates brightness of each pixel by applying the shade reflection ratio value r and a brightness adjustment width Yrate to an input digital video signal. Thus, it is possible to improve picture quality of a video displayed on a screen.

Abstract: In a color range designation apparatus and method, a designation pixel of a display image is input, and a color of the designation pixel of the display image is determined. A range between a minimum color and a maximum color for the input designation pixel is determined based on the color determined.

Abstract: A keyed color generator for use in a machine vision system may include three color channels with a subtractor in each to subtract a corresponding component color of a background on which the object under inspection is being observed. This subtraction operation produces adjusted red (R), green (G), and blue (B) values. The R and B values may be divided by the adjusted G value to produce R/G and B/G color ratios. These color ratios and the adjusted G value may be compared to associated upper and lower threshold values corresponding to a keyed color. If all of the calculated values fall within the associated ranges, the generator outputs a signal indicative of the keyed color.

Abstract: The present invention is a method and apparatus for automatically defocusing a background scene as the background scene is being composited with a foreground subject during the photography of the subject, where the background scene becomes increasingly defocused as the subject appears to approach the camera. A source of background image signals is connected to a background input of a compositing device capable of averaging a selected group of background pixels. A source of foreground image signals is connected to a foreground input of the compositing device. A matte signal generated by the compositing device is accessed and the matte signal is used to determine the ratio of foreground subject area to image frame area. The area ratio is then used to select, for each pixel in said background image, a number of adjacent pixels to be averaged to form an average pixel level. The signal levels at each pixel in the background scene are replaced with the average pixel level.

Abstract: The present invention provides an optimal processing pipeline suitable for high quality video and graphics processing. According to the invention, color key extraction is performed before actual processing and transforming of the video/graphics data. This substantially minimizes the amount of artifacts in composed pictures. In accordance with the present invention, a video/graphics data processing pipeline is provided. The pipeline comprises a pre-processing circuit that is configured to pre-process a stream of digital video/graphics data and output pre-processed data; a color key processing circuit, operably coupled to the pre-processing circuit, that is configured to extract a color key from the pre-processed data and output resulting data; and a processing/transforming circuit, operably coupled to the color key processing circuit, that is configured to process and transform the resulting data.

Abstract: A video signal processing apparatus A comprises: an adder 107 for generating a second address value S106 which has a predetermined phase difference from a first address value S101 outputted by an address value output means 120 and outputting the same; a selector 108 for selecting either a first address value S101 or a second address value S106 to output as an output signal S107; a vertical synchronizing signal output means 123 for outputting the vertical synchronizing signal S104 to the selector 108; a ROM 109 for outputting first data corresponding to the first address value S101 or second data corresponding to the second address value S106 as a signal S108; a loading hold mode flip-flop 110 for preserving the first data; a loading hold mode flip-flop 111 for preserving the second data; and a hue adjustment means B which adjusts the hue of the video signal by using the output signal S109 of the loading hold mode flip-flop 110 and the output signal S110 of the loading hold mode flip-flop 111.

Abstract: The invention relates to a method and system for creating video programs in a virtual studio, ensuring the interactive interaction of actors with objects of virtual reality, and also simplification and acceleration of the procedure of creating animated programs. During the filming of an actor 2 in a virtual studio, an image of the actor is superimposed with the image of virtual space formed at the angle of view of a virtual camera with parameters, which correspond to the parameters of the television camera 3. Wherein in order ensure interactive interaction of the actor with the objects of virtual space with the aid of a means 10, the angle of view of the actor is determined and the image of virtual space formed in the unit 8 in accordance with the angle of view of the actor is displayed to him by means of the means 11.

Abstract: A video signal is generated representative of a background scene, such as a weather map, which provides an outline of all the detail in the map. This outline detail is made visible to a foreground subject by projecting it onto a white screen behind the subject in a selected color such as green. The projector is selectively inhibited so as to prevent the background detail from projecting onto the foreground subject. The white screen and the green detail lines are removed and replaced by the background scene by an image compositing process. Prompts are visible to the foreground subject, but not visible to a home viewing audience.

Abstract: There is provided configuration for enabling extraction of the concerned area with simple operations. An arbitrary position within the desired concerned area is designated by the position designation means, and the pixel color of the designated position is stored in the memory. The tolerable color difference setting means sets the initial color difference from the pixel color of the designated position as 0. The pixel group (within tolerable color difference) extraction means extracts the pixels within the tolerable color difference from all the pixels. The adjacent pixel group (within tolerable color difference) selective display means selectively displays the pixel group including the pixel of the designated position, based on the result of extraction by the extraction means. At each execution by the selective display means, the tolerable color difference setting means increases the tolerable color difference. Thereafter the extraction means and the selective display means repeat the execution.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: An automated image recording and document generation system is disclosed that generates identity documents using image and text information that is input to the system using computer controlled video cameras. The image and text information is combined with other stored images, such as logos, signatures and seals, to produce official identity documents such as identity cards, drivers licenses and passports. Prior to use the system automatically enters a setup and calibration phase wherein a video camera images a backdrop having borders on the left and right vertical edges and the digitized video output is analyzed to adjust the camera zoom and to locate the center of the backdrop in front of which an individual will sit or stand to have their picture taken. The image of a person whose picture is taken is analyzed and is centered horizontally in a picture by adding or subtracting columns of background color to the left or right side of the picture as needed.

Abstract: A fade circuit adjusts the luma as well as one or more chroma components of a main video so that the fade ins and fade outs of the main video do not change the color of an on-screen display image, such as the volume bar. In one embodiment, luma component (Y) is adjusted by subtracting a fade factor from the luma component to form a faded luma component. At the same time, one or more chroma components (Cb and Cr) are scaled by (1) subtracting a predetermined value from the chroma component to form a resultant, (2) multiplying the resultant with a scale factor to form a product, and (3) adding the predetermined value to the product to form a faded chroma component.

Abstract: An image chrominance signal filtering method and apparatus in which object chrominance information and background chrominance information are extracted in an image format conversion process, based on shape information of luminance signals, and then decimation-filtered or interpolation-filtered. In accordance with the method and apparatus of the present invention, it is possible to avoid a color bleeding phenomenon occurring at the boundaries of objects in an image. Accordingly, there is an advantage in that a degradation in picture quality is prevented.

Abstract: An encoder and encoding method for inserting logos into a digital television signal. The logo insertion is performed at the front end of the encoder (e.g., prior to compression) by sharing the video capture frame buffer of the encoder, so there is no need for a separate logo inserter with a separate buffer, and encoding cost are reduced. An alpha blending function receives logo image and logo alpha map data for blending with input video data. The input video is retrieved from the frame buffer, and written back to the frame buffer after blending with the logo data. Subsequently, the frame buffer contents are provided to a pre-processing function for filtering and film mode detection. For a film mode frame, a drop field decision is provided from the pre-processing function to the frame buffer to drop the redundant field. The pre-processed video data is then provided for conventional compression processing. In an HDTV embodiment, several compressors are provided which each receive a panel of a video frame.

Abstract: Text and graphics elements may be alpha blended in a way to reduce flicker when the text or graphics are display by a processor-based television receiver. The alpha values are used to intelligently smooth pixels adjacent the element to create television text and graphics.

Abstract: A method provides for an improved chroma-key suppression technique. The improved method reduces a halo-like effect which might otherwise appear in a composite image containing a foreground object selected from a first image and a background image selected from a second image. In accordance with the present invention, a chroma-key patch is translated into x, y axis coordinates and one or more pixels of the image in question can be compared to a chroma-key patch and a transition region at least partially surrounding the chroma-key patch to better select suppression signals to be applied in an image processing operation.

Abstract: An improved technique for mixing picture signals directed at a monitor screen. Two analog video signals (such as an analog VGA input and an analog RGB signal produced in response to a stored digital still or moving image) may be multiplexed in analog form. An analog chromakey mixer detects a background color in the first video signal (such as the analog VGA input), and replaces the portion of that first video signal with the second video signal. The time delays of the first video signal and the second video signal may be adjusted so that they reach the monitor screen (by means of an a multiplexer output) at the same time. An alignment detector may attempt to align two known signals (such as a VGA sync signal and a signal generated for this purpose), and may adjust a set of time delays in the analog chromakey mixer until the time difference between the first and second video signals falls below a threshold.

Abstract: An improved method for enhanced puppetry or similar types of performances utilizing a virtual set having a key-color screen behind the set to do live action filming. All objects on the set, except for the performing puppet, or other objects which are to appear in the final product, are wrapped in a material which matches the color of the keycolor screen. A virtual background is generated and combined with the live action whereby only the puppet (or other object) appears on the virtual background in real time, with all other objects on the live set, including puppeteers, for example, being eliminated from the final product.

Abstract: An improved cinematographic system and method for multiple compositing, within a virtual studio, of an image frame or image sequence of a real/action image of an action sequence of a puppet, with another image frame or image sequence of a real/action image of the same or another puppet, within a given virtual studio space. This system and method have application to the compositing of a master camera angle image and a close-up image of the same puppet character; and, to the compositing of a master camera angle image of one action puppet character with a second image from another camera angle of another puppet action character, so as to provide an interactive image sequence of each of the characters of each image within the same image frame.

Abstract: Text and graphics elements may be alpha blended in a way to reduce flicker when the text or graphics are display by a processor-based television receiver. The alpha values are used to intelligently smooth pixels adjacent the element to create television text and graphics.