Abstract: An improved method of tracking a camera in dynamic chroma-keying of the type in which a foreground object is photographed against a multicolored chroma-key screen. The multicolor patterns are created by projection on a monochrome screen, for example by projecting light through a mask on a screen colored with the chroma-key color. The projection of multiple patterns can emulate the use of a single pattern having multiple levels of detail, and can enable lateral tracking of the camera. Sequentially projecting known transformations (for example, rotations) of a pattern adds an extra degree of freedom which further enhances the accuracy of the method.

Abstract: An electronic billboard replacement system for use in a TV broadcast system including electronic billboard storage device for storing a plurality of replacement billboards and an electronic sequencer device for controlling the time period that each one of the plurality of billboards is displayed to a TV viewer.

Abstract: The disclosed system has particular applications to image archives and reediting. Given an image of an article having graphic objects including texts and pictures, the disclosed system first distinguishes graphic objects from the background by segmenting the image so as to produce an object image comprising a foreground, wherein the foreground corresponds to the graphic objects in the image. With respect to the foreground, the disclosed system “repaints” those spaces previously occupied by the graphic objects, referred to as object spaces, with the background color in the image as such the background continuity is preserved when the graphic objects are rendered and subsequently superimposed onto the repainted background. To account for various backgrounds, the disclosed system uses a point-wise patching approach followed by a one-dimensional patching approach if the object spaces contain two different colors.

Abstract: In an image processing method and an image processing apparatus in which information on the distance to a subject is successively allocated to each pixel of a processing target picture to generate a distance image, a key signal is generated from the processing target picture, and a distance image is subjected to keying processing on the basis of the key signal, whereby the outline can be displayed clearly when pictures are superimposed to generate a composite image on the bass of the distance image.

Abstract: An image processing unit is provided to solve the problem of an aliasing usually occurred when a foreground image and a background image are synthesized by using a key signal; this image processing unit comprises: an image filter circuit that applies to the foreground image an anti-aliasing processing to make obscure an aliasing that displays a slant graphic border in a stepped indentation due to an insufficiency of the number of pixels; a key filter circuit that applies the anti-aliasing processing to the key signal; and a pixel detection circuit that detects a pixel having a possibility to generate a color mixture by an operation of the image filter circuit from the key signal and a size of the image filter circuit. In this construction, the image filter circuit applies an anti-aliasing processing using only the pixel that constitutes the foreground image and does not contain a background color to the pixel having a possibility to generate the color mixture that the pixel detection circuit detects.

Abstract: The system comprises a store 11 having several disc drives for storing multiple video frames in random access order. The store 11 also has at least two ports 15, 16 each capable of transferring data relating to a respective video clip at video rate. The system further comprises processors 27, 28 for processing frame data associated with at least two video clips and a monitor for displaying selected ones of said multiple video frames. In a preview mode of operation video clips can be read from the store 11, combined and displayed on the monitor at video rate, and changes can be made to the clips and the manner in which they are combined without committing the combination to the store.

Abstract: A method and an arrangement for generating a composite video signal in accordance with the chroma-key method in which a virtual background spill signal is generated and added to the composite video signal to avoid darkening effects which are produced when eliminating spill light, and to eliminate brightening effects which are produced in "clean-up" operations. The background spill signal may consist of the product of a virtual spill signal source (SP) and a control signal (k.sub.3). The control signal (k.sub.3) is preferably the difference between a foreground control signal (k.sub.1) and a background control signal (k.sub.2), and both signals should be identical in the foreground and background ranges but different in spill ranges.

Abstract: A communication circuit includes a dual-channel coder having an unencoded data communication port, a first encoded data communication port, and a second encoded data communication port. The dual-channel coder is operative to translate between unencoded data at the unencoded communication port and corresponding encoded data at both the first encoded data port and at the second encoded data port The circuit further includes a real-time channel interface for connection to a real-time communication channel and operatively connected to the first encoded data tort of the coder. The real-time communication channel has a first latency of a guaranteed maximum for a data element to travel between ends of the real-time communication channel. The circuit further includes a best-efforts channel interface for connection to a best-efforts communication channel and operatively connected to the second encoded data port of the coder.

Abstract: The invention provides a mechanism and process for feathering a first image and a second image in a composite frame. In this process an original matte image is defined according to the first and second images. A portion of the original matte image is box filtered horizontally and vertically to generate an intermediate matte image. At least a portion of the intermediate matte image is box filtered horizontally and vertically to generate a processed matte image. A composite image including the first image and the second image is then generated according to the box-filtered processed matte image.

Abstract: A corner detector capable of detecting each corner position of a predetermined area from an input signal with a simple structure. There is provided memory means (9B) for storing memorizing an input signal (keyT) and corner detection means (9C) for detecting a point where the signal level becomes the reference signal level or more at first by reading an input signal stored in the memory means sequentially in horizontal direction from an upper limit and a lower limit of a retrieval scope and in vertical direction from the left end to the right end of the retrieval scope, and detecting a point where the signal level becomes the reference signal level or more at first by reading an input signal stored in the memory means sequentially in a diagonal direction at a predetermined angle from each angle of the retrieval scope to detect from the detected points four points whose positions differ.

Abstract: A chromokeying system includes a store that contains a representation of a known coded chromokeying pattern. The system further includes a frame grabber that grabs a video image including at least a portion of the known coded chromokeying pattern and a foreground subject. A perspective transformation computation unit computes a perspective transformation by comparing the video image of the portion of the coded chromokeying pattern with the known chromokeying pattern. The system may further include a background generation unit that receives a background image and applies the perspective transformation to the background image to produce a transformed background. The portion of the coded chromokeying pattern in the video image can then be replaced by the transformed background to create a composite image.

Abstract: A system for producing multiple personalized video sequences of a subject includes a storage medium storing a foreground video sequence of an element of interest which has been pre-mixed to enable keyed superposition over an other video image, and a video camera for generating a background video signal corresponding to a real-time video sequence of the subject. A mixer superposes the foreground video sequence over the background video signal to produce a combination video sequence in which the subject appears together with the element of interest. A video monitor is provided for displaying the combination video sequence as it is mixed. The system may be constructed as an automated machine with an automatic payment system and a media recorder and feeder. Preferably, the system includes camera and lighting control systems for producing effects in the real-time video signal to mimic similar effects in the pre-recorded video sequence.

Abstract: A multi-resolution background adaptation system and method wherein image information for a video frame is analyzed to update a background image in as great a resolution as possible. The video frame is partitioned into a plurality of cell levels, each cell level comprising at least one cell. Each cell is further partitioned into children cells for several hierarchical levels. Background image adaptation begins at the frame level and proceeds to lower cell levels of smaller cells when the lower cell levels are not substantially occluded by objects.

Abstract: Personalized story presentations, such as video movies, are prepared with the aid of a kit including a film camera, pose instruction set and chroma-key backdrop. The camera is preferably a special single-use camera having a visual aid strip seen in the viewfinder showing a series of poses associated with a selected story line. An optional audio accessory is provided to capture spoken phrases and other sounds to be associated with the presentation. The exposed film and sound recording are submitted to a photofinisher/image processor where the images and audio are digitized and incorporated into a preexisting digitized story using existing image processing programs. When completed, the personalized story is recorded on suitable playback media and returned to the customer. The same process can be used to create interactive game programs.

Abstract: Representative picture extracting means apparatus extracts representative pictures from a coded input signal 101 which consists of representative pictures, motion parameters for motion compensation which refers the representative picture, and reference relationships, and outputs a coded representative picture signal 103. The signal is decoded by a representative picture decoding means apparatus, and output as a decoded representative picture signal 105 to a delay memory 106. On the other hand, representative picture reference relationship extracting means apparatus extracts reference relationship additional information 113, and outputs it to decoded signal output controlling means apparatus. The sequence of outputting the representative pictures is determined on the basis of the reference relationship additional information 113, and an output control signal 115 is output to the delay memory 106.

Abstract: Use of a digital television as a remote display for a computer system is accomplished by capturing video data signals, compressing the captured video data signals, capturing audio output data signals, converting the captured audio output data signals and captured video data signals into broadcast digital television data packets, and transmitting the television data packets as television signals to the digital television.

Abstract: In a keying system, an image of an object is gained and a plurality of the background images each of which is obtained correspondingly to a view angle of a view point in a three-dimensional space to be imaged and a view position of the view point therein are stored on a memory device. The background image from the plurality of background images stored in the memory device is selectively read according to the view angle and the view position preliminarily defined in accordance with the image of the object. A chroma-keying composition is performed between the background image and the image of the object thereby producing a composite image.

Abstract: A new method and apparatus for creating, positioning and manipulating a garbage matte which obscures everything outside of a three-dimensional physical set or blue stage. Effectively, the garbage matte is a "negative" of a blue stage. What is important is that the garbage matte is created either as a virtual enclosure around all virtual objects in the virtual environment, or simply as a background color of the graphics engine generating the garbage matte. In this way, the garbage matte provides extensions of blue screens which comprise the blue stage, extending all the way around and behind the television cameras. Consequently, a compositor will not include in a composited output image those physical set elements which are masked by the virtual garbage matte. The compositor will replace areas hidden by the garbage matte with image data supplied by the computer image generator which stores the virtual environment.

Abstract: A method of compositing a set of ordered image layers in which a compound layer contains a plurality of image layers. The compound layer has a compound layer effect. Any image layers under the compound layer are composited to generate a first intermediate image, the first intermediate image is composited with each image layer in the compound layer to generate a second intermediate image, the first intermediate image is composited with the second intermediate image according to the compound layer effect to generate a third intermediate image, and the third intermediate image is composited with any remaining image layers to generate a final image.

Abstract: A graphics blending feature for a terminal such as a home communication terminal (HCT) allows an overlay image to be selectively blended with a background image through the use of a chroma key function and one or more alpha control bits. The chroma key function is used to determine whether the overlay will be completely transparent or not, and the one or more alpha control bits are used to look up a larger alpha value used to blend the overlay and background images. By using a small number of alpha control bits to retrieve a larger alpha value for blending, memory requirements per pixel are reduced. The chroma key function may be implemented by comparing each overlay pixel value to a chroma value and, responsive to a match, making the overlay pixel transparent (i.e., no blending occurs). A dithering function is included in various embodiments to smooth out the resulting image.

Abstract: A video coding device capable of making coded data have a hierarchical structure, a specified area of each frame is selected. The position and the shape of the selected area are encoded, a pixel value of the selected area is encoded as slower-layer coded data, a pixel value of a whole image is encoded as first upper-layer coded data by using pixel values of already decoded images of the lower-layer and the first upper layer and a pixel value of the selected area is encoded as second upper-layer coded data by using pixel values of already decoded images of the lower-layer and the second upper layer.

Abstract: Since the corner detection means (7, 9) to detect each position of the blue board area from video signal, the conversion address generation means (11) to generate the conversion address based on the position information detected and the position information showing each corner position of the image area of video signal to be inserted and the image conversion means (16) to form conversion source video signal based on the conversion address are provided and the source video signal is to be inserted to the video signal, the operator's operation adjustment as the conventional device becomes unnecessary when inserting the source video signal into the prescribed frame of the video signal, and the operation of the operator can be further decreased. Thus, a video signal processing device capable of further decreasing the operator's operation can be realized.

Abstract: A method for segmenting a digital image into a foreground region and a key color region including characterizing a distribution of key color values; using the distribution of key color values to produce a multi-dimensional look-up-table having three or more dimensions indexed by color values in a selected color space to define a key color volume; addressing the multi-dimensional look-up table with color values of pixels in the digital image to determine whether the color values of such pixels are within the key color volume; and labeling pixels in the digital image whose color values fall within the key color volume to be within the key color region and labeling all other pixels to be within the foreground region whereby the digital image is segmented into the foreground region and the key color region.

Abstract: A method of image processing and the image processor which includes providing a convolution operator having an input for receiving raw imaging data at a data rate N and a plurality of output paths M. The convolution operator provides a time (phase) delay T to the imaging data between the input and the output paths and applies the imaging data on a time delayed basis to the output paths in phased relation to their time of application to the convolution operator. The convolution operator provides a low pass filtering operation to the data to provide background information. A phase equalization circuit is provided having an input for receiving the raw imaging data at the data rate N and M output paths, one path corresponding to each output path of the convolution operator, to provide a time delay to the raw imaging data at each output path of the phase equalization circuit equal to the time (phase) delay T of the convolution operator.

Abstract: An interactive video menu system provides an economical method for the storage, transmission, and reception of data necessary for interactive video sessions, which allows high-resolution images to be broadcast to end users along with all the control information necessary to display and navigate through these images. A simple interpretive script is run on the end user's device which traps the broadcast information and allows rapid response time and control of the interactive session without requiring expensive high-bandwidth facilities. Buffer equalized coding is used so that still, picture-in-a-still; and moving video images can be compressed at rates below those typically used with the MPEG-2 standard and continuously transmitted as video backgrounds in a seamless loop saving bandwidth without degradation in video quality.

Abstract: A real-time video production technique using recursive techniques adds an output framestore, a feedback storage unit and a synchronized controller to a pipelined video processing system. Partial composites are stored in the feedback storage unit while complete composites are stored in the output framestore. The output framestore provides a preview video during the video processing. For automatic assembly where the feedback storage unit has a length of many frames the complete composites are stored also in the feedback storage unit and a multiplexer is used to select the complete composites either from the output framestore for each new complete composite or from the feedback storage unit otherwise.

Abstract: A method for determining a control signal for use in combining a first digital image that includes both a foreground region and a key color region having an associated key color with a second background digital image, both images including pixels having color values is disclosed. The method includes segmenting the first digital image into a foreground region and a key color region; and identifying transition region pixels in the first digital image that are in the vicinity of a boundary between the segmented foreground region and the segmented key color region. The method further includes computing a color difference signal between the color values of the first digital image and the key color for at least some pixels in the transition region; and computing a control signal for transition region pixels as a function of the color difference signal, where the control signal is to be used to combine the foreground region of the first digital image with the second background digital image.

Abstract: An image processing method and photobooth employing the method are disclosed which produce a composite image using a conventional chroma-key device. The subject in the photobooth is illuminated with low temperature light and is filmed before a backdrop of uniform saturated blue color to provide a foreground image to the chroma-key device. The chroma-key device compares the intensity of the blue color component for each pixel of the foreground image to a threshold intensity level and replaces those pixels of the foreground image that have a blue color component intensity greater than the threshold with a corresponding pixel of a pre-stored background image thereby producing a composite image. By illuminating the subject with low temperature light, the method decreases the intensity of most blue color components in the light reflected from the subject to a level below the threshold level used by the chroma-key device.

Abstract: A user interface is described for an image computing workstation for electronically arranging the components of a special effects job, such as image-compositing, from a plurality of image sequences obtained by the scanning of motion picture film. The interface controls the ordering of a plurality of image sequences into a hierarchy of background and foreground image sequences, with each sequence being composed of frames whose appearance imitates the frames of a motion picture film. The hierarchical image sequences are displayed adjacent to each other in a windowing environment so that the frames thereof visually align on a frame-to-frame basis. The interface includes means for varying the hierarchical order and the adjacency of the image sequences so that different frames thereof are brought into visual alignment with each other, whereby the image sequences are correctly ordered as to hierarchy and adjacency for a special effect.

Abstract: A method of removing the foreground subject and its shadow from a series of image frames including a subject before a colored backing being photographed by a moving camera during a live broadcast. Such removal results in a series of image frames of the colored backing without the subject, each image frame corresponding to an image frame containing the subject. The method steps employed identify, for each frame, those pixels in the frame occupied by elements of the subject. Those pixels are set to an RGB level of zero, to create an image of the colored backing in which the subject area is reduced to black. The image of the colored backing is then smeared to obliterate the defined edges of the subject's shadow and to smear the color of the backing into the black area previously occupied by the subject to generate a clear frame.

Abstract: A method for combining a first digital image and a second background digital image, both images including pixels having color values, wherein the first digital image includes both a foreground region having foreground color values and a key color region characterized by a key color, as well as a mixed region where the pixel color values are a mixture of the foreground color value and the key color, includes determining a first control signal that indicates the relative proportions of the foreground color value and the key color for pixels in the first digital image; and segmenting the first digital image into a key color region and a non-key color region in which the non-key color region includes pixels in the first digital image that are not in the key color region.

Abstract: A device and method that overlays, onto a new colored background a subject clipped from a source video image having a subject moving against a first colored background. A clipping key KD is calculated which makes it possible to separate the color space representing the image into three regions, a first region defining a volume representing the first colored background, a second region defining a volume representing the subject, and a third region representing a region of transition between the first colored background and the subject. A video image VD representing the subject moving against the new colored background formed according to the formula:VD=KD.times.subject video+(1-KD).times.background video,where "subject video" and background video respectively represent a video image containing the subject and the video image of the new colored background.

Abstract: The present invention is useful in taking a visible light image for identification and other purposes without the requirement of a photobooth, regardless of the background of the visible light image. The original background of the visible light image is replaced with a preselected background. Two IR images with different intensities of IR illumination in the foreground and background regions of the scene, respectively, are compared to produce a difference image of light intensity differences between corresponding pixels of the two images. A binarized image is generated by binarizing the difference image with respect to a predetermined threshold value .theta.. A connectivity constraint is used to generate a binary mask from the binarized image, then a gray-scale mask is produced by multiplying the binary mask times a preselected modulation function of the difference image. Warping the gray-scale mask produces a transformed mask.

Abstract: An electronic imaging system useful for compositing images includes an electronic camera for capturing multiple images, including a first image of a subject plus background and a second image of the background only. The first and second images are subtracted to generate a difference image, and the difference image is processed to generate a mask image. The mask image is then applied to the first image to select an area in which the subject is located, whereby the selected subject area is used in the compositing of a new image.

Abstract: The invention utilizes the fact that anyone with normal color vision has the ability look at a scene on a video display and recognize a black area if one is present; a white area if one is present, and face or flesh areas if a person is present. It is also easy to recognize blond hair, subjects that are opaque, subjects that are semi-transparent, and subjects that are bright green. The aforesaid abilities to recognize luminance and color characteristics of elements within a video scene are used in conjunction with the invention to produce ideal composite images by utilizing of a set of equations that incorporate a knowledge of color science, of video and existing compositing techniques. These equations are used to make adjustment decisions to produce the best possible composite image. The equations are used to compute certain constant values utilized in the existing compositing techniques.

Abstract: The invention relates to a method for determining a key KD for clipping a subject moving against a colored background, the said key making it possible to separate the color space into three regions, a first region defining a volume representing the colored background, a second region defining a volume representing the subject and a third region defining a transition region between the colored background and the subject, where the device and method defines the volume representing the colored background in the form of a cone of aperture angle .alpha. whose axis of symmetry (W) passes through the achromic and zero-luminance point of the color space and a point representing the color of the colored background. The invention also relates to any type of electronic apparatus implementing the abovementioned device and method, such as video mixers or autonomous devices for clipping and overlaying video images.

Abstract: Apparatus and methods are provided for selecting channels on a television system by theme.

Abstract: Apparatus for creating video test patterns for outputting to a video test pattern generator enables individual lines to be built from standard components with appropriate parameters. Completed lines are held in a form which is television standard-independent and can be edited numerically or graphically. A test pattern is built from a set of lines and a part or fully completed pattern can be displayed to an operator in a picture representation which simulates the appearance of the test pattern when displayed on a television receiver.

Abstract: A method and apparatus used in the field of image compositing which eliminates the need to obtain an original clear frame of the backing during production, by synthesizing during post production a clear frame of the backing from a frame of the foreground scene that includes the subject as well as the backing. This synthetic clear frame eliminates the problems of obtaining a registered clear frame during production, and thereby permits the ready application of nonuniformity correction to image compositing in both motion pictures and graphic arts. The invention is also directed to a method and apparatus used in the field of image compositing which reduces the processing time for developing the inhibit signal that prevents the corrections from being applied to the subject, the control signal E.sub.c, and a number of other functions that are computed from the colored backing.

Abstract: A system interactively controlled by a TV viewer remote superimposes portions of a scroll program guide over a basic programming signal for display on the viewer's display screen. A tuner has an input for receiving TV signals in a plurality of cable channels and an output for passing a signal of any selected one of said channels. A computer has an input for receiving any of a plurality of control signals from the TV viewer remote and an output for controlling the tuner to pass the signal of the selected one of the channels in response to one of the plurality of control signals from the TV viewer remote. The computer receives and stores a scroll input picture image signal containing local program guide data and generates a scroll output picture image signal consisting of at least a portion of the scroll input picture image signal. A combiner superimposes output picture image signal over the passed signal to provide a display signal for input to the viewer's display screen.

Abstract: A video mixing apparatus for mixing a first video signal and a second video signal in accordance with a first key signal and a second key signal. The video mixing apparatus includes a key signal mixer for receiving the first and second key signals and generating and outputting a third key signal and a fourth key signal, wherein a level K.sub.1 of the first key signal, a level K.sub.2 of the second key signal, a level K.sub.p of the third key signal, and a level K.sub.m of the fourth key signal satisfy the relationships:K.sub.p =K.sub.2 -K.sub.1 K.sub.2,andK.sub.m =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2 ;a key signal division section for receiving the third and fourth key signals and generating and outputting a fifth key signal, wherein a level K.sub.g of the fifth key signal satisfies the relationship:K.sub.g =K.sub.p /K.sub.

Abstract: A method and apparatus for providing a multi-layer sprite graphic function in video equipment having an on-screen-graphic function where the multi-layer sprite graphic function is realized in hardware to accomplish a smooth graphic. The multi-layer sprite graphic apparatus includes a controller for generating scan address data, a frame memory for outputting video data stored therein according to the scan address data, a window pulse generator for receiving the scan address data and for generating a window pulse which represents scan address data which is included in a window area, an address generator for generating read address data according to the window pulse, a sprite memory for storing sprite graphic data and outputting the stored sprite graphic data according to the read address data, and a data selector for selecting and outputting one of the data output from the frame memory and the sprite memory according to the presence or absence of the data output from the sprite memory.

Abstract: A computer-implemented method and apparatus for encoding pictures of a sequence of pictures. According to a preferred embodiment, an encoding system determines a relatively fixed background of the sequence of pictures, and transmits the background to a decoding system. Foreground objects of a current picture are separated from the background, and motion compensation encoding of the foreground objects is performed with respect to at least one previous picture. The encoded foreground objects are then transmitted to the decoding system.

Abstract: An apparatus and method effecting a linear color transformation between foreground video and insert video, in a chroma key video image. A determination is made whether a particular pel, or pixel in the foreground video image is either a full foreground pel, a full blue screen pel, or a transition pel. Predetermined "look up" tables store color values in vectorscope domain which correspond to endpoint UV foreground and endpoint full background UV blue values, for each foreground to background transition pel. A key signal related to the percent distance of each such transition pel from these two endpoints in the UV plane is created. The composite output pel is formed from the current YUV transition pel value, by subtracting the selected full blue YUV from it, and adding insert video to it in proportion to the key signal.

Abstract: A moving picture data compressing unit compresses picture data representing a moving picture in which a foreground moves in front of a predetermined background. A header adding unit adds a header to the compressed moving picture data obtained through the moving picture data compression unit, the header comprising a color code indicating the color of the predetermined background. A header removing unit removes the header from the compressed moving picture data and the header removing unit then extracts the color code indicating the color of the predetermined background from the header. A moving picture data expanding unit expands the compressed moving picture data, the header added to this data having been removed by the header removing unit.

Abstract: A film image input system is disclosed which provides an increased degree of freedom of design thereof, can be reduce the size and costs thereof, and can execute a trimming operation with ease. The film image input system forms an image of a developed still photo film 134 on a light receiving surface of an image pickup element 140 through a zoomable taking lens 138 and outputs to a monitor TV an image signal photo-electrically converted by the image pickup element 140 to thereby reproduce the film image on the screen of the monitor TV. The film image input system comprises at least one mirror 137 interposed between the photo film 134 and taking lens 138 for bending the optical axis of the taking lens 138, a mirror drive mechanism 168 for inclining the mirror 137 in all directions, and an operation part 170 for driving the mirror drive mechanism 168 in order to execute a desired scanning. This allows the system to be made compact and increases the freedom of design of the system.

Abstract: A method that allows the real-time replacement of the designated background portion of an incoming video signal with an alternate background. The method utilizes the actual background image for reference as the basis for determining the background and foreground elements within the image with the end result being comparable to traditional blue-screen processes, such as chroma-key and ultimate technology, but requiring only a personal computer, video camera and the software. In this case, however, the reference background image can be any reasonably static scene with a sufficient and stable light source captured by the camera. The video data stream is modified in real-time by comparisons against the reference background image and is then passed on to its original destination. Multiple signal-noise processing algorithms are applied in real-time against the signal to achieve a visually acceptable matte.

Abstract: Representative picture extracting device 102 extracts representative pictures from a coded input signal 101 which consists of representative pictures, motion parameters for motion compensation which refers the representative picture, and reference relationships, and outputs a coded representative picture signal 103. The signal is decoded by a representative picture decoder 104, and output as a decoded representative picture signal 105 to a delay memory 106. On the other hand, representative picture reference relationship extracting device 112 extracts reference relationship additional information 113, and outputs it to decoded signal output controller 114. The sequence of outputting the representative pictures is determined on the basis of the reference relationship additional information 113, and an output control signal 115 is output to the delay memory 106.

Abstract: The invention is a method used with a system for compositing a foreground scene including a subject before a nonuniformly illuminated colored backing, and a background scene, and where the nonuniformity is nonlinear from side to side and/or nonlinear from top to bottom. A window is employed to mask unwanted areas outside of, or on, the colored backing and one or more window edges form a visible join line where the window edges join the backing. The visible join line is made nonvisible without affecting the subject by a horizontal and vertical linear interpolation method for obtaining backing corrections that cause the backing level control signal to be uniform at the window edges and match an assigned window signal level.

Abstract: A method and system for implanting an image onto a selected one at a time of a plurality of video frames representing a stream of action occurring within a background space, the space having fixed planar surfaces and being scanned by at least one video camera. The method also includes a step of generating a model of a selected one of the fixed surfaces, the model includes a representation of geometrical features characterizing the surface. The model also includes a step of utilizing the model to perspectively distort the image so as to provide it in generally the same perspective of the selected frame, a step of producing a background mask of the selected frame, the frame includes at lest a portion of the fixed surface, the background mask defines changeable regions of the selected frame and unchangeable regions thereof and the step of blending the perspectively distorted image into the selected portion of the changeable region, thereby implanting said image into said selected frame.