Abstract: An improved method for enhanced puppetry or similar types of performances utilizing a virtual set having a key-color screen behind the set to do live action filming. All objects on the set, except for the performing puppet, or other objects which are to appear in the final product, are wrapped in a material which matches the color of the key-color screen. A virtual background is generated and combined with the live action whereby only the puppet (or other object) appears on the virtual background in real time, with all other objects on the live set, including puppeteers, for example, being eliminated from the final product.

Abstract: Of an object extracted from an image, it is difficult to separately process a main object and a secondary object, such as a shade, attached to the main object. If an object extracted from an image contains a plurality of objects, these objects are difficult to process as independent objects. In this invention, an object indicating a shade is separated from an object extracted from an image to thereby classify the object into a main object and a secondary object, and suitable image processing is performed for each of the main object and the secondary object. An object extracted from an image is separated on the basis of shape information of the object. The similarity of each separated object is measured in units of frames to obtain an interframe correlation. This increases the encoding efficiency.

Abstract: A video signal is generated representative of a background scene, such as a weather map, which provides an outline of all the detail in the map. This outline detail is made visible to a foreground subject by projecting it onto a white screen behind the subject in a selected color such as green. The projector is selectively inhibited so as to prevent the background detail from projecting onto the foreground subject. The white screen and the green detail lines are removed and replaced by the background scene by an image compositing process. Prompts are visible to the foreground subject, but not visible to a home viewing audience.

Abstract: The present invention relates to an image processing apparatus for generating an image having a high density in the direction of time and having a natural-looking motion blur. The correlation calculators 103 and 104 respectively calculate a correlation between pixel data of a target pixel in a target frame #n from among frames and pixel data of a corresponding pixel in a first frame #n−1 next to the target frame #n and a correlation between the pixel data of the target pixel in the target frame #n and pixel data of a corresponding pixel in a second frame #n+1 next to the target frame #n. The half-side pixel value generator 105 generates first pixel data in a first synthesis frame generated between the target frame #n and one of the first frame #n−1 and the second frame #n+1 containing the corresponding pixel having the pixel data with a larger correlation.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: The present invention provides an image compositing apparatus capable of producing a natural composite image, with a simple structure and a less occupying space. The present invention also provides a method for compositing an image by providing shadow-free conditions in a limited space for chroma-keying so that a subject image and a desired background image are naturally integrated as one image.

Abstract: An automated image recording and document generation system is disclosed that generates identity documents using image and text information that is input to the system using computer controlled video cameras. The image and text information is combined with other stored images, such as logos, signatures and seals, to produce official identity documents such as identity cards, drivers licenses and passports. Prior to use the system automatically enters a setup and calibration phase wherein a video camera images a backdrop having borders on the left and right vertical edges and the digitized video output is analyzed to adjust the camera zoom and to locate the center of the backdrop in front of which an individual will sit or stand to have their picture taken. The image of a person whose picture is taken is analyzed and is centered horizontally in a picture by adding or subtracting columns of background color to the left or right side of the picture as needed.

Abstract: A method and apparatus that provides for the straightforward completion of preprinted forms with a word processor, or with another computer program suitable for generating text, is disclosed. The method and apparatus provide for the display of a scaled image of the form so that a user can accurately position text or other data for printing in the fields of the form. An image of the preprinted form is provided to a document having a background and a foreground. The image is displayed in the background Data is entered into the foreground. The data in the foreground is printed onto the preprinted form. The form can be scanned to create the image. The form is then provided to a printer. The image is provided to a word processing document as the background. The data is entered into the foreground with the word processor.

Abstract: The disclosed system has particular applications to image archives and reediting. Given an image of an article having graphic objects including texts and pictures, the disclosed system first distinguishes graphic objects from the background by segmenting the image so as to produce an object image comprising a foreground, wherein the foreground corresponds to the graphic objects in the image. With respect to the foreground, the disclosed system “repaints” those spaces previously occupied by the graphic objects, referred to as object spaces, with the background color in the image as such the background continuity is preserved when the graphic objects are rendered and subsequently superimposed onto the repainted background. To account for various backgrounds, the disclosed system uses a point-wise patching approach followed by a one-dimensional patching approach if the object spaces contain two different colors.

Abstract: A broadcasting receiver comprises a digital tuner and an analog tuner. An OSD circuit and an adder add video data such as characters produced in the receiver to received video data on a channel tuned in to by the digital tuner. A video analog-to-digital processor converts a received video signal on a channel tuned in to by the analog tuner into digital received video data, and the OSD circuit and the adder similarly add the video data such as characters produced in the receiver to the received video data.

Abstract: A method for automatically implementing and coordinating the techniques of creating the illusion of illumination changes on a foreground subject that should occur when the subject moves throughout the various illumination levels on the background of a composite image.

Abstract: The present invention relates to a television receiver for teletext for receiving a composite video signal having text information multiplex on a television video signal, and more particularly to a television receiver for teletext capable of displaying the television video signal and teletext screen simultaneously on the picture screen by superimposing or dividing the screen, and according to this television receiver for teletext, which comprises preprocessing means for issuing various preprocessing correction signals on the basis of the teletext signal extracted by the teletext signal receiving means, the preprocessing correction signal issued by the preprocessing means, and the teletext signal received by the teletext signal receiving means are combined and displayed on the picture screen, and thereby the boundary of the television video signal and teletext signal is clearer, so that the text of thetelet ext signal is easier to read.

Abstract: An image merging and displaying apparatus for forming an image to be displayed on a display. A document editing device edits document image by generating document image data. A document data obtaining device obtains the document image data from the document editing device. A sheet image data generating device generates sheet image data that constitutes a sheet image having a size in accordance with the document image. An image data merging/reducing device first merges the document image data with the sheet image data, and second reduces an image constituted by the thus merged image data to form an image to be displayed on the display.

Abstract: A method of combining a foreground image and a background image includes scaling up a pixel of interest, which is positioned along an edge between a subject and a key colored backing, into a plurality of edge subpixels. The pixel of interest is included in a digital antialiased foreground image. A corresponding pixel of a digital background scene is also scaled up. The corresponding pixel is associated with the pixel of interest and is scaled up into a plurality of background subpixels. For each of the edge subpixels, if a color of the edge subpixel matches the key colored backing, a respective new color of the edge subpixel is determined as a function of one of the background subpixels, which is associated with the edge subpixel. Also, the new color is stored to the edge subpixel. After all the subpixels have been evaluated, the edge subpixels are scaled down to a new pixel of interest.

Abstract: A background lighting module illuminates an object from behind by visible light with respect to a photographing module to identify an area including the boundary between the object and the background portion in an image to be photographed by the photographing module. A controller controls a photographing operation including the exposure of the photographing module and the lighting intensity of the background lighting module. An image processing module processes the images photographed by the photographing module. The controller sets the exposure and lighting intensity to specific conditions so as to photograph a processing image where the background portion on the periphery of the object has a higher luminance than that of the silhouette portion of the object. The image processing module extracts the shape of the object by using the luminance difference between the silhouette area of the object and the background area on the periphery of the object.

Abstract: The tele-illustrator system enables a commentator to mark the progression of a player as defined on a pitch in real time as an event progresses and for this progressive position to be correctly positioned on a video screen regardless of the movement of a video camera creating the video image of the pitch as defined.

Abstract: A method of providing a video enhancement to an interactive television content page, includes providing a graphical overlay with a transparent section; providing a graphical underlay capable to show an underlay content; and displaying the underlay content through the transparent section. An apparatus for providing a video enhancement to an interactive television content page, includes a display engine capable to display a graphical overlay having an associated transparent section and to display an underlay content on a graphical underlay and through the associated transparent section; and a processor communicatively coupled to the display engine and capable to execute the display engine.

Abstract: A composite image generator for combining a prestored composite background image, a prestored composite foreground image, and a composite interior image is disclosed. The composite interior image is preferably generated by the composite image generator by interlacing a prestored interior image with a captured digital image. Portions of the composite background image are deleted or hidden based on the composite interior image. Similarly, portions of the composite interior image are deleted or hidden based on the composite foreground image.

Abstract: An illumination reproduction apparatus and process for illuminating a subject with the illumination at a location in a scene when the subject is not in the scene. Scene illumination data is generated that specifies the illumination at the location in the scene from a plurality of spatial directions. The subject is then illuminated with the illumination at the location in the scene by driving a plurality of light sources surrounding the subject with the scene illumination data.

Abstract: It is intended to enable main image data from a video camera and background image data recorded on a recording medium to be chromakey-combined with each other naturally at a low cost. When a video switcher chromakey-combines main image data that is produced by imaging with a video camera with background image data that is reproduced from a magnetic tape by a VTR, the main image data is chromakey-combined with the background image data such that the VTR is caused to perform a reproducing operation on the magnetic tape based on time codes that are stored in a control device as one of a pair of information and the operations of the video camera and a video camera stage are controlled based on camera control information as the other of the pair of information.

Abstract: A teleconferencing system in which the video image of a subject in front of a selected background scene is extracted from that scene and transmitted to other locations where selected backgrounds are stored. By compositing the subject and background images at each remote location, both image elements, being originals, will show no loss of detail when projected. For a front projection screen, the projector is inhibited from illuminating a presenter.

Abstract: A method for the digital manipulation of a video image, in which an object is located and replaced by another object. To account for ambient lighting effects, a base set of appearance parameter values for the first object is determined, such as average values of hue, saturation and luminance. Selected regions of the object are analysed and in respect of each selected region the extent to which actual appearance parameter values deviate from the base set of apparatus parameter values is determined. The method includes storing data representation of the positions of the regions and the respective deviations from the base set of values. The first object is replaced by a second object, and the method then includes the step of applying to regions of the second object adjustments to appearance parameter values by reference to the stored data.

Abstract: A photographic system 1 comprising a digital still camera 3 for producing an output signal, means 11 for processing the output signal with a pre-recorded picture signal to produce a revised image signal and means 13 for printing the revised image, wherein the means 11 for processing uses chroma-key processing 37,39 to insert a background picture signal into a key color-characterized region of a foreground picture signal The invention results in a novel application of chroma-key processing to produce good quality still photographs using a simple and robust system.

Abstract: A video signal processing device includes an address generator to calculate a transformation matrix for three-dimensionally transforming an image to a “blue board” area. The transformation is based on corner positions of the blue board area of a video signal and those of an image area of a source video signal to be inserted. Address information is calculated for reading the source video signal from a memory based on an inverse matrix of the transformation matrix. In this way, the image area to be inserted can be three-dimensionally transformed and automatically inserted into the blue board area, without requiring an operator to input parameters indicative of a post-transformation state.

Abstract: A digital camera includes a memory card. The memory card is previously recorded with template image data that has been subjected to conversion of Y-data effective range and JPEG compressing. A CPU expands this template image data by a JPEG method, and then subjects only expanded data greater than a predetermined value to effective-range conversion that is reverse to the above. The CPU composites the template image data thus obtained with photographed image data, thereby creating composite image data.

Abstract: A mix/effect bank has its capability doubled by increasing the number of keyers input from two to four. The outputs from the keyers are routed through a crosspoint matrix for form a current and a next stack representing the priority of the keyer outputs from highest to lowest. The current stack is input to a current priority combiner and the next stack is input to a next priority combiner. The output of the current priority combiner is a program video output bus and the output of the next priority combiner is a preview video output bus. The two buses are input to a transition mixer, the output of which is coupled through a program/preview switch to the program video output bus. The transition mixer passes the output of the current priority combiner to the program video output bus except when the transition is made between preview and program, at which point the transition product is provided to the program video output bus.

Abstract: A camcorder operation condition detecting portion (103) reads image data string and detects camcorder on/off information and camcorder operating information. A video splitting portion (104) splits videos into respective shots based on the camcorder on/off information. A subject/background separating portion (105) separates a subject and a background based on the camcorder operating information, etc. A subject motion information extracting portion (106) correlates subject information separated every frame between frames. A video taken space resynthesizing portion (107) resynthesizes video taken spaces based on the camcorder operating information and the background. A shot-to-shot relation calculating portion (108) calculates spatial shot-to-shot relations between a plurality of video taken spaces.

Abstract: There is disclosed a method of extracting the region of a subject image from an input image including the subject image. A subject region mask for masking the region of the subject image is generated, and the contour of the subject region mask is shaped. After local regions for correcting the contour shaped by contour shaping are set on the basis of information of the contour of the subject region mask before and after contour shaping, the contour of the shaped subject region mask is corrected within the set local regions.

Abstract: An electronic imaging system includes a portable electronic camera operable in a compositing mode and a separate processor for compositing images using the difference of two images.

Abstract: A scheme for detecting telop character displaying frames in video image which is capable of suppressing erroneous detection of frames without telop characters due to instability of image features is disclosed. In this scheme, each input frame constituting the video data is entered, and whether each input frame is a telop character displaying frame in which telop characters are displayed or not is judged, according to edge pairs detected from each input frame by detecting each two adjacent edge pixels for which intensity gradient directions are opposite on some scanning line used in judging an intensity gradient direction at each edge pixel and for which an intensity difference between said two adjacent edge pixels is within a prescribed range as one edge pair, edge pixels being pixels at which an intensity value locally changes by at least a prescribed amount with respect to a neighboring pixel among a plurality of pixels constituting each input frame.

Abstract: A digital photo system digitally exposes a light-sensitive material on the basis of digitized first image data, and outputs a print reproducing the first image data. The system includes an information input section, an image database, a data selecting section, and a data output section. The digital photo system ensures that high-quality photos of picturesque sites, mascots and other objects of interest can be offered to customers as prints free of charge regardless of weather, situation an other external conditions. In addition, the first image data may be assembled with the second image data as a constituent material for a composite image so that a composite picture can be produced in a simple but positive way.

Abstract: Apparatus for producing a composite image from a foreground image (FG), showing an object or a scene with a substantially monochrome background, and background image (BG) comprising a first processing unit (R4) for producing a control signal (SEP) for each pixel of the foregoing image (FG), reflecting whether an individual pixel of the foreground image is part of the object or part of the monochrome background, based both on the chromatic values of the pixel and on predetermined chromatic values, describing the color composition of the monochrome background, a selection unit (R5) suffixed to the first processing unit (R4), for calculating the chromatic values of an individual pixel of the composite image from, depending on the control signal (SEP), either the chromatic values of the corresponding pixel of the foreground image (FG) or the chromatic values of the corresponding pixel of the background image (BG), a second processing unit for calculating correction values for the chromatic values of an individual

Abstract: A video mixing apparatus carries out a chromakey process producing less degradation of picture quality by generating a key signal which separates a foreground object component from a screen component by using luminance information. In a three-dimensional color space, a smaller oval body surrounding a region where the foreground object is distributed and a larger oval body surrounding the smaller one are set. These two oval bodies and a distribution of a source video signal determine a key signal distribution. Key signal K=0 (zero) when the source video signal is inside the smaller oval body, and K=1 (one) when the signal is outside the larger oval body. 0<K<1 when the signal is between the smaller and the larger oval bodies. Based on the key signal K generated, the source video signal is mixed with the background video signal.

Abstract: A virtual three-dimensional presentation in accordance with the present invention includes three layers, a three-dimensional background layer, a two-dimensional video insert layer, and a three-dimensional foreground layer. A surface, the Z-sphere, is defined in the virtual three-dimensional space of the three-dimensional scene with reference to the aim point of a virtual camera looking at the three-dimensional scene being created. The three-dimensional foreground layer scene may include a key which defines the transparency of objects in the foreground layer. The two-dimensional video insert layer may be generated by positioning a presenter, or other object, in a chroma-key set. The two-dimensional video insert layer may be distorted before being composited with the background and foreground such that elements of the two-dimensional video appear to move across a three-dimensional floor of the three-dimensional scene.

Abstract: Given two video sequences, a composite video sequence can be generated which includes visual elements from each of the given sequences, suitably synchronized and represented in a chosen focal plane. For example, given two video sequences with each showing a different contestant individually racing the same down-hill course, the composite sequence can include elements from each of the given sequences to show the contestants as if racing simultaneously. A composite video sequence can be made also by similarly combining a video sequence with an audio sequence.

Abstract: A video signal mixing apparatus and a method thereof, which is capable of minimizing timing jitter caused when onsynchronized video signals are digitally mixed. A signal subtractor subtracts a second video signal synchronized with a clock signal from a first video signal which is not synchronized with the clock signal, and a weighted value extractor divides one period of the clock signal into N intervals, detects the interval where a digital selection signal is generated, among the N divided intervals, and outputs a predetermined value (where 0≦predetermined value≦1) allocated to the detected interval as a weighted value. A multiplier multiplies the weighted value with the output of the signal subtractor and outputs the multiplication result, and a signal mixer mixes the multiplication result with the second video signal and outputs the mixed result as a mixed video signal. Therefore, error causing timing jitter is reduced to 1/N, thereby minimizing dot crawling of the mixed image.

Abstract: A method of determining the position of a TV camera relative to a patterned panel being viewed by the TV camera including the steps of: identifying a plurality of edge points of the pattern from the video signal produced by said camera and using these edge points to calculate the perspective of the pattern relative to the camera.

Abstract: A method for pulling (extracting) a matte of an image of a foreground object from a composite image, using a computer. An image of the foreground object is recorded over at least two backgrounds having arbitrarily different coloring. Each point of one background must have a color that is different than the color of a corresponding point in the other backgrounds. The images may be recorded with an analog camera and digitized with a scanner or recorded with a digital camera. Images should be registered during recording and digitization to eliminate misalignment of corresponding points in each recorded image. A triangulation of corresponding points of each recorded image is performed so that an alpha value (opacity) and a set of color coordinates for each point of an uncomposited image of the foreground object may be determined using either a difference of sums technique or a least squares technique. To facilitate the triangulation, images are recorded of each background alone, without the foreground object.

Abstract: The process comprises:

Abstract: In an image being displayed on a monitor, each observed background color is identified using a cursor to select the dominant colors. Each foreground color is also identified by using the cursor as a selector. For each pixel, several Candidate mattes are computed one for each background color. Each Candidate matte is computed from a single background color and the set of selected foreground colors using any known method. Of the several Candidate mattes, the greater of these Candidates becomes the matte signal for a given pixel. If this matte is 1.0, then the pixel is part of the background. If the matte is zero, then the pixel is part of the subject. If the matte is between 1.0 and 0.0, then the pixel is in a transition area and the contribution of the background to the pixel is that pixel's matte level. A ‘Processed Foreground’ is generated by removing the contribution of the background from each pixel in the image, resulting in the subject appearing against a black field.

Abstract: A system and method for an interactive, Internet-based videoconferencing multicast operation which utilizes a video production studio with a live instructor giving lectures in real-time to multiple participating students. The videoconference multicasting permits the students to interact with the instructor and other installations during the course of the lecture. In the case of software training, the system and method also utilize Internet-based application sharing and collaboration to permit the students at remote locations to drive a studio-based computer with the software for which the training is being given. The software screen is then used as a background with the instructor being able to literally point to areas of the screen which are being discussed. The instructor has a set of monitors in the studio which allow him/her to see the students on-location.

Abstract: Method and system aspects for digital image stamp positioning are disclosed. A method aspect, and system for providing same, positions a stamp in a digital image captured with a digital image capture unit independently of the digital image orientation. Included are the selecting of at least two offset values for a stamp and identifying of an area in an image for placing the stamp based on the at least two offset values. Additionally included is the positioning of the stamp within the identified area based on the at least two offset values.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: An image processing system 11 is arranged to produce data representing a combined image from foreground data F representing a foreground subject in front of a chroma backing and background data B representing a background image. The foreground data is processed and color corrected to produce first and second processed foreground data which is combined in a combiner 25 under the control of a first key K1. The background data is processed using a second key K2 to “cut” a “hole” in the background image. The processed background data and the combined foreground data are added together in an adder 44. A third key K3 is used to remove unwanted data from the added foreground and background data and to combine the resulting data with the processed background data in a combiner 45.

Abstract: An automatic correcting device of an identification photo system comprises a skin pigmentation area abstracting device that abstracts a skin pigmentation area from an image of a person, a skin pigmentation correction value calculating device that calculates skin pigmentation correction values according to colors of the skin pigmentation area abstracted by the skin pigmentation area abstracting device and a predetermined skin pigmentation correction target value, and a color correcting device that corrects colors of the skin pigmentation area according to the skin pigmentation correction values calculated by the skin pigmentation correction value calculating device. Thus, the skin pigmentation of the person in the photo can be corrected to the person's true pigmentation.

Abstract: A method is disclosed for integrating a message such as an icon at a specified location within a graphical image. The method includes the steps of first retrieving transformation parameters associated with the specified location of the graphical image. The message or icon is then transformed in accordance with the retrieved transformation parameters and subsequently superimposed on top of the graphical image. As a result, an integrated image is created which is conveyed to the electronic display. The method has particular industrial applicability to streamed content such as conveyed on television and over the Internet. Also disclosed is a method for identifying transformation parameters useful in specifying a locality within a graphical image wherein a frame of a graphical image is displayed as a background image and a another, preselected message is displayed as a foreground image. The method permits translation and scaling of the foreground image while the background image remains unaffected.

Abstract: A device for producing printed images of a subject is described. The device includes a housing containing an imaging apparatus, and a frame carrying a hood configured to exclude outside light from illuminating a subject. The frame is rotationally spring loaded and counterbalanced on the housing, allowing the frame to be pulled downward without pulling the housing over onto the subject. The hood is configured to indirectly illuminate the subject by reflecting light onto the subject. The imaging apparatus includes a camera configured to take subject image data (i.e., a picture of the subject), a device to provide component-image data (i.e., background, foreground or framing images) to be synthesized with the picture of the subject, a device to synthesize the picture with the component-images, and a printer to print the resulting synthesized images. A cassette unit that contains a plurality of read-only memory chips is removably plugged into the device.

Abstract: A sprite-based coding system includes an encoder and decoder where sprite-building is automatic and segmentation of the sprite object is automatic and integrated into the sprite building as well as the coding process. The sprite object is distinguished from the rest of the video objects on basis of its motion. The sprite object moves according to the dominant component of the scene motion, which is usually due to camera motion or zoom. Hence, the sprite-based coding system utilizes dominant motion, to distinguish background images from foreground images. The sprite-based coding system is easily integrated into a video object-based coding framework such as MPEG-4, where shape and texture of individual video objects are coded separately. The automatic segmentation integrated in the sprite-based coding system identifies the shape and texture of the sprite object.

Abstract: A position detecting device for an object with virtual set comprises providing the object with an emitting device and using the device in conjunction with a plain or patterned chroma-key background to provide the exact position of a TV camera or alone to provide a position for another object or actor.

Abstract: A method and apparatus to isolate the video image of an object, usually a human being, from its background for use in forming a composite image. The viewer's image, with its background, is captured in both visible light and infra-red. In the preferred embodiment, the visible light image is modified by replacing, from an independent visible image source, that area corresponding to the cold (non-viewer) areas of the infra-red image.