Abstract: A method, apparatus, and computer program product are described that utilizes spatial modeling to represent foreground objects of an event to allow virtual graphics to be integrated into a background of the event in the presence of dynamic objects. The present invention detects a presence of dynamic objects within a region of interest from a video depicting the event. The present invention produces a suppression key corresponding to the dynamic object when present in the video or a suppression key with a default value when and where no dynamic object is present in the video.

Abstract: A control device controls a television. The control device includes a touch module. The control device displays a menu containing a number of soft keys on a screen. The soft keys are activated to control the television to carry out corresponding functions. All positions on the menu are associated with all positions on the touch module correspondingly. As a result, a user can select desired soft keys to carry out corresponding functions by viewing the menu on the television and touching the touch module, rather than viewing the touch module.

Abstract: In order to display selected content as desired by a viewer by performing an easy operation without interrupting current viewing, a display apparatus includes a reception unit for receiving from a remote controller for transmitting an operation instruction to the display apparatus operation information including the amount of operation of a selection member which is detected at the time of selecting content and identification information identifying selected content, a determination unit for determining an output attribute of the selected content identified using the identification information based on the amount of operation, an output image generation unit for generating an output image of the selected content based on the output attribute determined by the determination unit, and a display control unit for displaying the output image generated by the output image generation unit.

Abstract: A video broadcast of a live event is enhanced by providing graphics in the video in real time to depict the fluid flow around a moving object in the event and to provide other informative graphics regarding aerodynamic forces on the object. A detailed flow field around the object is calculated before the event, on an offline basis, for different speeds of the object and different locations of other nearby objects. The fluid flow data is represented by baseline data and modification factors or adjustments which are based on the speed of the object and the locations of the other objects. During the event, the modification factors are applied to the baseline data to determine fluid flow in real time, as the event is captured on video. In an example implementation, the objects are race cars which transmit their location and/or speed to a processing facility which provides the video.

Abstract: The method and apparatus for generating an adaptive chroma key includes taking into consideration foreground object information during the creation of a composite scene. The luminance and chrominance of an area of interest between a foreground key and a background scene are considered and accounted for during the created of the composite scene.

Abstract: Intelligent resource state memory recall techniques, and associated apparatus and methods, are disclosed. States of one or more video switcher resources in a resource state memory may be recalled to the same or different resources, depending on resource availability at the time of memory recall. A memory recall need not affect an on air signal. The memory may be recalled to recreate a desired program output, as defined in the memory, on a preview output of the video switcher, which leaves a current program output of the video switcher undisturbed when the memory is recalled.

Abstract: A method of processing on screen display data with an image post processor includes receiving a data stream from a video processor at a post processing device having at least one port, the data stream including on screen display data overlaid on a white background and the on screen display data overlaid on a black background, finding a difference between the on screen display data overlaid on white and the on screen display data overlaid on black, using the difference to determine a complement of an alpha blend value, performing image processing on the image data with the post processor by applying the complement of an alpha blend value to the image data to produce processed image data, and transmitting the processed image data and the on screen display data through a display port.

Abstract: A method is disclosed for performing stereoscopic imaging. The method may involve obtaining a first image of a scene, at a first time, using a camera disposed on a platform, where the distance between the camera and the scene is changing. The camera may be used to obtain a second image of the scene, at a second time, with one of the first and second images being larger than the other. One of the images that is larger than the other may be resized so that the sizes of the two images are substantially similar. Both of the images may be rotated a predetermined degree so that the images form a stereo pair that may be viewed with a stereoscope viewing component or made into an anaglyph for viewing with an anaglyph viewing component.

Abstract: A video layer effects processing system which receives normal video and special effects information on separate layers has been presented. The system selectively mixes various video layers to transmit a composite video signal for a video display such as a television, or a virtual reality system. Special effects include spotlights, zooming, etc. Additional special effects such as shaping of objects and ghost effects are created by masking and superimposing selected video layers. The selective mixing, for example, to enable or disable, strengthen or weaken, or otherwise arrange special effects, can be directed from a remote source or locally by a user through real-time control or prior setup. The video layer effects processing system can also be incorporated into a set-top-box or a local consumer box.

Abstract: A system and method of geometrical predistortion of a graphical source signal is provided in which the graphical source signal is merged with an input video signal for display on a display device. The input video signal is received at a hardware scaler device and a predistorted video signal is generated there from. A warping map is calculated using a programmed processor and a graphics source signal is then predistorted, in software, using the warping map to generate a warped graphical overlay signal. The predistorted video signal from the hardware scaler is then merged with the warped graphical overlay signal from the programmed processor.

Abstract: An ambient, beautiful, entertaining visual experience that can be displayed on a TV requiring little or no user interaction beyond initiation. Multiple image layers that may be still or moving video, photos, etc, or a combination thereof can be overlaid on each other.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map but not effective at presenting local detail. In contrast, street -side images show excellent detail but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: A video layer effects processing system which receives normal video and special effects information on separate layers has been presented. The system selectively mixes various video layers to transmit a composite video signal for a video display such as a television, or a virtual reality system. Special effects include spotlights, zooming, etc. Additional special effects such as shaping of objects and ghost effects are created by masking and superimposing selected video layers. The selective mixing, for example, to enable or disable, strengthen or weaken, or otherwise arrange special effects, can be directed from a remote source or locally by a user through real-time control or prior setup. The video layer effects processing system can also be incorporated into a set-top-box or a local consumer box.

Abstract: A system and method for volumetric display of video images extracted from arbitrary background environments comprising an arrangement for extracting a video image in real time from an arbitrary background and creating a stream of extracted image data in response thereto and a free space or volumetric display operationally adapted to display the stream.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map, but not effective at presenting local detail. In contrast, street-side images show excellent detail, but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps, and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: A video mixer is employed to form a transition between two video compositions, for example a fade or a wipe. A video storage device is associated with the video mixer and plays out a video signal, the timing of which is controlled in dependence upon the progress of the transition made by the said video mixer.

Abstract: A method for extracting an alpha matte from images of a scene illuminated by unpolarized light is presented. A first pair of images is acquired with a foreground object placed in front of a background producing polarized light. One image of the first pair of images measures vertically polarized light of the scene, and a second image of the first pair of images measures horizontally polarized light of the scene. A second pair of images is acquired of the background producing the polarized light. One image of the second pair of images measures vertically polarized light of the background, and a second image of the second pair of images measures the horizontally polarized light of the background. The first and second pairs of images arte combined to generate an alpha matte and an alpha multiplied foreground.

Abstract: A method, system, and device for video production, including adding a mixer to an Auxiliary Bus of a Video Production Switcher; adding one or more keyers to the Auxiliary Bus of the Video Production Switcher; and adding special effects to the Auxiliary Bus.

Abstract: A video mixer may be employed to form a transition between two video compositions, for example a fade or a wipe. A video storage device may be associated with the video mixer and plays out a video signal, the timing of which is controlled in dependence upon the progress of the transition made by the said video mixer.

Abstract: The image synthesis apparatus 10 includes an anti-aliasing processing circuit 11 for generating a foreground image having a reduced aliasing by blending the color information and blending the alpha information for each dot of the input foreground image, and an image synthesizing circuit 15 for synthesizing the color information of the foreground image having the reduced aliasing and the color information of the background image, using the alpha information of the foreground image having the reduced aliasing.

Abstract: A key signal control unit for controlling the level of a key signal corresponding to an arbitrary position within a frame area to a level corresponding to a minimum distance from an inner edge of the frame area on the basis of the level of a key signal on the inner edge of the frame area as a reference value so that the frame area appears along an outer circumference of an image corresponding to a video signal. A totally new image special effect is thus made on the video signal.

Abstract: A video mixing apparatus carries out a chromakey process producing less degradation of picture quality by generating a key signal which separates a foreground object component from a screen component by using luminance information. In a three-dimensional color space, a smaller oval body surrounding a region where the foreground object is distributed and a larger oval body surrounding the smaller one are set. These two oval bodies and a distribution of a source video signal determine a key signal distribution. Key signal K=0 (zero) when the source video signal is inside the smaller oval body, and K=1 (one) when the signal is outside the larger oval body. 0<K<1 when the signal is between the smaller and the larger oval bodies. Based on the key signal K generated, the source video signal is mixed with the background video signal.

Abstract: Upon chromakey processing, 4×4 transformation matrix is provided through which a backing color selected is transformed to the original point and monochrome color is transformed to vertically distribute at a spot away from the original point along an axis. Matrix multiplication comprising only addition and multiplication is applied to a foreground image data signal to generate a masked output image and a color-processed foreground output image without requiring complex arithmetic operations.

Abstract: A video processor produces video and key signals to be processed by a television production switcher for superimposing text or the like on a background image. The video processor has a key generator for receiving an input video signal and an input key signal and selecting one of these signals and shaping waveforms of the selected signal. Responsive to a first control signal, the input video signal is stored in a first frame memory and read during a later frame interval. Responsive to a second control signal, the output signal of the key generator is stored in a second frame memory and read during a later frame interval. A delay time corresponding to the processing time of the key generator is introduced to the input video signal. A first switch selects one of the outputs of the delay circuit and the first frame memory, and a second switch selects one of the outputs of the key generator and the second frame memory.

Abstract: The present invention provides methods and apparatus to distinguish and/or separate an object from a background. The methods use backgrounds of known and/or advantageous texture. In an embodiment, a measure of image texture, namely the spatial frequency is used to distinguish and/or separate an object from its background. The use of image texture overcomes limitations of chroma keying used as a processing technique in photography for object-background separation. This is useful in the separation of image pixels belonging to the object of interest from image pixels belonging to the background.

Abstract: A secure image communications system includes one or more cameras disposed at a first location, such as a day care center. The system also includes a computer disposed at the first location and connected to the camera or cameras, as the case may be. A server of the system is located at a second location, remote from the first location, but communicatively connected to the computer. The system also includes one or more display devices, which are disparately located remotely from the first location and the second location. Each display device is communicatively connected to the server, for example, via the Internet or other network. The cameras periodically, or virtually continuously, capture images from the first location. The images are saved and manipulated by the computer, for digitization and security. Digital data representative of each image is communicated to the server, via secure channels and schemes.

Abstract: The color-keyed regions of a color-keyed image are extracted from the color-keyed image, and the color-keyed regions and the non-color-keyed regions are independently scaled. The independently scaled regions are subsequently merged to form a scaled color-key image with clearly distinguished color-keyed regions and non-color-keyed regions. To minimize the blurring of edges in the non-color-key regions, the non-color-key colors are extended into color-keyed regions after the color-keyed information is extracted from the color-keyed image. To minimize the encroachment of the scaled color-keyed regions into the scaled non-color-keyed regions of the scaled color-key image, the edges of the scaled color-key regions are sharpened by defining the color-keyed region as the region wherein each scaled/filtered color-key value exceeds a non-zero threshold value. To facilitate the use of existing memory and structure in images that are encoded using three components per pixel, such as RGB, YUV, etc.

Abstract: The present invention provides an image compositing apparatus capable of producing a natural composite image, with a simple structure and a less occupying space. The present invention also provides a method for compositing an image by providing shadow-free conditions in a limited space for chroma-keying so that a subject image and a desired background image are naturally integrated as one image.

Abstract: The present invention is a method and apparatus for automatically defocusing a background scene as the background scene is being composited with a foreground subject during the photography of the subject, where the background scene becomes increasingly defocused as the subject appears to approach the camera. A source of background image signals is connected to a background input of a compositing device capable of averaging a selected group of background pixels. A source of foreground image signals is connected to a foreground input of the compositing device. A matte signal generated by the compositing device is accessed and the matte signal is used to determine the ratio of foreground subject area to image frame area. The area ratio is then used to select, for each pixel in said background image, a number of adjacent pixels to be averaged to form an average pixel level. The signal levels at each pixel in the background scene are replaced with the average pixel level.

Abstract: A video processing device and method receives data from a common data source, such as a frame buffer and outputs first overlay information in a first color space from a first port and outputs second overlay information in a second color from a second port to facilitate output of multiple overlay images in different color spaces from common memory through different ports. In one embodiment a bidirectional port is used to allow a set of common signal pads or a bus to function as a flexible bidirectional video data port.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: Linking keyers to background source selections is achieved by defining a key link association table between background sources and keyers for an M/E of a production switcher. Key Add and Key Drop modifiers are provided so that the effects of the key link association table may be modified while making a background source change.

Abstract: A video signal processing device includes an address generator to calculate a transformation matrix for three-dimensionally transforming an image to a “blue board” area. The transformation is based on corner positions of the blue board area of a video signal and those of an image area of a source video signal to be inserted. Address information is calculated for reading the source video signal from a memory based on an inverse matrix of the transformation matrix. In this way, the image area to be inserted can be three-dimensionally transformed and automatically inserted into the blue board area, without requiring an operator to input parameters indicative of a post-transformation state.

Abstract: It is an object of the present invention to provide a color conversion apparatus in which an output result of a color converting circuit at the succeeding stage for color-converting a specific color can be prevented from being affected by an output result of a color converting circuit at the preceding stage for color-converting a whole image. Since a first color converting circuit (10) color-converts a whole image of image data in a first color-conversion fashion.

Abstract: Method and apparatus for generating keys for encoding data for transmission, a device identification is accessed and at least one key corresponding to the device identification. Data is encoded using at least one key. A message is transmitted from the first device to the second device, the message comprising a header comprising the device identification and a datafield comprising the encoded data. The second device uses the device identification received in the header of the message to determine the at least one key and decode the encoded data received in the datafield of the message using the determined at least one key.

Abstract: Apparatus for producing a composite image from a foreground image (FG), showing an object or a scene with a substantially monochrome background, and background image (BG) comprising a first processing unit (R4) for producing a control signal (SEP) for each pixel of the foregoing image (FG), reflecting whether an individual pixel of the foreground image is part of the object or part of the monochrome background, based both on the chromatic values of the pixel and on predetermined chromatic values, describing the color composition of the monochrome background, a selection unit (R5) suffixed to the first processing unit (R4), for calculating the chromatic values of an individual pixel of the composite image from, depending on the control signal (SEP), either the chromatic values of the corresponding pixel of the foreground image (FG) or the chromatic values of the corresponding pixel of the background image (BG), a second processing unit for calculating correction values for the chromatic values of an individual

Abstract: A reference picture being as a reference of the replacement area, the reference position of the replacement area and the size of the replacement area has been memorized. Moreover, a replacing LOGO picture has also been memorized. A two dimensional movement amount of a camera is detected by a rotary encoder set on the pan head of the camera, and the detected movement amount is outputted as a movement information. In the picture synthesis device, an address of the reference position of the replacement area in the present picture is calculated based on the movement information, and the replacement area is detected with this address as reference. Then, a key signal indicating a picture in which the present picture and the reference picture within the replacement area are identical or different, and an identical portion between the present picture and the reference picture is replaced with a LOGO picture corresponding to the foregoing identical portion out of the LOGO picture based on this key signal.

Abstract: To enable interlacing edge-generating means to be used for a progressive image signal that is separated into lines as two sequences of signals, the present invention comprises a pre-edge processing circuit (11) that executes appropriate pre-edge processing on the progressive image signal separated into lines depending on the condition of each of the two signals, and an edge generating circuit (18, 19) that executes on the two signals after pre-edge processing pre-edge generation processing similar to that for interlacing.

Abstract: A mix-effect bank architecture for a production video switcher has multiple programmable outputs, the outputs being determined by a selected operational mode including split, programmable clean feed and mix minus modes. Four keyers with video and key signal inputs produce four outputs. The outputs are selectively routed to four corresponding inputs of four mixers, which mixers also have two pairs of background/utility video inputs. The four mixers provide four outputs which are determined by the selected operating mode. A pair of background video signals may be provided to all of the mixers to provide programmable clean feed outputs, or the pair of background video signals and a mix minus pair of background video signals may be provided to the mixers to provide mix minus outputs, or a primary set of background video signals may be provided to two mixers and a secondary set of background video signals may be provided to the other two mixers for the split mode.

Abstract: A three-dimensional model is created to represent an environment to be captured on video. A camera is fitted with pan, tilt and/or zoom sensors. An operator selects a location in the environment. The three-dimensional model is used to determine the three-dimensional coordinates of the location selected by the operator. Information from the pan, tilt and/or zoom sensors is used to transform the three-dimensional coordinates to a two-dimensional position in the video from the camera. Using the two-dimensional position of the video, a graphic is properly added to the video such that the graphic appears to be at the selected location in the environment.

Abstract: An image processing system 11 is arranged to produce data representing a combined image from foreground data F representing a foreground subject in front of a chroma backing and background data B representing a background image. The foreground data is processed and color corrected to produce first and second processed foreground data which is combined in a combiner 25 under the control of a first key K1. The background data is processed using a second key K2 to “cut” a “hole” in the background image. The processed background data and the combined foreground data are added together in an adder 44. A third key K3 is used to remove unwanted data from the added foreground and background data and to combine the resulting data with the processed background data in a combiner 45.

Abstract: A method of concealing temporal shifts when a digital video effects system is used with a video switcher adds a mixer to the digital video effects system to mix the input to and output from the digital video effects system if the image to be transformed is on-screen at the beginning of the effect. An input video signal from a keyer in the video switcher is switched by an effects send/return matrix to the inputs of the digital video effects system and the mixer, and the output from the mixer is returned to the effects send/return matrix for input to the mix/effects stage of the video switcher. When the digital video effects system is bypassed, a delay circuit is used in the bypass path of the effects send/return matrix, the delay time equaling the processing time of the mixer.

Abstract: A system for enhancing the television presentation of an object that can highlight the object without obscuring the image of the object. The system receives a first video image, matches a second video image to a portion of the first video image corresponding to the image of the object. Specific pixels within the portion of the first video image which are not part of the image of the object are modified using a pixel from the second video image.

Abstract: An image signal processing apparatus is provided and includes a YC separator circuit for extracting a chrominance signal from an image signal, a signal level detector circuit for outputting a signal level detecting signal by detecting a signal level of the chrominance signal and a signal level corrector circuit for correcting a signal level of the signal level detecting signal to generate a key signal according to the chrominance signal, the signal level corrector circuit including an oversampler circuit.

Abstract: A position detecting device for an object with virtual set comprises providing the object with an emitting device and using the device in conjunction with a plain or patterned chroma-key background to provide the exact position of a TV camera or alone to provide a position for another object or actor.

Abstract: An image processing unit is provided to solve the problem of an aliasing usually occurred when a foreground image and a background image are synthesized by using a key signal; this image processing unit comprises: an image filter circuit that applies to the foreground image an anti-aliasing processing to make obscure an aliasing that displays a slant graphic border in a stepped indentation due to an insufficiency of the number of pixels; a key filter circuit that applies the anti-aliasing processing to the key signal; and a pixel detection circuit that detects a pixel having a possibility to generate a color mixture by an operation of the image filter circuit from the key signal and a size of the image filter circuit. In this construction, the image filter circuit applies an anti-aliasing processing using only the pixel that constitutes the foreground image and does not contain a background color to the pixel having a possibility to generate the color mixture that the pixel detection circuit detects.

Abstract: A method for merging real and synthetic images in real time is comprised of the steps of providing a first signal containing depth and image information per pixel about a real image. A second signal containing depth and image information per pixel about a synthetic image is provided. The depth information corresponding to the real image and the depth information corresponding to the synthetic image for each pixel are compared. Based on the comparison, either the image information corresponding to the real image or the image information corresponding to the synthetic image is selected and combined.

Abstract: The present invention relates to a picture generator and a picture generation method.

Abstract: A method and an arrangement for generating a composite video signal in accordance with the chroma-key method in which a virtual background spill signal is generated and added to the composite video signal to avoid darkening effects which are produced when eliminating spill light, and to eliminate brightening effects which are produced in "clean-up" operations. The background spill signal may consist of the product of a virtual spill signal source (SP) and a control signal (k.sub.3). The control signal (k.sub.3) is preferably the difference between a foreground control signal (k.sub.1) and a background control signal (k.sub.2), and both signals should be identical in the foreground and background ranges but different in spill ranges.

Abstract: In this invention, when the portion from which a key signal .alpha. is to be generated of picture is caused to be foreground F, the portion except for the above is caused to be background B, and pixel value of pixels constituting that picture is designated at C, the key signal .alpha. is generated so as to satisfy the relational expression C'=(F-B).alpha.'('(prime) represents differentiation). In more practical sense, a change detecting section 10 calculates change C' of pixel value between pixels constituting picture, and an F-B detecting section 30 calculates difference F-B between the foreground and the background. In addition, an integral value calculating section 40 divides the change C' by the difference F-B to integrate the result obtained by divisional operation to thereby determine key signal .alpha.. As a result, precise key signal can be obtained in this invention.