Abstract: A digital video effects system for producing live-action video effects in real time includes an address generator having a pair of 2-D tables for providing x-coordinate and y-coordinate offset values. A third 2-D table contains warp activation factors (activators) which are scaled by a clip and gain processing technique to produce scaled activators. The scaled activators are used to scale the x- and y-offset values which are then combined with the original raster-order addresses to produce frame buffer readout addresses. An output video signal is produced by an inverse mapping of the input frame buffer to the output. The 2-D tables provide control of the image on a pixel-by-pixel basis. The degree of scaling by the clip and gain unit varies with time so that the resulting readout addresses also vary with time. A video effect, therefore, is produced simply by adjusting the scaling of the clip and gain unit. Moreover, a variety of effects can be achieved simply by changing the various 2-D tables.

Abstract: An improved video window control apparatus and a method thereof which are capable of generating a plurality of video windows on a television or a computer monitor, controlling the size and position thereof, and providing a video window overlap function and a picture-in-picture function.

Abstract: A source relative warping technique for corner pinning calculates a final projection matrix representing a desired video effect. At least three non-collinear points are specified in an input video signal representing an image in a source plane. One or more of the non-collinear points are "deformed", and then the points as deformed are processed by the final projection matrix to produce projected points in a target plane. A new projection matrix is defined that projects the original non-collinear points in the source plane onto the projected points in the target plane. The new projection matrix is finally substituted for the final projection matrix.

Abstract: A digital video effects apparatus has a graphical user interface having a display upon which is produced a video image within a predetermined shape, the video Image being rotated in time and space to represent a 3-dimensional effect. Control points are set by a user together with rotation angles and x-y scaling parameters of the video image. The apparatus interpolates between the control points to provide a smooth transition from control point to control point. The video image is zoomed in and out as the video image changes orientation and/or size so that the video image substantially fills an image area of the graphical user interface display. In the invention the video image is tracked on the GUI display even when it is outside the normally visible screen area.

Abstract: A virtual 3-D object video signal V1 is produced by performing a 3-D image transformation for a source video signal, and a 2-D objet video signal V2 for virtually representing the 3-D image transformation is produced by projecting the object video signal V1 onto an X-Y plane. Further, 3-D shadow signals V3 and V5 are produced by projecting the 3-D image transformed 3-D object video signal V1 onto a shadow plane, and 2-D shadow signals V4 and V6 corresponding to said 2-D object video signal are produced by projecting the 3-D shadow signals onto the X-Y plane. Therefore, a shadow signal for a 3-D image transformed object video signal can be produced by calculations.

Abstract: With employment of two images acquired by imaging an imaging object at two different positions and also parameters of a camera under imaging operation at these positions, both the imaging positions with respect to an origin, and also positions of the imaging object with respect to both the imaging positions are obtained as three-dimensional vectors. With employment of the calculated three-dimensional vector of the imaging position with respect to the origin and also the three-dimensional vector of the imaging object position with respect to the imaging position, the imaging object position with respect to the origin is mapped as the three-dimensional vector.

Abstract: A video signal processor which includes a circuit for converting the number of lines in a digitized video signal, a circuit for generating a display dot clock, a circuit for outputting analog pixel data subjected to a line number conversion and having a frequency different from that of the display dot clock, and a circuit for smoothing the analog pixel data; and in which a frequency fck of the display dot clock, an output frequency frk of the analog pixel data and a frequency fho of the horizontal synchronization signal satisfies an equation;frck/N=fck/M=fhowhere M and N are natural numbers satisfying M.noteq.N.

Abstract: An image displaying apparatus includes a memory, an image reader, an image processor, an image adder and a display. The memory stores a plurality of medical images including temporally sequential images of a common portion of a same patient taken at different points of time. The image reader reads out the plurality of medical images from the memory. The image processor processes at least two of the plurality of medical images read out from the memory according to registration information of the at least two of the plurality of medical images so as to obtain a processed image. The image adder adds one of the plurality of medical images read out from the memory to the processed image so as to obtain an addition image. And the display displays the addition image.

Abstract: In a method of processing 16:9 pictures for display on a screen with a 4:3 aspect ratio, each line of the television signal is compressed and/or expanded so that the ratio of the length of a segment of unprocessed signal to the length of the resultant signal derived from it, varies along the line. Preferably, each line is subject to "cylindrical" processing such that it is compressed as though the line were extended along an arc of a circle and projected along a direction onto a flat plane joining the ends of the arc. The picture may also be subject to slight vertical stretching to give a final image which is subject to distortion at an acceptable level while retaining a good level of vertical detail.

Abstract: A system and method for realtime occlusion processing for seamlessly and realistically blending an inserted image such as an advertisement into a region of a live broadcast image without obscuring the action of the live image. The average color and intensity of a synthetic reference image containing at least some of the region to be replaced is compared to the average color and intensity of the current live broadcast image to determine the difference between the two images. The resulting difference image obtained from processing the current image and synthetic, reference image determines areas of the intended insertion region within the current image which are obscured by live action. The processor then generates an occlusion mask based on the difference image and only those pixels that are unoccluded within the intended insertion region are allowed to be inserted into the live broadcast.

Abstract: A special effect picture device is disclosed in which a transformed picture which is non-linear with respect to an original signal is formed using a video signal and a key signal for the original signal. A video signal is stored in a video signal storage unit and a key signal is stored in a key signal storage unit. The read-out addresses for the information concerning an upper picture of the transformed picture and the information concerning a lower picture of the transformed picture and also the information concerning the depth are generated by a read-out address generating unit. The key signal read out from the key signal storage unit and the video signal read out from the video signal storage unit are respectively divided by a dividing unit into upper and lower key signals and upper and lower video signals responsive to the read-out address for the upper picture and read-out address for the lower picture.

Abstract: A method of rendering at least part of an image from an at least one external source into a two-dimensional memory array having integer x and y pixel coordinates based upon a set of integer coordinates of an outline of the rendered image. The method includes the steps of forming a parallelogram defined by a parallel series of effect lines forming an angle e with either the x or y axis of the memory array and bounded on opposing ends of the scan lines by a scan axis, the parallelogram surrounding at least part of the two-dimensional memory array and rendering the image from the at least one external source into the memory array while moving unidirectionally along the effect lines and scan axis using the outline coordinates as transition points for selection and non-selection of the image.

Abstract: A video special effect generator comprises a first mixer supplied with an input video signal indicative of an input image, a delay circuit for delaying an output video signal supplied thereto from the first mixer and supplying a delayed output video signal to the first mixer, and a control circuit including an edge detecting circuit for detecting an edge of an input image indicated by the input video signal supplied thereto and outputting an edge signal indicative of the detected edge and generating a mixing ratio control signal on the basis of the edge signal, wherein the first mixer mixes the input video signal and the delayed output video signal supplied thereto from the first delay circuit with a mixing ratio based on the mixing ratio control signal.

Abstract: An interphone with television includes a terminal device having a wide-angle image input camera, an image output circuit, and a master device for receiving an image signal from the image output circuit. The master device converts the image to a digital format and stores the image signal in an image memory. The image may be panned, magnified, and corrected using digital processing techniques. The contents of the image memory are converted to an analogue signal for reproduction on a monitor.

Abstract: A method for tracking motion from field to field in a sequence of related video broadcast images. The method uses template correlation to follow a set of predetermined landmarks within a scene in order to provide position information of objects in the current image. The current image object position information is compared to position information of the same objects within a reference array data table. The comparison is accomplished through the use of warp equations that map points in the current image to points in the reference array. Motion is tracked according to a velocity prediction scheme utilizing a weighted formula that emphasizes the weight of landmarks that are closer to their predicted position.

Abstract: In a scanning line converting operation, an image signal is processed through a system including memories, switches, arithmetic circuits, an adder, a subtracter and a switch. In a graphic process, coordinate data processed by a parameter generator and a drawing unit is subjected to a coordinate converting calculation by the arithmetic circuits and supplied to an address generator. Based on an address generated by the address generator, a texture model, which has been stored in a memory under control of a CPU, is read out and supplied to a synthesizing circuit. In the synthesizing circuit, the texture model is attached to a polygon output from a drawing unit.

Abstract: An adaptation of an aspect ratio of a picture signal is effected by providing (1) a second derivative (D2) of an expansion factor (EF) in response to at least one constant value (C1, C2), by providing (3-13) a first derivative (D1) of the expansion factor (EF) in response to the second derivative (D2), by providing (14-21) the expansion factor (EF) in response to the first derivative (D1), and by expanding the picture signal in dependence upon the expansion factor (EF) to adapt the aspect ratio of the picture signal, whereby use of an expansion factor (EF) less than one results in a compression of said picture signal.

Abstract: In response to the designation of a rectangular partial region of an original picture to be reproduced, the designation of a rectangular partial region of the displayable picture at the reproduction end, and information corresponding relationship between the displayable picture and the original picture that an image of a certain region of the displayable picture and of the original picture are equivalent to each other, an instruction is generated for a reproduction operation to reuse part of the displayable picture, as it is reusable as part of the region at the reproduction end, and to reproduce from the original picture a region at the reproduction end in order to reproduce a part of the original picture in the displayable picture.

Abstract: A cascaded anti-aliasing filter control circuit for sampled images has a plurality of video effects modules coupled in a chain,. each module performing a particular transform of a cascaded video effect. An input module has as inputs constants for the particular transform and a pixel address signal, and provides as outputs a new pixel address signal and a set of partial derivative signals. The new pixel address signal is input to a next module in the chain as the pixel address signal, and the set of partial derivative signals are input to a matrix multiplier. A set of partial derivative signals from the next module also are input to the matrix multiplier to produce an intermediate set of partial derivative signals.

Abstract: An automatic, voice-directional video camera image steering system specifically for use for teleconferencing that electronically selects segmented images from a selected panoramic video scene typically around a conference table so that the participant in the conference currently speaking will be the selected segmented image in the proper viewing aspect ratio, eliminating the need for manual camera movement or automated mechanical camera movement. The system includes an audio detection circuit from an array of microphones that can instantaneously determine the direction of a particular speaker and provide directional signals to a video camera and lens system that provides a panoramic display that can electronically select portions of that image and, through warping techniques, remove any distortion from the most significant portions of the image which lie from the horizon up to approximately 30 degrees in a hemispheric viewing area.

Abstract: The resolution of an original image, represented as a pixel array, is increased by applying a spectral transformation to the pixel array, producing a spectral array representing the image, and then applying an inverting spectral transformation to produce a larger pixel array. The inverting spectral transformation is of a kind designed to convert high frequency spectral components not present in the original image or identified by the spectral array. These high-frequency terms of the inverting spectral transformation are either ignored or supplied with zero values. As a result, the final, larger pixel array has the same spectral distribution as the original pixel array, but a larger number of pixels.

Abstract: A video signal compression apparatus extracts a specific value written in a read only memory at every system clock pulse. The specific value can be varied at every clock pulse. Therefore, for example, only the center part of a picture can be horizontally compressed. A FIFO memory may be used. It is possible to select a mode with a fixed compression ratio or a mode in which a compression ratio varies at every clock pulse. Further, the fixed compression ratio can be set from the outside. Display position of the picture can also be changed.

Abstract: An image display apparatus having a computer system and an image processor. The computer system includes: a personal computer having a CPU and a main memory; and input/output apparatuses such as magneto-optical disk drive, image scanner, full color printer, etc. The image processor which commonly uses a system bus of the computer system includes an independent dedicated image bus, a compression/expansion unit, an image memory read/write controller, image memories, and a video processor. Image data which is sent from the magneto-optical disk drive is decoded by the compression/expansion unit and is held in the image memories. The image data of the image memories is transferred to the video processor through a dedicated signal line and is displayed on a large screen projection display.

Abstract: A special effect picture device is disclosed in which a transformed picture which is non-linear with respect to an original signal is formed using a video signal and a key signal for the original signal. A video signal is stored in a video signal storage unit and a key signal is stored in a key signal storage unit. The read-out addresses for the information concerning an upper picture of the transformed picture and the information concerning a lower picture of the transformed picture and also the information concerning the depth are generated by a read-out address generating unit. The key signal read out from the key signal storage unit and the video signal read out from the video signal storage unit are respectively divided by a dividing unit into upper and lower key signals and upper and lower video signals responsive to the read-out address for the upper picture and read-out address for the lower picture.

Abstract: Image signals corresponding to a first row of the image are horizontally scaled and stored in an external memory device. A first portion of the horizontally scaled first-row image signals are retrieved from the external memory device and stored in an internal memory device. Image signals corresponding to a first portion of a second row of the image are horizontally scaled and partially vertically scaled first-portion image signals are generated from the first portion of the horizontally scaled first-row image signals and the first portion of the horizontally scaled second-row image signals. The partially vertically scaled first-portion image signals are stored in the external memory device. A second portion of the horizontally scaled first-row image signals are retrieved from the external memory device and stored in the internal memory device.

Abstract: A video special effect generator comprises a first mixer supplied with an input video signal indicative of an input image, a delay circuit for delaying an output video signal supplied thereto from the first mixer and supplying a delayed output video signal to the first mixer, and a control circuit including an edge detecting circuit for detecting an edge of an input image indicated by the input video signal supplied thereto and outputting an edge signal indicative of the detected edge and generating a mixing ratio control signal on the basis of the edge signal, wherein the first mixer mixes the input video signal and the delayed output video signal supplied thereto from the first delay circuit with a mixing ratio based on the mixing ratio control signal.

Abstract: In an image transformation apparatus, the image formed by an input video signal is stored into a memory, and the input video signal is read based on a read-address data of a predetermined read-address generator means, to execute a predetermined image transformation with respect to an image. The transformed image is formed by using a function in which a distance from the center of the transformed image is changeable corresponding to an angle from the center of that, so as to obtain the lens effect transforming the image into images having various curvilinearly shapes.

Abstract: A dynamically variable anti-aliasing filtering system calculates on a local basis the compression factors (Cf) present in an image that is being mapped from a two-dimensional source image through a three-dimensional space and into a two-dimensional target image, the apparatus implementing a linear equation of the form:Cf=A*X.sub.s +B*Y.sub.s +Cwhere, X.sub.s and Y.sub.s are, respectively, the horizontal and vertical coordinates of pixels in the source image, and A, B and C are precalculated (each field or frame) constants that depend on the transform matrix function F. A total of four compression factors are required, one for control of horizontal luminance filtering, one for control of vertical luminance filtering, one for control of horizontal chrominance filtering and one for control of vertical chrominance filtering. Three dual accumulator circuits are used to implement the linear equation in X.sub.s and Y.sub.s for three different sets of A, B and C.

Abstract: An image transforming apparatus comprising a means for holding an input image signal, a means for holding geometric parameters for the image signal in a photographing mode, a processing means for geometrically transforming the image signal by the use of such geometric parameters, and a means for outputting the image signal transformed geometrically by the processing means. There is also provided a method of transforming an input image by employing the above apparatus to realize a tilting process and a depth-effect emphasizing process for the image obtained from a video camera, an electronic still camera or the like.

Abstract: Apparatus for use with standard television (TV) for superimposing images, captions, titles, or other information over the television scene. Synchronization of the superimposed images with the television scene is brought about by phase locking the images to the horizontal synchronization pulse train of the television scene. A joystick input device allows the television viewer to select from a library of superimposed images and to move the images to any location over the television scene. The viewer can continue to move the superimposed images over the television scene to set up and maintain humorous or other expressive effects. The apparatus can also be used as an educational tool in conjunction with appropriate broadcasted or recorded programming. The horizontal synchronization pulse train of the television scene can be modified by introducing variable time delays from one pulse to the next. This variable synchronization delay can be used to create fun-house mirror effects.

Abstract: In an image transforming apparatus for performing the predetermined image transform for the image, the image formed by input video signal is stored in a memory, and the input video signal in the memory is read out in accordance with the predetermined read address data of the read address generating means, so that the special effect as if the image bursts is obtained. The random number generator is added to the read address generating means, and the extension of image and the value of random numbers to be added are controlled based on the data corresponding to the angle for the center of effect, so that the burst effect as if the picture elements scatter separately can be obtained.

Abstract: An image composing and displaying apparatus includes frame memory constituent elements of an identical structure, a video input portion, a video output portion, a controller for selecting connection of each element to the video input or output portion, and an image drawing portion for reading and writing video data from and in the memory elements. The memory elements can be used for the input and output operations and hence the size thereof can be easily expanded; moreover, the numbers of the elements respectively connected to the video input and output portion can be adaptively varied.

Abstract: A process modification of the content of a sequence of images which can be represented as a matrix of pixels. For that purpose a non-deformable target zone to be replaced in the scene is identified and is characterized, both in position and in dimensions, by reference to marks located close to each other and connected to the target zone in each image. The position with respect to the marks to be assigned to a model which can be superimposed on the target zone, stored in digital form, is determined. For each particular image, the geometrical transformation to be carried out on the model so that it corresponds to variations in the appearance of the target zone in all the successive images in the same shot is determined automatically using a correlation calculation based on the marks. Data suitable for enabling replacement of each current representation of the target are derived from the transformation and output. Apparatus for carrying out the method is also described.

Abstract: A system for electronic imaging of a hemispheric field of view includes a camera for receiving optical images of the field of view and for producing output data corresponding to the optical images. The camera includes an optical assembly for producing images throughout a hemispheric field of view for optical conveyance to an imaging device or photographic film. The optical system assembly has lens components that selectively emphasize the peripheral content of the hemispheric field of view. An electronic imaging device within the camera or a film-to-digital date conversion system provides digitized output signals to input image memory or electronic storage devices. A transform processor selectively accesses and processes the digitized output signals from the input image memory according to user-defined criteria and stores the signals in output image memory. The signals in the output image memory can then be displayed according to the user-defined criteria.

Abstract: A method and pixel interpolation system for non-linear interpolation of images having a plurality of input pixels and pixel positions. According to a preferred embodiment of the invention, a plurality of pairs of input pixels and a sequence of corresponding interpolation weights are received with a one-dimensional interpolator. A plurality of sequential weighted sums of the pairs of input pixels are provided at a plurality of the pixel positions in accordance with the interpolation weights. The sequence of interpolation weights is provided, where differences between pairs of successive interpolation weights of the sequence of interpolation weights differ. The sequence of interpolation weights is applied to the one-dimensional interpolator.

Abstract: A programmable video transformation rendering method and apparatus regenerates an arbitrary reverse address map according to a transformation function representing a desired video effect by using a set of parameters that are run length encoded. Each scan line in target space for an output image is divided into one or more continuous line segments in source space for the input image using a continuous function for each line segment. The parameters for each line segment are determined, encoded, and stored for execution of the transformation function. For each line segment the parameters are updated, with only those parameters needing updated being stored together with the prior parameters that do not need to be updated. The continuous function is in the form of a polynomial equation and is a compromise between the amount of data generated and the calculations required.

Abstract: Methods and systems are presented in which at least one geometric distortion function is separately determined for application to a particular primary color component of a color video display to cause a geometric distortion that compensates for lateral chromatic aberration in an optical system used to view the display.

Abstract: A patch-driven video 3D special effects system constructs an output display of a desired three-dimensional shape with real-time video picture information displayed on the surface of the shape by dividing a video source plane into a plurality of polygonal patches and manipulating said patches in three dimensions to create the shape. The special effects system is controlled by a keyframing control system in which a small number of selected parameters are used to define several general purpose 3D shapes. These parameters are then specified in each keyframe. By varying the selected parameters, the general purpose object can be reshaped into a number of familiar shapes such as cubes, cones, etc. A pre-defined program converts the selected parameters into patch shapes and vertice positions which are used by the video special effects hardware to actually create the images.

Abstract: The process makes it possible to modify the content of a sequence of images which can be represented as a pixel matrix. For that a non-deformable target zone to be replaced in the images is identified and is characterized, both in position and in dimensions, by reference to marks located close to each other and having an unchanging geometrical relation with the target zone in each image. The position, with respect to the marks, to be assigned to a model or pattern which can be superimposed on the target zone, stored in digital form, is determined. For each particular image of a same shot the geometrical transformation to be carried out on the model so that it corresponds to variations in the appearance of the target zone in all the successive images in the same shot is determined automatically by a correlation based on the marks. Last the pixels representative of the model are substituted for the pixels representative of the target zone in the image.

Abstract: An image transforming apparatus for transforming an input video signal representing a two dimensional image into a transformed video signal representing a three-dimensional surface and for depicting illumination of the image is provided.