Abstract: A video signal processing system for processing a video data VIN and graphic data D?P includes a filter unit, which receives the video data VIN. The filter unit filters the video data VIN to convert the video data VIN into video pictures formatted with a different number of columns and/or lines, and provides a filtered video signal indicative thereof. The filter unit buffers individual pixels and/or lines in a first memory device. A second memory device receives and stores the graphic data D?P and the filtered video signal and provides stored signals indicative thereof. A third memory device is connected to the second memory, and stores data received from the second memory device. A mixing unit receives and mixes the stored graphic data and the stored filtered video data to provide a video output signal VOUT.

Abstract: A method and apparatus where a source delivers graphics data to a target, which receives and displays the graphics data. The source of the graphics data controls how the graphics data is to be displayed at the target. The source transmits a display control signal prescribing a manner in which the video signal is to be displayed in relation to the graphics data. A target receives the video signal, the graphics signal, and the display control signal, and combines the video signal and the graphics data in the manner prescribed by the display control signal to form a combined display at the target.

Abstract: An imaging system for obtaining a wide field of view comprises a plurality of imaging devices each having a defined field of view and each of the imaging devices having a mechanism for capturing an image at a selected time instant. The imaging devices are positioned such that the field of view of each device overlaps the field of view of each adjacent device. A control module simultaneously actuates each of the imaging devices to capturing an image within the field of view of all devices concurrently. The resulting images from each of the devices are merged to produce a wide field of view image.

Abstract: A system for creating a variation of an audio track from audio building blocks is presented, where track variation may be created during a live performance. Two or more of the presented systems may be coupled to automatically maintain a beat mix between two or more playing audio track building blocks. Audio building blocks are prepared in advance to include features that may enable the creation of the track variation and the automatic maintaining of the beat mix.

Abstract: An improved cinematographic system and method for multiple compositing, within a virtual studio, of an image frame or image sequence of a real/action image of an action sequence of a puppet, with another image frame or image sequence of a real/action image of the same or another puppet, within a given virtual studio space. This system and method have application to the compositing of a master camera angle image and a close-up image of the same puppet character; and, to the compositing of a master camera angle image of one action puppet character with a second image from another camera angle of another puppet action character, so as to provide an interactive image sequence of each of the characters of each image within the same image frame.

Abstract: As information to be processed at an object-based video or audio-visual (AV) terminal, an object-oriented bitstream includes objects, composition information, and scene demarcation information. Such bitstream structure allows on-line editing, e.g. cut and paste, insertion/deletion, grouping, and special effects. In the interest of ease of editing, AV objects and their composition information are transmitted or accessed on separate logical channels (LCs). Objects which have a lifetime in the decoder beyond their initial presentation time are cached for reuse until a selected expiration time. The system includes a de-multiplexer (1), a controller (2) which controls the operation of the AV terminal, input buffers (3), AV objects decoders (4), buffers (4?) for decoded data, a composer (5), a display (6), and an object cache (7).

Abstract: An apparatus and method for video data processing in digital video decoding, such as digital video disk (DVD) decoding, which produces new video data according to main picture data, sub-picture unit (SPU) data, and an aspect ratio. The apparatus includes a sub-picture-unit-decoding and color-determining device, a mixer, a buffer, and an interpolator. The sub-picture-unit-decoding and color-determining device is used for performing sub-picture decoding and color determination on the SPU data, and producing decoded SPU data. The mixer, coupled to the SPU-decoding and color-determining device, is employed to mix the main picture data and the decoded SPU data, and outputting combined video data. The buffer, coupled to the mixer, for storing the combined video data outputted from the mixer.

Abstract: Digital watermarks can serve to indicate copyright ownership of digitized video. When video images are transmitted as transformed by discrete cosine transformation (DCT) for compression, with or without motion compensation, it is advantageous to include a watermark after transformation. To this end, a DCT watermark is generated for optimal visibility based on the original image data, and the generated watermark is superposed on the transformed data.

Abstract: A display control apparatus includes a display controller for receiving image signals corresponding to a plurality of images, to perform image processing on the image signals, and to synthesize images corresponding to the thus-processed image signals. While the images are displayed in a main picture and a sub-picture, the display controller further displays, adjacently to the sub-picture, a list of a plurality of images.

Abstract: An apparatus for protecting an occupant in a vehicle includes a pair of image sensors for taking images of an area on a seat in the vehicle. Transverse-direction shifts between corresponding portions of the images are calculated. Longitudinal-direction positions of objects whose images are in the portions of the images taken by the image sensors are measured in response to the calculated transverse-direction shifts. A longitudinal-direction position of an occupant on the seat is decided in response to the measured longitudinal-direction positions of the objects. Occupant protecting operation at a time of occurrence of a collision of the vehicle is changed in response to the decided longitudinal-direction position of the occupant. From the measured longitudinal-direction positions of the objects, one corresponding to a highest position with respect to the vehicle and being in front of the seat is selected as a longitudinal-direction position of a head of the occupant.

Abstract: The present invention provides a process for accurately combining low-resolution and high-resolution video streams into a single seamless display to a human observer. The present invention also provides a method for the smooth blending of high- and low-resolution video boundary. In order to create an effective visual display, it is advantageous that the boundary between high- and low-resolution video not be overly distracting and irregular. The present method to reduce distractions from the quadrilateral boundary between low-and high-resolution video by smoothly blending the two in an annular region between the two. This results in a much more visually pleasing, effective display. The present invention also provides a method for progressively mosaicking high resolution imagery over a low resolution image captured by our panoramic sensor.

Abstract: Methods and systems for spectrally-encoding plural source images and for providing the spectrally-encoded plural source images in a composite image, for rendering the composite image on a substrate, and for recovering at least one of the encoded source images from the rendered composite image. A desired source image is recovered when the rendered composite image is subjected to illumination by one or more illuminants and the desired source image is detected by one or more sensors in an image capture device. The spectral characteristics of the colorants, illuminants, and sensors are employed to spectrally encode the source image in the composite image.

Abstract: An image processing apparatus is capable of displaying a first image obtained from a broadcast wave and a second image reproduced from a storage medium on a display unit. The apparatus comprises a first image processing unit adapted to increase a size of the first image if an instruction for temporarily stopping a reproduction of the second image is detected while the first image and the secod image are displayed on the display unit; and a second image processing unit adapted to decrease a size of the second image if the instruction for temporarily stopping the reproduction of the second image is detected while the first image and the second image are displayed on the display unit.

Abstract: A real-time system and method for inserting perspective correct content into an image sequence are presented. The invention inserts the content with the location, size, orientation, shape and occlusion properties that are appropriate for the camera view represented by the image sequence. Both static and dynamic content insert positions are supported. The location, size, orientation and shape of the inserted content are determined independently of the image sequence content. Furthermore, no knowledge of three dimensional real world space locations or real world measurements, as related to the content of the image sequence, is used during the content insert process.

Abstract: A method and system provides a face-to-face video conference. The method and apparatus comprise a conferencing system consisting of a conferencing station defining a predetermined motif, an image system for generating a substantially full scale image of a person at the conferencing station so that participants at the conferencing station feel that any images of persons displayed by the imager at the conferencing station are present and face-to-face. The method comprises the steps of receiving image data at a teleconferencing station, the image data including data corresponding to at least one person, and displaying an image corresponding to the image data at the teleconferencing station so that at least one participant at the teleconferencing station views an image of said at least one person, thereby providing a face-to-face presence environment whereat the image of at least one person appears substantially life size.

Abstract: A device for generating fusion images by fusioning two images, in particular medical images, comprising an image-processing computation unit (2) for fusioning the images, as well as a monitor (3) connected thereto for image output, a gray-value histogram (7, I, II) being displayable on the monitor (3) for each image of the images to be fusioned, which device is designed in such a way that, in each gray-value histogram (7, I, II) of the images to be fusioned, one or more gray-value ranges can be selected by user-controlled highlighting of one or more markings (8) on the monitor (3), as well as for generating the fusion image with the aid of the selected gray-value ranges.

Abstract: A method of displaying an image with a display device includes receiving image data for the image. A first sub-frame and a second sub-frame corresponding to the image data are generated. The first and the second sub-frames are generated based on minimization of an error between the image data and a simulated image. The method includes alternating between displaying the first sub-frame in a first position and displaying the second sub-frame in a second position spatially offset from the first position.

Abstract: A special effect image generating apparatus provided with an image conversion processing circuit for posterization or other image conversion, a luminance and chroma condition setting circuit for image extraction by luminance and colors, a mask pattern generator for selection of a mask, and mixer for preparing a video signal, a transformation unit for transformation processing such as movement, and a post video modification unit for addition of a locus etc. The extracted image automatically tracks movement of the image so there is no change in visual effects, images having the same luminance and color conditions can be deleted by mask adjustment, movement of the image can be handled by adjustment of the mask, and highly accurate boundaries can be set by the wave-filtering and shaping circuit. Therefore, a special effect image with distinctive luminance and color can be easily prepared.

Abstract: A special effect image generating apparatus provided with an image conversion processing circuit for posterization or other image conversion, a luminance and chroma condition setting circuit for image extraction by luminance and colors, a mask pattern generator for selection of a mask, and mixer for preparing a video signal, a transformation unit for transformation processing such as movement, and a post video modification unit for addition of a locus etc. The extracted image automatically tracks movement of the image so there is no change in visual effects, images having the same luminance and color conditions can be deleted by mask adjustment, movement of the image can be handled by adjustment of the mask, and highly accurate boundaries can be set by the wave-filtering and shaping circuit. Therefore, a special effect image with distinctive luminance and color can be easily prepared.

Abstract: A system and method are disclosed for digitally compositing an object from an input image onto a destination image. The object is composited from an image having an arbitrary or non-uniform colored background containing some non-static elements onto a destination image with reduced effects from shadows cast by the object and with reduced gaps or holes within the object. Various improvements in the compositing procedure such as shadow reduction and hole filling, and less restrictive requirements regarding the object's surroundings are disclosed. A background model is created and a frame of an input image containing the object is obtained. An alpha image is created in which each pixel is either a zero, indicating it is not part of the object, or a one, indicating that it is part of the object.

Abstract: The embedded program comprises a part of the function of the Java program. The embedded program executes the part of the function during the start-up processing period of Java program. Thus, the start-up time appears to be shortened. Further, the present invention provides the information regarding the action state of the embedded program to the Java program, thereby enabling a consistent execution of the Java program on completion of the Java program start-up process.

Abstract: Apparatus for inserting an externally supplied video image into a computer graphics image. A TV card (131), responsive to synchronization signals, is connected to a video source to receive and convert an input video stream and also connected to provide a scaled and positioned video image (754) synchronized to a computer graphics image. A graphics card (150) is configured to provide the TV card (131), with a computer graphics image (652) having an embedded color key signal, video scaling and positioning parameters and horizontal and vertical synchronization signals. A window keyer (260) is connected to the TV card (131) and the graphics card (150) to provide the video stream and the computer graphics image to a computer monitor (170).

Abstract: A digital video stream is digitally scaled to properly display on a device having a horizontal to vertical aspect ratio different than the source aspect ratio leaving a blank area on the device. Graphic data is digitally scaled separately to extend partially or completely into and therefore use the blank area. A compositing blender digitally combines the two prior to a display encoder which produces analog signals for driving the display device.

Abstract: A method and system for processing video signals is disclosed. The system receives a video signal, a first audio signal containing an annotation and a second audio signal containing environmental sounds corresponding to the video signal. In one embodiment the system generates searchable annotations corresponding to the video and second audio signals via the first audio signal.

Abstract: An apparatus to proceed data received from a broadcast signal, where the data includes a plurality of formats. The apparatus comprises: means for separating the data from the broadcast signal into a plurality of formats; layer image signal generating means for generating layer image signals of predetermined sizes, wherein each layer image signal is separately positioned; display section signal generating means for generating display section signal for each layer image signal; and adaptive image processing means for superimposing the layer image signals and for subjecting each superimposed layer image signal corresponding to the display section signal to adaptive image processing according to a preset parameter of each layer image signal.

Abstract: An apparatus and method for video data processing in digital video decoding, such as digital video disk (DVD) decoding, which produces new video data according to main picture data, sub-picture unit (SPU) data, and an aspect ratio. The apparatus includes a sub-picture-unit-decoding and color-determining device, a mixer, a buffer, and an interpolator. The sub-picture-unit-decoding and color-determining device is used for performing sub-picture decoding and color determination on the SPU data, and producing decoded SPU data. The mixer, coupled to the SPU-decoding and color-determining device, is employed to mix the main picture data and the decoded SPU data, and outputting combined video data. The buffer, coupled to the mixer, for storing the combined video data outputted from the mixer.

Abstract: An interfacing method and system for a stream source apparatus and a display device, which includes a stream source apparatus receiving analog/digital signals from external analog/digital equipments to generate a plurality of transmission packet streams corresponding to the analog/digital signals, the stream source apparatus synthesizing a plurality of the transmission packet streams into a single synthesized transmission packet stream to transmit the synthesized transmission packet stream by wireless, a display apparatus receiving the synthesized transmission packet stream transmitted from the stream source apparatus, the display apparatus separating the synthesized transmission packet stream into a transmission packet stream corresponding to a main screen and a transmission packet stream corresponding to a sub-screen, the display apparatus decoding the transmission packet streams corresponding to the main screen and the sub-screen respectively to generate digital video/audio signals to display on a display

Abstract: A video system and method for combining multiple video signals on a single display is provided. The video system includes a video processor to process a second video signal and generate a processed video signal. The processed video signal has the same resolution and scan rates as a first video signal. A multiplexer is used to selectively display either the processed video signal or the first video signal on a display.

Abstract: The video signal processing method of this invention is employed in a video signal processing apparatus that includes a plurality of signal processing parts, each for executing signal processing, for processing two or more digitalized video signals in parallel, and the video signal processing method includes the steps of selecting one or more video signals from the two or more digitalized video signals; and obtaining an object video signal by selecting, from the plurality of signal processing parts, signal processing parts used for signal processing of the selected video signals in accordance with a mode of the object video signal and executing the signal processing in the selected signal processing parts in an order in accordance with the mode of the object video signal.

Abstract: Video picture signals are received via at least three channels. At least three control instructing operators are provided in correspondence with the channels. Each control instructing operator is operable to give a signal control instruction for the corresponding channel in accordance with an operated amount of the operator. Controller performs signal control on the video picture signals of the channels on the basis of the respective signal control instructions given via the control instructing operators. Synthesizer synthesizes the video picture signals of the channels having been subjected to the signal control by the controller. Video picture signals of two desired channels are designated, and a contact-type operator gives signal control instructions, corresponding to a predetermined position of the operator contacted by a human operator, with respect to the video picture signals of the designated two channels.

Abstract: A digital signal path selector is disclosed in its simplest form for selectively connecting two input terminals to two output terminals. Both input terminals and output terminals are laid out on a control panel, on which there are also provided two input select pushbuttons, positioned one adjacent each input terminal, and two output select pushbuttons positioned one adjacent each output terminal. The input select pushbuttons and the output select pushbuttons are arranged so close to one another that any one input select pushbutton and any one output select pushbutton are capable of concurrent depression with the thumb and forefinger of one hand in order to specify one associated input terminal and one associated output terminal for creation of a signal path therebetween.

Abstract: A special effect image generating apparatus provided with an image conversion processing circuit for posterization or other image conversion, a luminance and chroma condition setting circuit for image extraction by luminance and colors, a mask pattern generator for selection of a mask, and mixer for preparing a video signal, a transformation unit for transformation processing such as movement, and a post video modification unit for addition of a locus etc. The extracted image automatically tracks movement of the image so there is no change in visual effects, images having the same luminance and color conditions can be deleted by mask adjustment, movement of the image can be handled by adjustment of the mask, and highly accurate boundaries can be set by the wave-filtering and shaping circuit. Therefore, a special effect image with distinctive luminance and color can be easily prepared.

Abstract: An image composition apparatus includes a composition processing unit comprising a composition position determination unit for receiving a shape signal and an image signal which are outputted from an image decoding unit, and determining a composition position of an object as a foreground image; a shape boundary determination unit for determining the shape and boundary of the object; an arbitrary-shaped frame generation unit for generating an outline or frame of the object on the basis of information relating to the shape and boundary of the object; and a pixel composition unit for compositing a target pixel (pixel to be processed) of the object or an arbitrary-shaped frame pixel that is generated by the arbitrary-shaped frame generation unit 4c, with the corresponding pixel in the background image. Therefore, a composite image, in which an outline or an arbitrary-shaped shape is added to an arbitrary-shaped object, can be generated.

Abstract: Image-based lighting for use in rendering of digital objects is derived from image data collected from a real motion-picture set. The image data includes sets of correlated images at different exposure levels, each corresponding to a selected location. The image data is processed to define an extended dynamic range panoramic image for each selected set location. The image data is color and intensity corrected based on a scaled reference object. At least key lights are modeled for the set by processing a plurality of such panoramic images. Other lighting may be defined by interpolating from the panoramic images to mathematically define a location-specific set of fill lights. In the alternative, other set lighting may be modeled by projecting panoramic image data onto a dynamically sub-dividable light primitive derived from the set geometry. Any desired object may then rendered using the defined lights, and inserted into a corrected real image of the set at the desired location.

Abstract: A method for integration of a source object into a base image. The method comprises the steps of identifying similar border pixels, calculating characteristic values of the similar border pixels in the source object and the base image, creating a tonal map using the characteristic values, segmentation filtering the source object and the overlapped area into regions, identifying similar regions in the source object, each of which, in the characteristic values, has a difference smaller than a second threshold from the similar border pixels in the source object and smaller than a third threshold from one region in the overlapped area having an average difference smaller than a fourth threshold from the similar border pixels in the overlapped area, and applying the tonal map to the similar regions.

Abstract: Disclosed is an image processing method and an image processing apparatus that improve quality of display images in different formats of a multi-format data broadcast image. The image processing method according to the present invention comprises the steps of: separating menu data, character data, still image data, and moving image data in a plurality of formats from a broadcast video signal; generating a layer image signal such that the image signal of data in each of the formats is superimposable on the data in the plurality of formats; and subjecting the superimposed layer image signal to adaptive image processing according to a preset parameter by means of an adaptive image processing unit. Therefore, by subjecting each layer to different image processing irrespective of the type and the format of the signal, it is possible to perform image processing adapted to each format.

Abstract: Disclosed is an image processing method and an image processing apparatus that improve quality of display images in different formats of a multi-format data broadcast image. The image processing method according to the present invention comprises the steps of: separating menu data, character data, still image data, and moving image data in a plurality of formats from a broadcast video signal; generating a layer image signal such that the image signal of data in each of the formats is superimposable on the data in the plurality of formats; and subjecting the superimposed layer image signal to adaptive image processing according to a preset parameter by means of an adaptive image processing unit. Therefore, by subjecting each layer to different image processing irrespective of the type and the format of the signal, it is possible to perform image processing adapted to each format.

Abstract: In an apparatus for composing image data of a main picture and image data of a sub-picture by a chroma key process, an attribute of an image contained in the sub-picture is detected, a partial area of the sub-picture is set as a chroma key mask area in accordance with the attribute detection result, and composing the image data of the main picture and the image data of the sub-picture by executing the chroma key process for an area other than the chroma key mask area without executing the chroma key process for the chroma key mask area in the sub-picture.

Abstract: There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

Abstract: The present invention provides a system for mosaicing multiple input images, captured by one or more remote sensors, into a seamless mosaic of an area of interest. Each set of input images captured by the remote sensors within a capture interval are ortho-rectified and mosaiced together into a composite image. Successive composite images, along a given flight path, are then mosaiced together to form a strip. Adjacent strips are then mosaiced together to form a final image of the area of interest.

Abstract: An information processing apparatus obtains a first image and display timing information of the first image via a first channel, and a second image via a second channel different from the first channel. The information processing apparatus includes a main CPU for processing the obtained second image in accordance with the contents of the first image, and a CRTC for outputting the obtained first image, the processed second image and the display timing information to a predetermined display unit to display a combined image obtained by combining the first and second images on the display unit.

Abstract: A method and apparatus for effecting a seamless, frame accurate splicing of MPEG-like transport streams by constructing a transition stream or clip with portions from each stream proximate respective splice points.

Abstract: A method for generating a transition stream and processing video, audio or other data within the transition stream using, respectively, pixel domain processing, audio domain processing or other data domain processing.

Abstract: Systems and methods for compositing an image directly from multiple source image data for reducing system memory footprint and bandwidth and for improving color quality of the image. The image is divided into spans, lines, and slices. Each line includes at least one span and each slice includes at least one line. All lines in a slice have spans associated with identical sources. An image is composited by reading the image data directly from one or more sources of each span. If necessary, the sources are blended. A control structure is used to provide the image context and identifies the sources of the spans. The control structure includes headers for each data stream from each source of each span. Also, the color quality of the image is improved by reducing the number of color space conversions that occur as the image is composited. All sources in the same color space are blended before being blended with sources from other color spaces. Preferably, no more than a single color conversion is required.

Abstract: A contrast-based image fusion system and method of processing multiple images to form a processed or fused image including regions selected from one or more images. Images are divided into image regions. Portions of the images are filtered if necessary. A contrast map is generated for each image via a convolution kernel resulting in a contrast map with contrast values for each image region. Contrast values are compared and image regions are selected based on a selection criteria or process such as greater or maximum contrast. The selected image regions form the fused image. If necessary, the luminance of one or more portions of the fused image is adjusted. One sensor is selected as a reference sensor, and an average intensity of each region of the reference sensor image is determined across the reference sensor image. The intensity of one or more regions in the final image is adjusted by combining the determined average luminance values and intensity values of the final image.

Abstract: A video amplifier having an on-screen display (OSD) capability uses one channel of an OSD input video signal to generate a blanking signal for blocking output of a video signal. When the blanking signal is asserted, the OSD channels provide the on-screen display. The blanking signal is generated in a high speed mixer circuit including an emitter-coupled differential pair for amplifying the OSD input signal about an operating DC offset voltage and a pull down circuit for providing the blanking signal.

Abstract: An image compositing apparatus of the present invention composites a video image and a plurality of graphical images together into a final composite image. The image compositing apparatus includes a first obtaining unit, a first compositing unit, a calculating unit, a second obtaining unit, and a second compositing unit. The first obtaining unit obtains the graphical images and composition information that includes an image compositing order and is used for calculating the composition ratios of the images to the final composite image. The first compositing unit composites the graphical images together into one composite graphical image according to the composition information. The calculating unit calculates the composition ratio of the video image to the final composite image according to the composition information. The second obtaining unit obtains frames of the video image. The second compositing unit composites the frames with the composite graphical image using the composition ratio of the video image.

Abstract: Disclosed is an image processing method and an image processing apparatus that improve quality of display images in different formats of a multi-format data broadcast image. The image processing method according to the present invention comprises the steps of: separating menu data, character data, still image data, and moving image data in a plurality of formats from a broadcast video signal; generating a layer image signal such that the image signal of data in each of the formats is superimposable on the data in the plurality of formats; and subjecting the superimposed layer image signal to adaptive image processing according to a preset parameter by means of an adaptive image processing unit. Therefore, by subjecting each layer to different image processing irrespective of the type and the format of the signal, it is possible to perform image processing adapted to each format.

Abstract: In the first stage, a merging position relationship (a rotation angle, and/or presence/absence of mirror image flipping) between two images is identified by using reduced images, and a rough overlapping region is detected. In the second stage, an exact overlapping position, an inclination, etc. are detected. In the third stage, the two images are merged by using the process results of the first and the second stages.

Abstract: In an apparatus for composing image data of a main picture and image data of a sub-picture by a chroma key process, an attribute of an image contained in the sub-picture is detected, a partial area of the sub-picture is set as a chroma key mask area in accordance with the attribute detection result, and composing the image data of the main picture and the image data of the sub-picturee by executing the chroma key process for an area other than the chroma key mask area without executing the chroma key process for the chroma key mask area in the sub-picture.