Abstract: This disclosure describes techniques for rendering pixels on a display. A processing unit may receive pixel values for surface pixels of each surface of a plurality of surface. The processing unit may also receive an order of the plurality of surfaces. Based on at least the location and order of the plurality surfaces, the processing unit may blend pixel values for co-located surface pixels. The processing unit may also accumulate opaqueness values for co-located surface pixels and/or opaqueness values for surfaces with co-located surface pixels.

Abstract: A video processing apparatus includes a first video processing block, a second video processing block and a third video processing block. The first video processing block has a plurality of first video processing circuits disposed at a first video processing path, and is arranged for generating a first video output according to a first video input. The second video processing block has a plurality of second video processing circuits disposed at a second video processing path parallel with the first video processing path, and is arranged for generating an intermediate video output in response to a second video input, wherein an output signal of one of the first video processing circuits acts as the second video input fed into one of the second video processing circuits. The third video processing block is arranged for generating the second video output according to the intermediate video output.

Abstract: A video processing apparatus prevents image quality degradation, while reducing motion by combining high-frequency and low-frequency image data at the immediately preceding sub-frame at a first composite ratio ?, generating first-sub-frame image data. By combining low-frequency image data and high-frequency image data at a second composite ratio 1-?, image data is generated as second-sub-frame image data. Then, the second-sub-frame image data is output with their polarity inverted with respect to the first-sub-frame image data. The ratio ? is gradually decreased frame by frame at a first frame group, and the ratio ? is gradually increased frame by frame at a second frame group subsequent to the first frame group.

Abstract: A disclosed projection system includes a display that renders a video representing a sequence of original images each having a corresponding frame interval, and one or more viewing device(s). During each frame interval, multiple subimages are displayed that, in some cases, average together to approximate an original image corresponding to that frame interval. The viewing device(s) attenuate each of the subimages by a respective coefficient to synthesize a target image for each frame interval. The system may include additional viewing device(s) that apply attenuation coefficients to the subimages to synthesize a second, different target image for each frame interval. A described projection method includes displaying multiple subimages in each frame interval, and transmitting attenuation coefficients to the viewing device(s).

Abstract: An information presenting device includes: a first image generating unit configured to extract, from video data input by way of an input unit, a portion of the video data, and generate multiple main images; a second image generating unit configured to generate multiple sub-images from information correlated to the video data; and an image output unit configured to generate a display image, wherein the plurality of main images are placed in time sequence, and each of the plurality of sub-images are displayed in time sequence corresponding to the main images.

Abstract: A video processor and method for swiftly detecting swaps occurring between links during transmission of images by the dual-link system. A first image combiner unit combines an image D1 of a first link as an odd-numbered image, with an image of a second link, to generate a first combination image. A second image combiner unit combines an image of a second link as an odd-numbered image, with the image of the first link to generate a second combination image. An edge detector unit detects the horizontal edge of the first combination image and the second combination image. A judgment unit compares the number of triple edges in the first combination image and second combination image, and judges the combination image having more triple edges as the error image. The triple edges contain three consecutive edges along the horizontal direction, and the rising edges and falling edges are arrayed alternately.

Abstract: As information to be processed at an object-based video or audio-visual (AV) terminal, an object-oriented bitstream includes objects, composition information, and scene demarcation information. Such bitstream structure allows on-line editing, e.g. cut and paste, insertion/deletion, grouping, and special effects. In the interest of ease of editing, AV objects and their composition information are transmitted or accessed on separate logical channels (LCs). Objects which have a lifetime in the decoder beyond their initial presentation time are cached for reuse until a selected expiration time. The system includes a de-multiplexer, a controller which controls the operation of the AV terminal, input buffers, AV objects decoders, buffers for decoded data, a composer, a display, and an object cache.

Abstract: A video image transfer device includes a transfer section arranged to selectively transfer to a display device a plurality of video signals acquired from at least one image pickup device, an assigning section arranged to divide a refresh rate of the display device into portions and assign the portions among the plurality of video signals, and a transfer controller arranged to control the transfer section in such a manner that each of the video signals is transferred to the display device at a timing according to the portion of the refresh rate assigned to each of the video signals. This makes it possible to prevent a dropped frame and an insufficient resolution of an important video image.

Abstract: A method of processing on screen display data with an image post processor includes receiving a data stream from a video processor at a post processing device having at least one port, the data stream including on screen display data overlaid on a white background and the on screen display data overlaid on a black background, finding a difference between the on screen display data overlaid on white and the on screen display data overlaid on black, using the difference to determine a complement of an alpha blend value, performing image processing on the image data with the post processor by applying the complement of an alpha blend value to the image data to produce processed image data, and transmitting the processed image data and the on screen display data through a display port.

Abstract: A signal processing apparatus, comprising: an input section; a storage section; first and second signal processing sections; and a control section.

Abstract: Measurement of the relative timing between images and associated information, for example video and audio. Image mutual event characteristics are recognized in the images and associated mutual event characteristics are recognized in the associated information. The image mutual events and associated mutual events are compared to determine their occurrences, one relative to the other as a measure of relative timing. Particular operation with audio and video signals is described.

Abstract: A video layer effects processing system which receives normal video and special effects information on separate layers has been presented. The system selectively mixes various video layers to transmit a composite video signal for a video display such as a television, or a virtual reality system. Special effects include spotlights, zooming, etc. Additional special effects such as shaping of objects and ghost effects are created by masking and superimposing selected video layers. The selective mixing, for example, to enable or disable, strengthen or weaken, or otherwise arrange special effects, can be directed from a remote source or locally by a user through real-time control or prior setup. The video layer effects processing system can also be incorporated into a set-top-box or a local consumer box.

Abstract: Using a background-side image which is a shot of an arbitrary background and a material-side image which is a shot of a composition material against the same background, two images are compared to extract an image material to be composited. Images shot in any scenery can thus be used to extract a composition material, being part of the images, without using a certain background such as a blue screen.

Abstract: Disclosed is a method for replacing people in a scene of a film with other people by removing the original people with video space-time completion of the film and inserting the other people with video processing software with user input. The method segments automatically the film with the original people and segments automatically the film with the other people.

Abstract: A video processing system comprising a video frame buffer memory, a first video pipeline, a second video pipeline, a blender, and an overdrive processing unit. The video frame buffer memory has a first memory region and a second memory region, the first memory region being configured to store a first video data frame and the second memory region being configured to store a second video data frame. The first video pipeline is coupled to the video frame buffer memory and configured to receive and process the first video data frame. The second video pipeline is coupled to the video frame buffer memory and configured to receive and process the second video data frame. The blender is coupled to the first and second video pipelines and is configured to receive and blend the processed first video data frame and the processed second video data frame in a first mode of operation and to provide the blended processed first and second video data frame to a display.

Abstract: A plurality of input image signals are synthesized to generate a synthesis signal on the basis of synthesis information indicating an area where input image signals which are image signals of an image composed of at least one of input moving images and still images are respectively synthesized, a motion vector of the synthesis signal is detected, a synthesis interpolation exclusion area is decided where the interpolation in the synthesis signal is not performed on the basis of the synthesis information and interpolation control information indicating an input interpolation exclusion area where the interpolation in the respective input image signals is not performed, and a synthesis signal in-between signal is interpolated and output which is an image signal at an arbitrary time between the synthesis signal and a previous synthesis signal on the basis of the motion vector in an area other than the synthesis interpolation exclusion area.

Abstract: A multimedia device provided with an operating system (OS) capable of processing a plurality of graphic data comprises a first client receiving first graphic data of a managed application; a native module pre-processing an application drafted in a native code; a second client receiving second graphic data of the application pre-processed by the native module; a composite module compositing the first graphic data output from the first client and the second graphic data output from the second client; and a display module outputting the composited first and second graphic data, wherein the composite module is accessed to the first client and the second client.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: A video signal processing device that includes first and second input terminals and a size changer configured to change an image size of an image to be displayed based on a video signal input from the second input terminal. A mixer is configured to mix a video signal input from the first input terminal with a video signal that has passed through the size changer, and an output terminal is configured to output a video signal arising from mixing by the mixer.

Abstract: A signal synthesis section synthesizes a first input image signal and a second input image signal such that frames of a first input effective signal and of a second input effective signal, overlap between the frames being long, are synthesized.

Abstract: An aspect of the present invention reduces memory accesses while forming combined images of a subpicture frame with each of a sequence of image frames. In an embodiment, line information indicating the specific lines (e.g., rows) of the subpicture frame having display information is first generated. The line information is then used to retrieve only those lines of the subpicture frame that have display information while forming combined frames. According to another aspect, the portions of the combined images having sharp edges due to the inclusion of the subpicture frame are identified based on the line information, and such portions are then filtered. The sequence of combined frames may be displayed on a video output device.

Abstract: A system and method of geometrical predistortion of a graphical source signal is provided in which the graphical source signal is merged with an input video signal for display on a display device. The input video signal is received at a hardware scaler device and a predistorted video signal is generated there from. A warping map is calculated using a programmed processor and a graphics source signal is then predistorted, in software, using the warping map to generate a warped graphical overlay signal. The predistorted video signal from the hardware scaler is then merged with the warped graphical overlay signal from the programmed processor.

Abstract: An ambient, beautiful, entertaining visual experience that can be displayed on a TV requiring little or no user interaction beyond initiation. Multiple image layers that may be still or moving video, photos, etc, or a combination thereof can be overlaid on each other.

Abstract: As information to be processed at an object-based video or audio-visual (AV) terminal, an object-oriented bitstream includes objects, composition information, and scene demarcation information. Such bitstream structure allows on-line editing, e.g. cut and paste, insertion/deletion, grouping, and special effects. In the interest of ease of editing, AV objects and their composition information are transmitted or accessed on separate logical channels (LCs). Objects which have a lifetime in the decoder beyond their initial presentation time are cached for reuse until a selected expiration time. The system includes a de-multiplexer, a controller which controls the operation of the AV terminal, input buffers, AV objects decoders, buffers for decoded data, a composer, a display, and an object cache.

Abstract: Provided are a method, system, and article of manufacture for generating a video output by combining a first video input and a second video input. A first input image is accessed from the first video input and a second input image is accessed from the second video input, wherein the second input image includes a selected element recorded in front of a monochromatic background. A first region and a second region are generated from the first input image. An output image that includes the first region and the second region with a gap separating the first region from the second region is generated. The selected element is placed at least over the gap in the output image, wherein predetermined areas of the first region and the second region remain visible in the output image. The output image is included in the video output.

Abstract: Various embodiments of separating a picture part of interest from an arbitrary background are described. The background may be a moving or still frame. The picture part of interest and background frames may be in or out of focus. One separation approach employs the difference between luminance and chrominance values of the input and background frames where changes in luminance from frame to frame are compensated for. In another approach, picture part of interest separation is based on spatial resolution differences between the background and the picture part of interest frames. Parameter matching can also be performed for the picture part of interest and the basic picture into which the picture part of interest is embedded. Further, a separated picture part of interest can be embedded into a basic picture containing text.

Abstract: System and method for multistage frame rate conversion. A method comprises receiving an incoming frame at a first frame rate, and determining whether a fault condition exists. The method also includes if the fault condition does not exist, toggling a write buffer pointer from a first frame buffer to a second frame buffer, and storing the incoming frame in the second frame buffer. The method additionally includes if the fault condition exists, determining whether a previously received frame was repeated, discarding the incoming frame if the previously received incoming frame was not repeated, and storing the incoming frame in one of the frame buffers pointed to by the write buffer pointer if the previously received incoming frame was repeated.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map but not effective at presenting local detail. In contrast, street -side images show excellent detail but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: A System for video and audio real-time communication among a large Community of members connected to Internet via local computers, cell phone or iPads with a webcam and a Central Computer System. The User's Devices and the Central Computer System are made of commercially available hardware and they run standard software plus proprietary software described in this patent. The Proprietary Software, VRTCOS, runs in the Central Computer System. All the users have a Community ID and a Profile. Upon request, every user is presented with the video and audio signals from a subset of the Community's members, the User's Neighborhood, in only one video stream. Neighborhood of 30 users can be achieved with a Central Computer System of average power. The technology allow to develop a large set of application for video-based Social Networking.

Abstract: The present invention is directed to provide an AV processing device and the like that allow mixing three or more AV signals through easy operation. According to the invention, an AV processing device 30 includes an input unit 310 inputting three or more AV signals that are audio signals or video signals, a coordinate point assigning unit 322 assigning a given coordinate point in a predetermined two-dimensional region in which a coordinate axis for each input AV signal indicating its mixing rate from minimum to maximum is virtually assigned, a mixing rate calculator 331 calculating the mixing rate of each AV signal based on the coordinate axis for the AV signal and the assigned coordinate point, a mixed AV signal generator 332 generating mixed AV signals based on the calculated mixing rate of each AV signal, and an output unit 350 outputting the generated mixed AV signals.

Abstract: Provided is a moving picture processing method which prevents degradation of subjective image quality caused by a motion of a moving picture. The moving picture processing method includes the following steps: a motion compensation step (S116) of shifting a noise indicated by a stored noise signal (FMN) according to a motion of a moving picture indicated by an input image signal (VIN), by performing motion compensation on the stored noise signal (FMN) that is used for superimposition on a picture indicated by an input image signal (VIN) and is stored in a noise frame memory (102); and a superimposition step (S120) of superimposing the shifted noise, as a superimposition noise signal SN, onto a current picture to be processed which is indicated by an input image signal (VIN) and is a moving picture that appears after the motion has occurred.

Abstract: A system includes determination of a first graphic overlay associated with a first video feed, and automatic determination a second graphic overlay to associate with a second video feed based on the determined first graphic overlay. Determination of the first graphic overlay may include detection of a first manipulation of a first user interface of a first application executing on a first computing system, and automatic determination of the second graphic overlay may include execution of a second manipulation of a second user interface of a second application executing on a second computing system. In further aspects, the second manipulation corresponds to the first manipulation.

Abstract: The system relates to a method for merging surveillance imagery to provide enhanced situational awareness. In one aspect of the method, near real time video from an unmanned aerial done is merged with existing imagery from a database. The method also contemplates writing the merged images into a Keyhole Markup Language (KML) Zip (KMZ) file to permit the merged images to be viewed by an Earth browser.

Abstract: According to some embodiments, encoded information associated with an image is received at a decoder. The encoded information may be decoded at the decoder to generate full-sized first image pixels representing a full-sized version of the image. Moreover, the full-sized pixels may be scaled at the decoder to generate scaled image pixels representing a scaled version of the image.

Abstract: A video processing apparatus in which image quality degradation, such as burn-in, is prevented while reducing motion blurs by implementing pseudo-impulse driving. By combining high-frequency image data and low-frequency image data at the immediately preceding sub-frame at a first composite ratio ?, image data is generated as first-sub-frame image data. By combining low-frequency image data and high-frequency image data at a second composite ratio 1??, image data is generated as second-sub-frame image data. Then, the second-sub-frame image data is output with their polarity inverted with respect to the first-sub-frame image data. The ratio ? is gradually decreased frame by frame at the first frame group, and the ratio ? is gradually increased frame by frame at the second frame group subsequent to the first frame group.

Abstract: An image display control apparatus is disclosed. The image display control apparatus stores first layers for original image data in first planes, combines the first layers into the original image data, records the original image data in an addition plane, and stores second layers for replacement image data in second planes. The second layers in the second planes and the original image data in the addition plane are respectively, synchronously and cyclically inputted to a compositing circuit so that the compositing circuit combines the second set of layers into the replacement image data. In the synchronous and cyclical input, the display of the display device is switched from the original image data to the replacement image data while a manner of combining the original image data and the replacement image data is being gradually changed between consecutive frames.

Abstract: A video processing system which may include a first video input configured to receive a first georeferenced video feed from a first video source, and a second video input configured to receive a second georeferenced video feed from a second video source, where the second georeferenced video feed overlaps the first georeferenced video feed. The system may further include a video processor coupled to the first and second video inputs. The video processor may include an annotation module configured to generate an annotation for an object in the first georeferenced video feed, and a geospatial correlation module configured to geospatially correlate the annotation to the object in the second georeferenced video feed overlapping the first georeferenced video feed.

Abstract: A system and method for a low complexity and robust spatiotemporal combining for video enhancement is disclosed. In one embodiment, the method includes computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in a video sequence, computing an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame, computing a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate, and combining the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frame using the computed temporal weighting factor.

Abstract: A video processing apparatus can receive video at two different rates, which may be High Definition video and Standard Definition Video. The input video is stored and read into a processor at a fixed internal rate for processing at that rate. Processed video is output to a further store from which it can be read at either of the input rates.

Abstract: A video signal processing device includes: a first video signal processing section performing a first process on an input video signal for displaying a composite image that is a combination of a natural image and an artificial image, the first process being performed on pixels in a region larger than an artificial image combining region and being a process on which pixels within the combining region have influence; a second video signal processing section performing a second process on the input video signal, the second process being performed on pixels in a region larger than the combining region and being a process on which pixels within the combining region have no influence; and a process restricting section restricting the first process in a first region overlapping and encompassing the combining region and restricting the second process in a second region which is identical to the artificial image combining region.

Abstract: A video layer effects processing system which receives normal video and special effects information on separate layers has been presented. The system selectively mixes various video layers to transmit a composite video signal for a video display such as a television, or a virtual reality system. Special effects include spotlights, zooming, etc. Additional special effects such as shaping of objects and ghost effects are created by masking and superimposing selected video layers. The selective mixing, for example, to enable or disable, strengthen or weaken, or otherwise arrange special effects, can be directed from a remote source or locally by a user through real-time control or prior setup. The video layer effects processing system can also be incorporated into a set-top-box or a local consumer box.

Abstract: Techniques are described herein for combining video frames of two or more real-time video streams into combined video frames of a combined real-time video stream for continuous presence. Video frames of at least two real-time video streams are combined into combined video frames of a combined video stream. The combined video stream is supplied to a video display for displaying the combined video stream. Each video stream includes video frames with subject and background images. The subject images of corresponding video frames of the first and second video streams are combined into a combined video frame of a combined video stream such that the subject image of the first video stream is positioned in an anterior portion of the combined frame and the subject image of the second video stream is positioned in a posterior portion of the combined frame.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map, but not effective at presenting local detail. In contrast, street-side images show excellent detail, but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps, and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: A system and method for volumetric display of video images extracted from arbitrary background environments comprising an arrangement for extracting a video image in real time from an arbitrary background and creating a stream of extracted image data in response thereto and a free space or volumetric display operationally adapted to display the stream.

Abstract: There is performed processing for displaying content on a video image so that the content is superimposed on the video image without blocking an important portion of the video image.

Abstract: A control system for controlling video and audio parameters of a display device and a play device is provided. An OSD system of the play device and an OSD system of the display device receive OSD signals respectively. The OSD signals are transmitted between the play device and the display device through a bus. Therefore, the video and audio parameters are controlled synchronously by the OSD signals. Furthermore, displayed images and sound are controlled as well.

Abstract: A method of adding a virtual insertion to an image, according to an embodiment, includes extracting dynamic features from an input image, associating the dynamic extracted features with dynamic reference features in a reference feature database, generating a camera model based on the associations, mixing a virtual insertion into the input image based on the camera model, and outputting an image containing both the input image and the virtual insertion. According to another embodiment, a method of adding a virtual insertion to an image includes generating a biased camera model using a statistically selected subset of a plurality of non-fixed regions of the image, locating fixed reference objects in the image, using the biased camera model as an entry point for a search, generating a corrected camera model using the fixed reference objects in the image, and adding a virtual insertion to the image using the corrected camera model.

Abstract: A system and method for displaying multiple images on a single display. A plurality of unique video sources may be provided where each video source provides video frames having a plurality of vertical lines. A portion of the vertical lines are captured for each video source and transmitted to the display. The partial video frames may then be re-assembled into a single video frame which can be shown on the display. The display contains a masking where only certain vertical lines are viewable at certain angles. The masking may allow two or three images to be simultaneously visible to the observer, depending on the angle of viewing the display. Wireless or wired transmission may be used. Some embodiments also use a sound focusing device which may be synced with the video source so that separate sound messages can also be observed depending on the angle of viewing the display.

Abstract: A video mixer is employed to form a transition between two video compositions, for example a fade or a wipe. A video storage device is associated with the video mixer and plays out a video signal, the timing of which is controlled in dependence upon the progress of the transition made by the said video mixer.

Abstract: An image processor for combining video data and graphic data is provided. The image processor includes a scaler that is configured to scale compressed graphic data in a horizontal direction using bilinear scaling, to scale a horizontally scaled graphic data in a vertical direction using line copy, and to process a data value of a pixel at a border of a vertically scaled graphic data based on a data value of the compressed graphic data and a data combiner that is configured to combine video data with processed graphic data output from the scaler.