Abstract: A virtual three-dimensional presentation in accordance with the present invention includes three stereoscopic layers, a stereoscopic background layer, a stereoscopic video insert layer, and a stereoscopic three-dimensional foreground layer. A surface, the Z-sphere, is defined in the virtual three-dimensional space of the three-dimensional scene with reference to the aim point, the distance between the cameras, and the distance from the camera of the video scene, of a virtual stereoscopic camera looking at the three-dimensional scene being created. The separation of the virtual stereoscopic camera lens and distance to the aim point are set based on the stereoscopic cameras that are creating the video insert layer. The stereoscopic three-dimensional foreground layer scene may include a key which defines the transparency of objects in the foreground layer.

Abstract: Generally, this disclosure provides methods and systems for real-time video communication with three dimensional perception image rendering through generated parallax effects based on identification, segmentation and tracking of foreground and background layers of an image. The system may include an image segmentation module configured to segment a current local video frame into a local foreground layer and a local background layer and to generate a local foreground mask based on an estimated boundary between the local foreground layer and the local background layer; a face tracking module configured to track a position of a local user's face; a background layer estimation module configured to estimate a remote background layer; and an image rendering module configured to render a 3D perception image based on the estimated remote background layer, the current remote video frame and the remote foreground mask.

Abstract: Methods and systems for video blurring in a secure environment are described. In one embodiment, the method includes receiving video at a video visitation device in a secure environment, adjusting a depth of field parameter for the video, such that an image of a first object at a first distance from the video visitation device is in focus and an image of a second object at a second distance from the video visitation device is blurred, and providing the video to a viewing device located outside of the secure environment.

Abstract: A display system combines a graphic plane and a video overlay plane using color keys in the graphics plane. By time-averaging patterns of color keys in successive frames of the graphics plane, individual pixels of the graphics plane can be made to appear partially transparent. Using this technique, regions in the graphics plane (e.g., a menu) can be partially transparent with respect to the video overlay, and aliasing can be reduced by making selected pixels in the graphics plane partially transparent.

Abstract: A projector that modulates light emitted from a light source and projects the modulated image light on a projection surface, the projector including: an object detection unit for determining the position of an object that blocks projection of the image light; a distance detection unit for determining the distance to the object; and a projection control unit for determining an avoidance area where the object prevents the image light from reaching the projection surface based on the position of the object determined by the object detection unit and the distance to the object determined by the distance detection unit and projecting the image light in an area other than the avoidance area.

Abstract: A non-transitory computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps that include analyzing an image, identifying one or more faces in the image using a face recognition technique, designating at least one of the identified faces collectively as a first area of interest, and determining whether an insertion area exists in the image where additional content can be inserted without obstructing the first area of interest. Another computer program is adapted to cause a processor based system to execute steps that include determining whether the insertion area can be divided into two or more regions based on color. Methods and processor based apparatuses that perform one or more of these steps are also disclosed.

Abstract: The present invention ensures the visibility of a character or a drawing displayed on a screen. The illuminance of one or more partial areas forming a display unit is measured, and a video display position is set to an area except for the partial area where the illuminance is a reference value or more.

Abstract: A method for embedding an image in a video sequence for a mobile terminal. Preferably, the mobile terminal is a tablet or smartphone. The method comprises the steps of choosing an image to be embedded, reading the video sequence, displaying a frame, and determining the presence of an embedding zone in the frame. The embedding zone having been previously identified or deduced according to a predefined algorithm. The method further comprises the step of applying a deformation to the image to be embedded such that the image to be embedded coincides with the form of the embedding zone. The image combining the frame and the image to be embedded is displayed/disposed in place of the embedding zone.

Abstract: Stage props, such as consumer products, in legacy program content are replaced with dynamically replaceable assets. Such assets can be used for advertising purposes in that images of different products and services can be inserted therein and are changeable via a network. Such assets may be created by identifying props in the content for replacement, and determining location and visual effects information for each identified prop. The content may be played back by broadcasting the content and reference information designating parameters for inserting the assets into the content. Replacement images, such as images of products, may be obtained via a network. The visual appearance of each replacement image may be modified using visual effects information so the inserted objects appear natural as if they were part of the original scene.

Abstract: Multi-mode decoding and encoding of texture blocks are disclosed wherein in a default decoding and encoding mode all bits of a codeword sequence are available as payload bits for representing texel values of the texels in the texture block. In an auxiliary encoding and decoding mode one less bit of the codeword sequence is available as payload bits. The auxiliary mode is employed as a complement to the default mode and will be used to process those texture blocks, which the default mode handles poorly.

Abstract: It is a task to provide a mobile electronic device with high operability and high safety. The mobile electronic device includes an image projector that projects an image, a detector that detects a specific change in an irradiation area of light irradiated from the image projector or in a predetermined area including the irradiation area, and a control unit that controls the operation of the image projector. The task is solved in such a manner that when the detector detects the specific change, the control unit causes the image projector to stop emission of light therefrom, or to reduce an amount of light emitted therefrom.

Abstract: Techniques are described herein for combining video frames of two or more real-time video streams into combined video frames of a combined real-time video stream for continuous presence. Video frames of at least two real-time video streams are combined into combined video frames of a combined video stream. The combined video stream is supplied to a video display for displaying the combined video stream. Each video stream includes video frames with subject and background images. The subject images of corresponding video frames of the first and second video streams are combined into a combined video frame of a combined video stream such that the subject image of the first video stream is positioned in an anterior portion of the combined frame and the subject image of the second video stream is positioned in a posterior portion of the combined frame.

Abstract: Moving objects are classified based on maximum margin classification and discriminative probabilistic sequential modeling of range data acquired by a scanner with a set of one or more 1D laser line scanner. The range data in the form of 2D images is pre-processed and then classified. The classifier is composed of appearance classifiers, sequence classifiers with different inference techniques, and state machine enforcement of a structure of the objects.

Abstract: A method to create a faux group by using at least one digital image combined with at least one other digital image is provided. Associated with each digital image is data that is linked, which identifies the image and biographical data elements associated with the subject appearing in the image. From the digital images and linked data, a faux group image is created. On the faux group image, biographical data elements such as names or other identifiers are optionally displayed. If displayed, each biographical data element is linked to the associated individual digital image in the order it appears. Any rearrangement, movement or adjustment to either the digital image or associated biographical data element in the faux group image causes the digital image and biographical data element to be updated relative to all of the other digital images and biographical data element in the order that the subject of each individual digital image appears.

Abstract: A mosaic image which encourages users' motivation of continuously browsing mosaic images is generated. An image generation device which generates a mosaic image using as a source image a material image divided into a plurality of divided areas, has: an acquiring means that acquires an image from a terminal device through a network; and a mosaic image generating means that generates a mosaic image by allocating the image acquired by the acquiring means, to one of the divided areas based on color information of the image acquired by the acquiring means and color information of each of the divided areas of the material image used as the source image. After generating the mosaic image, the mosaic image generating means generates a new mosaic image by changing at least one of a number of the divided areas and the material image in response to an increase in a number of images acquired by the acquiring means.

Abstract: The present invention provides a method, apparatus and system of content creation, content post processing, new image capture and image composition whereby alternate images or video content may be selectively integrated into an original video in real time. In the present invention, sufficient metadata is created at the time of the creation of the original video content to both describe objects/areas in the original video that are available for integration of alternate images/video and to provide a means of controlling the alternate video capture and processing to fit the alternate image/video into the areas in the original video defined as available for integration of alternate image/video. The result is a mechanism whereby personal/alternate video/images may be integrated with existing video content, such as in one embodiment, music videos (e.g., video Karaoke), games, broadcast video, DVD videos, and the like, in real time.

Abstract: A process and system that allows an end user to insert images into a video content so that the images appear part of that content. This allows a consumer to seem to be part of a video, and interact with the famous personalities in that video. A video content is produced and a first software program is used to insert place holding templates into the video content. The end user produces a video image satisfying the requirements of the inserted template, and a second software program composites the two video streams so that the end user's video image is inserted into the first video content replacing the templates. The system can also be used to insert advertising information into a background to create custom, personalized, “on the fly” advertisements and product placements.

Abstract: An image processing system computes blended pixel data from two image layers and ?-layer data. ?-layer data indicates a transparency of one of the image layers. The image processing system includes more than one memory capable of storing pixel data. A processor is programmed to apply different processing methods to pixel data based on their storage locations. A selector may obtain pixel data from each image layer and the ?-layer data. The selector may transmit the pixel data to one of the multiple memories based on the ?-layer data.

Abstract: A first image is provided to a projector, which is configured to project the first image on a projection screen. A captured first image is received from a camera configured to capture the projected first image and an occluding object between the projector and the projection screen. A key including a difference between the captured first image and the first image is generated. A second image is modified according to the key to generate a new second image. The new second image is provided to the projector, which is further configured to project the new second image.

Abstract: The present invention discloses a video communication device and a method thereof, the method comprises: obtain a current battery energy level of a device; load information of the battery energy level to a ready-to-send video; execute video encoding to the ready-to-send video and sending the same. The present invention can display the information of the energy level of one party's device on the video communication image of another party's device, so that another party can realize the actually current battery energy level of one party's device, tempos of the video communication can be controlled well, effects of the video communication can be raised.

Abstract: A method and apparatus for maintaining smooth video transition between distinct applications includes a processor, a secondary memory and a system memory. In providing a smooth transition between applications, the apparatus and method provides synchronization of the video and graphics components while transitioning from a first application to a second application. If there is no video component in either application, no action is needed to provide a smooth transition between applications, and when only the first application includes a video component, the video component need only be turned off for smooth transition between the applications to occur. When both the first application and the second application include video components, smooth transition between the applications is dependent upon the display window size of the first application in comparison to the second application. A process is triggered according to the size of the display windows of the first and second applications.

Abstract: A method for determining a quotient value from a dividend value and a divisor value in a digital processing circuit is provided. The method includes computing a reciprocal value of the divisor value and multiplying the reciprocal value by the dividend value to obtain a reciprocal product, the reciprocal product having an integer part. The method also includes computing an intermediate remainder value by computing a product of the integer part and the divisor value, and subtracting the resulting product from the dividend value and determining the quotient value based upon the intermediate remainder value.

Abstract: A method for use with content includes analyzing a sequence of frames of the content, determining whether an area exists in a scene depicted by the sequence of frames where additional content such as advertising can be inserted without obstructing activity in the scene, for any such area, determining an amount of time that the area is available when the sequence of frames is being played, and for any such area, determining a size of the area. A storage medium storing a computer program for causing a processor based system to execute these steps and an apparatus for use with content are also disclosed.

Abstract: A method and a portable device controls output of a display unit to display information accurately and clearly regardless of a background image. Disclosed is an arrangement for calculating a difference between an arbitrary expression value of an arbitrary screen configuration element to be displayed on a given area of the background image and an actual expression value of the given area of the background image. Each expression value includes at least one of a color and lightness. The arrangement automatically selects the expression value of the screen configuration element based on the calculation result. The screen configuration element is displayed at the given area of the background image based on the selected arbitrary expression value.

Abstract: An alpha matte is generated from image forming elements of an image. For each of one or more of the image forming elements: a respective representative foreground value is determined from one or more of the image forming element values; the respective representative foreground value and the value of the image forming element are normalized with respect to a threshold level; and a respective value of the alpha matte is generated from an evaluation of the normalized image forming element value in relation to the normalized representative foreground value.

Abstract: A display device that comprises a flag memory containing state flags of pixel areas of the image is provided. The display device comprises a display screen and a graphical generation unit implementing at least three functions for displaying an image, i.e. a first data erasure function, a second function for generating an image comprised of pixels in a first memory, and a third function for displaying the image by reading the pixels in said memory and controlling the screen, in which an image is divided into a plurality of separate pixel areas and in that each area is addressed by a flag, wherein the display device further includes a memory that stores the flag states so that the graphical generation unit can execute the display function on the basis of the flag states. The generation of images having a predominantly uniform background can, in particular, be used for application in aeronautics.

Abstract: An imaging device of the present invention comprises an imaging section for forming a subject image and outputting image data, a face detection section for detecting a person's face based on the image data, a decoration image selection section for selecting a decoration image from a plurality of decoration image data, in accordance with a face detected by the face detection section, and a first combining section for combining the selected decoration image and the face image. Also, an image composition and display device of the present invention comprises a storage section for storing image data, a decoration image selection section for selecting a decoration image from a plurality of decoration image data, in accordance with a face detected from image data, and a first combining section for combining the selected decoration image and the face image.

Abstract: The present invention discloses a video communication device and a method thereof, the method comprises: obtain a current battery energy level of a device; load information of the battery energy level to a ready-to-send video; execute video encoding to the ready-to-send video and sending the same. The present invention can display the information of the energy level of one party's device on the video communication image of another party's device, so that another party can realize the actually current battery energy level of one party's device, tempos of the video communication can be controlled well, effects of the video communication can be raised.

Abstract: Stage props, such as consumer products, in legacy program content are replaced with dynamically replaceable assets. Such assets can be used for advertising purposes in that images of different products and services can be inserted therein and are changeable via a network. Such assets may be created by identifying props in the content for replacement, determining location and visual effects information for each identified prop, and creating a reference file that includes the content and the location and the visual effects information associated with each identified prop. A value may be determined for each asset or advertisers may bid on the assets to yield additional advertising revenue channel for the content. The content may be played back by broadcasting the content and reference information designating parameters for inserting the assets into the content. Replacement images, such as images of products, may be obtained via a network.

Abstract: An apparatus, system, and method are disclosed for providing social content and/or interaction. A content tracking module is configured to track content displayed at multiple locations on an electronic display. An individual tracking module is configured to track one or more individuals in multiple video feeds of observing areas at the multiple locations. The multiple video feeds include a first video feed and a second video feed. A change detection module is configured to detect a change in expression and/or a body movement in at least one individual in the first video feed and an overlay display module is configured to initiate display of an image of the at least one individuals overlaying the content displayed at a location of the second video feed.

Abstract: A method for displaying a video image includes acquiring foreground information about a video image to be output, where the foreground information includes information that defines a size of a foreground picture. The method further includes determining an adjustment coefficient for the foreground picture according to the size of the foreground picture, a size and a resolution of a display device, and a preset adjustment rule. The preset adjustment rule indicates that the product of the adjustment coefficient for the foreground picture and a zooming multiple for display on the display device is equal to a fixed constant. The method also includes adjusting the video image to be output according to the adjustment coefficient for the foreground picture, and outputting, to the display device for display, the video image after adjustment.

Abstract: Multi-mode decoding and encoding of texture blocks are disclosed wherein in a default decoding and encoding mode all bits of a codeword sequence are available as payload bits for representing texel values of the texels in the texture block. In an auxiliary encoding and decoding mode one less bit of the codeword sequence is available as payload bits. The auxiliary mode is employed as a complement to the default mode and will be used to process those texture blocks, which the default mode handles poorly.

Abstract: Several implementations provide inpainting solutions, and particular solutions provide spatial and temporal continuity. One particular implementation accesses first and second pictures that each include a representation of a background. A background value is determined for a pixel in an occluded area of the background in the first picture based on a source region in the first picture. A source region in the second picture is accessed that is related to the source region in the first picture. A background value is determined for a pixel in an occluded area of the background in the second picture using an algorithm that is based on the source region in the second picture. Another particular implementation displays a picture showing an occluded background region. Input is received that selects a fill portion and a source portion. An algorithm fills the fill portion based on the source portion, and display the resulting picture.

Abstract: An image processing apparatus and an image processing method blurs a background portion of an image. The image processing apparatus includes an image acquiring unit for acquiring original image data; an image processing unit for separating background pixels from foreground pixels in the original image; an image filtering unit for filtering the background pixels; and an image merging unit for merging the foreground pixels with the filtered background pixels in order to generate a new image having a blurred background.

Abstract: Provided are techniques for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera. The first photograph is called the “naked photo.” Using a graphics program, photos subsequent to the naked photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the naked photo as layers. The modified naked photo, including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the naked photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.

Abstract: Methods, systems, products and devices are implemented for editing video image frames. According to one such method, image content is embedded into video. A selection input is received for a candidate location in a video frame of the video. The candidate location is traced in subsequent video frames of the video by approximating three-dimensional camera motion between two frames using a model that compensates for camera rotations, camera translations and zooming, and by optimizing the approximation using statistical modeling of three-dimensional camera motion between video frames. Image content is embedded in the candidate location in the subsequent video frames of the video based upon the tracking thereof.

Abstract: A method, system and computer readable media for real-time chromakey matting using image statistics. To identify the chroma key spectrum, the system/method executes in three stages. In an off-line training stage, the system performs semi-automatic calibration of the chroma key parameterization. In the real-time classification stage, the system estimates the alpha matte on a GPU. Finally, an optional error minimization stage improves the estimated matte, accounting for misclassifications and signal noise. Given the resulting matte, standard alpha blending composites the virtual scene with the video feed to create the illusion that both worlds coexist.

Abstract: A video source, a display and a method of processing multilayered video are disclosed. The video source decodes a multilayered video bit stream to transmit synchronized streams of decompressed video images and corresponding overlay images to an interconnected display. The display receives separate streams of video and overlay images. Transmission and reception of corresponding video and overlay images is synchronized in time. A video image received in the display can be selectively processed separately from its corresponding overlay image. The video image as processed at the display is later composited with its corresponding overlay image to form an output image for display.

Abstract: The method and apparatus for generating an adaptive chroma key includes taking into consideration foreground object information during the creation of a composite scene. The luminance and chrominance of an area of interest between a foreground key and a background scene are considered and accounted for during the created of the composite scene.

Abstract: A method for use with content includes analyzing a sequence of frames of the content, determining whether an area exists in a scene depicted by the sequence of frames where additional content such as advertising can be inserted without obstructing activity in the scene, for any such area, determining an amount of time that the area is available when the sequence of frames is being played, and for any such area, determining a size of the area. A storage medium storing a computer program for causing a processor based system to execute these steps and an apparatus for use with content are also disclosed.

Abstract: Intelligent resource state memory recall techniques, and associated apparatus and methods, are disclosed. States of one or more video switcher resources in a resource state memory may be recalled to the same or different resources, depending on resource availability at the time of memory recall. A memory recall need not affect an on air signal. The memory may be recalled to recreate a desired program output, as defined in the memory, on a preview output of the video switcher, which leaves a current program output of the video switcher undisturbed when the memory is recalled.

Abstract: The present disclosure includes, among other things, systems, methods and program products for generating a clean reference frame image. A method includes obtaining a color census of a color image. A color profile is selected based on the color census. One or more foreground areas of the image are identified, the foreground areas comprising image areas containing colors that do not fit the color profile. For each identified foreground area, a color is applied to the identified foreground area based on one or more colors of one or more non-identified image areas to create a clean reference image.

Abstract: A system and a method for facilitating transitions between video streams is provided. The method includes the steps of: (i) receiving a primary video stream that includes a first primary video stream portion and a second primary video stream portion, wherein the second stream portion follows the first primary video stream portion; (ii) receiving a secondary video stream; processing at least one of the primary video stream and the secondary video stream to facilitate a seamless transition, at a multiple tuner device, between the first primary video stream portion and the secondary video stream; (iii) transmitting the primary video stream to a first tuner of the multiple tuner device; (iv) transmitting the secondary video stream to a second tuner of the multiple tuner device; and (v) instructing the multiple tuner device to perform a seamless transition between the first primary video stream portion to the secondary video stream.

Abstract: In a method of realism assessment of an image composite, the foreground and the background are transformed into a color space, such as YCbCr, followed by projecting the foreground and the background to a subspace represented by the axes representing chromatic information. The image composite is assessed in the projected subspace, according to linearity of color distributions of the foreground/the background, or according to distance between the color distributions of the foreground/the background and a center of the transformed color space.

Abstract: A method of processing on screen display data with an image post processor includes receiving a data stream from a video processor at a post processing device having at least one port, the data stream including on screen display data overlaid on a white background and the on screen display data overlaid on a black background, finding a difference between the on screen display data overlaid on white and the on screen display data overlaid on black, using the difference to determine a complement of an alpha blend value, performing image processing on the image data with the post processor by applying the complement of an alpha blend value to the image data to produce processed image data, and transmitting the processed image data and the on screen display data through a display port.

Abstract: The invention relates to a device and method for detecting changes in background of successive images. More particularly, the invention relates to a device and method for detecting changes in background of successive images by obtaining vertically accumulated values and horizontally accumulated values from multiple binary images of previous image and current image, obtaining pairs of rows and pairs of columns based on the vertically accumulated values and horizontally accumulated values, and transforming pairs of rows and pairs of columns using Hough transformation. Also, the invention relates to an interface system including background changes detecting device and display device connected to the background changes detecting device.

Abstract: Systems and methods provide drag-and-drop pasting for seamless image composition. In one implementation, a user casually outlines a region of a source image that contains a visual object to be pasted into a target image. An exemplary system automatically calculates a new boundary within this region, such that when pasted at this boundary, visual seams are minimized. The system applies a shortest path calculation to find the optimal pasting boundary. The best path has minimal color variation along its length, thus avoiding structure and visual objects in the target image and providing the best chance for seamlessness. Poisson image editing is applied across this optimized boundary to blend colors. When the visual object being pasted has fine structure at its border that could be truncated by the Poisson editing, the exemplary system integrates the alpha matte of the visual object into the Poisson equations to protect the fine structure.

Abstract: Apparatus and methods are disclosed for modifying video based on user input and or face detection data received with a mobile device to generate foreground regions (e.g., to separate a user image from background in the video). According to one disclosed embodiment, a method comprises receiving user input and/or face regions generated with a mobile device, producing an initial representation for segmenting input video into a plurality of portions based on the user input, where the initial representation includes probabilities for one or more regions of the input video being designated as foreground regions or background regions. Based on the initial representation, input video is segmented by designating one or more of the regions of the input video as foreground regions or background regions.

Abstract: Provided are a method for extracting a correlation to generate 3D motion data, and a motion capture system and method using the extracting method to easily compose a humanoid character on a real background image. Cameras for motion capture are installed in a real background capture location (such as an outdoor location or in a studio), and the correlation between motion capture fixed cameras and a moving camera for capturing a real background image is obtained to capture 3D motion data prior to performing motion capture for integrating a humanoid character, so that even when there is interaction between a 3D figure and an actual prop such as a chair or table within the captured space, a humanoid character can easily be composed with the real background.

Abstract: A method for achieving segmentation of a picture according to one aspect of the present invention comprises: determining a first foreground of a picture based on a predetermined mask; applying Gaussian Mixture Models with weighted data (GMM-WD) to the first foreground to generate a second foreground; determining a first background of the picture based on the second foreground; applying the GMM-WD to the first background to generate a second background; and determining an unknown region based on the second background and the second foreground.