Abstract: A computer implemented method can decode a frame of video data comprising an array of pixels to obtain decoded luma values and decoded chroma values corresponding to the array of pixels, and extract a frame mask based on the decoded luma values. The frame mask can include an array of mask values respectively corresponding to the array of pixels. A mask value indicates whether a corresponding pixel is in foreground or background of the frame. The method can perform a morphological operation to the frame mask to change one or more mask values to indicate their corresponding pixels are removed from the foreground and added to the background of the frame. The method can also identify foreground pixels after performing the morphological operation to the frame mask, and render a foreground image for display based on the decoded luma values and decoded chroma values of the foreground pixels.

Abstract: Various embodiments disclosed herein relate to systems and methods for image matching involving the segmentation of images into regions and then defining and computing features of these regions to further identify geometrical relationships between the regions.

Abstract: An image signal is subjected to image correction performed by an image correction unit on the basis of retinex processing. The image correction unit performs spectral decomposition for the image signal. A retinex unit performs retinex processing for the image signal subjected to the spectral decomposition, and a spectrum synthesis unit synthesizes the image signal output from the retinex unit. A transformation unit performs transformation from a RGB color space to a HSV color space, and an inverse transformation unit performs transformation from the HSV color space to the RGB color space. The transformation unit transforms an input image signal and outputs the transformed image signal to the spectral decomposition unit. The inverse transformation unit receives the output signal from the spectrum synthesis unit and outputs an image correction signal. Spectral decomposition of the image signal in the spectral decomposition unit is hue-based spectral decomposition in the HSV color space.

Abstract: An image processing apparatus includes an acquisition unit configured to acquire a bitmap image in which each of contained pixels has an alpha value indicating opacity of this pixel, and a rendering unit configured to render the bitmap image. The rendering unit is configured to, when rendering the bitmap image, refrain from performing alpha blending on a pixel contained in the bitmap image that has a specific alpha value and perform the alpha blending on a pixel contained in the bitmap image that has a different alpha value from the specific alpha value.

Abstract: An image processing method includes the following steps. An original image is read, and the original image includes a red channel layer, a green channel layer and a blue channel layer. A processing is performed on the red channel layer, the green channel layer and the blue channel layer, respectively, to get a derived red channel layer, a derived green channel layer and a derived blue channel layer. And the derived red channel layer, the derived green channel layer and the derived blue channel layer are combined to form a new image. The processing includes the following steps. Gradient-variations of a plurality of directions of a region are calculated. An average of the gradient-variations is calculated. A calculating procedure is provided to decide diffusion-coefficient equations of the directions, and each of the diffusion-coefficient equations is substituted into an anisotropic diffusion equation.

Abstract: Aspects of the present invention are related to systems and methods for determining local-analysis-window size and weighting parameters in a gradient-based motion estimation system.

Abstract: System and method can support an image processing device. The image processing device operates to obtain a first set of characterization values, which represents a first group of pixels that are associated with a denoising pixel in an image. Also, the image processing device can obtain a second set of characterization values, which represents a second group of pixels that are associated with a denoising reference pixel. Furthermore, the image processing device operates to use the first set of characterization values and the second set of characterization values to determine a similarity between the denoising pixel and the denoising reference pixel. Then, the image processing device can calculate a denoised value for the denoising pixel based on the determined similarity between the denoising pixel and the denoising reference pixel.

Abstract: A method of generating three-dimensional (3D) volumetric data may be performed by generating a multilayer image, generating volume information and a type of a visible part of an object, based on the generated multilayer image, and generating volume information and a type of an invisible part of the object, based on the generated multilayer image. The volume information and the type of each of the visible part and invisible part may be generated based on the generated multilayered image which may be include at least one of a ray-casting-based multilayer image, a chroma key screen-based multilayer image, and a primitive template-based multilayer image.

Abstract: The invention provides devices and methods that process images. The invention processes a received signal representing information of texture and information of an image, which has the texture removed from at least one region. The image information is encoded to obtain encoded information of the image. An output signal is generated representing the texture information and the encoded image information. In another embodiment, the invention synthesizes texture based on the received texture information, decodes received image information, which is encoded, to obtain a decoded image, and then maps the synthesized texture onto the decoded image.

Abstract: An image processing device and image processing method that are capable of generating a stereoscopic image with limited system resources. Mask information defines a display region so that substantially the same number of pixels in first image data and second image data are displayed while the pixels are dispersed substantially uniformly. A mixer unit references the mask information and mixes the first image data with the second image data to generate output image data, which is a stereoscopic image.

Abstract: Visual feedback is provided to a local user of a remote collaboration system. While an image is being captured, it is recognized that content is being shared on a screen. A composite image is generated which includes a form of the image being captured and the shared content. The composite image is caused to be displayed on a remote screen. A variably semi-transparent image of at least a portion of the composite image or the image is generated and is rendered on a portion of the screen such that the variably semi-transparent image is overlaid on any of the shared content or another composite image displayed on the screen.

Abstract: One or more implementations access a digital image containing one or more bands. Adjacent bands of the one or more bands have a difference in color resulting in a contour between the adjacent bands. The one or more implementations apply an algorithm to at least a portion of the digital image for reducing visibility of a contour. The algorithm is based on a value representing the fraction of pixels in a region of the digital image having a particular color value.

Abstract: In some embodiments, an apparatus includes interface circuitry to receive signals including video signals and drawing commands, and a command interpreter to receive the drawing commands and provide on screen display (OSD) signals in response to the drawing commands. Video processing circuitry processes the received video signals to provide processed video signals, and a blender to blend the OSD signals and the processed video signals to produce blended video signals including the OSD signals and the processed video signals. Other embodiments are described and claimed.

Abstract: A video composition model that provides a set of application programming interfaces (APIs) to set device contexts, and determine capabilities of graphics hardware from a device driver. After the model determines a configuration, the model determines input video stream states applicable to frame rates, color-spaces and alpha indexing of input video streams, interactive graphics, and background images. The model prepares the input video frames and reference frames, as well as a frame format and input/output frame index information. The input video streams, interactive graphics and background images are processed individually and mixed to generate an output video stream.

Abstract: A method of noise filtering of a digital video sequence to reduce ghosting artifacts, the method including computing motion values for pixels in a frame of the digital video sequence based on a reference frame, computing blending factors for the pixels based on the motion values, generating filtered output pixel values by applying the blending factors to corresponding pixel values in the reference frame and the frame, wherein selected filtered output pixel values are converged toward corresponding pixel values in the frame to reduce ghosting artifacts, and outputting the filtered frame.

Abstract: Embodiments are described for a method to generate an image that includes image structure detail captured from a first image and color from a second image. The first image of a defined subject can be obtained from a computer memory. The first image may be a downsampled fine image with image detail. The second image captured of the defined subject in the first image can be obtained from a computer memory. The second image may be a coarse image. A target pixel in the second image can be selected. A target color distribution for a pixel window of the target pixel can then be computed. A source color distribution for a pixel window of a corresponding pixel in the first image can be computed using a computer processor. Further, a statistic of the target pixel can be determined with respect to the target color distribution. The source color in the source color distribution can be computed with the statistic. The target pixel color can then be replaced by the source color.

Abstract: Provided are techniques for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera. The first photograph is called the “naked photo.” Using a graphics program, photos subsequent to the naked photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the naked photo as layers. The modified naked photo, including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the naked photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.

Abstract: Systems and methods of generating depth data using edge detection are disclosed. In a particular embodiment, first image data is received corresponding to a scene recorded by an image capture device at a first focus position at a first distance. Second image data is received corresponding to a second focus position at a second distance that is greater than the first distance. Edge detection generates first edge data corresponding to at least a first portion of the first image data and generates second edge data corresponding to at least a second portion of the second image data. The edge detection detects presence or absence of an edge at each location of the first portion and the second portion to identify each detected edge as a hard or soft edge. Depth data is generated based on the edge data generated for the first and second focus positions.

Abstract: A method for sharpness enhancing digital image data (ID), including: generating an intermediate processed image (IPI), in which uniform sections of the digital image data (ID) are cleaned from noise and in which at least one of a group consisting of contours, edges, wedges, structures and textures are detected, wherein the uniform section each fulfil a predefined uniformity criterion, which is descriptive for at least one of a group consisting of uniformity, flatness, structure, and noise content; deriving a blend value b for each pixel (Pbjkab) from the intermediate processed image (IPI) with b ranging between 0 corresponding to flatness and 1 corresponding to texture; two-dimensional sharpness enhancing the digital image data (ID) to generate processed digital image data (PID); and generating output data (outD) by pixelwise blending the digital image data with the processed digital image data.

Abstract: Tilt is reduced or eliminated in captured digital images. Edges in a first image are detected. Angles corresponding to the detected edges are determined. A dominant angle is selected from the determined angles. The first image is rotated according to the selected dominant angle to generate a second image. The second image is a de-tilted version of the first image.

Abstract: An image processing unit is disclosed that smoothens a notice pixel of input image data with pixel values of pixels around the notice pixel to reduce noise in the image data. The image processing unit includes an edge extraction unit that extracts an edge based on the pixel values of the image data; a region determination unit that determines a region to be processed where a sum of edge intensities of the pixels including the notice pixel becomes greater than or equal to a threshold; and a smoothening unit that changes a smoothening intensity in accordance with a size of the region to be processed to smoothen the notice pixel corresponding to the region to be processed.

Abstract: Systems and methods provide drag-and-drop pasting for seamless image composition. In one implementation, a user casually outlines a region of a source image that contains a visual object to be pasted into a target image. An exemplary system automatically calculates a new boundary within this region, such that when pasted at this boundary, visual seams are minimized. The system applies a shortest path calculation to find the optimal pasting boundary. The best path has minimal color variation along its length, thus avoiding structure and visual objects in the target image and providing the best chance for seamlessness. Poisson image editing is applied across this optimized boundary to blend colors. When the visual object being pasted has fine structure at its border that could be truncated by the Poisson editing, the exemplary system integrates the alpha matte of the visual object into the Poisson equations to protect the fine structure.

Abstract: According to one embodiment, an electronic apparatus includes a motion search module, a flicker reduction module and a display controller. The motion search module determines first vectors including motion vectors corresponding to pixel blocks in a target frame in video data, and determines pixels in a previous frame by using the first vectors, the pixels corresponding to pixels in the target frame. The flicker reduction module reduces flicker by blending a first pixel in the target frame and a second pixel in the previous frame. The display controller controls displaying the target frame including the blended pixel.

Abstract: A method for deformable registration of 2 digital images includes providing a pair of digital images, including a fixed image and a moving image, extracting a set of edge images from each image of the pair of images, each edge set being extracted at a different resolution, selecting a pair of edge images with a lowest resolution, determining a mapping from edge points of the fixed image to edge points of moving image using a geodesic thin plate spline interpolation, applying the mapping to a next higher resolution edge point image of the moving image, selecting a pair of edge images at a next higher resolution, where a moving edge image is the moving edge image to which the mapping has been applied, repeating the steps at a next higher resolution for all edge images in the set of edge images, and applying the mapping to an entire moving image.

Abstract: Embodiments that provide multi-video synthesis are disclosed. In accordance with one embodiment, multi-video synthesis includes breaking a main video into a plurality of main frames and break a supplementary video into a plurality of supplementary frames. The multi-video synthesis also includes assigning one or more supplementary frames into each of a plurality of states of a Hidden Markov Model (HMM), where each of the plurality of states corresponding to one or more main frames. The multi-video synthesis further includes determining optimal frames in the plurality of main frames for insertion of the plurality of supplementary frames based on the plurality of states and visual properties. The optimal frames include optimal insertion positions. The multi-video synthesis additionally includes inserting the plurality of supplementary frames into the optimal insertion positions to form a synthesized video.

Abstract: Systems and methods of generating depth data using edge detection are disclosed. In a particular embodiment, first image data is received corresponding to a scene recorded by an image capture device at a first focus position at a first distance. Second image data is received corresponding to a second focus position at a second distance that is greater than the first distance. Edge detection generates first edge data corresponding to at least a first portion of the first image data and generates second edge data corresponding to at least a second portion of the second image data. The edge detection detects presence or absence of an edge at each location of the first portion and the second portion to identify each detected edge as a hard or soft edge. Depth data is generated based on the edge data generated for the first and second focus positions.

Abstract: From the target image data, a luminance component, a first color difference component, and a second color difference component which represent color of respective pixels are acquired; and a maximum magnitude smoothing process is carried out on the first color difference component.

Abstract: A suppression method that provides adaptive (i.e., selective) processing of an input picture to generate an enhanced output picture with ringing-like areas of the input picture suppressed. For each window in the input picture, if the window is detected as around a ringing-like area in the picture, then the output pixel for the position of the window comprises the low-pass filtered (i.e., smoothed) pixel in the input picture. If the window is not detected as around a ringing-like area, then the output pixel for the position of the window comprises essentially the unchanged window in the input picture. No blurring is introduced in areas where ringing-like patterns are not detected. The output picture is an enhanced version of the input picture comprising portions of the input picture where ringing-like patterns were not detected, and portions of the input picture with suppressed (i.e., smoothed) ringing-like patterns where detected.

Abstract: A device for removing noise by using an adjustable threshold. The device for removing noise in accordance with an embodiment of the present invention determines a difference value between a maximum value and a minimum value of elements of inputted image data, determines a method of removing noise of the image data in accordance with the difference value, and removes noise in accordance with the method. With the present invention, improved picture quality can be achieved because noise can be removed as desired by the user.

Abstract: A method of enhancing details in an input image. The input image comprises input pixels, which have input pixel values (IPV) limited to a range (RA). The method comprises average filtering (1) the input pixel values (IPV) to obtain average brightness values (LV). A luminance mask is applied (2) to the average brightness values (LV) to obtain masked values (MV) which are different for average brightness values (LV) in a sub-range (SR) of the range (RA) than for pixels outside the sub-range (SR). The input pixel values (IPV) are detail filtered (3) to obtain detail values (HV) indicative for an amount of detail. A non-linear function (NLF) is applied (5) on the input pixel values (IPV) to obtain for each input pixel value (IPV) a corresponding output pixel value (OPV). A gain of the non-linear function (NLF) is dependent on both the masked value (MV) and detail value (HV) which both are determined for the particular input pixel.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map but not effective at presenting local detail. In contrast, street -side images show excellent detail but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: The invention provides the image method and apparatus to increase the sharpness of a resized image. The image includes a plurality of pixels with an alpha value and an image data. The method detects the alpha value of neighboring first and second pixels. Weighting values of interpolated pixels between the first and second pixels are determined. The image data of the interpolated pixels are set to be identical to the image data of the first pixel when one of the first pixel or the second pixel is zero.

Abstract: Provided is a method for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera typically fixed in one position. The first photograph is called the “naked photo.” Using a graphics program, photos subsequent to the naked photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the naked photo as layers. The modified naked photo, including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the naked photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.

Abstract: The present invention provides an image processing method. In one embodiment, the method provides discontinuity-preserving image smoothing and segmentation, noise reduction, reduction of image variations particularly those variations caused by illumination conditions, exposure compensation, and dynamic range compression. The present invention also provides an electronic image sensor that is able to detect high dynamic range optical images and produce electronic images with reduced dynamic range.

Abstract: Certain aspects of a method and system for motion compensated temporal filtering using both finite impulse response (FIR) and infinite impulse response (IIR) filtering may include blending at least one finite impulse response (FIR) filtered output picture of video data and at least one infinite impulse response (IIR) filtered output picture of video data to generate at least one blended non-motion compensated output picture of video data. A motion compensated picture of video data may be generated utilizing at least one previously generated output picture of video data and at least one current input picture of video data. A motion compensated picture of video data may be blended with at least one current input picture of video data to generate a motion compensated output picture of video data. The generated motion compensated output picture of video data and the generated non-motion compensated output picture of video data may be blended to generate at least one current output picture of video data.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map, but not effective at presenting local detail. In contrast, street-side images show excellent detail, but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps, and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: The present disclosure provides methods and systems for image processing by locally adaptive filters that preserve the edges while smoothing the image. In the exemplary method, a filter adjusts image pixel values utilizing a locally adaptive weighted average method. To adjust the value of a target pixel, the filter uses the data corresponding to some of its surrounding pixels and modifies the weights in an inverse relation with both their distance from the target pixel and the difference between their data. Various embodiments present different schemes for selection of surrounding pixels and computation of weighted average values.

Abstract: In a specific embodiment of the present disclosure, a source image is smoothed to create a smoothed image, and an edge detector is used to create an edge layer. A blending controller is used to control a blending between the source image and the smoothed image. The blended destination image maintains detail while eliminating unwanted noise.

Abstract: An exemplary method includes receiving a trimap for an image that specifies a background region, a foreground region and an unknown region for the image wherein a boundary exists between the foreground region and the unknown region and wherein another boundary exists between the unknown region and the background region, solving a set of Poisson equations having boundary conditions for the two boundaries to provide a matte that distinguishes a foreground region from a background region in the unknown region, and refining the matte by solving a set of Poisson equations for a local unknown region. Various other exemplary technologies are also presented.

Abstract: Provided is a method for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera typically fixed in one position. The first photograph is called the “naked photo.” Using a graphics program, photos subsequent to the naked photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the naked photo as layers. The modified naked photo, including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the naked photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.

Abstract: Electronic data output from CCD is separated into a brightness component Y and color difference components Cb and Cr and an edge is extracted for each of the components. The edge amounts are calculated from the extracted edges and the component having the maximum edge amount is selected. Edge information (for example, edge gradient direction) is calculated based on the selected component having the maximum edge amount, a filter is selected based on the calculated edge information about the component having the maximum edge amount, and smoothing processing is performed for the electronic data output from the CCD based on the filter. The electronic data subjected to the smoothing processing is written into flash memory.

Abstract: An image scaling method for calculating a pixel value of a target pixel within a scaled image block is disclosed. The method includes selecting a plurality of reference pixels from the image block, wherein each reference pixel has a pixel value and corresponds to a transparency parameter; respectively setting a corresponding weight value for each reference pixel; adjusting the weight values according to the transparency parameters of the reference pixels; and blending the pixel values of the reference pixels to generate the pixel value of the target pixel according to the adjusted weight values of the reference pixels.

Abstract: The present invention relates to a method for composing a scene containing a plurality of objects, an object comprising chrominance and luminance components, a chrominance value being associated with a set of at least two luminance values, wherein said method comprises a step of blending a first object with a second object resulting in a blended object, said step comprising the sub-steps of:—generating a luminance component of the blended object from the corresponding luminance components of the first and second objects and from a first composition function, and—generating a chrominance component of the blended object from the corresponding chrominance components of the first and second object and from a second composition function, the second composition function depending on a set of associated values of the first composition function.

Abstract: When one video image (e.g., second video image) is blended or synthesized to video image (e.g., main video image), time base correction is made between both video data. A video data processing apparatus comprising a first video generator generating a first video data having an arbitrary frame rate, a second video generator generating a second video data having an arbitrary frame rate different from the first video data, and a synchronization controller using video reproduction time managed by the first video generator as a reference time, and correcting video reproduction time of the second video generator shifted from the reference time by repeatedly using the second video data to obtain frame synchronization.

Abstract: A Gaussian blur approximation is applied to an image by repeated down-sampling operations followed by an up-sample operation. By using a truncated Gaussian filter as the down-sample filter, the frequency spectrum removed during down-sampling operations closely approximates the frequency spectrum lost during a true Gaussian blur operation. While any “good” up-sample filter may be used, up-sampling via linear interpolation may be especially beneficial in systems having a dedicated graphics processing unit. One benefit of the described technique is that it is computationally less costly to implement than a Gaussian blur. Another benefit is that this computational benefit increases as the size of the blur increases—becoming significant even for small blurs. Yet another benefit of the invention is that a judicious selection of pixel address to convolve with the filter leads to substantially reduced number of texture lookups required to effect a convolution.

Abstract: A key signal control unit for controlling the level of a key signal corresponding to an arbitrary position within a frame area to a level corresponding to a minimum distance from an inner edge of the frame area on the basis of the level of a key signal on the inner edge of the frame area as a reference value so that the frame area appears along an outer circumference of an image corresponding to a video signal. A totally new image special effect is thus made on the video signal.

Abstract: Automatic detection and tracking of multiple individuals includes receiving a frame of video and/or audio content and identifying a candidate area for a new face region in the frame. One or more hierarchical verification levels are used to verify whether a human face is in the candidate area, and an indication made that the candidate area includes a face if the one or more hierarchical verification levels verify that a human face is in the candidate area. A plurality of audio and/or video cues are used to track each verified face in the video content from frame to frame.

Abstract: A polygon drawing apparatus and method draws a polygon by performing intensity processing on a polygon to be drawn so as to smoothly draw each edge portion of the polygon, by performing intensity processing on a polygon to be drawn so as to smoothly draw each edge portion of the polygon.

Abstract: A flicker filter is adjusted according to degree of alpha blending performed on a display signal. For some weakly showing graphics images, a lower flicker filter level may be implemented or the flicker filter may be turned off. A threshold for turning off the flicker filter may be programmable.

Abstract: Text and graphics elements may be alpha blended in a way to reduce flicker when the text or graphics are display by a processor-based television receiver. The alpha values are used to intelligently smooth pixels adjacent the element to create television text and graphics.