Abstract: Innovations in encoder-side search ranges having horizontal bias or vertical bias are described herein. For example, a video encoder determines a block vector (“BV”) for a current block of a picture, performs intra prediction for the current block using the BV, and encodes the BV. The BV indicates a displacement to a region within the picture. When determining the BV, the encoder checks a constraint that the region is within a BV search range having a horizontal bias or vertical bias. The encoder can select the BV search range from among multiple available BV search ranges, e.g., depending at least in part on BV values of one or more previous blocks, which can be tracked in a histogram data structure.

Abstract: Innovations in encoder-side search ranges having horizontal bias or vertical bias are described herein. For example, a video encoder determines a block vector (“BV”) for a current block of a picture, performs intra prediction for the current block using the BV, and encodes the BV. The BV indicates a displacement to a region within the picture. When determining the BV, the encoder checks a constraint that the region is within a BV search range having a horizontal bias or vertical bias. The encoder can select the BV search range from among multiple available BV search ranges, e.g., depending at least in part on BV values of one or more previous blocks, which can be tracked in a histogram data structure.

Abstract: An apparatus includes a processor circuit and an ID recycle circuit. The processor circuit may be configured to generate a component table while performing connected-component labeling on a digital image. The ID recycle circuit is generally in communication with the processor circuit. The ID recycle circuit may be configured to minimize a number of entries in the component table generated by the processor circuit.

Abstract: An image processing apparatus for synthesizing continuously captured images includes a positioning unit configured to position images to be synthesized by using a motion vector indicating a positional deviation of the images between the images, and a synthesis unit configured to synthesize the images positioned by the positioning unit. The image processing apparatus further includes a group classification unit configured to classify the images into groups based on an order of imaging, and a setting unit configured to set a reference image in each group. The positioning unit includes a first positioning unit configured to position the images within the groups with respect to the respective reference images, and a second positioning unit configured to position the reference images between the groups.

Abstract: The present technology relates to an image processing apparatus and method capable of preventing an increase in a cost of the apparatus. A setting unit sets identification information for identifying a correspondence relationship between a size of a block of an image and changing of a prediction method applied to the block, and an inter-prediction unit generates a prediction image according to the identification information. An encoder codes the block by using the prediction image so as to generate a coded stream. In addition, the encoder transmits the coded stream and the identification information. The present technology is applicable to, for example, a case of coding/decoding an image, and the like.

Abstract: A method and a device providing one virtual endpoint dedicated to serve one particular real endpoint, and the virtual endpoint is typically installed on a server in the same local network as the associated real endpoint, where an MCU or a fraction of a distributed MCCJ also is installed. In the upstream direction, the virtual endpoint includes at least an upstream decoder, a scaling unit and an upstream encoder. In the downstream direction, the virtual endpoint includes at least a number of decoders, a composing unit and a downstream encoder.

Abstract: Methods, apparatus, and systems for video coding/decoding are disclosed. One representative method includes a decoder receiving video content including at least a base layer (BL), an enhancement layer (EL) and phase information. The phase information includes an indicator indicating one or more sets of phase parameters from among plural sets of phase parameters. The method further includes assembling the BL into an inter-layer reference (ILR) picture based on the video content and the received phase information, selecting one or both of the ILR picture or an EL reference picture, and predicting a current EL picture using the phase information and one or more of the selected ILR picture or the selected EL reference picture.

Abstract: Various embodiments each include at least one of systems, methods, devices, and software for environment mapping with automatic motion model selection. One embodiment in the form of a method includes receiving a video frame captured by a camera device into memory and estimating a type of motion from a previously received video frame held in memory to the received video frame. When the type of motion is the same as motion type of a current keyframe group held in memory, the method includes adding the received video frame to the current keyframe group. Conversely, when the type of motion is not the same motion type of the current keyframe group held in memory, the method includes creating a new keyframe group in memory and adding the received video frame to the new keyframe group.

Abstract: Tiling or blockiness detection based on spectral power signature uses one-dimensional vectors at block edges to find a spectral signature created by the tiling or blockiness in an image. A baseband component of the image, such as luminance, is edge enhanced, and then the pixel values along each horizontal line are summed to form a one-dimensional column vector of summed edge values for the image. The power of the column vector and the power of selected frequency components within the column vector are determined. The powers are then combined and converted to dimensionless tiling or blockiness values relative to each of the selected frequencies.

Abstract: An automatic tracking camera system includes: a rotating unit for panning and tilting an image pickup unit including a lens apparatus and an image pickup apparatus; a tracking object detector; a motion vector detector for detecting a motion vector of the object to be tracked; a capture position setting unit for setting a capture position of the object to be tracked in the picked up image; and a controller for controlling drive of the rotating unit. The controller controls the rotating unit in a capture mode to capture the object to be tracked at the capture position based on the motion vector detected by the motion vector detector after the tracking object detector has detected the object to be tracked in the picked up image, and a maintenance mode to continuously capture the object to be tracked at the capture position after the capture mode.

Abstract: An Engineer's View (EV) wireless video system for powered and unpowered model railroad engines is disclosed. The invention uses commercially available wireless spy cameras, powered by a custom power supply circuit which is compatible with either DC or DCC track systems. The present invention is compatible with all commercial model railroad gauge diesel engines including HO and N Gauge or may be factory installed. The EV system demonstrates a remarkably stable and realistic image of a model railroad layout. Moreover, the present invention may also provide a stable source of power to the engine where stalling could occur at points of track defects.

Abstract: A display apparatus and a control method thereof are provided The display apparatus includes: an image processor configured to process an image of content; a display configured to display the processed image of the content; a camera configured to capture an image of a remote controller; a storage configured to store information regarding a plurality of appearance states of the remote controller corresponding to user commands; and a controller configured to determine an appearance state from among the plurality of appearance states of the remote controller based on the image of remote controller captured by the camera, and control the display section to display the image of the content according to a user command corresponding to the determined appearance state of the remote controller.

Abstract: A remote control system includes a remote control device and an electronic device. The remote control device includes an input element, a wireless transmitter to transmit an absolute coordinate signal and a motion signal and a control unit electrically connected to the input element and the wireless transmitter. The electronic device includes a wireless receiver and a display screen. The wireless receiver receives the absolute coordinate signal and the motion signal, and displays the absolute coordinate signal at the display screen via a cursor. When the electronic device does not receive the motion signal, the absolute coordinate signal is not operated on an application program of the electronic device. When the electronic device receives the motion signal, the absolute coordinate signal is operated on the application program.

Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.

Abstract: Spatial or temporal interpolation may be performed upon source video content to create interpolated video content. A video signal including the interpolated video content and non-interpolated video content (e.g. the source video content) may be generated. At least one indicator for distinguishing the non-interpolated video content from the interpolated video content may also be generated. The video signal and indicator(s) may be passed from a video source device to a video sink device. The received indicator(s) may be used to distinguish the non-interpolated video content from the interpolated video content in the received video signal. The non-interpolated video content may be used to “redo” the interpolation or may be recorded to a storage medium.

Abstract: The present invention facilitates efficient and effective detection of pixel alteration. In one embodiment a pixel alteration analysis system includes a difference summing multiple engine component and a control component. The difference summing multiple engine component determines the sum of differences between pixel values in a plurality of pixels. The control component determines an indication of motion based upon said relationship of said pixels in said plurality of pixels. In one exemplary implementation, the difference in values corresponds to a relationship between values of pixels in a block of pixels at different frames. The number and configuration of pixels in a block partition can be flexibly changed.

Abstract: A method of obtaining a disparity vector and its encoding/decoding in the multi-view coding process is disclosed. The present invention includes essentially: determining a disparity vector between two views during the multi-view image coding, and computing a disparity vector between the other two views according to the disparity vector between the two views and the known relative location information between each of the views. Thereafter, the disparity vector is used for multi-view encoding/decoding. The present invention further makes use of the correlation between the disparity vector and depth information of the spatial vector on one hand, and on the other hand makes use of the direct relationship between the disparity vector and the location of each of the cameras. It is experimentally proved that the disparity vector between several views can be accurately computed during the multi-view coding, thereby improving the performance of multi-view coding.

Abstract: There is described method for producing a computer file for inclusion in an audio bundle of a digital cinema file in which is encoded a multi-channel vibro-kinetic signal for controlling a motion platform. The audio bundle is for being transported over a digital transport link between a D-Cinema player and a motion decoder. The method comprises: obtaining a succession of blocks of vibro-kinetic samples from a vibro-kinetic file (e.g., a KineLink file); encoding binary data which represents the samples of the multi-channel vibro-kinetic signal into a sequence of monophonic PCM samples, according to a defined structure; and building a computer file using the encoded binary data, the computer file for incorporation into the audio bundle of the digital-cinema file, the encoded binary data for being transported over the digital transport link of the D-Cinema player to a motion decoder controlling the motion platform.

Abstract: A 3D graphics rendering pipeline is used to carry out data comparisons for motion estimation in video data encoding. Video data for the pixel block of the video frame currently being encoded is loaded into the output buffers of the rendering pipeline. The video data for the comparison pixel blocks from the reference video frame is stored as texture map values in the texture cache of the rendering pipeline. Once the sets of pixel data for comparison have been stored, the rendering pipeline is controlled to render a primitive having fragment positions and texture coordinates corresponding to the data values that it is desired to compare. As each fragment is rendered, the stored and rendered fragment data is compared by fragment compare unit and the determined differences in the data values are accumulated in an error term register.

Abstract: An LCD device and an LCD driving method select one among a plurality of threshold values provided along gray level regions of the pixel data as a threshold value for pixel data in a current frame interval. Accordingly, the number of times over-driving occurs due to noise when a still image is displayed can be minimized.

Abstract: A transcoder and methods of encoding inter-prediction frames of a downsampled video wherein the downsampled video is a spatially downsampled version of a full-resolution video. Full-resolution motion vectors are downscaled and each downscaled motion vector pinpoints a search area within a reference frame. The union or combination of search areas defines the search field for candidate motion vectors. A motion vector is selected from the candidates based on realizing a minimum rate-distortion cost.

Abstract: A method and system for low-latency processing of intra-frame video pixel block prediction including: predicting a pixel block based on boundary pixels of left and upper neighbor blocks of said pixel block; subtracting said predicted pixel block from a source pixel block to generate a prediction error; forward transforming and quantizing said prediction error to generate a residual data; inverse transforming and quantizing said residual data; adding said predicted pixel block to said inverse transformed and quantized residual data to generate a reconstructed pixel block; pre-computing blocks of DC-coefficients used with luma and chroma intra prediction modes; pre-computing mode selection of a best prediction mode of said luma and chroma intra prediction modes; and outputting said residual data to be used in entropy or arithmetic coding, and a reconstructed data used for motion prediction.

Abstract: A system (100) for encoding an input video frame (1005), for transmitting or storing the encoded video and for decoding the video is disclosed. The system (100) includes an encoder (1000) and a decoder (1200) interconnected through a storage or transmission medium (1100). The encoder (1000) includes a turbo encoder (1015) for forming parity bit data from the input frame (1005) into a first data source (1120), and a sampler (1020) for down-sampling the input frame (1202) to form a second data source (1110). The decoder (1200) receives data from the second data source (1110) to form an estimate for the frame (1005). The decoder (1200) also receivers the parity bit data from the first data source (1120), and corrects errors in the estimate by applying the parity bit data to the estimate. Each bit plane is corrected in turn. Bits in bit planes other than a bit plane presently being processed are also modified based in a selective manner.

Abstract: A content data processing device includes: a stability score computing unit to compute a stability score corresponding to the stability of an image for each frame, based on the image data of each frame making up content data; and a playing segment selecting unit to select a playing segment from the content data based on the stability score computed with the stability score computing unit.

Abstract: A 3D graphics rendering pipeline is used to carry out data comparisons for motion estimation in video data encoding. Video data for the pixel block of the video frame currently being encoded is loaded into the output buffers of the rendering pipeline. The video data for the comparison pixel blocks from the reference video frame is stored as texture map values in the texture cache of the rendering pipeline. Once the sets of pixel data for comparison have been stored, the rendering pipeline is controlled to render a primitive having fragment positions and texture coordinates corresponding to the data values that it is desired to compare. As each fragment is rendered, the stored and rendered fragment data is compared by fragment compare unit and the determined differences in the data values are accumulated in an error term register.

Abstract: A method for use in video compression is disclosed. In particular, the claimed invention relates to a method of more efficient fractional-pixel interpolation in two steps by a fixed filter (240) and an adaptive filter (250) for fractional-pixel motion compensation.

Abstract: A method for determining values of motion vectors includes receiving an irregular pattern of motion vectors for a target image, estimating an initial value for each of the motion vectors, using the motion vectors to generate a tap structure for an adaptive temporal prediction filter, and using the tap structure to re-estimate the value of each motion vector.

Abstract: A method of performing adaptive temporal prediction includes receiving a target image, wherein a position of an object in the target image is different from a position of the object in a reference image, using a boundary of the object to generate an irregular pattern of target image motion vectors, using the target image motion vectors to partition the target image into area of influence cells, wherein each area of influence cell contains a unique one of the target image motion vectors, and generating a prediction of the target image by applying an adaptive area of influence filter to the area of influence cells.

Abstract: An image encoding method includes generating a predictive signal and encoding mode information according to each encoding mode from a macroblock signal corresponding to each macroblock, selecting a quantization code table corresponding to each macroblock, generating a predictive error signal for each encoding mode based on the macroblock signal and the predictive signal, subjecting the predictive error signal to orthogonal transformation, quantizing the orthogonal-transformed predictive error signal while changing a quantization parameter for every plural sub-pixel-blocks, using the quantization code table corresponding to the macroblock, encoding quantization transformation coefficient, calculating an encoding cost, selecting one encoding mode based on the encoding cost, selecting one quantization code table based on the encoding cost, and encoding information of an index indicating the selected quantization code table for every frame of the input image signal or every region of the frame.

Abstract: In an optical zoom tracking apparatus and method, and a computer-readable recording medium for performing the optical zoom tracking, the optical zoom tracking apparatus commands a focus lens to move according to a continuous zooming operation, such that a clear image can be maintained while the image is continuously zoomed in or out, resulting in the effective use of limited power if an optical zoom function of a digital camera or mobile phone is executed. The optical zoom tracking apparatus includes: a zoom lens, a focus lens interoperable with the zoom lens, a zoom-lens drive moving the zoom lens, a focus-lens drive moving the focus lens, and a focus-lens controller for determining a moving distance of the focus lens according to a moving distance of the zoom lens, and transmitting a control signal corresponding to the moving distance of the focus lens to the focus-lens drive.

Abstract: Low complexity (16 bit arithmetic) H.264 video compression replaces a single quantization table for all quantization parameters with multiple quantization tables and thereby equalizes quantization shifts and round-off additions; this eliminates the need for 32-bit accesses.

Abstract: An image distribution apparatus divides image data of a single frame into a plurality of blocks, orthogonally transforms the blocks and calculates transformation coefficients, quantizes the calculated transformation coefficients, codes the quantized transformation coefficients, and distributes the coded image data. The image distribution apparatus acquires the quantized transformation coefficients, stores the acquired transformation coefficients in a storage unit, calculates differences between the transformation coefficients of a first frame and the transformation coefficients of a second frame stored in the storage unit in a unit of block, counts blocks whose difference values calculated above are equal to or greater than a predetermined value as changing blocks of the first frame, and determines that the first frame has changed when the counted number of blocks is equal to or greater than a predetermined value.

Abstract: A system and method is provided for variable bit rate encoding using a complexity ratio. Quantization parameter is calculated using a complexity ratio, which is equal to a local complexity divided by a global complexity. Complex pictures are allocated a larger bit budget relative to simple pictures. With the larger bit budget the quality of complex pictures can be maintained while reducing the overall size of the encoded video stream.

Abstract: A pixel-data selection device providing motion compensation, and a method thereof. A first and a second storage parts store a current frame/field including first pixel-data and a previous frame/field including second pixel-data, respectively, corresponding to at least one of the inputted candidate motion vectors. A first and a second pixel-data extraction parts extract the first and the second pixel-data corresponding to the candidate motion vector, respectively from the first and the second storage parts. A first and a second compensation pixel calculation parts calculate first and second compensation pixel-data for motion compensation, respectively, by adaptively applying a predetermined first weight according to the abstracted first and second pixel-data. Therefore, the first and the second pixel-data can be calculated based on motion trajectories of a current block to be interpolated and peripheral blocks, and thus, block artifacts can be prevented as the motion compensation is performed adaptively.

Abstract: The image quality value of the code block currently processed is monitored, and when it falls below a threshold, encoding of the code block is terminated (in other words, encoding in the subsequent passes is omitted for the code block) to shift to encoding of the next code block.

Abstract: A video processor integrates the processing of video and graphics data by restructuring the discrete blocks of luminance and chrominance component data associated with video image data (Y,U,V) into composite pixel values (YUYV), and performing the subsequent processing, in particular motion compensation, upon this composite data form. The discrete blocks of video image data are queue and processed in parallel to form a composite pixel value associated with each pixel within the image areas represented by the discrete blocks. By forming composite pixel values for reference data and error term data, common processing elements can be optimized and used for both video and graphics image processing. For example, the trilinear interpolator commonly used for 3-D graphics filtering and texturing can be used to form predicted macroblocks for motion compensation, and the specular adder used for graphics lighting effects can be used to process the motion compensation error terms.

Abstract: An improved image processing system involves decoding compressed image data including frequency domain coefficients defining blocks of pixel values representing an image at a first resolution to provide an image at a reduced second resolution for display from a selected sub-set of the frequency domain coefficients. The apparatus includes an enhanced motion-compensation-unit (MCU) operating with blocks of pixel values representing an image at an intermediate third resolution lower than the first resolution but higher than the reduced second resolution.

Abstract: A system and method for detecting features in video from business meetings and video teleconferencing systems can use color, motion, morphological (shape) filtering and a set of heuristic rules to determine possible features in the scene. One embodiment includes obtaining a first video frame of images and a second video frame of images, performing a luminance conversion on the first video frame of images and the second video frame of images, performing a motion filter operation on the converted first and second frames of images, performing a chrominance normalization on the second video frame of images, performing a color filter operation on the normalized second video frame of images, and processing the first and second frames of video images after the motion filter and color filter operations.

Abstract: Terminal and method for transporting a still picture uses a moving picture terminal after extraction of a frame unit of still pictures, for example, from a moving picture. The extracted still picture frames can be encoded in a fixed quantizing value and stored before transmission, or the stored frame unit still pictures can be encoded in a fixed quantizing value using an overflow control technique or circuit. Further, the extracted still picture frame unit can be repeatedly sent using a varied quantizing value before transmission. Thus, the terminal and method for transporting a still picture permits transmission/reception of the still picture at a higher resolution than a moving picture regardless of time and place to enhance use of the moving picture terminal.

Abstract: A processing device (200) includes three hardware extensions: a motion estimation extension 202, a pixel interpolation extension 204 and a DCT/iDCT extension 206. The hardware extensions perform functions which would otherwise be highly processor intensive, resulting in high power consumption and/or low quality video/imaging processing. The processing device 200 could be used, for example, in a mobile videophone 150.

Abstract: An addition image generation module 10 sequentially timewise adds images (input images) of still pictures at individual discrete time points included in a motion picture to be analyzed, thereby generating two kinds of addition images (image A and image B), respectively including images of still pictures at different discrete time points with the images being added at different ratios. Matrix development modules respectively take out pixel groups (first pixel group a(i, j) and second pixel group b(i, j)) located in a predetermined area (for example, in an area having a size of 3×3), from the generated image A and image B. A motion detection module compares the taken out first pixel group a(i, j) and second pixel group b(i, j), to detect a motion component in the motion picture to be analyzed.

Abstract: Techniques and tools for video frame interpolation and motion analysis are described. The techniques and tools may be implemented separately or in combination in software and/or hardware devices for various applications. For example, a media playback device uses frame interpolation and motion analysis in real time to increase the frame rate of streamed video for playback. The device uses feature/region selection in global motion estimation, local motion estimation to correct the global motion estimation at an intermediate timestamp for a synthesized frame, and vector switching in the local motion estimation.

Abstract: The invention provides a motion vector searcher which includes an inter-block difference arithmetic operation section for calculating and outputting difference amounts between an original image MB and a plurality of search MBs, an additional amount arithmetic operation section for outputting a correction difference amount obtained by adding an additional amount, which relies upon a horizontal component and a vertical component of each of the motion vectors and a state of coding, to each of the difference amounts and for outputting a motion vector based on the motion vector, and a motion vector determination section for determining an optimum motion vector which exhibits the highest one of correlation degrees between the original image MB and the search MBs. With this arrangement, reduction of the information amount of motion vectors is achieved when the compression ratio is high and the transmission rate is low.

Abstract: An object-based quad-tree mesh motion compensation method using the Greedy algorithm is provided. This method defines an object-based quad-tree mesh structure defined by extending a hierarchical grid interpolation technique, by which complicated or partial motion is more accurately displayed, so that it is suitable for an object-based technique. Also, this method provides a quad-tree block segmentation method using the Greedy algorithm by which the transmission rate-distortion performance of motion compensation is improved. The object-based quad-tree mesh motion compensation method using the Greedy algorithm, includes (a) defining an object-based quad-tree mesh, (b) segmenting each block in an image frame, which is segmented into blocks of predetermined sizes, in order to form the object-based quad-tree mesh of the step (a), and (c) estimating the motions of vertices to minimize distortion during compensation of motions within the segmented block, and compensating for the motion of an image within the block.

Abstract: Motion compensation of a sequence of image fields (0-5) is carried out in the frequency domain using phase correlation (10) between corresponding picture areas of a pair of time-spaced, input fields (1,4) to produce a set of motion-vector estimates that are used for filtering the relevant areas of each field (1;4) of the pair by interpolation (11;12) with the corresponding area of its preceding and following input-fields (0,2;3,5) of the sequence, to produce a frame-approximation to that field (1;4) through combination of the individually-filtered areas. The filtering in each case involves respective application (24-26) of weighting coefficients to corresponding spatial-frequency components of the relevant picture areas of three fields, and summation (28) of the weighted components, the coefficients being calculated or selected (27) according to the motion-vector estimate associated with each picture area.

Abstract: A signal-processing method for performing a coordinate transformation operation and a quantization operation on an input data to obtain quantization outputs, and a signal-processing device therefor. A search strategy based on the characteristic of the input data is established. By using the search strategy, the End of Block (EOB) is predicted and the calculation structure is determined by the predicted EOB.

Abstract: In a dynamic video communication evaluation equipment for analyzing codes by multiple methods for evaluating a dynamic video image, an analysis including estimation is performed to fix a reliability of the analysis result, enabling a processing termination in response to the analysis result in view of effective utilization of time or cost.

Abstract: A method for determining a best match between a first pixel array in a picture currently being encoded and a plurality of second pixel arrays in a search region of a reference picture, wherein each of the first and second pixel arrays includes a plurality of rows and columns of individual pixel values.

Abstract: A method and apparatus are provided whereby the motion between two video fields of opposite parity may be measured so as to discriminate between the presence of motion and lack thereof. The level of motion at a specified position is determined by comparing a first motion value derived from successive fields of opposite parity with a second motion value derived from successive fields of the same parity at the spatial location corresponding to that used to generate the first motion value. This determination is made with one field being common to the first and second motion values, and taking the minimum of the first and second motion values to be the motion value at that position.

Abstract: A conventional MPEG video encoder searches forward motion vectors with respect to a previous image and backward motion vectors with respect to a subsequent image in order to provide a motion-compensated prediction image for encoding B-pictures. This requires 2N accesses to the memory in which said images are stored. Searching the motion vectors for P-pictures requires N memory accesses. The invention uses the spare capacity by running a two-pass motion vector search in the P-coding mode. In the second pass, the precision of the motion vectors found in the first pass is further refined. This provides more accurate motion vectors for P-pictures.