Abstract: A time-of-flight (ToF) image sensor system includes a pixel array, where each pixel of the pixel array is configured to receive a reflected modulated light signal and to demodulate the reflected modulated light signal to generate an electrical signal; a plurality of analog-to-digital converters (ADCs), where each ADC is coupled to at least one assigned pixel of the pixel array and is configured to convert a corresponding electrical signal generated by the at least one assigned pixel into an actual pixel value; and a binning circuit coupled to the plurality of ADCs and configured to generate at least one interpolated pixel, where the binning circuit is configured to generate each of the at least one interpolated pixel based on actual pixel values corresponding to a different pair of adjacent pixels of the pixel array, each of the at least one interpolated pixel having a virtual pixel value.

Abstract: An image processing method and an image processing circuit are provided. The method and circuit are applied to motion estimation. The method includes the steps of: performing low-pass filtering on a first image and a second image, wherein the first image is part of a first frame, the second image is part of a second frame, and the first frame is different from the second frame; calculating a first characteristic value of the first image and calculating a second characteristic value of the second image; calculating a sum of absolute difference (SAD) between the first image and the second image; blending the difference between the first characteristic value and the second characteristic value and the SAD to generate a blended result; and estimating a motion vector between the first image and the second image according to the blended result.

Abstract: The present invention relates to a method and apparatus for encoding or decoding a video signal. According to the present invention, a plurality of reference units for image prediction of the current unit is acquired and combined to obtain a unit prediction value, thereby improving the accuracy of image prediction. More particularly, the present invention relates to a method for inducing a variety of reference units using a motion vector prediction value or a motion vector which is used in conventional inter-prediction, and also relates to a method which combines the reference units so as to obtain the prediction value for the current unit. In addition, the present invention relates to a method which involves acquiring a plurality of reference units for a merging mode, and combining the reference units so as to perform image prediction.

Abstract: In the subject architecture flexible binary arithmetic coding system, coding circuitry of an electronic device may receive video data that is to be coded (e.g., to be encoded or decoded) by binary arithmetic coding. The coding circuitry may also compute at least one of a least probable symbol (LPS) range or a most probable symbol (MPS) range based on a multiplication operation (e.g., without performing a table look-up operation). The coding circuitry may perform binary arithmetic coding on the video data using the at least one of the LPS range or the MPS range. The computation of the LPS range and/or the MPS range using the multiplication operation may have a lower computational cost than using a table look-up operation.

Abstract: An image encoding method includes: determining N P-frames from a sequence of images, N being a positive integer; for each P-frame, determining a source refreshing region in the P-frames, the source refreshing region being a portion less than a whole region of the P-frame; obtaining reconstructed images corresponding to the source refreshing regions by performing a first encoding on the source refreshing regions; obtaining updated P-frames by updating the source refreshing regions with the reconstructed images; and performing a second encoding on the updated P-frames.

Abstract: The present invention relates to a method and apparatus for encoding or decoding a video signal. According to the present invention, a plurality of reference units for image prediction of the current unit is acquired and combined to obtain a unit prediction value, thereby improving the accuracy of image prediction. More particularly, the present invention relates to a method for inducing a variety of reference units using a motion vector prediction value or a motion vector which is used in conventional inter-prediction, and also relates to a method which combines the reference units so as to obtain the prediction value for the current unit. In addition, the present invention relates to a method which involves acquiring a plurality of reference units for a merging mode, and combining the reference units so as to perform image prediction.

Abstract: An image encoding method includes determining N P-frames from a sequence of images, determining a source refreshing region in each one of the P-frames, obtaining reconstructed images corresponding to the source refreshing regions by performing a first encoding on the source refreshing regions, obtaining updated P-frames by updating the source refreshing regions with the reconstructed images, and performing a second encoding on the updated P-frames.

Abstract: A decoder includes a parser, an intra predictor, and an inter predictor. The parser parses a bit stream to extract header information and first through third data information, to determine a prediction mode for blocks in a current frame based on the header information, and to selectively output the first and second data information based on the prediction mode. The intra predictor generates a predicted value of a pixel of a current block based on a pixel value of a first reference block in the current frame based on the first data information. The inter predictor predicts a second reference block from a reference frame based on the second data information, converts a pixel value of the second reference block, and generates a predicted value of the pixel of the current block based on a converted pixel value.

Abstract: Technologies are generally described for coordination of structured light-based image detectors. In some examples, one or more structured light sources may be configured to project sets of points onto the scene. The sets of points may be arranged into disjoint sets of geometrical shapes such as lines, where each geometrical shape includes a subset of the points projected by an illumination source. A relative position and or a color of the points in each geometrical shape may encode an identification code with which each illumination source may be identified. Thus, even when the point clouds projected by each of the illumination sources overlap, the geometrical shapes may still be detected, and thereby a corresponding illumination source may be identified. A depth map may then be estimated based on stereo vision principles or depth-from-focus principles by one or more image detectors.

Abstract: Techniques and tools for video coding/decoding with motion resolution switching and sub-block transform coding/decoding are described. For example, a video encoder adaptively switches the resolution of motion estimation and compensation between quarter-pixel and half-pixel resolutions; a corresponding video decoder adaptively switches the resolution of motion compensation between quarter-pixel and half-pixel resolutions. For sub-block transform sizes, for example, a video encoder adaptively switches between 8×8, 8×4, and 4×8 DCTs when encoding 8×8 prediction residual blocks; a corresponding video decoder switches between 8×8, 8×4, and 4×8 inverse DCTs during decoding.

Abstract: Techniques and tools for video coding/decoding with sub-block transform coding/decoding and re-oriented transforms are described. For example, a video encoder adaptively switches between 8×8, 8×4, and 4×8 DCTs when encoding 8×8 prediction residual blocks; a corresponding video decoder switches between 8×8, 8×4, and 4×8 inverse DCTs during decoding. The video encoder may determine the transform sizes as well as switching levels (e.g., frame, macroblock, or block) in a closed loop evaluation of the different transform sizes and switching levels. When a video encoder or decoder uses spatial extrapolation from pixel values in a causal neighborhood to predict pixel values of a block of pixels, the encoder/decoder can use a re-oriented transform to address non-stationarity of prediction residual values.

Abstract: Disclosed are methods, apparatuses, systems, and/or non-transitory computer readable media for improving/optimizing image compression quality settings. A method of compressing an input image, using at least one processor, includes verifying a desired compression quality value desired for compressing the input image, determining an optimal image quality value that corresponds to a target peak signal-to-noise ratio (PSNR) from a set image quality range based on the desired compression quality value, and outputting an image file encoded at the optimal image quality value as a compressed file of the input image.

Abstract: Disclosed is an adaptive transform method based on an in-screen prediction, and an apparatus using the method. A method for encoding an image can comprise a step of determining in-screen prediction mode groups, and a step of transforming by using a different transform method according to the in-screen prediction mode group. As a result, transforming can be performed by applying the different transform method according to the in-screen prediction mode group.

Abstract: Disclosed is an adaptive transform method based on an in-screen prediction, and an apparatus using the method. A method for encoding an image can comprise a step of determining in-screen prediction mode groups, and a step of transforming by using a different transform method according to the in-screen prediction mode group. As a result, transforming can be performed by applying the different transform method according to the in-screen prediction mode group.

Abstract: To use both intraframe prediction coding and interframe prediction coding, and at the same time restrict a transfer volume of reference data used in motion detection in interframe prediction coding. In a coding apparatus that compression-codes moving images, both intraframe prediction coding and interframe prediction coding are applied and prediction coding is carried out using a prediction image produced by the coding system deemed to have the higher coding efficiency.

Abstract: Various techniques and tools for encoding and decoding (e.g., in a video encoder/decoder) binary information (e.g., skipped macroblock information) are described. In some embodiments, the binary information is arranged in a bit plane, and the bit plane is coded at the picture/frame layer. The encoder and decoder process the binary information and, in some embodiments, switch coding modes. For example, the encoder and decoder use normal, row-skip, column-skip, or differential modes, or other and/or additional modes. In some embodiments, the encoder and decoder define a skipped macroblock as a predicted macroblock whose motion is equal to its causally predicted motion and which has zero residual error. In some embodiments, the encoder and decoder use a raw coding mode to allow for low-latency applications.

Abstract: Disclosed is an adaptive transform method based on an in-screen prediction, and an apparatus using the method. A method for encoding an image can comprise a step of determining in-screen prediction mode groups, and a step of transforming by using a different transform method according to the in-screen prediction mode group. As a result, transforming can be performed by applying the different transform method according to the in-screen prediction mode group.

Abstract: A system for automatically tracking movement of a user participating in a video chat application executing in a computing device is disclosed. A capture device connected to the computing device captures a user in a field of view of the capture device and identifies a sub-frame of pixels identifying a position of the head, neck and shoulders of the user in a capture frame of a capture area. The sub-frame of pixels is displayed to a remote user at a remote computing system who is participating in the video chat application with the user. The capture device automatically tracks the position of the head, neck and shoulders of the user as the user moves to a next location within the capture area. A next sub-frame of pixels identifying a position of the head, neck and shoulders of the user in the next location is identified and displayed to the remote user at the remote computing device.

Abstract: A method for encoding a video stream with at least one frame having a plurality of blocks of pixels including a current block. The method includes identifying, peripheral to the current block, a first set of pixels and a second set of pixels in the at least one frame, wherein the first set of pixels has been coded; determining whether the second set of pixels has been coded; and determining, for the current block, a prediction block using the first set of pixels and the second set of pixels based on the determination of whether the second set of pixels has been coded.

Abstract: A video processing system dynamically adjusts video processing prediction error reduction computations in accordance with the amount of motion represented in a set of image data and/or available memory resources to store compressed video data. In at least one embodiment, video processing system adjusts utilization of prediction error computational resources based on the size of a prediction error between a first set of image data, such as current set of image data being processed, and a reference set of image data relative to an amount of motion in a current set of image data. Additionally, in at least one embodiment, the video processing adjusts utilization of prediction error computation resources based upon a fullness level of a data buffer relative to the amount of motion in the current set of image data.

Abstract: An image synthesis device includes a real image acquisition unit configured to acquire a real image, a post-substitution object image acquisition unit configured to acquire a post-substitution object image that is substituted for a pre-substitution object image included in the real image and synthesized with the real image, a masking object image region detection unit configured to detect a region of a masking object image that masks the pre-substitution object image in the real image, a masked portion cut-out unit configured to cut out a portion corresponding to the region of the masking object image from the post-substitution object image, and a synthesis execution unit configured to perform the synthesis of the post-substitution object image which the portion corresponding to the region of the masking object image has been cut out from the real image.

Abstract: Subject matter disclosed herein relates to arrangements and techniques that provide for identifying objects within an image such as the face position of a user of a portable electronic device. An application specific integrated circuit (ASIC) is configured to locate objects within images. The ASIC includes an image node configured to process an image and a search node configured to scale the image and search the scaled image for an object in the image. The ASIC also includes an ensemble node configured to confirm the presence of the object in the image. The ASIC is configured to convert scaling ratios from real-type numbers to integer-type numbers.

Abstract: When coding multiview video data, a video encoder and video decoder may select a candidate picture from one of one or more random access point view component (RAPVC) pictures and one or more pictures having a lowest temporal identification value. The video encoder and video decoder may determine whether a block in the selected candidate picture is inter-predicted with a disparity motion vector and determine a disparity vector for a current block of a current picture based on the disparity motion vector. The video encoder and video decoder may inter-prediction encode or decode, respectively, the current block based on the determined disparity vector.

Abstract: There is described herein a system and method for processing data streams in a codec having multiple modules, whereby each module may process macroblocks using its own designated processing order. The processing order of a first module may differ from the processing order of a second module.

Abstract: HDMI is a digital audio and video communications protocol commonly used in consumer electronics. HDMI is particularly synonymous with high fidelity audio and video. Even though HDMI is a digital communications protocol, the audio quality can be impaired by analog signal impairments and distortions even if there are no digital decoding errors. In particular, the very process by which the audio is converted from Digital (HDMI) to human audible “Analog Audio” can be prone to errors. This occurs when the Digital to Analog Converter (DAC) clock, which is derived from the HDMI TMDS clock or HDMI source, is “distorted” due to its jitter, resulting in erroneous sampling or outputting of vital audio samples, thereby reducing the audio quality of the experience. The present invention reduces the jitter on the TMDS clock, and hence the audio DAC clock, resulting in lower audio distortion.

Abstract: A router module is arranged in a housing of a smart television. The router module is externally connected to a modem for surfing the Internet. The router module is electrically connected to a micro processing unit of the smart television. Therefore, the smart television is connected to the Internet through the router module. A wireless transmission chip of the router module is configured to process Internet signals. An antenna module is configured to wirelessly transmit the Internet signals, so that wireless network is shared to outside.

Abstract: The present technology relates to a transmitter apparatus, an information processing method, a program, and a transmitter system capable of easily transmitting a wideband signal. The transmitter apparatus includes: a first acquisition unit that obtains first transmission control information; a second acquisition unit that obtains second transmission control information similar to information input to another transmitter apparatus; and a generating unit that processes transmission target data based on a parameter contained in the first transmission control information and generates data including the processed transmission target data and the second transmission control information. The present technology can be applied to a transmitter apparatus that transmits a DVB-C2 signal.

Abstract: A method is for monitoring the electrical integrity of lines of photosites of an imaging device with matrix array of photosites. The control lines of photosites may include for each line of photosites an emission of elementary electrical control signals for the photosites of the line. The method may include diagnosis of the elementary electrical control signals emitted.

Abstract: System and method for compressing and decompressing of differentially encoded video streams. I-frames of the encoded video stream may be relatively compressed and decompressed, thereby reducing video data size of an already encoded video stream. Compression and decompression may be lossless processes and may typically require relatively low processing power and small memory sizes.

Abstract: There are provided methods and apparatus for video coding using prediction data refinement. An apparatus includes an encoder for encoding an image region of a picture. The encoder has a prediction refinement filter for refining at least one of an intra prediction and an inter prediction for the image region. The prediction refinement filter refines the inter prediction for the image region using at least one of previously decoded data and previously encoded data, the previously decoded data and the previously encoded data corresponding to pixel values in neighboring regions with respect to the image region.

Abstract: A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, a complete index that can be used to locate each data chunk in each of these tracks and an abridged index that can enable the location of a subset of the data chunks in each track, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file.

Abstract: The invention provides a method for performing intra-prediction. A target pixel is selected from a plurality of pixels of a current block. A first intra-prediction mode of a left block and a second intra-prediction mode of an up block are then determined. A first prediction value of the target pixel is calculated according to the first intra-prediction mode. A second prediction value of the target pixel is calculated according to the second intra-prediction mode. The first prediction value and the second prediction value are then weighted-averaged to obtain a weighted-average prediction value as an intra-prediction value of the target pixel.

Abstract: The invention relates to a method for reconstructing a picture that is part of a sequence of pictures, from coded digital data, representative of said current picture. It comprises the following steps: construct, for each picture block, first and second prediction blocks (from a first picture and a second picture previously reconstructed, and calculate, for each block, a confidence value representative of the proximity between the visual content of the first predictive block and the visual content of the second predictive block, and reconstruct each block from a part of said coded digital data representative of said block and initial auxiliary data calculated from the first and second predictive blocks when the block confidence value is greater than a predetermined threshold.

Abstract: A decoding apparatus includes a standard predicted image generating unit which generates a standard decoded image and a standard predicted image of standard image quality; a non-standard decoded image generating unit which generates a non-standard decoded image different in image quality based on a prediction error information; a non-standard predicted image generating unit which generates a non-standard predicted image different in image quality based on the non-standard decoded image; and a correction value calculating unit which calculates correction values corresponding to differences between the standard and non-standard predicted images. The non-standard decoded image generating unit includes a predicted image reconstructing unit which corrects the non-standard predicted image, and a decoding unit which inverse-quantizes the prediction error information and adds the inverse-quantized prediction error information and the corrected non-standard predicted image to generate the non-standard decoded image.

Abstract: An image encoding method includes determining a corresponding point on a target image for encoding, which corresponds to each pixel on a reference image, based on the distance from a camera used for obtaining the reference image to an imaged object, and a positional relationship between cameras; computing a parallax vector from the position of the pixel to the corresponding point in the pixel space; computing a target predictive vector having the same starting point as the parallax vector and components obtained by rounding off the components of the parallax vector; computing a target reference vector having the same starting point as the parallax vector and the same size and direction as a differential vector between the target predictive vector and the parallax vector; and setting a predicted pixel value of a pixel on the target encoding image, which is indicated by the target predictive vector, to a value of a pixel on the reference image, which is indicated by the target reference vector.

Abstract: A method and system for low-latency processing of intra-frame video pixel block prediction including: predicting a pixel block based on boundary pixels of left and upper neighbor blocks of said pixel block; subtracting said predicted pixel block from a source pixel block to generate a prediction error; forward transforming and quantizing said prediction error to generate a residual data; inverse transforming and quantizing said residual data; adding said predicted pixel block to said inverse transformed and quantized residual data to generate a reconstructed pixel block; pre-computing blocks of DC-coefficients used with luma and chroma intra prediction modes; pre-computing mode selection of a best prediction mode of said luma and chroma intra prediction modes; and outputting said residual data to be used in entropy or arithmetic coding, and a reconstructed data used for motion prediction.

Abstract: Provided are an apparatus and method for effectively compressing and restoring edge areas in an image. Therefore, by predicting values of pixels positioned at each directional edge, among pixels constructing a 2×2 block in a current image, using values of neighbor pixels of the pixels positioned at each directional edge, selecting an edge mode corresponding to a directional edge in which the difference between the predicted values and actual values of the pixels is a minimum, and outputting edge mode data indicating the edge mode instead of the predicted values corresponding to the edge mode, it is possible to effectively compress edge areas in which little similarity exists between pixel values, and accordingly improve a compression rate of edge areas.

Abstract: A method for compressing and transmitting a sequence of video frames represented by arrays of digital pixel values includes the following steps: transmitting a representation of a first frame (I1) of the sequence; deriving a sorting permutation P1 of the first frame; using the sorting permutation of the first frame, P1, to approximately sort a second frame (I2) of the sequence, to obtain approximately sorted frame P1(I2); and compressing and transmitting the approximately sorted frame P1(I2).

Abstract: Intra-frame prediction coding data of a channel that the viewer is not viewing is stored. When the viewer has switched channels to be viewed, the stored intra-frame prediction coding data is output during a period before intra-frame prediction coding data of the newly selected channel is received.

Abstract: Methods and apparatuses for encoding and decoding a multi-view image are provided. The method of encoding the multi-view image can use a difference in views between pictures of the multi-view image, add an image area obtained from a picture at one view at a first time to a picture at another view at a second time, thereby generating a reference picture, and perform prediction encoding using the generated reference picture, thereby increasing prediction encoding efficiency.

Abstract: A method, system, and apparatus are directed towards computing minimum mean squared error (MMSE) predictive-transform (PT) source coding integrated with subband compression to further improve the performance of low bit rate MMSE PT source coders. A desirable byproduct of the advanced scheme is that the incorporation of joint optimum prediction and transformation from subband to subband is ideally suited to its integration with JPEG2000 to yield even higher compression levels while producing an outstanding objective as well as subjective visual performance.

Abstract: A multi-view video signal is encoded. The multi-view video signal includes picture signals corresponding to different viewpoints respectively. One among the viewpoints is designated as a base viewpoint. The base viewpoint corresponds to a picture signal which is encoded without referring to at least one picture signal corresponding to one of the viewpoints except the base viewpoint. There is determined a desired delay time of the start of decoding a coded signal originating from each of the picture signals corresponding to the viewpoints except the base viewpoint relative to the start of decoding a coded signal originating from the picture signal corresponding to the base viewpoint. Information representing the determined delay time is generated. Then, the generated information is encoded.

Abstract: Provided are an image encoding method and apparatus and an image decoding method and apparatus that are capable of canceling a correlation remaining in a residual image by predicting the residual image by using residual pixel values of restored neighboring pixels of a current block and then encoding only the difference between the residual image and a predicted image of the residual image, where the residual image is obtained using an inter color compensation algorithm that predicts one of a plurality of color component images constituting an image by using one of the remnants of the color component images.

Abstract: A residual picture is produced and encoded that is a residual picture that is a residual signal between a picture to be coded that is an input moving-picture video signal to be subjected to coding and a predictive picture produced from a reference picture that is a local decoded video signal for each of a plurality of rectangular zones, each composed of a specific number of pixels, into which a video area of the moving-picture video signal is divided. A boundary condition of each of a plurality of borders is obtained between the rectangular zones and another plurality of rectangular zones adjacent to the rectangular zones, and a border, of the reference picture, having a boundary condition that matches the boundary condition, is found by motion-vector search in the reference picture, and border motion-vector data is generated that is data on a motion vector from a border of the rectangular zone in the picture to be coded to the border of the reference picture thus found.

Abstract: An automatic process for performing CMY (Cyan, Magenta, Yellow) registration for film digital restoration. After three color components Cyan, Magenta, and Yellow of a picture are scanned into files, each component is divided into blocks, and edge detection is applied to each block, and an edge match is performed. The data of displacements is processed, and then affine transform parameters are calculated. The affine transform is then applied for each block, and warping is used to combine the color components and obtain the registered picture of a color component.

Abstract: In difference coding, each of a first to M-th channel signals is divided into frames and independent energy of every channel signal and difference energy of difference signals between all channel signals are calculated for each frame. In ascending order of energy, if a signal corresponding to an energy value is independent signal, it is determined that independent coding should be used for the signal. If the signal is a difference signal and the type of coding for one of channel signals has been determined, it is determined that the other should be difference-coded using the former channel signal as a reference signal. If the type of coding for neither of the channel signals has been determined, it is determined that one of them should be independently coded and the other should be difference-coded using the former channel signal as a reference signal.

Abstract: A quantization matrix used in inverse quantization is generated. A received bitstream includes a coded truncated quantization matrix. The coded truncated quantization matrix has first coded bits and second coded bits. The first coded bits include bits obtained by coding a transmitting part of quantization elements and the second coded bits includes bits obtained by coding an end code. The coded truncated quantization matrix is decoded until the second coded bits corresponding to the end code are read out, to obtain the transmitting part of quantization elements. At least one additional quantization element is obtained. A complete quantization matrix is generated, using the transmitting part of quantization elements and at least one additional quantization element, by ordering the transmitting part of quantization elements and at least one additional quantization element in a zig-zag scan.

Abstract: A computer readable medium for compressing video data with an edit track is provided. Generally, computer readable code for compressing video data is provided. The computer readable code for compressing comprises computer readable code for accessing the edit track to use data in the edit track during the compressing. A method of compressing video data with an edit track is provided. Generally, video data is compressed. The compressing comprises accessing the edit track to use data in the edit track during the compressing. A system for compressing video data is also provided. An edit track reader for accesses data within the edit track and generates instructions based on the data within the data track. A video compressor receives instruction from the edit track reader and receives the edited video track and audio track, and compresses the edited video according to the instructions from the edit track reader.

Abstract: An embodiment of the present invention includes a receiver, and a selector. The receiver receives a default stream and N restart sub-streams from a transmitter over a transmission path, N is an integer equal to at least 1 and is selected according to a selection. The default stream is coded by a multiple description (MD) coding. The N restart sub-streams are coded by a predictive coding and sampled according to a sampling pattern. The default and N restart sub-streams correspond to a media content. The selector selects a receiving stream from the default stream and one of the N restart sub-streams according to a loss status in the default stream.

Abstract: An embodiment of the present invention includes a buffer, a selector, and an analyzer. The buffer stores at least a default stream coded by a multiple description (MD) coding and a restart stream coded by a predictive coding. The default and restart streams correspond to a media content. The selector selects a transmit frame from the default and restart streams according to a transmission status. The transmit frame is transmitted to a receiver. The analyzer provides the transmission status based on feedback information provided by the receiver.