Abstract: Certain embodiments teach a variety of experience or “sentio” codecs, and methods and systems for enabling an experience platform, as well as a Quality of Experience (QoS) engine which allows the sentio codec to select a suitable encoding engine or device. The sentio codec is capable of encoding and transmitting data streams that correspond to participant experiences with a variety of different dimensions and features. As will be appreciated, the following description provides one paradigm for understanding the multi-dimensional experience available to the participants, and as implemented utilizing a sentio codec. There are many suitable ways of describing, characterizing and implementing the sentio codec and experience platform contemplated herein.

Abstract: Methods of encoding and decoding for video data are described for encoding or decoding multi-level significance maps while enabling pipelining of the BAC engine. In one example, coefficient groups are redefined to remove the significant-coefficient flags of the first and last position of a block and replace them with significant-coefficient flags of the last position in the previous block and the first position in the next block. A modified scan order is applied to each coefficient group. In another example, the coefficient groups remain block-based, but the scan order is modified to interleave the encoding and decoding sequential coefficient groups.

Abstract: The present invention relates to a video signal decoding method for adding an intra prediction mode as a sub-macroblock type to prediction of a macroblock in coding a video signal. The present invention includes obtaining a macroblock type, when a macroblock includes the intra prediction coded sub-macroblock and the inter prediction coded sub-macroblock based on the macroblock type, obtaining prediction mode flag information indicating whether the sub-macroblock is the intra prediction coded or the inter prediction coded, and obtaining a prediction value of the sub-macroblock based on the prediction mode flag information. Accordingly, the present invention is able to raise coding efficiency of video signal by adding an intra prediction mode as a sub-macroblock type in predicting a macroblock.

Abstract: A rear camera system for a vehicle with a rear-lift door including a camera unit mounted on the rear-lift door, the rear-lift door having open and closed positions, the camera unit having a first field of view when the rear-lift door is in the open position and a second field of view when the rear-lift door is in the closed position, the first and second fields of view overlapping in a shared field of view; a sensor configured to indicate when the rear-lift door is in the open or closed position; a controller configured to receive image data from the camera unit, determine whether the rear-lift door is in the open or closed position based on a signal received from the sensor, and adjust the image data to primarily include the shared field of view based on whether the rear-lift door is in the open position or the closed position.

Abstract: A frequency of each gradation in an image for the left eye histogram is compared with a frequency of each gradation in an image for the right eye histogram. An integration histogram is generated using at least a larger one of the frequency of each gradation in the image for the left eye histogram and the frequency of each gradation in the image for the right eye histogram. A gradation correction parameter is set based on the generated integration histogram. The gradations of the image for the left eye and the image for the right eye are corrected using the gradation correction parameter.

Abstract: The invention relates to a method for encoding of a bit amount of a data section and to a corresponding decoding method. Furthermore, the invention relates to encoding, decoding, transmission and/or storage of audio and/or video data wherein said method for encoding of a bit amount of a data section and/or said corresponding decoding method are used in processing of the audio and/or video data. Said method for encoding of a bit amount of a data section comprises the steps of encoding said bit amount indicating integer as a first number of equally valued bits followed by a stop bit of different value wherein said first number equals said bit amount increased by a threshold value. Using said method, quotients of values larger than a threshold can be encoded using unary as well as binary code wherein quotients of values smaller than the threshold can be encoded in unary code.

Abstract: A luminance signal and a color information signal having high S/N ratios are generated by combining a visible luminance image component and an infrared image component at an appropriate ratio according to brightness of a subject such as brightness on a sunny day or brightness in darkness. An image pickup element 3 picks up a ye image component Dye, an R image component DR, an infrared image component DBlk and a luminance image component DW. An evaluation value calculator 41 calculates an evaluation value eDW and an evaluation value eDBlk by adding pixel values of the luminance image component DW and pixel values of the infrared image component DBlk in a local area, and calculates an evaluation value e (=eDW?eDBlk). A factor determiner 51 determines weighting factors k, kw from the evaluation value e.

Abstract: Mobile camera localization using depth maps is described for robotics, immersive gaming, augmented reality and other applications. In an embodiment a mobile depth camera is tracked in an environment at the same time as a 3D model of the environment is formed using the sensed depth data. In an embodiment, when camera tracking fails, this is detected and the camera is relocalized either by using previously gathered keyframes or in other ways. In an embodiment, loop closures are detected in which the mobile camera revisits a location, by comparing features of a current depth map with the 3D model in real time. In embodiments the detected loop closures are used to improve the consistency and accuracy of the 3D model of the environment.

Abstract: Described are methods and systems for processing data. A motion estimator uses a block of an input frame of video data and a block of a reference frame of video data to generate motion vectors according to a first encoding scheme. A motion compensator produces half pel motion vectors from the motion vectors according to a second encoding scheme that is different from the first encoding scheme.

Abstract: A motion vector generation apparatus which generates a motion vector utilized to execute motion-compensated encoding based on comparison between a block to be encoded in an image to be encoded and a reference block in a reference image. The apparatus sequentially selects a candidate from a plurality of motion vector candidates, sequentially calculates differences between pixel values of the block to be encoded and pixel values of the reference block corresponding to respective motion vector candidates, calculates, as an average difference, differences between an average pixel value obtained by averaging the pixel values of the block to be encoded and respective pixel values of the block to be encoded, decides a weighting coefficient based on a ratio between a minimum difference and the average difference, and calculates, for each selected motion vector candidate, an evaluation value for deciding a motion vector candidate having a minimum evaluation value.

Abstract: A method and apparatus including a camera collecting video images of a secured area, extracting objects; for each extracted object determining an object size, correcting the object size, for each extracted object determining, an object size, an object aspect ratio, an object speed and object motion path track, comparing the distance corrected object size with a statistical bell curve tuned to nominal human size, comparing aspect ratio to a statistical bell curve tuned to nominal aspect ratio of human proportions, comparing object speed to a statistical bell curve tuned to nominal travel speed of a typical human and comparing object motion path track against ramp function of absolute distance traveled over time, determining a respective threat probability for each of the extracted object signatures based upon the corrected object size, summing the respective threat probabilities and generating an motion alert upon detecting the summed threat probabilities exceeding a threshold value.

Abstract: A method for measuring distortion is provided. In one embodiment, the method for measuring distortion of a current block, used to estimate motion by estimating high-frequency and low-frequency components of the current block, comprises: calculating the sum of distortion values of the high-frequency component of the current block; calculating the sum of first distortion values of the low-frequency component of the current block; calculating a second distortion value of the low-frequency component of the current block; and adding the sum of the distortion values of the high-frequency component and the second distortion value of the low-frequency component of the current block.

Abstract: A depth-sensing camera system includes a common sensor configured to record color and infrared data from a target, an infrared illuminant that projects infrared light on the target, and a control logic that switches a mode of operation of the. camera between a color mode and an infrared mode. When the camera system is in the infrared mode, the infrared illuminant operates to project the infrared light on the target and when in the color mode, the infrared illuminant is disabled. The camera system also includes a color buffer for storing color chroma and luma values and a depth buffer for storing infrared luma data.

Abstract: Rate control is provided in a two-pass encoder. A first encoding pass is performed to encode an input video sequence. Coding statistics for the first encoding pass are collected. Target coding parameters for a second encoding pass are calculated based on the coding statistics for the first encoding pass. The second encoding pass is performed to encode the input video sequence at a constant bit rate (CBR) using the target coding parameters to form a second pass encoded stream.

Abstract: An object is to provide a vehicle periphery monitoring device wherein distortions in a captured image containing an edge of the vehicle body can be corrected so that parallel perception is the same as in actual space, and wherein images readily discernible to the driver can be displayed. The edge of the vehicle body is included in the image captured by a camera provided to the vehicle. A Y-axis along the edge of the vehicle body and an X-axis orthogonal to the Y-axis are set in the captured image. Distortions are corrected so that the X-axis is enlarged at a magnification ratio ? that increases in a nonlinear fashion that depends of the distance from the X-axis while the Y-axis is kept substantially fixed. The captured image thus corrected for distortion is displayed on an onboard monitor.

Abstract: A signal processor includes: a phase matching section adapted to bring two image signals supplied from two cameras into phase, one image signal being a left image signal and the other image signal being a right image signal; a phase adjustment section adapted to change the horizontal phase of the left and/or right image signal based on a phase displacement so as to move both or either of the left and right images horizontally by a predetermined distance and output the image signals with changed parallax between the left and right images; and a read section adapted to output the left and/or right image signal in which, of those areas displayed three-dimensionally and other areas where only the left or right image is displayed two-dimensionally, the image in the two-dimensionally displayed areas has been replaced by an image different from that in the three-dimensionally displayed areas.

Abstract: A video encoding method includes selecting a reference vector target frame and a reference frame from among already-encoded frames; encoding information for designating each frame; setting a reference vector for indicating an area in the reference vector target frame with respect to an encoding target area; encoding the reference vector; performing a corresponding area search by using image information of a reference vector target area, which belongs to the reference vector target frame and is indicated by the reference vector, and the reference frame; determining a reference area in the reference frame based on the search result; generating a predicted image by using image information of the reference frame, which corresponds to the reference area; and encoding differential information between image information of the encoding target area and the predicted image.

Abstract: A single progressive 1080P60 side-by-side 3D video or a single progressive 1080P60 2D video is captured for transmission to interlaced receivers such as a legacy 1080i capable video receiver. A video transmitter splits the captured 1080P60 video into a plurality of even-indexed line pictures and odd-indexed line pictures. Lines of the plurality of even-indexed line pictures and odd-indexed line pictures are reassembled to generate two interlaced video sequences such as two 1080i video sequences. The video transmitter compresses the generated two 1080i video sequences, respectively, utilizing different compression algorithms, for example. Pictures that originate from the same one of the plurality of pictures in the captured 1080P60 video may be synchronized for a progressive display at the legacy 1080i capable video receiver. The legacy 1080i capable video receiver may decode the synchronized pictures from the video transmitter so as to restore the captured 1080P60 video for display in progressive format.

Abstract: A system, apparatus, and method for filtering a decoded video stream having a plurality of frames, each frame having a plurality of blocks. The method can include selecting a current block from a current frame of the plurality of frames and an adjacent block from the current frame of the plurality of frames, the current block being adjacent to and sharing an edge with the adjacent block and filtering the edge between the current block and the adjacent block using a processor if an output from an edge-detection function of the values of at least four pixels located about the edge and within a line of pixels extending through both the current block and the adjacent block is less than an edge threshold.

Abstract: An apparatus for decoding residual data based on a bit plane and a method thereof, capable of achieving a significant reduction in data traffic between a memory and a functional module in a parallel decoding system, include a variable length decoding module configured to generate residual data for each macroblock from a bit stream, divide the residual data into groups, and generate a bit plane regarding each of the groups, and a variable length decoding memory configured to store the bit plane generated from the variable length decoding module and store the residual data of the groups according to a value of the bit plane.