Abstract: A display device and method are provided. The display device includes a projector that is configured to project light based on an image signal per frame unit on a screen and a light receiving sensor that is configured to output a voltage proportional or inversely proportional to an amount of light reflected by the screen among the light according to the image signal. A controller is configured to measure the amount of light reflected by the screen based on the voltage output from the light receiving sensor, to detect an abnormal position at which the voltage that corresponds to the amount of light reflected by the screen exceeds a predetermined reference voltage, and to adjust an image signal to be projected on the abnormal position in a subsequent frame.

Abstract: Signal detection and recognition employees coordinated illumination and capture of images under to facilitate extraction of a signal of interest. Pulsed illumination of different colors facilitates extraction of signals from color channels, as well as improved signal to noise ratio by combining signals of different color channels. The successive pulsing of different color illumination appears white to the user, yet facilitates signal detection, even for lower cost monochrome sensors, as in barcode scanning and other automatic identification equipment.

Abstract: In an image capturing apparatus, a subject image is converted into an image signal, which undergoes automatic correction processing including white balance correction processing, and further undergoes image quality change processing. A first evaluation value indicating a largest value of an R signal, a G signal, and a B signal of the image signal undergone the image quality change processing and a second evaluation value indicating a luminance of the image signal undergone the image quality change processing are detected. A control evaluation value is calculated using weighted average of the first evaluation value and the second evaluation value according to at least one of an amount of image quality changing effect due to the image quality change processing and a reliability of the automatic correction processing, and exposure control is performed based on the control evaluation value.

Abstract: Disclosed herein are an imaging apparatus, an imaging method, a recording medium, and a program which are capable of processing imaging data in a manner similar to that of a normal frame rate. Image data captured by a solid-state imaging element capable of performing imaging at a high resolution and a high frame rate is supplied to a memory control. The memory control, at the same time as writing the imaging data input from the imaging element in a frame memory, reads preceding frames of imaging data that are recorded on the frame memory, and sequentially respectively outputs them in parallel, as video image data items, for each frame, to respective camera signal processing units. In the camera signal processing units, a video output, a viewfinder output, codec units, and recording units, processing similar to that when a frame rate that is ¼ the imaging frame rate is executed.

Abstract: A time lapse video is created in real-time, without post-production. User configurations are set for a time lapse video recording. A real-time video feed is received into a buffer. Based on a user configuration for frequency, certain frames in the buffer can be discarded prior to generating the video file. The time lapse video is output as a video file according to user configurations.

Abstract: A method and apparatus for representing allocation of capacity of a storage unit within an audio/video (AV) recording device is described. In one example, a quantity of AV program data stored on the storage unit is determined. A storage schedule for new AV program data that is defined over a predetermined time period is obtained. A deletion schedule for old AV program data that is defined over the predetermined time period is obtained. Temporally dynamic indicia is produced that is representative of allocation of the capacity of the storage unit over the predetermined time period in response to the quantity of stored AV program data, the storage schedule, and the deletion schedule. A pictorial representation of the temporally dynamic indicia may then be displayed on a display coupled to the AV recording device.

Abstract: An electronic apparatus including an imaging unit detects the attitude of the electronic apparatus, and performs specific processing for an image captured by the imaging unit based on the detected attitude. When performing interval recording in which an image captured by the imaging unit is recorded at an interval based on a predetermined setting interval, the electronic apparatus performs, for images recorded in the second and subsequent operations, the specific processing based on information of an attitude used to perform the first image recording operation.

Abstract: An image processing method according to the present invention cuts out partial images corresponding to trimming regions, which is specified for multiple viewpoint images of a stereoscopic image obtained by pupil-division-scheme imaging, from the respective viewpoint images, generates a stereoscopic partial image including multiple partial images, generates parallax information that indicates the parallax between the partial images, adjusts the parallax between the partial images based on the parallax information, and then, for the partial images after the parallax adjustment, enhances the sharpness as the adjusted parallax amount decreases and reduces the sharpness as the adjusted parallax amount increases.

Abstract: An image generation apparatus includes a holding unit configured to acquire and hold pixel values of pixel groups that serve as targets for comparison from the respective first and second images; a reading unit configured to sequentially read out, from the pixel values of the respective pixel groups that are held in the holding unit, pixel values in one direction for each area that is set depending on a pixel position of the range image; a calculation unit configured to calculate an evaluation value based on the pixel values read out by the reading unit; an estimation unit configured to estimate the subject distance based on the evaluation value; and a generation unit configured to generate a range image based on the subject distance estimated by the estimation unit.

Abstract: Provided are three-dimensional (3D) data processing apparatus and method. 3D stereoscopic image common format data preserving common 3D image information is defined by converting 3D stereoscopic image data of each format to apply the same 3D image processing algorithm to 3D data of various formats, and native format data of each format is maintained to maintain merits of each format, and a format-specific algorithm table is maintained with respect to a common 3D image processing function, whereby the same 3D image processing algorithm may be applied to various 3D data and a unique algorithm allowing for maintaining the merits of each 3D data may be applied.

Abstract: Depth information can be used to assist with image processing functionality, such as various calibration approaches to determine and correct for misalignments between cameras. In at least some embodiments, depth information obtained from stereo imaging or distance sensing, for example, can be used to segment an image or frame of video into at least a foreground object and a background object. Once the foreground and background object has been determined, information about that objects can be used to determine a mapping, and once a subsequent stereoscopic image is captured using the cameras, the mapping can be applied to each image to account for misalignment effects due to a misaligned stereo camera pair before providing the stereoscopic image for display.

Abstract: A method of image processing in a structured light imaging device is provided that includes receiving a captured image of a scene, wherein the captured image is captured by a camera of a projector-camera pair in the structured light imaging system, and wherein the captured image includes a pre-determined hierarchical binary pattern projected into the scene by the projector, wherein the pre-determined hierarchical binary pattern was formed by iteratively scaling a lower resolution binary pattern to multiple successively higher resolutions, rectifying the captured image to generated a rectified captured image, extracting a binary image from the rectified captured image at full resolution and at each resolution used to generate the pre-determined hierarchical binary pattern, and using the binary images to generate a depth map of the captured image.

Abstract: Machine learning method that learns to convert 2D video to 3D video from a set of training examples. Uses machine learning to perform any or all of the 2D to 3D conversion steps of identifying and locating objects, masking objects, modeling object depth, generating stereoscopic image pairs, and filling gaps created by pixel displacement for depth effects. Training examples comprise inputs and outputs for the conversion steps. The machine learning system generates transformation functions that generate the outputs from the inputs; these functions may then be used on new 2D videos to automate or semi-automate the conversion process. Operator input may be used to augment the results of the machine learning system. Illustrative representations for conversion data in the training examples include object tags to identify objects and locate their features, Bézier curves to mask object regions, and point clouds or geometric shapes to model object depth.

Abstract: There is provided an image processing device including an image acquisition part acquiring an image; a depth acquisition part acquiring a depth associated with a pixel in the image; a depth conversion part converting the depth in accordance with a function having a characteristic to nonlinearly approach a predetermined value with an increase in the depth; and a storage part storing the converted depth in association with the image.

Abstract: A stereoscopic image output system includes a stereoscopic vision output unit, an image database storage unit, and an output control unit. The stereoscopic vision is realized by outputting, from the stereoscopic vision output unit, a left-eye image and a right-eye image with parallax such that the left and right-eye images are visually recognized by the left and right eyes, respectively. Left-eye parallel projection data and right-eye parallel projection data are generated by parallel projection of a three-dimensional model using respective projection angles set for the left eye and right eye so as to produce the parallax therebetween, and stored in the database storage unit as two-dimensional drawing data. The output control unit controls an output range of the left and right-eye images. If the output range for the stereoscopic image changes, moving directions of the left-eye image and the right-eye image are individually determined by the output control unit.

Abstract: A method is provided for controlling stereoscopic display. The method includes a collection device obtaining a position variation between a space position of a viewer at the current time and a space position of the viewer at the previous time, wherein the position variation is an offset of parallel translation of the space position of the viewer relative to a display panel. The method also includes an adjusting device adjusting a stereoscopic display apparatus based on the space position of the viewer at the current time and the position variation.

Abstract: A stereoscopic display system including a display apparatus and an image guiding plate is provided. The display apparatus provides diverge images. The display apparatus includes a plurality of stereoscopic display unit groups. Each of the stereoscopic display unit groups includes at least one stereoscopic display unit. Each of the stereoscopic display units includes a plurality of pixel groups. In each of the stereoscopic display units, the pixel groups provide a plurality of image beams corresponding to parts of the diverge images. Different stereoscopic display units correspond to different parts of the diverge images. The image guiding plate is disposed on a transmission path of the image beams. The image guiding plate includes a plurality of optical structures arranged periodically, so as to respectively guide the image beams to a plurality of directions. Furthermore, an image display method of the foregoing stereoscopic display system is provided.

Abstract: Ghosting of images can be produced by the use anaglyph techniques to produce stereoscopic images. Ghost effects can be produced when filtering is applied to images by displays such as televisions or monitors. Techniques and apparatus are described for reducing or cancelling ghost effects. Anaglyph ghost reduction information can be produced to reduce or cancel ghost effects.

Abstract: A method and system using hardware and software to enhance the realism, capabilities and efficiencies when generating and displaying 3D content is disclosed.

Abstract: An image capturing device, control method for grouping image capturing devices, and control system thereof are provided. The control method is applied in the control system for controlling image capturing devices. Every image capturing device includes a direction detection unit for indicating a current direction, a command receiving unit, a computing unit, a driving unit and an image capturing unit. The control method comprises the following steps. A steering command for indicating a specified region is provided to at least two image capturing devices. The computing unit calculates a steering angle according to the current direction and specified region. The driving unit drives the image capturing device to capture the specific region according to the steering angle.

Abstract: Iterative video encoding systems, methods and computer program products, where residue quantization and data packing operations of an encoding process may he repeated with various values for a quantization parameter, without repeating the determination of macroblock prediction codes. In an embodiment, the size of an actual file generated by encoding is compared to a target file size. The QP may be adjusted depending on the amount by which these file sizes differ. The quantization and packing may then be repeated with the adjusted QP. In an embodiment, a greater difference in these file sizes results in a greater adjustment to the QP.

Abstract: To prevent deterioration in performance that is caused by the processing for copying a context parameter between memories, an image processing apparatus writes an updated context parameter into context memories corresponding to respective entropy coding units and into a shared context memory, until it completes encoding processing for M blocks positioned on the left side of a slice.

Abstract: In some embodiments, a video (e.g. MPEG-2, H.264) transcoder channel pool is used to transcode multiple independent videos (programs) per channel substantially concurrently. A syntactically-unified combined input video stream is assembled by interleaving segments of different input video streams. The combined stream may be a container stream or elementary stream. Each segment includes one or more groups of pictures (GOP). The combined stream includes the payload video data of the input streams in unmodified form, and modified header data characterizing the combined stream as a single video stream. The combined input stream is transcoded using a single transcoder channel/input port to generate a combined output video stream. Multiple independent output video streams are assembled by de-interleaving segments of the combined output video stream according to stored interleaving break identifiers.

Abstract: A reduction in residual energy of inter-frame prediction with motion compensation and improvement in encoding efficiency are achieved by using a region-dividing type adaptive interpolation filter that takes an edge property of a picture into consideration. An edge calculation unit calculates edge information from reference picture data designated by a motion vector. A region dividing unit divides an encoding target frame into a plurality of regions that are units to which interpolation filters are adaptively applied based on the edge information. A filter coefficient optimizing unit optimizes an interpolation filter for a fractional-accuracy pixel for each of the regions. A reference picture interpolating unit interpolates the fractional-accuracy pixel of a reference picture using the optimized interpolation filter, and a predictive encoding unit performs predictive encoding using motion compensation of fractional-accuracy.

Abstract: Systems and methods may provide for the detection, location, and processing of static pixels during video processing. In one example, the method may include determining if a color component value of a pixel located at a pixel location remains constant between a first frame and a next frame, determining if the pixel is a low-difference pixel, calculating a motion-compensation error of the color component, determining if the motion compensation error of the color component is large, and generating a map of static pixels including the pixel.

Abstract: An image decoding method includes: obtaining, from a bitstream, a first temporal motion vector prediction flag, which is a temporal motion vector prediction flag indicating whether or not temporal motion vector prediction is to be used, indicating that temporal motion vector prediction is not to be used on a first picture; decoding the first picture without using the temporal motion vector prediction; and decoding a second picture which follows the first picture in decoding order, with referring to a motion vector of a picture preceding the first picture in decoding order being prohibited.

Abstract: A receiving apparatus comprises a receiver for receiving a video signal, an output for outputting the video signal to a screen, storage device or further terminal; and a concealment module for applying a concealment algorithm to a lost area of the video signal. The concealment module is configured to determine an estimate of concealment quality selectively directed toward a region of interest within the area in question, and based on this estimate to determine whether or not to apply the concealment algorithm.

Abstract: The present invention provides an image encoding/decoding technique that is capable of achieving the higher compression efficiency. An image encoding method comprises: an intra prediction step which performs intra prediction on a block basis to generate a predicted image; a subtraction step which calculates the difference in prediction between the predicted image generated by the intra prediction step and an original image; a frequency conversion step which performs frequency conversion processing for the difference in prediction; a quantization step which subjects the output of the frequency conversion step to quantization processing; and a variable-length encoding step which subjects the output of the quantization step to variable-length encoding processing; wherein the intra prediction encoding step predicts a target pixel to be encoded by use of pixel values of two reference pixels between which the target pixel to be encoded is located.

Abstract: Computer-implemented techniques that leverage available CPU resources to incrementally improve quality and compression of media for faster transfer over data networks for improved viewing are described.

Abstract: An image encoding and decoding method comprising: a coefficient calculator for calculating adaptive interpolation filter coefficient of a current frame; an image encoder for interpolating reference frames using the adaptive interpolation filter coefficient of the current frame and encoding the current frame using the interpolated reference frames; a filter flag encoder for generating and encoding a coefficient-inserted flag or coefficient non-inserted flag as a filter flag according to the adaptive interpolation filter coefficient of the current frame; a coefficient encoder for encoding the adaptive interpolation filter coefficient of the current frame when the filter flag is a coefficient-inserted flag; and a bit stream generator for generating and outputting a bit stream, which includes the encoded current frame and encoded filter flag, and further includes encoded adaptive interpolation filter coefficient of the current frame when the filter flag is the coefficient-inserted flag.

Abstract: Provided is an apparatus for decoding an image that adaptively filters reference pixels according to an intra prediction mode and a size of a prediction block, and generates the prediction block according to the intra prediction mode. When the reference pixels for a second directional intra prediction mode are filtered, the reference pixels for a first directional intra prediction mode, that is closer to an intra prediction mode having the direction of 45° with reference to a horizontal mode than the second directional intra prediction mode is, are also filtered. The first and the second intra prediction modes exist between the horizontal mode and the intra prediction mode having the direction of 45° with reference to the horizontal mode. The number of intra prediction modes in which the filter is applied increases as the size of the prediction block increases.

Abstract: When carrying out an average prediction, the intra predictor carries out a filtering process on target pixels of the intra prediction located at an upper end and a left end of the block, the filtering process using an intermediate prediction value, which is an average value of adjacent pixels of the block, and at least one adjacent pixel of the target pixel. The intra predictor sets a filter coefficient to ½, associated with the intermediate prediction value for a target pixel at an upper left corner of the block, and sets a filter coefficient to ¼, associated with an adjacent pixel adjacent to an upper side or a left side of the target pixel. As a result, prediction errors locally occurring can be reduced, and the image quality can be improved.

Abstract: An image decoding apparatus that includes a motion compensation prediction circuit configured to conduct motion compensation prediction for each of blocks to be decoded by using the reconstructed image, an inverse transformation circuit configured to conduct inverse orthogonal transformation for the data of the blocks to be decoded, and a determination circuit configured to determine a filtering strength and whether or not to conduct filtering, with respect to each of the boundaries. In addition, the determining circuit is configured to determine filtering is conducted when at least one of the two adjacent blocks is intra-coded, and filtering is not conducted when both of the two adjacent blocks are not intra-coded, a non-zero transformation coefficient is not coded in both of the two adjacent blocks, the two adjacent blocks are predicted by the same reference frame, and an absolute value of a difference between motion vectors of the two adjacent blocks is smaller than a specified threshold value.

Abstract: An electronic device includes an image capture unit that generates first RAW image data; a compression unit that compresses the first RAW image data; a decompression unit that decompresses the compressed first RAW image data to generate second RAW image data; a development unit that generates first developed image data from the first RAW image data, and generates second developed image data from the second RAW image data; and a control unit that controls the compression unit based on the first developed image data and the second developed image data.

Abstract: A video decoder performs a method of dynamic voltage/frequency scaling (DVFS) for video processing. The method includes parsing a bitstream associated with a video to determine embedded information associated with a complexity of a first portion of the video, estimating the complexity of the first portion of the video using the embedded information, determining a voltage and frequency to be used for decoding the first portion of the video based on the estimated complexity, and decoding the first portion of the video at the determined voltage and frequency.

Abstract: Techniques related to content adaptive entropy coding of modes and reference types data are described.

Abstract: This disclosure describes methods and apparatus for decoding data. In one aspect, the method comprises decoding encoded video data to obtain decoded video frame data, the encoded video data comprising encoded video frame data encoded at a first frame rate and embedded data. The method further comprises determining a camera parameter from the embedded data and up-converting the decoded video frame data to a second frame rate based on the camera parameter. The determined camera parameter may be, for example, a parameter associated with one or more of a zoom factor, an auto focus status, lens position information, frame luma information, an auto exposure (AE) convergence status, an automatic white balance (AWB) convergence status, global motion information, and frame blurriness information, and the like. An encoding device may embed the camera parameter(s) in an encoded video bit stream for a decoder to utilize during frame rate up-conversion.

Abstract: A method includes encoding, at a mobile device having a camera, a first portion of a media stream captured by the camera based on an encoding parameter. The method also includes sending the encoded first portion of the media stream from the mobile device to a computing device via a network connection. The method further includes detecting a change in available network bandwidth of the network connection. The method includes automatically adjusting the encoding parameter in response to the change in the available network bandwidth. The method also includes encoding a second portion of the media stream based on the adjusted encoding parameter and sending the encoded second portion of the media stream from the mobile device to the computing device.

Abstract: Methods and apparatus for parsing friendly and error resilient merge flag coding in video coding are provided. In some methods, in contrast to merging candidate list size dependent coding of the merge flag in the prior art, a merge flag is always encoded in the encoded bit stream for each inter-predicted prediction unit (PU) that is not encoded using skip mode. In some methods, in contrast to the prior art that allowed the merging candidate list to be empty, one or more zero motion vector merging candidates formatted according to the prediction type of the slice containing a PU are added to the merging candidate list if needed to ensure that the list is not empty and/or to ensure that the list contains a maximum number of merging candidates.

Abstract: A video encoding apparatus using a tree structure, includes: a splitter to generate a partition flag indicating whether each block, starting from a block corresponding to an uppermost layer of the tree structure, is divided into four blocks of a lower layer; and an encoder to encode, into a bitstream, the partition flag and prediction type information on a block which is not further divided in the tree structure, wherein, when a block of a first layer is divided into four blocks of a second layer which is a lower layer of the first layer, the encoder is configured to encode the partition flag for each of the four blocks of the second layer in a predetermined order.

Abstract: A video decoding apparatus for reconstructing residual signals of a current block to be decoded by using a tree structure, includes: a decoder to decode, from a bitstream, prediction type information on the current block to be decoded, and divide, by the tree structure, the current block into one or more subblocks of which information on residual signals is to be reconstructed, by decoding, from the bitstream, a partition flag which indicates whether a block corresponding thereto is divided into blocks of a lower layer in the tree structure, wherein blocks which are not further divided are identified as the subblocks of which information on the residual signals is to be reconstructed; and a reconstructor to reconstruct information on residual signals of each of the subblocks from the bitstream.

Abstract: Embodiments of the invention receive videos and feedback data associated with the videos from a client device and adaptively encode the videos based on the feedback data. The encoded videos are suitable to be transmitted over a network and displayed on the client device. Embodiments of an encoding server adaptively changes resolution of a video on the fly or scale the video quality up or down based on the factors described by the feedback data, including network condition for transmitting the encoded video, network delay, encoder and decoder processing capacity and feedback from viewers of the decoded video. Furthermore, the encoding server adaptively encodes the video based on a combination of various factors described by the feedback data.

Abstract: A method for derivation of a temporal motion data (TMD) candidate for a prediction unit (PU) in video encoding or video decoding is provided. The derived TMD candidate is for inclusion in an inter-prediction candidate list for the PU. The method includes determining a primary TMD position relative to a co-located PU in a co-located largest coding unit (LCU), wherein the co-located PU is a block in a reference picture having a same size, shape, and coordinates as the PU, and selecting at least some motion data of a secondary TMD position as the TMD candidate when the primary TMD position is in a bottom neighboring LCU or in a bottom right neighboring LCU of the co-located LCU, wherein the secondary TMD position is determined relative to the co-located PU.

Abstract: In some examples, a layered encoding component and a layered decoding component provide for different ways to encode and decode, respectively, video streams transmitted between devices. For instance, in encoding a video stream, a layered encoding component may analyze the content of successive video frames and determine different types of encoding techniques to use for different ones of the video frames. Further, in some cases, some of the encoding techniques may be used on less than an entire video frame. In another example, in decoding a video stream, a layered decoding component may receive video frames encoded with different types of encoding. The layered decoding component may decode the differently encoded video frames and combine them to reconstruct a video stream.

Abstract: In one embodiment, a method determines buffer parameter settings for a plurality of layers in a scalable video stream for a video. Each layer includes a respective buffer parameter setting. Then, the method applies respective buffer parameter settings to individual buffers for respective layers in the plurality of layers. The respective layers are buffered in the individual buffers according to the respective buffer parameter settings where the respective layers are combined after the buffers to form a combined bitstream including the respective layers for decoding.

Abstract: A method and system for just-in-time (JIT) encoding of media content is described. The JIT encoder allows a server to create one or more slices of requested portions of the media content according to one of the available quality profiles when requested without previously creating and storing different copies of the media content at the different quality profiles.

Abstract: Encoding and decoding is accomplished herein using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.

Abstract: A method of selecting reference blocks for intra or inter prediction coding of a current block of a video signal. Each reference blocks is selected by: (i) determining a group of candidate blocks comprising at least some candidate blocks other than immediately adjacent spatial neighbors of the current block; and (ii) selecting one of the candidate blocks as the reference block based on a second metric, different from the first metric, the second metric relating to a number of bits that would be required in the encoded bitstream to encode both the residual block and the side information identifying the respective reference block.

Abstract: Combining intra-frame and inter-frame prediction is described. A first combined prediction block for a first block is formed by combining weighted pixel values of a first inter prediction block and a first intra prediction block. The weighting is based on the intra prediction mode. A second combined prediction block is formed by selecting a second intra prediction block using a first partitioned area of the first block, selecting a second inter prediction block using a second partitioned area of the second block, the first and second partitioned areas separated by a border at an angle to an orientation of a row or column of pixels, and combining pixel values of the second inter and intra prediction blocks that are weighted by a weighting function based on a distance of a pixel from the border. One of the combined prediction blocks is selected to encode the first block.

Abstract: A method is provided for coding at least one image split up into partitions, a current partition to be coded containing data, at least one data item of which is allotted a sign. The coding method includes, for the current partition, the following steps: calculating the value of a function representative of the data of the current partition with the exclusion of the sign; comparing the calculated value with a predetermined value of the sign; as a function of the result of the comparison, modifying or not modifying at least one of the data items of the current partition, in the case of modification, coding the at least one modified data item.