Abstract: Embodiments described herein can be used to detect holes in a subset of pixels of a depth image that has been specified as corresponding to a user, and to fill such detected holes. Additionally, embodiments described herein can be used to produce a low resolution version of a subset of pixels that has been specified as corresponding to a user, so that when an image including a representation of the user is displayed, the image respects the shape of the user, yet is not a mirror image of the user. Further, embodiments described herein can be used to identify pixels, of a subset of pixels specified as corresponding to the user, that likely correspond to a floor supporting the user. This enables the removal of the pixels, identified as likely corresponding to the floor, from the subset of pixels specified as corresponding to the user.

Abstract: A method and system for determining a distance and direction between a video camera secured on a vehicle and a target point relies on an electronic control unit. The system maps and stores grid points representing a world coordinate grid onto a screen coordinate grid and displays the video image on a display using the screen coordinate grid. The system obtains a target point of an object in the video image and determines a locus of four closest grid points of the screen coordinate grid that encircle the target point. The system determines screen distances from the target point to each of the four grid points and maps the four grid points onto the world coordinate grid. The electronic control unit interpolates the location of the target point in the world coordinate grid as weighted by the screen distances. Using the video camera location in world coordinates and the target point location in world coordinates, the system determines a distance between the video camera and the target point.

Abstract: For a decoding apparatus based on H.265/HEVC with single-core or single-threaded hardware not parallelized, which executes decoding a plurality of tiles and filtering around a tile boundary, the disclosed invention is intended to reduce the frequency of access to decoded data around the boundaries between tiles stored in a frame memory for filtering such data or reduce the circuit size of a buffer that retains decoded data around the boundaries between tiles. The image decoding apparatus disclosed herein executes decoding and filtering in raster scan order across a screen independently of the sizes and positional relations of tiles. At a tile boundary, decoding proceeds to a right adjacent tile on the same row, rather than decoding coding blocks on one row down in the same tile, and filtering is also executed using decoded data of row-wise adjacent coding blocks.

Abstract: Error concealment techniques for video decoding are described. For example, a video decoder after finding a corrupted picture in a bit stream, finds a suitable neighbor for the corrupted picture. For example, the video decoder favors pictures with the same parity as the corrupted picture and considers picture order count and picture corruption in choosing a neighbor. The decoder then modifies syntax elements for the encoded video in the bit stream to allow the neighbor to be used in concealing the corruption in the corrupted picture. The modification of syntax elements can depend on the particular video decoder implementation. For example, in a software-only multithreaded video decoder, a task graph is modified, while in a system utilizing video acceleration, syntax elements for reference lists are modified.

Abstract: A camera includes an unwanted object shape acquisition unit, a viewpoint selection unit, and an unwanted object removal unit. The viewpoint selection unit selects a plurality of viewpoints based on information regarding a shape of an unwanted object in a subject, which is acquired by the unwanted object shape acquisition unit. The unwanted object removal unit performs unwanted object removal processing with use of images corresponding to the viewpoints selected by the viewpoint selection unit.

Abstract: A computing device can determine its position relative to a reference point. The device can render a portion of content too large to be suitably displayed in full on a display of the device. The device can render the content in full to appear (i.e., can virtually position the entire content) to be located in a stationary position relative to the reference point. The device can detect a change to its position, such as a movement of the device caused by a user of the device. Based on the detected change to the device's position, the device can modify which portion of the entire content to render. The rendered portion of the entire content can change corresponding to where and how the device moves.

Abstract: A video processing system can include a buffer, a packetizer block that is coupled to the buffer, and a buffer controller that is coupled to the buffer and the packetizer block. The buffer is capable of receiving and storing a video signal as video data. The packetizer block is capable of packetizing video data read from the buffer and sending packetized data to a node external to the video processing system. The buffer controller is capable of controlling an amount of video data included within each packet generated by the packetizer block.

Abstract: Video data bitstreams may contain bitstream conformance parameters, such as hypothetical reference decoder (HRD) parameters, which may be used to allow a decoder to test the conformance of a received bitstream. In multi-layer codecs transmitted using partitions, the video data may be associated with one or more layer sets. Each layer set may be associated with one or more output layer sets. Each output layer set may be further associated with one or more partitioning schemes. Conformance parameters are mapped to partitions of a partitioning scheme, based upon the output layer set that the partitioning scheme is associated with. This allows for a partition to be associated with different conformance parameters, depending upon the output layer set that is being used.

Abstract: Lane level traffic levels are determined based on traffic camera images. A controller aligns a three-dimensional map with a traffic camera view, and identifies multiple lanes in the traffic camera view based on lane delineations of the three-dimensional map. The controller calculates a traffic parameter based on the multiple lanes in image frames from the traffic camera view and provides a traffic graphic based on the traffic parameter.

Abstract: A method and an apparatus of encoding/decoding intra prediction mode using a plurality of candidate intra prediction modes are disclosed. A method of decoding an intra prediction mode can comprise deriving three candidate intra prediction modes about a current block and deriving an intra prediction mode of the current block. Therefore, by predicting an intra prediction mode of the current block based on a plurality of candidate intra prediction modes, video encoding efficiency can be improved.

Abstract: A method and a system for controlling camera orientation in training and exhibition systems. The method and system use a control algorithm to drive the orientation of a camera system at a determined reference velocity in order to place the aim-point of the camera system following a target aim-point in a local coordinate system. In some embodiments, the position and velocity of the target aim-point in the local coordinate system are determined based on dynamically filtered position and motion of a target object, where the position and motion of the target object are measured from a local positioning system.

Abstract: As set forth herein, systems and methods are described that facilitate to analyze a video stream from a camera mounted on the side of a school bus, wherein a sub-set of video sequences showing cars illegally passing the stopped school bus are automatically identified through image and/or video processing. The described systems and methods provide a significant savings in terms of the amount of manual review that is required to identify such violations. The video sequences also can be analyzed further to additionally produce images of the license plate (for identification of the violator), thereby providing further reduction in required human processing and review time. In one embodiment, automatic license plate recognition (ALPR) is employed to identify text on the violator's license plate, as well as the state by which the license plate was issued, without requiring human review of the license plate image.

Abstract: Plenoptic cameras and eye ports are separable units and can be attached to either the smart phone or to the eyeglasses by a mating surface. These separable units can be wireless coupled to a remote device, to a remote display, to other separable plenoptic cameras, or to other eyeglasses. The separable units can be mated to an eyeglass and positioned over the eye or eyes of the user. In addition, these separable cameras can be electrically wired through the mating device. The cameras can be separated and placed at various distances apart from one another to offer greater flexibility in analyzing the depth of images. These images from these cameras are shared within the system. The smart phone can be in wireless contact with a remote system. The remote system can be another server, the Internet, another smart phone, another camera system, or the camera mounted on the eyeglass.

Abstract: A system and method for using camera capture settings and related metadata to estimate the parameters for encoding a frame of the captured video data and to modify reference frames to accommodate detected camera setting changes. Global brightness and color changes in video capture may be modeled by performing a sequence of transform operations on the reference frames to further improve the coding efficiency of a video coding system.

Abstract: A video decoding apparatus includes: a decoder to determine a size of a minimum block unit among block units in which quantization parameter information is decoded from a bitstream, determine a current block to be decoded by dividing a block larger than 16×16 into one or more blocks, decode, from the bitstream, a skip information and the motion information for deriving the motion vector of the current block without decoding information on residual signals of the current block, and decode, from the bitstream, prediction information of the current block and quantized transform coefficients of the current block; and a video reconstructor to determine the motion vector of the current block using the decoded motion information, reconstruct residual signals from the quantized transform coefficients by inversely quantizing the quantized transform coefficients using a quantization parameter, and reconstruct the current block based on the prediction information and the reconstructed residual signals.

Abstract: An imaging signal obtained during pattern light projection and an imaging signal during pattern light non-projection are separated from an imaging signal, and the projection angle of a light spot is specified on the basis of an array of light spots in the projection image component. The projected pattern light includes a plurality of cells that accompanies the light spots and that constitutes a discrimination code, and specifies the position of the light spots accompanied by the discrimination code in the projection pattern on the basis of the discrimination code. Distance information to an object to be imaged can be acquired using a low amount of computation.

Abstract: A video encoding/decoding apparatus and method are disclosed. The video encoding/decoding apparatus includes: a video encoder for encoding a differential value between a quantization parameter value of a macroblock of a video and a quantization parameter value of a subblock in an extended macroblock based on additional information on the macroblock and the subblock; and a video decoder for reconstructing a differential value of a quantization parameter encoded by the video encoder, reconstructing a residual block based on a reconstructed differential value of the quantization parameter, and reconstructing the video based on the residual block reconstructed.

Abstract: Video data with both ultra-high definition (UHD) resolution and high or enhanced dynamic range (EDR) data are coded in a backward-compatible layered stream which allows legacy decoders to extract an HD standard dynamic range (SDR) signal. In response to a base layer HD SDR signal, a predicted signal is generated using separate luma and chroma prediction models. In the luma predictor, luma pixel values of the predicted signal are computed based only on luma pixel values of the base layer, while in the chroma predictor, chroma pixel values of the predicted signal are computed based on both the luma and the chroma pixel values of the base layer. A residual signal is computed based on the input UHD EDR signal and the predicted signal. The base layer and the residual signal are coded separately to form a coded bitstream. A compatible dual-layer decoder is also presented.

Abstract: Systems and methods for multispectral imaging are disclosed. The multispectral imaging system can include a near infrared (NIR) imaging sensor and a visible imaging sensor. The disclosed systems and methods can be implemented to improve alignment between the NIR and visible images. Once the NIR and visible images are aligned, various types of multispectral processing techniques can be performed on the aligned images.

Abstract: It is possible to achieve an effective transmission of image data (suppression in the transmission bandwidth and improvement in quality of a reproduced image) in order to cause a stereoscopic image due to a multiview configuration to be observed with the naked eye. Image data of at least a left view and a right view, and image data of an intermediate view located between the left view and the right view, for example, image data of a center view are acquired, among a plurality of views for stereoscopic image display. A container which has a predetermined format and includes a video stream obtained by coding image data of respective views is transmitted. For example, view configuration information regarding image data in the video stream is inserted into a layer of the video stream.