Abstract: Information available from coding/decoding the base layer, i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.

Abstract: An apparatus, method, and computer readable medium for a virtual reality (VR) client and a contents server for live virtual reality events are provided. The contents server receives feeds from each 360° camera at a venue. The contents server transmits a primary first 360° video in a first stream and converted secondary non-360° videos in a second stream to a VR client. The VR client determines relative positions of each non-360° video in order to display rendered thumbnails of the non-360° videos in the first 360° video. The VR client transmits a selection of a non-360° video to the contents server. The contents server transmits the second 360° video related to the selection in a first stream and the converted first non-360° video in the second stream.

Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

Abstract: A system-on-chip is provided which is configured for real-time depth estimation of video data. The system-on-chip includes a monoscopic depth estimator configured to perform monoscopic depth estimation from monoscopic-type video data, and a stereoscopic depth estimator configured to perform stereoscopic depth estimation from stereoscopic-type video data. The system-on-chip is reconfigurable to perform either the monoscopic depth estimation or the stereoscopic depth estimation on the basis of configuration data defining a selected depth estimation mode. Both depth estimators include shared circuits which are instantiated in hardware and reconfigurable to account for differences in the functionality of the circuit in each depth estimator.

Abstract: According to the present invention, there is provided a method of encoding a three-dimensional (3D) image, the method comprising: determining a prediction mode for a current block as an inter prediction mode; determining whether a reference block corresponding to the current block in a reference picture has motion information; when the reference block has the motion information, deriving motion information on the current block for each sub prediction block in the current block; and deriving a prediction sample for the current block based on the motion information on the current block.

Abstract: Embodiments of the present invention provide methods and devices for coding and decoding a depth map, including: determining to perform simplified depth coding (SDC) decoding according to a flag of an SDC mode; determining a size of an image block and a maximum prediction size; determining an intra-frame prediction mode; in a case in which the size of the image block is greater than the maximum prediction size, splitting the image block to obtain N split image blocks; and performing the SDC decoding on the N split image blocks by using the intra-frame prediction mode. In this way, processing efficiency of coding and decoding a depth map can be improved.

Abstract: A computer-implemented system and method of configuring a path of a virtual camera. The method comprises receiving user steering information to control the path of the virtual camera in a scene; determining a primary target based upon a field of view of the virtual camera; and estimating a future path and a corresponding future field of view of the virtual camera, based on the received steering information. The method further comprises determining a secondary target of the scene proximate to the estimated future path of the virtual camera based on a preferred perspective of the secondary target; and configuring the path to capture the secondary target from the preferred perspective.

Abstract: The present invention relates to 3D video coding device and method. A decoding method, according to the present invention, provides a 3D video decoding method. A decoding method comprises the steps of: obtaining a disparity value on the basis of a reference view and a predetermined value; deriving movement information of a current block in a depth picture on the basis of the disparity value; and generating a prediction sample of the current block on the basis of the movement information, wherein the reference view is a view of a reference picture in a reference picture list. According to the present invention, even when a base view cannot be accessed, a disparity vector can be derived on the basis of an available reference view index in a decoded picture buffer (DPB), and coding efficiency can be enhanced.

Abstract: A method of processing a file including video data, including processing a file including fisheye video data, the file including a syntax structure including a plurality of syntax elements that specify attributes of the fisheye video data, wherein the plurality of syntax elements include one or more bits that indicate fisheye video type information, determining, based on the one or more bits of the syntax structure, the fisheye video type information for the fisheye video data, outputting, based on the determination, the fisheye video data for rendering.

Abstract: Disclosed is a method for coding and decoding depth information, and the method includes: data in original Depth Look-up Tables (DLTs) of selected views are combined to establish a unified DLT, a value of the number of elements in the unified DLT and each element in the unified DLT are coded respectively and a coded value and each coded element are transmitted to a decoder; and depth information of each view is coded by taking the unified DLT as a whole or in portions and coded depth information of each view is transmitted to the decoder. Further disclosed are a system and device for coding and decoding depth information; by means of the disclosure, it is possible to reduce redundancy of coding information and improve coding and decoding efficiency.

Abstract: A method for developing a virtual testing model of a subject for use in simulated aerodynamic testing comprises providing a computer generated generic 3D mesh of the subject, identifying a dimension of the subject and at least one reference point on the subject, imaging the subject to develop point cloud data representing at least the subject's outer surface and adapting the generic 3D mesh to the subject. The generic 3D mesh is adapted by modifying it to have a corresponding dimension and at least one corresponding reference point, and applying at least a portion of the point cloud data from the imaged subject's outer surface at selected locations to scale the generic 3D mesh to correspond to the subject, thereby developing the virtual testing model specific to the subject.

Abstract: Various embodiments of the present disclosure relate generally to systems and processes for generating stereo pairs for virtual reality. According to particular embodiments, a method comprises obtaining a monocular sequence of images using the single lens camera during a capture mode. The sequence of images is captured along a camera translation. Each image in the sequence of images contains at least a portion of overlapping subject matter, which includes an object. The method further comprises generating stereo pairs, for one or more points along the camera translation, for virtual reality using the sequence of images. Generating the stereo pairs may include: selecting frames for each stereo pair based on a spatial baseline; interpolating virtual images in between captured images in the sequence of images; correcting selected frames by rotating the images; and rendering the selected frames by assigning each image in the selected frames to left and right eyes.

Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

Abstract: A display image for a display panel (503) of an autostereoscopic display projecting the display image in a plurality of view cones is generated. A source (803) provides a three dimensional representation of a scene to be displayed and a generator (805) generates the display image from the representation. For each pixel, the generator (805) determines a scene viewpoint direction indication reflecting a view point direction for the scene in response to a direction mapping function and a view cone projection direction indication reflecting a projection direction for the pixel within the view cones. The direction mapping function reflects a relationship between view cone projection directions and scene view point directions. The pixel value corresponding to the view point direction is then generated from the three dimensional representation. In addition, a processor (809) determines a viewer characteristic; and an adapter (811) for adapts the direction mapping function in response to the viewer characteristic.

Abstract: The invention relates to a method, where a first and second stereoscopic image are formed comprising a left eye image and a right eye image, a first central image region and a first peripheral image region are determined in the first stereoscopic image, the first central image region comprising a first central scene feature and the first peripheral image region comprising a first peripheral scene feature, and in the second stereoscopic image a second central image region and a second peripheral image region in said second stereoscopic image are determined, and based on said determining that said second central image region comprises said first peripheral scene feature, encoding said first stereoscopic image such that said first peripheral image region is encoded with a reduced quality with respect to said first central image region.

Abstract: The invention concerns the encoding of at least one current integral image (IIj) captured by an image capture device, comprising the steps consisting of: —decomposing (C1) the current integral image into at least one frame (Vu) representing a given perspective of a scene and, from at least one image capturing parameter associated with the image capture device, —encoding (C2) said at least one frame, —decoding (C4) said at least one frame, —recomposing (C5) the current integral image from said at least one decoded frame by applying an inverse decomposition of said decomposition of the integral image and from said at least one image capturing parameter associated with the image capture device, said encoding method being characterised in that it implements the steps consisting of: —determining (C6) a residual integral image by comparing said at least one current integral image with said recomposed integral image, —encoding (C7) the data associated with the residual integral image and said at least one image capt

Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

Abstract: A three-dimensional (3D) image display system includes a profile information provider configured to provide profile information defining a hardware characteristic of a 3D image display device, and a 3D image reproducer configured to collect information of the hardware characteristic of the 3D image display device from the profile information provider and render image content according to the profile information.

Abstract: Techniques are described that enable stereoscopic content to be delivered. These techniques including encoding frames of stereoscopic video content within a base layer and temporal enhancement layer and decoding the encoded frames.

Abstract: This present invention discloses an image guided augmented reality method, comprising the following steps of: obtaining a first conversion matrix of a camera and a marked point; obtaining a second conversion matrix of the eye and the camera; linking the first conversion matrix and the second conversion matrix to obtain a correct position corresponding matrix of the eye to the marked point; and linking the correct position corresponding matrix to a position feature of the marked point to obtain the correct position of the eye to the marked point. The present invention also discloses a surgical navigation method of wearable glasses, used for obtaining the correct position of the operator's eye to the marked point.

Abstract: A system that incorporates teachings of the present disclosure may include, for example, a media processor having a controller to record stereoscopic media content supplied by a multimedia system, receive from a communication device a request for the recorded stereoscopic media content, determine rendering capabilities of the communication device, generate transcoded content by transcoding the recorded stereoscopic media content according to the rendering capabilities of the communication device, and transmit to the communication device the transcoded content. Other embodiments are disclosed and contemplated.

Abstract: A method is provided for decoding a current image having at least two views which are respectively representative of a same scene. The decoding method includes derivation of a disparity motion vector and, during the derivation: constructing at least one list of disparity motion vectors, in which at least two disparity motion vectors have been obtained respectively according to two different estimation methods; and applying a function to the at least two disparity motion vectors of the list. The method is applicable, for example, to a current image Ik of an MVV or MVD type.

Abstract: A method for a three-dimensional encoding or decoding system incorporating sub-block based inter-view motion prediction is disclosed. The system utilizes motion or disparity parameters associated with reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PCU split from a current texture PU (prediction unit) to predict the motion or disparity parameters of the current texture PU. Candidate motion or disparity parameters for the current texture PU may comprise candidate motion or disparity parameters derived for all texture sub-PUs from splitting the current texture PU. The candidate motion or disparity parameters for the current texture PU can be used as a sub-block-based inter-view Merge candidate for the current texture PU in Merge mode. The sub-block-based inter-view Merge candidate can be inserted into a first position of a candidate list.

Abstract: The present invention relates to a device and a method for coding a multi-view video, a residual prediction method, according to the present invention, comprising the steps of: deriving a disparity vector of a current block; performing residual prediction on the current block on the basis of the disparity vector; and generating a residual prediction sample, wherein the disparity vector is not derived on the basis of a neighboring block of the current block, but is derived from a preset default vector. According to the present invention, the effect of prediction may be increased by performing residual prediction on the current block according to a certain condition, not only when the disparity vector is induced but also when the disparity vector is not induced from the neighboring block of the current block.

Abstract: A binocular image capture device includes a plurality of stacked circuit boards, a front-facing dual image sensor mounted to a first circuit board of the plurality of stacked circuit boards, and signal conditioning electronics mounted to one or more of the plurality of stacked circuit boards and coupled to receive electrical signals generated by the dual image sensor. The dual image sensor is enclosed in a hermetic housing. In some examples, the hermetic housing may be formed by the first circuit board, a transition ring secured to the first circuit board, and an optics mount secured to the transition ring. In some examples, the hermetic housing may be formed using materials having matching coefficients of thermal expansion. In some examples, the binocular image capture device is enclosed by a shaft, the plurality of stacked circuit boards being stacked along a length of the shaft.

Abstract: This disclosure describes techniques for 3D video coding. In particular, this disclosure is related to techniques for advanced residual prediction (ARP) in 3D-HEVC. According to one techniques of this disclosure, when performing inter-view ARP for a bi-directionally predicted block, the video coder may determine a motion vector for a first corresponding block as part of performing ARP for a first prediction direction and reuse that determined motion vector when performing ARP for a second prediction direction. According to another technique, for a bi-directionally predicted block, a video coder may apply ARP in only one direction for a chroma component of a block but apply ARP in two directions for a luma component of the block. According to another technique, a video coder may selectively apply ARP to chroma components based on block size. These simplifications, as well as other techniques included in this disclosure, may reduce overall coding complexity.

Abstract: Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.

Abstract: A method comprising: rendering a user interface for user selection of sound objects for rendering, each sound object being associated with a location in a three-dimensional sound space, wherein the user interface maps sound objects onto at least one shape and identifies sound objects on the shape at a collection of locations on the shape that differs from the associated locations of the identified sound objects; and in response to a user actuation selecting a sound object, rendering at least the selected sound object in the three-dimensional sound space at its associated location.

Abstract: A method and system are disclosed for locating or otherwise generating positional information for an object, such as but not limited generating positional coordinates for an object attached to an athlete engaging in an athletic event. The positional coordinates may be processed with other telemetry and biometrical information to provide real-time performance metrics while the athlete engages in the athletic event.

Abstract: A system is provided and includes a memory and a control module. The memory stores first and second pixel data corresponding to first and second image frames. The control module performs stereo vision matching including: accessing the first and second pixel data; determining initial disparity values that indicate differences between positions of the first and second pixel data; determining matching merit values for the first pixel data, where each of the matching merit values is indicative of a reliability level of a corresponding one of the initial disparity values; determining weights based on (i) the initial disparity values, (ii) differences between intensity values of the first and second pixel data, and (iii) the matching merit values; and refining the initial disparity values, based on the weights, to provide refined disparity values. The control module estimates a depth of a feature or an object based on the refined disparity values.

Abstract: A method of adjusting depth in a stereoscopic video may include generating a left-eye viewing frame of a stereoscopic video. The left-eye viewing frame may include a plurality of left-eye viewing frame elements. The method may also include generating a right-eye viewing frame of the stereoscopic video. The right-eye viewing frame may correspond to the left-eye viewing frame and may include a plurality of right-eye viewing frame elements. Further, each right-eye viewing frame element may correspond to one of the left-eye viewing frame elements. The method may additionally include determining an offset between each right-eye viewing frame element and its corresponding left-eye viewing frame element. Further, the method may include applying a uniform summing factor to each offset to uniformly shift by substantially the same amount each right-eye viewing frame element with respect to its corresponding left-eye viewing frame element such that a perceived focus point is adjusted.

Abstract: A method and apparatus for depth-fill algorithm for low-complexity stereo vision. The method includes utilizing right and left images of a stereo camera to estimate depth of the scene, wherein the estimated depth relates to each pixel of the image, and updating a depth model with the current depth utilizing the estimated depth of the scene.

Abstract: The way of predicting a current block by assigning constant partition values to the partitions of a bi-partitioning of a block is quite effective, especially in case of coding sample arrays such as depth/disparity maps where the content of these sample arrays is mostly composed of plateaus or simple connected regions of similar value separated from each other by steep edges. The transmission of such constant partition values would, however, still need a considerable amount of side information which should be avoided. This side information rate may be further reduced if mean values of values of neighboring samples associated or adjoining the respective partitions are used as predictors for the constant partition values.

Abstract: In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.

Abstract: Systems and methods are disclosed indexing digital content. The method may include receiving a plurality of pieces of digital content from a plurality of sources and identifying a time stamp associated with each piece of digital content. The method may also include associating the digital content together into groups based on the time stamps. Moreover, the method may include providing access to the associated digital content.

Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.

Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.

Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.

Abstract: A system for facilitating virtual gifting of goods or services over a communications network includes: a) a first client module configured for purchasing a virtual gift for a recipient, b) a second client module configured for receiving and viewing the purchased virtual gift from the server, over the communications network; c) a third client module configured for receiving a wireless signal for the recipient from the second client module and viewing the purchased virtual gift, and d) a web server module configured for processing electronic payment for the purchased virtual gift with a payment gateway, transmitting the purchased virtual gift to the second client module, and transmitting a confirmation of payment for the purchased virtual gift to a brick and mortar outlet, wherein the purchased virtual gift is configured for redemption at said brick and mortar outlet.

Abstract: The present invention relates to a device and a method for transmitting/receiving a broadcast signal including video data and high dynamic range information. A broadcast signal transmitting method according to an embodiment of the present invention may include the steps of: generating video data; generating a broadcast signal including the generated video data and image quality improving metadata; and transmitting the generated broadcast signal.

Abstract: A method and apparatus of reference picture list construction for video encoding and decoding includes considering a current picture when an Intra Picture Block Copy (IntraBC) mode is allowed. Embodiments of the reference picture list construction process comprise receiving input data of a current slice in the current picture, determining a temporary reference picture list for the current slice, and determining a final reference picture list from the temporary reference picture list. The reference picture list construction process further comprises adjusting the final reference picture list by setting the current picture to a predefined position in the final reference picture list if the IntraBC mode is allowed. An example of the predefined position is the last position. An example of the reference picture list construction only inserts the current picture into the predefined position when reference picture list modification is not used.

Abstract: Systems, methods, and computer programs are disclosed for reducing memory bandwidth via multiview compression/decompression. One embodiment is a compression method for a multiview rendering in a graphics pipeline. The method comprises receiving a first image and a second image for a multiview rendering. A difference is calculated between the first and second images. The method compresses the first image and the difference between the first and second images. The compressed first image and the compressed difference are stored in a memory. The compressed first image and the compressed difference are decompressed. The second image is generated by comparing the first image to the difference.

Abstract: The display system for remote control of a working machine includes a plurality of camera units and an image processing device, both provided on or in a working machine, and a display device and a remote control device, both provided in the remote control side. The display device detects movement of the head of an operator and transmits the detected movement of the head of the operator to the remote control device. The remote control device transmits, to the image processing device over wireless communications, the movement of the head of the operator transmitted from the display device. The image processing device adjusts, for transmission to the display device, parts of left-eye and right-eye panoramic images according to the movement of the head of the operator transmitted from the remote control device.

Abstract: A scalable video decoder is described which is configured to reconstruct a base layer signal from a coded data stream to obtain a reconstructed base layer signal; and reconstruct an enhancement layer signal including spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components; and predictively reconstructing the enhancement layer signal using the enhancement layer prediction signal.

Abstract: A scalable texture data representation which enables spatio-temporal texture synthesis for occlusion by using a temporally consistent texture UV map, view-dependent texture mapping for seamless/specular color by using an additional multi-layer texture UV map, and view-dependent texture alignment for natural mapping by using an extra flow UV map, is described herein.

Abstract: A method and system for controlling a home security system. A processor may be trained to recognize an image standard for a scene, wherein the training comprises creating a profile of the image standard. Operational imaging of the scene may be performed to create an operational image. A profile of the operational image may be created. Profiles of the image standard and the operational image may be compared. A state of a security system may be changed as a result of a comparison of the profiles of the image standard and the operational image.

Abstract: A method of MVP (motion vector prediction) for video coding with adaptive motion vector resolution is disclosed. According to the present invention, the MVP coding is applied to the current MV or the current MV is stored depending on the current MV resolution, the reference MV resolution, or both the current MV resolution and the reference MV resolution. In one embodiment, when the current MV resolution corresponds to integer pixel resolution, MVP coding is then applied to the current MV using a modified temporal MV as a motion vector predictor for the current MV, where the modified temporal MV is generated by right-shifting the temporal MV. In another embodiment, when the current MV resolution corresponds to integer pixel resolution, the current MV is left-shifted before it is stored in a memory.

Abstract: The present technology relates to a coding device and method, and a decoding device and method, and a program capable of reducing the amount of calculations for decoding. A separating unit separates a supplied bit stream into coded data of channel sources including a dialog source, coded data of additional data sources, and coded data of dialog information. A dialog information decoding unit decodes the coded data of the dialog information. When the dialog information acquired by the decoding is presented to a viewer, the viewer selects one source from the dialog source and some additional dialog sources. An additional dialog source decoding unit decodes only the coded data of an additional dialog source selected by the viewer. An additional dialog selection unit outputs a viewer-selected audio signal from among the audio signals of the dialog source and additional dialog sources in response to the selection instruction of the viewer.

Abstract: A video encoder generates a network abstraction layer (NAL) unit that includes at least a first syntax element and a second syntax element. The first syntax element indicates that the NAL unit belongs to a particular NAL unit type. Coded slices of texture view components and depth view components are encapsulated within NAL units that belong to the particular NAL unit type. The second syntax element indicates whether a NAL unit header of the NAL unit includes an Advanced Video Coding (AVC)-compatible 3-dimensional video (3DV) header extension or includes a Multiview Video Coding (MVC)-compatible 3DV header extension. The video encoder outputs a bitstream that includes the NAL unit. A video decoder receives the NAL unit and determines whether the second syntax element indicates that the NAL unit header of the NAL unit includes the AVC-compatible 3DV header extension or the MVC-compatible 3DV header extension.

Abstract: An image processing apparatus includes an attention area detection unit, a luminance parallax conversion unit, and a parallax estimation unit. The attention area detection unit is configured to detect an attention area including a desired subject from a standard image. The luminance parallax conversion unit is configured to perform a luminance parallax conversion with respect to the attention area on the basis of a luminance parallax conversion characteristic estimated by using a past frame. The parallax estimation unit is configured to perform parallax estimation on the basis of the standard image and a reference image, a viewpoint position of which is different from that of the standard image, and perform, in the attention area, the parallax estimation by using a luminance parallax conversion result obtained by the luminance parallax conversion unit.