Abstract: A motion prediction method is provided. The method has the following steps of: determining a plurality of candidate units corresponding to a current unit of a current frame; obtaining a plurality of motion vectors of the candidate units; calculating a plurality of temporal scaling factors of the candidate units according to a plurality of temporal distances between a plurality of reference frames of the motion vectors and the current frame; scaling the motion vectors of the candidate units according to the temporal scaling factors to obtain a plurality of scaled motion vectors; and selecting a motion vector predictor for motion prediction of the current unit from the candidate units according to the scaled motion vectors.

Abstract: A method and apparatus for performing hybrid multihypothesis prediction during video coding of a coding unit includes: processing a plurality of sub-coding units in the coding unit; and performing disparity vector (DV) derivation when the coding unit is processed by a 3D or multi-view coding tool or performing block vector (BV) derivation when the coding unit is processed by intra picture block copy (IntraBC) mode. The step of performing DV or BV derivation includes deriving a plurality of vectors for multihypothesis motion-compensated prediction of a specific sub-coding unit from at least one other sub-coding/coding unit. The one other sub-coding/coding unit is coded before the corresponding DV or BV is derived for multihypothesis motion-compensated prediction of the specific sub-coding unit. A linear combination of a plurality of pixel values derived from the plurality of vectors is used as a predicted pixel value of the specific sub-coding unit.

Abstract: The invention provides a motion prediction method. First, a plurality of motion vector predictors is obtained to be included in a candidate set for motion prediction of a current unit of a current frame. Whether the current frame is a non-reference frame which is not referred to by other frames for motion prediction is then determined. When the current frame is not the non-reference frame, any motion vector predictor corresponding to a previously coded frame is removed from the candidate set, and a motion vector of the current unit is predicted according to the motion vector predictors of the candidate set.

Abstract: A method and apparatus for deriving MVP (motion vector predictor) for Skip or Merge mode in 3D video coding are disclosed. In one embodiment, the method comprises determining an MVP candidate set for a selected block and selecting one MVP from an MVP list for motion vector coding of the block. The MVP candidate set may comprise multiple spatial MVP candidates associated with neighboring blocks and one inter-view candidate, and the MVP list is selected from the MVP candidate set. The MVP list may consist of only one MVP candidate or multiple MVP candidates. If only one MVP candidate is used, there is no need to incorporate an MVP index associated with the MVP candidate in the video bitstream corresponding to the three-dimensional video coding. Also, the MVP candidate can be the first available MVP candidate from the MVP candidate set according to a pre-defined order.

Abstract: A method for performing hybrid multihypothesis prediction during video coding of a coding unit includes: processing a plurality of sub-coding units in the coding unit; and performing motion vector derivation of a portion of the sub-coding units. More particularly, the step of performing motion vector derivation of the portion of the sub-coding units further includes: deriving a plurality of motion vectors for multihypothesis motion-compensated prediction of a specific sub-coding unit of the portion of the sub-coding units from at least one other sub-coding/coding unit or by performing motion estimation. The method further includes performing multihypothesis motion-compensated prediction on the specific sub-coding unit according to the plurality of motion vectors, and more particularly, includes utilizing a linear combination of a plurality of pixel values derived from the plurality of motion vectors as a predicted pixel value of the specific sub-coding unit. An associated apparatus is also provided.

Abstract: A 3D displaying method, comprising: acquiring distance information map from at least one image; receiving control information from a user input device; modifying the distance information map according to the control information to generate modified distance information map; generating an interactive 3D image according to the modified distance information map; and displaying the interactive 3D image.

Abstract: A method for performing localized multihypothesis prediction during video coding of a coding unit includes processing the coding unit. More particularly, the step of processing the coding unit further includes: obtaining at least two sets of motion information derived from a set of coded units for multihypothesis motion compensation of the coding unit; and utilizing a linear combination of a plurality of pixel values derived from the at least two sets of motion information derived from the set of coded units as a predicted pixel value of the coding unit. An associated apparatus is also provided.

Abstract: A method for performing localized multihypothesis prediction during video coding of a coding unit includes: dividing the coding unit into a plurality of sub-coding units; and performing motion vector prediction of each of the sub-coding units. More particularly, the step of performing motion vector prediction of each of the sub-coding units further includes: obtaining a plurality of motion vectors for multihypothesis motion compensation of a specific sub-coding unit of the sub-coding units from a plurality of other sub-coding/coding units. The method further includes performing multihypothesis motion compensation on the specific sub-coding unit according to the plurality of motion vectors, and more particularly, includes utilizing a linear combination of a plurality of pixel values of the plurality of other sub-coding/coding units as a predicted pixel value of the specific sub-coding unit. An associated apparatus is also provided.

Abstract: A method and apparatus for encoding a video sequence comprising a plurality of pictures are disclosed. In video coding systems, the temporal redundancy is exploited using motion compensated prediction. The video sequence is often organized into multiple GOP (group of pictures) where different types of GOP may be used. In conventional coding systems, IPPP and IBBP GOP structure is often used. In H.264/AVC and the emerging High Efficiency Video Coding (HEVC), hierarchical GOP structure, including hierarchical P GOP structure and hierarchical B GOP structure, has been introduced to allow temporal scalability. Furthermore, low-delay IBBB GOP structure has been also introduced, for low-delay application. In the present invention, a low-delay hierarchical B GOP structure is disclosed. The new structure uses low-delay B-pictures only so as to minimize the processing delay while the hierarchical structure provides the temporal scalability.

Abstract: The present invention utilizes depth images captured by a depth camera to detect foreground/background. The method comprises establishing a single background distribution model, updating the background distribution model if a new depth value for the pixel can be represented by the background distribution model, skipping update of the background distribution model if the pixel is before the background, and replacing the background distribution model if the pixel is behind the background. In case that the background distribution model does not exist initially, a new background distribution model is created. The fluctuation of the depth value due to noise is handled by using a candidate background distribution model. Furthermore, the noise for pixels around object edges is handled by using a mixture of two background distribution models.

Abstract: A method for performing local motion vector derivation during video coding of a coding unit includes: processing a plurality of sub-coding units in the coding unit; and performing motion vector prediction of each of the sub-coding units. More particularly, the step of performing motion vector prediction of each of the sub-coding units further includes: deriving a motion vector of a specific sub-coding unit of the sub-coding units by utilizing at least one motion vector of at least one other sub-coding/coding unit. Thus, the method performs motion compensation on the specific sub-coding unit according to the motion vector of the specific sub-coding unit. An associated apparatus is also provided.

Abstract: A method for generating a final depth information related map includes the following steps: receiving a coarse depth information related map, wherein a resolution of the coarse depth information related map is smaller than a resolution of the final depth information related map; and outputting the final depth information related map reconstructed from the coarse depth information related map by receiving an input data and performing a guided interpolation operation upon the coarse depth information related map according to the input data.

Abstract: An apparatus and method for deriving a motion vector predictor (MVP) or a MVP candidate for a current block are disclosed. Embodiments according of the present invention receive a first motion vector associated a first reference picture in a first reference picture list and a second motion vector associated with a second reference picture in a second reference picture list of a spatially neighboring block. A MVP or at least one MVP candidate associated with a selected reference picture in a selected reference picture list for the current block is then determined based on the first reference picture, the second reference picture and the selected reference picture according to a pre-defined priority order. The MVP or MVP candidate is determined depending on whether the first reference picture is the same as the selected reference picture or whether the second reference picture is the same as the selected reference picture.

Abstract: An apparatus and method of deriving a motion vector predictor (MVP) for a current MV of a current block in Inter, Merge or Skip mode are disclosed based on motion vector (MV) attribute search. The system determines first MV attribute search comprising whether a given MV pointing to the target reference picture in the given reference list, or whether the given MV pointing to the target reference picture in other reference list, and determines second MV attribute search comprising whether the given MV pointing to other reference pictures in the given reference list, or whether the given MV pointing to the other reference pictures in the other reference list. The MVP for the current block is then determined from the neighboring blocks according to a search order.

Abstract: An interaction display system applied in a mobile device is provided. The system has a camera unit configured to capture images of a scene; a motion detection unit configured to detect motions of the mobile device during capturing the images; and a processing unit coupled to the camera unit and the motion detection unit, configured to estimate a geometry of the scene according to the captured images and the detected motions.

Abstract: An apparatus and method for deriving a motion vector predictor are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted or stored. Motion vector prediction has been used to further conserve the bitrate associated with motion vector coding. In a conventional coding system, a motion vector predictor (MVP) is selected from the spatial MVPs and temporal MVP. The spatial MVP according to a conventional approach is based on motion vectors (MVs) of neighboring blocking pointing to a target reference picture in a given reference list. Embodiments according to the present invention perform the MVP search among an extended search set including MVs pointing to other reference pictures in the given reference list or the other reference list and MVs pointing to the target reference picture in the given reference list or the other reference list.

Abstract: A method and apparatus for determining a motion vector predictor (MVP) or a MVP candidate based on a MVP set are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the video data to be transmitted or stored. Motion vector prediction has been used to further conserve the bitrate associated with motion vector coding. Motion vector prediction technique being developed for the current high efficiency video coding (HEVC) only uses a MVP candidate set including spatial MVP candidates and a temporal candidate corresponding to the co-located block. In the current disclosure, the spatial and temporal motion vector predictor set is extended to include at least one spatially neighboring block associated with list 0 reference pictures and list 1 reference pictures, and co-located block and its neighboring block associated with list 0 reference pictures and list 1 reference pictures.

Abstract: A method and apparatus for texture image compression in a 3D video coding system are disclosed. Embodiments according to the present invention derive depth information related to a depth map associated with a texture image and then process the texture image based on the depth information derived. The invention can be applied to the encoder side as well as the decoder side. The encoding order or decoding order for the depth maps and the texture images can be based on block-wise interleaving or picture-wise interleaving. One aspect of the present invent is related to partitioning of the texture image based on depth information of the depth map. Another aspect of the present invention is related to motion vector or motion vector predictor processing based on the depth information.

Abstract: A method and apparatus for deriving MV/MVP (motion vector or motion vector predictor) or DV/DVP (disparity vector or disparity vector predictor) associated Skip mode, Merge mode or Inter mode for a block of a current picture in three-dimensional (3D) video coding are disclosed. The 3D video coding may use temporal prediction and inter-view prediction to exploit temporal and inter-view correlation. MV/DV prediction is applied to reduce bitrate associated with MV/DV coding. The MV/MVP or DV/DVP for a block is derived from spatial candidates, temporal candidates and inter-view candidates. For the inter-view candidate, the position of the inter-view co-located block can be located using a global disparity vector (GDV) or warping the current block onto the co-located picture according to the depth information. The candidate can also be derived as the vector corresponding to warping the current block onto the co-located picture according to the depth information.

Abstract: An interaction display system applied in a mobile device is provided. The system has a first camera, facing a first side of the mobile device configured to capture first images of a user; a second camera, facing a second side opposite to the first side of the mobile device, configured to capture second images of a scene; and a processing unit coupled to the first camera and the second camera directly, configured to perform interactions between the user and the scene utilizing the first images and the second images simultaneously captured by the first camera and the second camera.