Abstract: A method for using an alternate frame reference (ARF) includes selecting an anchor frame and video frames, where the anchor frame includes an anchor block, and the anchor block includes an anchor pixel; identifying, for the anchor block of the anchor frame, respective reference blocks in the video frames; determining, for the anchor pixel and using an anchor patch, respective distances between the anchor pixel and respective co-located reference pixels of the respective reference blocks, where the anchor patch includes anchor patch pixels, and a respective distance, of the respective distances, between the anchor pixel and a respective co-located reference pixel is determined using the anchor patch pixels and co-located reference pixels; determining, using the respective distances, respective weights; determining, using the respective weights, an ARF pixel that is co-located with the anchor pixel; and encoding, in a compressed bitstream, the ARF.

Abstract: A decoding apparatus is provided. The decoding apparatus includes a communication unit for receiving multiple encoding data respectively corresponding to multiple areas constituting one image, and reference data including attribute information of each of the multiple areas, and a processor for generating multiple divided images by decoding the multiple encoding data respectively, changing the resolutions of some divided images among the multiple divided images on the basis of the received attribute information, and generating a reconstructed image by merging the some divided images having the changed resolutions and the remaining divided images.

Abstract: Embodiments of the present disclosure disclose a video image processing method performed at a computing device, including: performing half pixel estimation on a predefined region of a target image frame to obtain an optimal half pixel location having a minimum rate distortion cost; dividing a surrounding area of the optimal half pixel location into four partitions; selecting, among the four partitions according to rate distortion costs respectively of four half pixel locations adjacent to the optimal half pixel location, a first partition used for quarter pixel estimation; performing quarter pixel estimation on the first partition according to the optimal half pixel location, to obtain an optimal quarter pixel location having a minimum rate distortion cost within the first partition; and performing motion compensation to the target image frame by using at least one of the optimal half pixel location and the optimal quarter pixel location as a motion estimation result.

Abstract: A method and apparatus use a geometric modified image for video encoding/decoding. The encoding method may include: generating a geometric modified reference picture by geometrically modifying a reference picture; generating a prediction block of a current block within an encoding target picture by performing inter prediction by referencing the reference picture or the geometrically modified reference picture; and encoding inter-prediction information of the current block.

Abstract: A video encoder and video decoder are configured to encode and decode blocks of video data using affine motion prediction. Affine motion prediction may include predicting control point motion vectors using an affine advanced motion vector prediction (AMVP) motion vector predictor list. The video encoder and video decoder may be configured to construct the affine AMVP motion vector predictor list of candidate control point motion vectors for the block of video data, wherein the affine AMVP motion vector predictor list includes one or more affine motion vector predictors that have all control point motion vectors equal to a designated motion vector.

Abstract: Methods and systems for determining motion vectors in a motion estimation process of a video encoder are provided. Embodiments of the present invention provide a solution for the problem of unnecessary cost function evaluations, found when combining the successive elimination method with a predetermined list of candidate motion vectors search ordering. In order to solve this problem, embodiments of the present invention provide an adaptive scan ordering of block matching candidates within a search area. Advantageously, embodiments of the present invention will only evaluate necessary cost functions, without impacting rate-distortion.

Abstract: A video encoding apparatus includes: an inter prediction unit to determine a motion parameter of a current block and generate a predicted block of the current block, by performing a motion estimation on the current block; and an optimal mode determining unit to set a prediction mode of the current block as a SKIP mode when (i) the motion parameter of the current block is identical to a motion parameter of a candidate block among a plurality of candidate blocks and (ii) all-zero coefficients result from a transform and a quantization performed on a residual data block representing the difference between the current block and the predicted block.

Abstract: A method for decoding an image signal according to the present invention may comprise the steps of: determining whether there is a brightness change between a current image including a current block and a reference image of the current image; if it is determined that there is a brightness change between the current image and the reference image, determining weight prediction parameter candidates for the current block; determining a weight prediction parameter for the current block on the basis of index information which specifies any one of the weight prediction parameter candidates; and performing a prediction on the current block on the basis of the weight prediction parameter.

Abstract: Inter-layer motion mapping information may be used to enable temporal motion vector prediction (TMVP) of an enhancement layer of a bitstream. For example, a reference picture and a motion vector (MV) of an inter-layer video block may be determined. The reference picture may be determined based on a collocated base layer video block. For example, the reference picture may be a collocated inter-layer reference picture of the reference picture of the collocated base layer video block. The MV may be determined based on a MV of the collocated base layer video block. For example, the MV may be determined by determining the MV of the collocated base layer video block and scaling the MV of the collocated base layer video block according to a spatial ratio between the base layer and the enhancement layer. TMVP may be performed on the enhancement layer picture using the MV of the inter-layer video block.

Abstract: A camera-based security system protects an asset by detecting an aerial surveillor and consequently storing notifications into a video archive, alerting to an operator console, and actuating privation apparatus. One or more cameras provides video streams to a processor which derives object motion. Attributes of object motion trigger notification to record and alert on conditions associated with an aerial surveillor. Tracking of pixels, pixel blocks, and motion vectors enable rules based determination of an airborne surveillance vehicle according to characteristic hovering or lingering by masking LSB of accumulated positive and negative movements. Actuators cause privation enhancement apparatus to obfuscate the protected asset (structure, area, or volume) or to interpose between the protected asset and the surveillor without damage or disabling. The method traces a travel path of an object; and determines a ray from a private property to a surveillor drone.

Abstract: Systems, apparatuses, and methods for implementing data recovery techniques for lossy wireless links are disclosed. A transmitter is configured to encode a video stream and wirelessly transmit the encoded video stream to a receiver, with the video stream representing a virtual reality (VR) rendered environment. The transmitter partitions the video stream into a plurality of substream components based on frequency. Motion vector parameters are calculated for the lowest frequency substream component of the video stream only, and the motion vector parameters are sent to the receiver using a low MCS level. When the receiver receives the motion vector parameters, but the receiver does not receive the lowest frequency component of a given chunk, the receiver uses the motion vector parameters to reconstruct the lowest frequency component of the given chunk by extrapolating from a corresponding chunk of the previous video frame.

Abstract: The present invention discloses an inter prediction mode-based image processing method and an apparatus therefore. Specifically, a method for processing an image based on an inter prediction may include: deriving motion information of a first prediction unit determined by a first partitioning mode of a current block and motion information of a second prediction unit determined by a second partitioning mode of the current block; generating a prediction block of the first prediction unit by using the motion information of the first prediction unit and generating a prediction block of the second prediction unit by using the motion information of the second prediction unit; and generating a prediction block of the current block in units of sub-prediction unit determined by combining the first prediction unit and the second prediction unit by using the first prediction block and the second prediction block.

Abstract: The invention relates to an encoding apparatus for processing a video signal comprising a plurality of frames dividable into video coding blocks. A first video coding block of a current frame of the video signal is partitioned into a first segment associated with a first segment motion vector relative to a first reference frame of the video signal and a second segment. The first video coding block is associated with a plurality of virtual partitions. Each virtual partition is associated with a respective subset of the plurality of video coding blocks of the current frame. Each video coding block of the respective subset neighbors the first video coding block and is associated with a motion vector.

Abstract: Provided is an apparatus for decoding an image. The apparatus restores a plurality of sub-blocks by applying a scan pattern determined according to the intra prediction mode of the current block on the quantization coefficient sequence and restores the quantized transform block by applying a scan pattern determined according to the intra prediction mode of the current block on the plurality of sub-blocks. Therefore, it is possible to reduce the amount of coding bits and computing resources required to decode a current prediction block.

Abstract: A multi-codec encoder includes a first partitioning unit and a second partitioning unit configured to receive first data and second data, respectively. Sequential frames of image data are alternately classified into the first data and the second data. The multi-codec encoder further includes a motion estimation module configured to generate motion estimation information, based on the first data and reference data, a first codec configured to encode the first data with the motion estimation information, and a second codec configured to encode the second data with the motion estimation information.

Abstract: An image processing device including a decoding section configured to decode an image from an encoded stream, a determination section configured to perform determination processes of determining whether to apply a deblocking filter to neighboring blocks neighboring across a block boundary within an image to be decoded by the decoding section, a filtering section configured to apply a deblocking filter to neighboring blocks to which the determination section has determined to apply a deblocking filter, and a control section configured to allow the determination section to perform the determination processes for a vertical block boundary and a horizontal block boundary using pixels of the neighboring blocks of a reconstruct image as reference pixels.

Abstract: A system and method for providing landscape (horizontal) and portrait (vertical) oriented images of a common scene on separate feeds with independent image controls includes a movable horizontal camera configured to provide a horizontal image on a horizontal image feed, a movable vertical camera configured to provide a vertical image on a vertical image feed, the horizontal and vertical cameras configured to be aligned along a camera axis and mounted to a common support, the horizontal and vertical cameras configured to view the common scene and to provide separate horizontal and vertical image feeds simultaneously, the cameras being independently controlled such that a given camera is moved when a tracked subject exceeds a control range threshold for that camera image, independent of the subject location in the other camera image. In some embodiments, a single high resolution image may be used with independently-controlled horizontal and vertical extracted images.

Abstract: A method of reconstructing video data using a merge mode can include constructing a merge list using available spatial and temporal merge candidates; determining a merge candidate on the merge list corresponding to a merge index as motion information of a current prediction unit; generating a predicted block of the current prediction unit using the motion information; generating a transformed block by inverse-quantizing a block of quantized coefficients using a quantization parameter; generating a residual block by inverse-transforming the transformed block; and generating a reconstructed block using the predicted block and the residual block, in which when the current prediction unit is a second prediction unit partitioned by asymmetric partitioning, the spatial merge candidate corresponding to a first prediction unit partitioned by the asymmetric partitioning is excluded from the merge list, and a motion vector of the temporal merge candidate is determined depending on a position of the current prediction u

Abstract: Systems, apparatuses, and methods for calculating a quantization parameter (QP) for encoding video frames to meet a given bit budget are disclosed. Control logic coupled to an encoder calculates a complexity indicator that represents a level of difficulty in encoding a previous video frame. The complexity indicator is based at least in part on a first parameter associated with the previous video frame and corresponds to one or more of a variance, an intra-prediction factor, and an inter-to-intra ratio. The complexity indicator is then used by the control logic to calculate a preferred QP to use to encode the current video frame to meet a given bit budget. By using the preferred QP generated based on the complexity indicator, the encoder is able to make fewer QP adjustments during the frame. This helps to improve the visual quality of the resulting encoded video bitstream.

Abstract: An apparatus may include a memory to receive an image frame to encode; and a modular motion estimation engine to process the image frame. The modular motion estimation engine includes modular motion estimation circuitry comprising a multiplicity of motion estimation circuits, and a motion estimation kernel for execution on the modular motion estimation circuitry to send the image frame through one or more configurable execution pipelines that each execute motion estimation over one or more of the motion estimation circuits.

Abstract: Various innovations in media encoding are presented herein. In particular, the innovations can reduce the computational complexity of encoding by selectively skipping certain evaluation stages during encoding. For example, based on analysis of decisions made earlier in encoding or based on analysis of media to be encoded, an encoder can selectively skip evaluation of certain coding tools (such as residual coding or rate-distortion-optimized quantization), skip evaluation of certain values for parameters or settings (such as candidate unit sizes or transform sizes, or candidate partition patterns for motion compensation), and/or skip evaluation of certain coding modes (such as frequency transform skip mode) that are not expected to improve rate-distortion performance during encoding.

Abstract: Disclosed are a method of encoding a video, including determining a motion vector resolution of a current block, determining a motion vector of the current block according to the motion vector resolution of the current block, predicting and encoding current block using a motion vector of the current block, and encoding information on the motion vector resolution of the current block.

Abstract: A method of performing merge candidate list construction for video coding using at least one processor includes determining a plurality of potential merge candidates; selecting a first potential merge candidate from among the plurality of potential merge candidates; performing a redundancy check by checking the potential merge candidate against a merge candidate included in the merge candidate list; based on a result of the redundancy check, determining whether to insert the potential merge candidate into the merge candidate list; determining whether a redundancy check threshold is exceeded, wherein the redundancy check threshold relates to at least one from among a number of redundancy checks which have been performed, and a number of potential merge candidates which have been checked by the redundancy checks; and based on the redundancy check threshold being exceeded, determining not to perform additional redundancy checks during the merge candidate list construction.

Abstract: A method for encoding at least one image, including subdividing the image into a plurality of blocks and subdividing at least one current block into a first portion and a second portion. The first portion has a rectangular or square shape and the second portion complements the first portion in the current block. The second portion has a geometric shape with m sides, wherein m>4. Then the first and second portions are encoded.

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

Abstract: An inter-prediction method according to the present invention comprises the steps of: deriving motion information of a current block; and generating a prediction block for the current block on the basis of the derived motion information. According to the present invention, computational complexity can be reduced and encoding efficiency can be improved.

Abstract: An image processing device including a predicted vector generation section configured to generate a predicted vector for use in encoding of a motion vector (MV) of a current block by scaling the MV of a reference block, which is a block of a position shifted from a position of the current block in an image of a different view, by a disparity obtained from a periphery of the current block in an image of a non-base view according to a reference destination of the current block and a reference destination of the reference block, an MV encoding section configured to encode the MV of the current block using the predicted vector generated by the predicted vector generation section, and an encoding section configured to generate an encoded stream by encoding the image in units having a hierarchical structure.

Abstract: Methods and systems for processing video data are provided. In one example, a first video bitstream can be obtained, which can include video frames of a spherical representation of 360-degree video data. Two-dimensional pixel coordinates of a pixel location of a planar surface of a geometry can be determined. The planar surface can be part of a plurality of planar surfaces of the geometry. Two-dimensional normalized coordinates can be determined for the pixel location based on an adaptation parameter and the two-dimensional pixel coordinates. Three-dimensional coordinates of a sample point of the spherical representation of the 360-degree video data can be determined based on the two-dimensional normalized coordinates. A pixel value for the pixel location of the planar surface of the geometry can be determined based on the sample point, and a second video bitstream can be generated that includes pixel values determined for pixel locations of the plurality of planar surfaces of the geometry.

Abstract: The invention relates to the encoding or decoding of at least one portion of an image by predicting the at least one portion using at least one predictor, the at least one predictor being determined as a function of at least one reference image portion and as a function of values of a plurality of items of motion information. After having obtained a value of a first item of the plurality of items, a value of a second item is evaluated as a function of the obtained value of the first item, the second item being an item of the plurality of items and being distinct from the first item. Next, the at least one predictor is determined as a function of the at least one reference image portion and as a function of the first and second items.

Abstract: A computer-implemented method includes receiving a feedback message including feedback information from a receiver of image data, obtaining a current frame to be encoded, encoding the current frame based at least in part on the feedback information, and transmitting the encoded current frame to the receiver.

Abstract: Embodiments include techniques for generation of candidate motion vector lists for use in inter-prediction. For example, according to some embodiments, a candidate motion vector list is generated to have an order that is based on motion information of each of the candidate motion vectors. The order can be applied as the list is generated, as a resorting after the list is partially generated, or after the list is generated.

Abstract: A motion compensating prediction method includes: determining a location of an initial reference pixel of a current pixel in a reference image, where the current pixel is located in a first sub-image in a current image, when the initial reference pixel is located outside a second sub-image at a location corresponding to the first sub-image in the reference image, determining a location of a target reference pixel of the current pixel in the reference image based on the location of the initial reference pixel, where location precision of the target reference pixel is limited to being less than or equal to preset pixel location precision, and determining a predicted value of a pixel value of the current pixel based on a pixel value of the target reference pixel and/or a pixel value of a neighboring pixel of the target reference pixel.

Abstract: Disclosed is a method allowing enhanced prediction of a video signal, the method comprising the steps of: entropy-decoding a neighboring block adjacent to a target block; inverse-quantizing the entropy-decoded neighboring block; acquiring the modified neighboring block by carrying out a modified inverse transform on an inverse-quantized transform coefficient vector of the neighboring block; and generating a prediction block for the target block based on the modified neighboring block, wherein the modified inverse transform applies a different scaling matrix for each pixel location reconstructed for the inverse-quantized transform coefficient vector of the neighboring block.

Abstract: According to an embodiment disclosed in the present specification, a history-based motion vector prediction (HMVP) candidate set with respect to a current block may be derived based on a history, the HMVP candidate set may be updated or initialized according to a condition, and motion information of the current block may be derived based on the HMVP candidate set, through which inter prediction efficiency can be improved.

Abstract: Method and apparatus of using Bilateral Template MV Refinement are disclosed to improve coding efficiency or reducing complexity. According to one method, if a size associated with the current block is greater than a threshold, then Bilateral Template MV Refinement is applied to the current block. Otherwise, the Bilateral Template MV Refinement is not applied to the current block. In another method, the Bilateral Template MV Refinement is turned on or off implicitly based on the two reference blocks. According to yet another method, the Bilateral Template MV Refinement is performed on the sub-block level. According to yet another method, the Bilateral Template MV Refinement is performed motion vectors selected from candidates of AMVP (advance MV prediction) candidate list. According to yet another method, the Bilateral Template MV Refinement used a modified template to refine motion vector.

Abstract: A motion vector decoding unit derives a motion vector of a prediction block subject to decoding on the basis of a motion vector of a candidate block included in candidate blocks selected from neighboring blocks. The motion compensation prediction unit performs motion compensation prediction using the derived motion vector. In case a motion vector number of a first block and a motion vector number of a second block are identical with each other, the motion vector decoding unit determines whether or not to set the second block as a candidate block in accordance with whether or not a reference index indicating a reference picture that the motion vector of the first block refers to and a reference index indicating a reference picture that the motion vector of the second block refers to are identical with each other.

Abstract: There are provided mechanisms for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction (MVP) and a motion vector difference (MVD) between the motion vector and the MVP. The MVD comprises a first MVD component y and a second MVD component x. The method comprises encoding the first MVD component y. The method comprises encoding a representation {circumflex over (x)} of the second MVD component x. The method comprises sending information to a video decoder on how reconstruct the second MVD component x from the representation {circumflex over (x)} of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type. There are provided mechanisms for reconstructing a motion vector from a motion vector prediction (MVP) and a motion vector difference (MVD).

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. In some embodiments, the processing circuitry decodes first prediction information of a first block from a coded video bitstream. The first block is within a merge sharing node (MSN) with an intra block copy (IBC) merge candidate list that is constructed based on the MSN and shared within the MSN. The first prediction information is indicative of an IBC mode. Then, the processing circuitry determines a first block vector that points to a first reference area in a same picture as the first block based on the IBC merge candidate list associated with the MSN, and reconstructs at least a sample of the first block based on first reference samples of the first reference area in the same picture.

Abstract: An example device for processing video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to determine to extract a motion constrained tile sets (MCTS) sub-bitstream from an original bitstream including the video data based at least in part on information of an MCTS extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message; and in response to determining to extract the MCTS sub-bitstream, omit all SEI network abstraction layer (NAL) units that contain non-MCTS-nested SEI messages from inclusion in the extracted MCTS sub-bitstream, regardless of a value of a NAL unit header layer identifier value for the non-MCTS-nested SEI messages.

Abstract: A video encoding method is provided, which includes steps of acquiring a synchronized multi-view video; generating a spatial layout information of the synchronized multi-view video; encoding the synchronized multi-view video; and signaling the spatial layout information corresponding to the encoded multi-view video.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry decodes prediction information of a current block in a current picture from a coded video bitstream. The prediction information is indicative of a sub-block based merge mode. Then, the processing circuitry decodes offset information from the coded video bitstream and reconstructs a sample in a sub-block of the current block according to motion information of the sub-block that is determined based on the sub-block based merge mode and the offset information.

Abstract: Techniques related to video encoding are discussed that, for each block of input video, select an individual partitioning and coding mode selection technique from multiple such selection techniques. For a picture, the selection algorithm takes as input scores for individual blocks, costs of the various partitioning and coding mode selection techniques, and various detector outputs. The selection algorithm provides as output a partitioning and coding mode selection technique for each block in picture. The algorithms selection is such that the overall cost of the selected algorithms in the picture is as close as possible to a given picture budget. Furthermore, a partitioning and coding mode selection algorithms, binary depth partitioning (BDP), is discussed. For a block, BDP provides fast convergence to a partitioning and associated coding modes first evaluating intermediate partitioning options and converging on the final partitioning by evaluating either larger of smaller partitions.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. An apparatus for video decoding includes processing circuitry that decodes prediction information for a current block in a current coded picture. The prediction information indicates an intra block copy mode and a first block vector predictor (BVP) used for the current block. The first BVP points to a first reference block (RB). The processing circuitry determines whether the first RB is accessible from a memory. When the first RB is determined to be inaccessible from the memory, the processing circuitry determines a second RB that is accessible from the memory according to at least one of a default RB, the first RB, and the current block. The processing circuitry includes a second BVP in a BVP candidate list. The second BVP points to the second RB. The processing circuitry reconstructs the current block based on the BVP candidate list.

Abstract: Systems and method for correcting images including artifacts due to dirty camera lenses of electronic device are disclosed.

Abstract: A method and apparatus for video coding operates by receiving input data associated with a current block in a current picture, determining restricted prediction based on whether IntraBC prediction (Intra Block Copy prediction) is included in a plurality of candidate coding modes, wherein said determining the restricted prediction comprising disabling or disallowing selected prediction for one or more selected PU (prediction unit) sizes, PU prediction types or both, and applying video coding to the current block using the candidate coding modes including IntraBC prediction (Intra Block Copy prediction) in accordance with the restricted prediction.

Abstract: A method of video operations includes generating derivative byproducts related to encoded video captured of a scene, initializing a first operation based on the encoded video, and initializing a second operation different from the first operation based on the derivative byproducts.

Abstract: The disclosure relates to systems and methods for automating offender documentation with facial or other recognition technique. A method can include generating, by cameras situated about a correctional facility, pixel data including first pixels corresponding to a face of a first offender in the correctional facility and an environment around the first offender corresponding to a location within the field of view of the camera, and providing, to a server, the pixel data from the cameras through a network connection, and receiving, from the server, an alert that, based on facial recognition and location detection analysis performed on the pixel data by the server, indicates a monitoring rule associated with the first offender is violated, an offender identification associated with the first offender, a location of the first offender in the correctional facility, and an indication of the monitoring rule violated.

Abstract: A next-generation video decoding technique performed by at least one computer processor including determining whether at least one parameter of a block is less than or equal to a threshold, signaling, in response to determining the parameter(s) of the block is/are less than or equal to the threshold, a horizontal transform or vertical transform, splitting, in response to determining that the at least one parameter of the block is greater than the threshold, the block into sub-blocks, applying a first signaling scheme on a luma component and a second signaling scheme on a chroma component, performing ones of transforms on the sub-blocks, and decoding a video stream by using the sub-blocks upon which the ones of the transforms are performed, where a maximum block size of the first signaling scheme is different than a maximum block size of the second signaling scheme.

Abstract: A method and apparatus for decoding a current view belonging to a previously coded multi-view image. The method includes: determining, in a set of views belonging to the multi-view image or to another multi-view image, a pathway of views that are necessary for the decoding of the current view, the pathway comprising at least one as yet undecoded view; decoding the at least one view not yet decoded; and decoding the current view on the basis of a set of coded data representative of at least one difference between the current view and another view of the multi-view image or of another multi-view image, and of the at least one decoded view.

Abstract: Rendered portions of a renderable portion of a first view of a multi-view signal are introduced into a prediction loop of a multi-view encoder to form a reference signal for the block-based prediction of the encoder's view predictor may improve the prediction and thereby increasing the coding efficiency. The introduction may be performed by completely inserting the renderable portion into the prediction loop to form new reference pictures with their own reference picture indices in addition to reference pictures obtained by the reconstructed version of the multi-view signal of the block-based prediction. Alternatively, the rendered portion may be introduced into the prediction loop completely, but with replacing the normal prediction reference signal, i.e., the normally reconstructed signal as obtained by block-based prediction. Alternatively, it may be signaled within the data stream which portions of the renderable portion are used to replace respective portions in the normally reconstructed signal.