Abstract: A method of and apparatus for forming a final image sequence from an initial image sequence by adding new pixels to the original image sequence is disclosed. An energy of the final image sequence and its displacement field is defined in terms of one or more of (i) the local spatial distribution of pixel information of at least one pixel, (ii) the local temporal distribution of pixel information of at least one pixel, and (iii) the local spatial distribution of at least one displacement field between two images of said successive images that are displaced in time and the local spatial distribution of pixel information and displacement fields at the position in neighbouring images to which the displacement vector of a new pixel is pointing. The final image sequence is determined by finding a minimum or nearly-minimum of said energy.