Abstract: A method of modifying a time-varying image sequence in which a parametric velocity vector field that characterizes changes in successive images of the image sequence is estimated. The estimating includes combining optical flow constraints, directional smoothness constraints and regularization constraints in a functional of the estimate of the parametric velocity vector field such that the weighting coefficients of the functional are functions of the parametric velocity vector field to be estimated. A system of nonlinear equations that arise from the optimality criterion of the functional are then solved. Once the system of nonlinear equations is solved, the estimate of the parametric velocity vector field is applied to modify at least one image in the image sequence.

Abstract: An interpolation operation is performed between a pair of stereo images to produce plural intermediate images. The interpiolation operation involves estimating the velocity vector field of the intermediate images. The estimation for a particular intermediate image includes constraining the search for the correspondences between the two images in the horizontal direction allowing the system to arrive at a more optimal solution. Excessive gap filling by smoothing is not necessary. At the same time the process vertically aligns the entirety of the images.