Abstract: A method and system for optimizing optical flow for images based on a residual field and a displacement field are provided. The method includes: obtaining reference images; estimating an initial optical flow field from the reference images by using an optical flow estimation method; obtaining an optical flow optimization model, where the optical flow optimization model includes an image encoder, an optical flow encoder, a first decoder, and a sub-decoder; inputting any image of the reference images and the initial optical flow field into the optical flow optimization model to output the residual field and the displacement field; superimposing the initial optical flow field and the residual field to obtain a preliminarily optimized optical flow field; and resampling the preliminarily optimized optical flow field by using the displacement field to obtain an optimized optical flow field.

Abstract: A method and system for optimizing optical flow for images based on a residual field and a displacement field are provided. The method includes: obtaining reference images; estimating an initial optical flow field from the reference images by using an optical flow estimation method; obtaining an optical flow optimization model, where the optical flow optimization model includes an image encoder, an optical flow encoder, a first decoder, and a sub-decoder; inputting any image of the reference images and the initial optical flow field into the optical flow optimization model to output the residual field and the displacement field; superimposing the initial optical flow field and the residual field to obtain a preliminarily optimized optical flow field; and resampling the preliminarily optimized optical flow field by using the displacement field to obtain an optimized optical flow field.