Abstract: A filtering method and filtering system is applied to an edge orientation map obtained from an edge direction detection system in order to keep accurate edge directions and filter out false edges or edges with wrong directions. If an edge direction does not have a certain minimum length, then that direction is filtered out and a default direction is provided. Additional assurances can be obtained by insuring that the edge direction has a certain minimum width. If an edge direction does not have the minimum width, then that edge direction is filtered out and the default direction is provided. A direction smoother can be applied to the directions in the edge orientation map to smooth the changing of neighboring edge directions. This process is found to be effective in improving the visual quality of an image that is interpolated based on edge directions.