Abstract: An optical pointing device includes: an image input part emitting light and accumulating the light reflected from a working surface during a sampling period to generate an analog image, and converting the analog image into a digital image to output a sample frame, a correlation matrix generator comparing the sample frame with a reference area to generate a correlation matrix, selecting one weighting matrix of a plurality of weighting matrices in response to a movement value, and outputting a weighted correlation matrix using the selected weighting matrix, a movement value calculator finding a cell having a largest correlation value among the weighted correlation matrix, calculating the movement value and outputting the movement value to a position of the cell, and transmitting the movement value to the correlation matrix generator to select a following weighting matrix, and an interface converting the outputted movement value into a signal of a certain format.