COMPUTER READABLE RECORDING MEDIUM CAN PERFORM IMAGE SENSING SYSTEM CONTROL METHOD AND IMAGE SENSING SYSTEM
An image sensing system control method, comprising: (a) predicting a first velocity of the image sensor; (b) calculating a first time duration between a first frame time and a first polling time after the first frame time, wherein the image sensor captures a first frame at the first frame time and receives a first polling from the control circuit at the first polling time; and (c) calculating a first predicted motion delta of the first time duration according to the first velocity and the first time duration.
The present invention relates to an image sensing system control method and an image sensing system, and particularly relates to an image sensing system control method and an image sensing system which can reduce the effect caused by non-synchronization between the frame rate and the MCU polling.
2. Description of the Prior ArtIn an optical navigation device such as an optical mouse, the image sensor thereof captures frames at a predetermined frame rate and then computes the motion delta between different frames. Such predetermined frame rate may change corresponding to different modes, for example, an active mode or a standby mode. Also, a MCU (micro control unit) polls the image sensor for motion delta (i.e. request the image sensor to output motion delta). However, the MCU polling rate and the image sensor frame rate are usually different and non-synchronized with each other. As a result, motion delta output and MCU polling will never be consistent.
For more details, the image sensor outputs motion deltas D_1, D_2 to the MCU responding to the polling P_1, outputs motion deltas D_3, D_4, D_5 to the MCU responding to the polling P_2, and outputs motion deltas D_6, D_7 to the MCU responding to the polling P_3. However, due to the non-synchronization, the pollings P_1, P_2, P_3 respectively has different latencies L_1, L_2, L_3 from the frames f_3, f_6, and f_8. Also, due to the non-synchronization, the MCU may receive different numbers of motion deltas responding to different pollings. For example, the MCU receives two motion deltas D_1, D_2 for the polling P1, but receives three motion deltas D_3, D_4, D_5 for the polling P2. Since the motion deltas are always applied to compute a position of the optical pointing device, the issues illustrated in
Therefore, one objective of the present invention is to provide an image sensing system control method can reduce the affect caused by non-synchronization between the frame rate and the polling.
Another objective of the present invention is to provide an image sensing system control method can reduce the affect caused by non-synchronization between the frame rate and the polling.
One embodiment of the present invention discloses: an image sensing system control method, comprising: (a) predicting a first velocity of the image sensor; (b) calculating a first time duration between a first frame time and a first polling time after the first frame time, wherein the image sensor captures a first frame at the first frame time and receives a first polling from the control circuit at the first polling time; and (c) calculating a first predicted motion delta of the first time duration according to the first velocity and the first time duration.
Another embodiment of the present invention discloses: an image sensing system, comprising: a control circuit; an image sensor, configured to perform: (a) predicting a first velocity of the image sensor; (b) calculating a first time duration between a first frame time and a first polling time after the first frame time, wherein the image sensor captures a first frame at the first frame time and receives a first polling from the control circuit at the first polling time; and (c) calculating a first predicted motion delta of the first time duration according to the first velocity and the first time duration.
In view of above-mentioned embodiments, the motion delta can be output corresponding to the time difference between a time of the frame and a time of the polling, thus can reduce the affect caused by non-synchronization between the frame rate and the polling.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
Several embodiments are provided in following descriptions to explain the concept of the present invention. Each component in following descriptions can be implemented by hardware (e.g. a device or a circuit) or hardware with software (e.g. a program installed to a processor). Besides, the method in following descriptions can be executed by programs stored in a non-transitory computer readable recording medium such as a hard disk, an optical disc or a memory. Besides, the term “first”, “second”, “third” in following descriptions are only for the purpose of distinguishing different one elements, and do not mean the sequence of the elements. For example, a first device and a second device only mean these devices can have the same structure but are different devices.
In following embodiments, at least one velocity of the image sensor (or at least one velocity of an electronic device comprising the image sensor) is predicted. After that, at least one predicted motion delta is calculated according to the predicted velocity, and an output motion delta, which is output to the control circuit, is calculated based on the predicted motion delta. Many methods can be applied to predict the velocity, and will be detailedly illustrated in following descriptions.
Please refer to
indicates the first motion delta, T_f1 indicates the first frame time and T_f2 indicates the second frame time. In such case, the first velocity equals to
In the embodiment of
However, in one embodiment, at least one frame exists in the time duration between the two frames which the image sensor 203 uses to predict the first velocity. Please refer to
indicates the first motion delta, T_f1 indicates the first frame time and T_f2 indicates the second frame time. Namely, the image sensor 203 predicts the first velocity V_1 based on the equation of
D_ab and D_b1 respectively mean the motion delta between the second frame f_2/frame a, frame f_a/frame f_b and frame f_b/first frame f_1. Also, TD_2a, TD_ab and TD_b1 respectively mean the time durations between the second frame f_2/frame a, frame f_a/frame f_b and frame f_b/first frame f_1.
As above-mentioned, the first velocity V_1 can be predicted by various methods. In the embodiments of
After the first accumulated motion delta ACM_1 is acquired, the image sensor 203 predicts the first velocity V_1 according to the first accumulated motion delta ACM_1 and the first polling period Pe_1. In one embodiment, the image sensor 203 predicts the first velocity V_1 according to an equation of
ACM_1 indicates the first accumulated motion delta, and Pe_1 indicates the first polling period. After that, the image sensor 203 calculates the first predicted motion delta PD_1 by V_1×TD_1. TD_1 is the above-mentioned first time duration.
The embodiment illustrated in
After the second velocity V_2 is predicted, the image sensor 203 performs a weighting equation to the first velocity V_1 and the second velocity V_2 to generate a weighting result. Then, the image sensor 203 predicts the velocity of the image sensor 203 or the electronic device comprising the image sensor 203 according to the weighting result. In one embodiment, the image sensor 203 calculates an average of the first velocity V_1 and the second velocity V_2 as the weighting result. It will be appreciated that although the embodiment in
Afterwards, the image sensor 203 reports an output motion delta responding to the first polling P_1 according to a first accumulated motion delta ACM_1 corresponding to the first polling, the first predicted motion delta PD_1 and the second predicted motion delta PD_2. In such case, the first accumulated motion delta ACM_1 can be the motion delta D_1 between the first frame f_1 and the motion delta D_2 between the first frame f_2. Also, in one embodiment, the output motion delta is ACM_1+PD_1−PD_2.
In view of above-mentioned embodiments, an image sensing system control method can be acquired, which can be performed by at least one program recorded in a non-transitory computer readable recording medium such as an optical disc, a hard disk or a memory card.
Step 801
Predict a first velocity (e.g. V_1 in
Step 803
Calculate a first time duration (e.g. TD_1 in
Step 805
Calculate a first predicted motion delta PD_1 of the first time duration according to the first velocity and the first time duration.
Other detail are explained in above-mentioned embodiments, thus are omitted for brevity here. Please note, the above-mentioned embodiments are only examples for explaining. The combination or variations based on above-mentioned teachings should also fall in the scope of the present invention.
Therefore, if it needs to confirm whether the computer 901 correctly receives the output motion delta OD or not, a protocol analyzer 903 can be used to capture the communication between the control circuit 201 and the image sensor 203. After that, extract the output motion delta OD (source) from the log file generated by the protocol analyzer 903. Also, capture the output motion delta OD (destination) at the computer 901, and compare the output motion delta OD (source) and the output motion delta OD (destination) by the data comparator 905. If the control circuit 201 does not change the output motion delta OD from the image sensor 203, the output motion delta OD (source) are the same. The protocol analyzer 903 can be implemented by a circuit specifically designed for capturing the output motion delta OD (source). Also, the protocol analyzer 903 can be a processor installed with at least one program to capture the output motion delta OD (source).
In view of above-mentioned embodiments, the motion delta can be output corresponding to the time difference between a time of the frame and a time of the polling, thus can reduce the affect caused by non-synchronization between the frame rate and the polling.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims
1. A non-transitory computer readable recording medium comprising at least one program code recorded therein, an image sensing system control method applied to the image sensing system comprising an image sensor and a control circuit can be performed when the program code is executed, the image sensing system control method comprising:
- (a) predicting a first velocity of the image sensor;
- (b) calculating a first time duration between a first frame time and a first polling time after the first frame time, wherein the image sensor captures a first frame at the first frame time and receives a first polling from the control circuit at the first polling time; and
- (c) calculating a first predicted motion delta of the first time duration according to the first velocity and the first time duration.
2. The non-transitory computer readable recording medium of claim 1, wherein the step (a) comprises following steps to predict the first velocity:
- (a1) calculating a second time duration between the first frame time and a second frame time before the first frame time, wherein the image sensor captures a second frame at the second frame time; and
- (a2) predicting the first velocity according to a first motion delta corresponding to the first frame and the second frame, and according to the second time duration.
3. The non-transitory computer readable recording medium of claim 2, wherein the step (a2) predicts the first velocity according to an equation of D_1/T_f1−T_f2, wherein D_1 indicates the first motion delta, T_f1 indicates the first frame time and T_f2 indicates the second frame time.
4. The non-transitory computer readable recording medium of claim 2, wherein the image sensor does not capture any frame in the second time duration.
5. The non-transitory computer readable recording medium of claim 2, wherein the image sensor receives a second polling at a second polling time before the first polling time, wherein the first frame time and the second frame time are before the first polling time and after the second polling time.
6. The non-transitory computer readable recording medium of claim 1, wherein the image sensor receives a second polling at a second polling time before the first polling time, wherein the step (a) comprises following steps to predict the first velocity:
- (a1) calculating a first polling period between the first polling time and the second polling time;
- (a2) calculating a first accumulated motion delta of the first polling; and
- (a3) predicting the first velocity according to the first accumulated motion delta and the first polling period.
7. The non-transitory computer readable recording medium of claim 6, wherein the step (a3) predicts the first velocity according to an equation of ACM_ 1 Pe_ 1,
- wherein ACM_1 indicates the first accumulated motion delta, and Pe_1 indicates the first polling period.
8. The non-transitory computer readable recording medium of claim 6, wherein the image sensor receives a third polling at a third polling time before the second polling time, wherein the image sensing system control method further comprises:
- calculating a second polling period between the second polling time and the third polling time;
- calculating a second accumulated motion delta of the second polling; and
- predicting a second velocity according to the second accumulated motion delta and the second polling period;
- wherein the step (c) calculates the first predicted motion delta according to the first velocity, the second velocity and the first time duration.
9. The non-transitory computer readable recording medium of claim 8, further comprising:
- performing a weighting equation to the first velocity and the second velocity to generate a weighting result;
- wherein the step (c) calculates the first predicted motion delta according to the weighting result and the first time duration.
10. The non-transitory computer readable recording medium of claim 1, further comprising:
- predicting a second velocity of the image sensor;
- calculating a third time duration between a third frame time and a second polling time after the third frame time, wherein the image sensor captures a third frame at the third frame time, wherein the image sensor receives a third polling from the control circuit at the third polling time, wherein the third frame time and the second polling time are before the first frame time and the first polling time; and
- calculating a second predicted motion delta of the third time duration according to the second velocity and the third time duration;
- wherein the image sensor reports an output motion delta responding to the first polling according to a first accumulated motion delta corresponding to the first polling, the first predicted motion delta and the second predicted motion delta.
11. The non-transitory computer readable recording medium of claim 10, wherein the image sensor reports the output motion delta via an equation of: ACM_1+PD_1−PD_2, wherein ACM_1 indicates the first accumulated motion delta, PD_1 indicates the first predicted motion delta, and PD_2 indicates the second predicted motion delta.
12. An image sensing system, comprising:
- a control circuit;
- an image sensor, configured to perform:
- (a) predicting a first velocity of the image sensor;
- (b) calculating a first time duration between a first frame time and a first polling time after the first frame time, wherein the image sensor captures a first frame at the first frame time and receives a first polling from the control circuit at the first polling time; and
- (c) calculating a first predicted motion delta of the first time duration according to the first velocity and the first time duration.
13. The image sensing system of claim 12, wherein the step (a) comprises following steps to predict the first velocity:
- (a1) calculating a second time duration between the first frame time and a second frame time before the first frame time, wherein the image sensor captures a second frame at the second frame time; and
- (a2) predicting the first velocity according to a first motion delta corresponding to the first frame and the second frame, and according to the second time duration.
14. The image sensing system of claim 13, wherein the step (a2) predicts the first velocity according to an equation of D_ 1 T_f 1 - T_f2,
- wherein D_1 indicates the first motion delta, T_f1 indicates the first frame time and T_f2 indicates the second frame time.
15. The image sensing system of claim 13, wherein the image sensor does not capture any frame in the second time duration.
16. The image sensing system of claim 13, wherein the image sensor receives a second polling at a second polling time before the first polling time, wherein the first frame time and the second frame time are before the first polling time and after the second polling time.
17. The image sensing system of claim 12, wherein the image sensor receives a second polling at a second polling time before the first polling time, wherein the step (a) comprises following steps to predict the first velocity:
- (a1) calculating a first polling period between the first polling time and the second polling time;
- (a2) calculating a first accumulated motion delta of the first polling; and
- (a3) predicting the first velocity according to the first accumulated motion delta and the first polling period.
18. The image sensing system of claim 17, wherein the step (a3) predicts the first velocity according to an equation of ACM_ 1 Pe_ 1,
- wherein ACM_1 indicates the first accumulated motion delta, and Pe_1 indicates the first polling period.
19. The image sensing system of claim 17, wherein the image sensor receives a third polling at a third polling time before the second polling time, wherein the image sensor further performs:
- calculating a second polling period between the second polling time and the third polling time;
- calculating a second accumulated motion delta of the second polling; and
- predicting a second velocity according to the second accumulated motion delta and the second polling period;
- wherein the step (c) calculates the first predicted motion delta according to the first velocity, the second velocity and the first time duration.
20. The image sensing system of claim 19, wherein the image sensor further performs:
- performing a weighting equation to the first velocity and the second velocity to generate a weighting result;
- wherein the step (c) calculates the first predicted motion delta according to the weighting result and the first time duration.
21. The image sensing system of claim 12, wherein the image sensor further performs:
- predicting a second velocity of the image sensor;
- calculating a third time duration between a third frame time and a second polling time after the third frame time, wherein the image sensor captures a third frame at the third frame time, wherein the image sensor receives a third polling from the control circuit at the third polling time, wherein the third frame time and the second polling time are before the first frame time and the first polling time; and
- calculating a second predicted motion delta of the third time duration according to the second velocity and the third time duration;
- wherein the image sensor reports an output motion delta responding to the first polling according to a first accumulated motion delta corresponding to the first polling, the first predicted motion delta and the second predicted motion delta.
22. The image sensing system of claim 21, wherein the image sensor reports the output motion delta via an equation of: ACM_1+PD_1−PD_2, wherein ACM_1 indicates the first accumulated motion delta, PD_1 indicates the first predicted motion delta, and PD_2 indicates the second predicted motion delta.
Type: Application
Filed: Mar 25, 2020
Publication Date: Sep 30, 2021
Inventor: Shang Chan KONG (Penang)
Application Number: 16/830,212