MOTION COMPONENT DOMINANCE FACTORS FOR MOTION LOCKING OF TOUCH SENSOR DATA
An image jaggedness filter is disclosed that can be used to detect the presence of ungrounded objects such as water droplets or coins, and delay periodic baseline adjustments until these objects are no longer present. To do otherwise could produce inaccurate normalized baseline sensor output values. The application of a global baseline offset is also disclosed to quickly modify the sensor offset values to account for conditions such as rapid temperature changes. Background pixels not part of any touch regions can be used to detect changes to no-touch sensor output values and globally modify the sensor offset values accordingly. The use of motion dominance ratios and axis domination confidence values is also disclosed to improve the accuracy of locking onto dominant motion components as part of gesture recognition.
Latest Apple Patents:
This application claims the benefit of U.S. Provisional Patent Application No. 61/019,222 filed on Jan. 4, 2008, the contents of which are incorporated herein by reference in their entirety for all purposes.
FIELD OF THE INVENTIONThis relates to touch sensor panels used as input devices for computing systems, and more particularly, to the normalization and post-processing of touch sensor data.
BACKGROUND OF THE INVENTIONMany types of input devices are presently available for performing operations in a computing system, such as buttons or keys, mice, trackballs, touch sensor panels, joysticks, touch screens and the like. Touch screens, in particular, are becoming increasingly popular because of their ease and versatility of operation as well as their declining price. Touch screens can include a touch sensor panel, which can be a clear panel with a touch-sensitive surface. The touch sensor panel can be positioned partially or completely in front of a display screen, or integrated partially or entirely within the display screen, so that at least a portion of the touch-sensitive surface covers at least a portion of the viewable area of the display screen. Touch screens can allow a user to make selections and move a cursor by simply touching the display screen via a finger or stylus. In general, the touch screen can recognize the touch and position of the touch on the display screen, and the computing system can interpret the touch and thereafter perform an action based on the touch event.
Touch sensor panels can be capable of detecting either single-touch events or multiple touch events, an example of which is described in Applicant's co-pending U.S. application Ser. No. 11/649,998 entitled “Proximity and Multi-Touch Sensor Detection and Demodulation,” filed on Jan. 3, 2007, the contents of which are incorporated by reference herein in their entirety for all purposes.
To provide a more uniform response from the touch sensor panel given the same amount of touch, the sensor output values can be calibrated or normalized by using offset values to compensate the raw no-touch output values for each sensor in the panel so that all sensor output values are normalized to approximately the same value. A periodic local baseline offset adjustment algorithm can then be employed to locally update the sensor offset values to account for variables such as temperature drift. However, when ungrounded objects such as water droplets or coins are present on the touch sensor panel, the periodic local baseline offset adjustment algorithm can generate inaccurate normalized results. Furthermore, factors such as temperature changes can rapidly skew the normalized sensor output values. In addition, when processing touch data to recognize gestures, it can be difficult to clearly identify and lock onto a particular dominant motion component as a preliminary step in recognizing a particular gesture.
SUMMARY OF THE INVENTIONThis relates to an image jaggedness filter that can be used to detect the presence of ungrounded objects such as water droplets or coins on a touch sensor panel, and delay periodic local offset adjustments until these objects have largely disappeared. To do otherwise could produce inaccurate normalized sensor output values. This also relates to the application of a global baseline offset to quickly normalize the sensor output values to account for conditions such as rapid temperature changes. Background pixels not part of any touch regions can be used to detect changes to no-touch sensor output values and compute a global baseline offset accordingly. This also relates to the use of motion dominance ratios and axis domination confidence values to improve the accuracy of locking onto dominant motion components as part of gesture recognition.
In the following description of preferred embodiments, reference is made to the accompanying drawings in which it is shown by way of illustration specific embodiments in which the invention can be practiced. It is to be understood that other embodiments can be used and structural changes can be made without departing from the scope of the embodiments of this invention.
This relates to an image jaggedness filter that can be used to detect the presence of ungrounded objects such as water droplets or coins, and delay periodic local baseline offset adjustments until these objects have largely disappeared. To do otherwise could produce inaccurate normalized sensor output values. This also relates to the application of a global baseline offset to quickly modify the sensor offset values to account for conditions such as rapid temperature changes. Background pixels not part of any touch regions can be used to detect changes to no-touch sensor output values and compute the global baseline offset accordingly. This also relates to the use of motion dominance ratios and axis domination confidence values to improve the accuracy of locking onto dominant motion components as part of gesture recognition.
Image Jaggedness Filter for Baseline CalculationsTo provide a more uniform response from the touch sensor panel given the same amount of touch, touch sensor panel output values can be calibrated using offset values to adjust the raw no-touch output values for each sensor in the panel so that all touch sensor panel output values are normalized to approximately the same value. However, even with normalized sensor outputs, temperature drift and other factors can cause the sensor output values to change, which will tend to skew the normalized baseline. To account for these gradual changes to the normalized sensor output values, a periodic local baseline offset adjustment algorithm can be employed.
As shown in
However, as shown in
As shown in
Despite this normalization, in multi-touch sensor panels, certain pixels can generate false, erroneous or otherwise distorted readings when two or more simultaneous touch events are generated by the same poorly grounded object. Compensation of these distorted readings (so-called “negative pixels”) is described in U.S. application Ser. No. 11/963,578 entitled “Negative Pixel Compensation,” the contents of which are incorporated by reference herein in their entirety for all purposes. To compensate for these distorted readings, a predicted negative pixel value can first be computed as an indicator of pixels that are likely to be distorted. The predicted negative pixel value for any particular pixel can be computed by summing up the touch output values for pixels in the drive line of the particular pixel being considered, summing up the touch output values for pixels in the sense line of the particular pixel being considered, and then multiplying these two sums. A scaled function of the predicted negative pixel value can then be added to the measured touch output value for the pixel to compensate for artificially negative readings.
However, due to physical design changes, state-of-the-art touch sensor panels can have a greater incidence of negative pixels than previous touch sensor panels. In trackpad embodiments, for example, negative pixels can appear more frequently due to the expected frequent usage of unplugged notebook computers, which can cause a higher incidence of touches by ungrounded objects. Thus, for a given image of touch, there can be a higher sum of negative and positive pixels than in previous designs.
Water droplets on a touch sensor panel can also appear as ungrounded objects. On trackpads, where user fingers and palms are often touching (sometimes inadvertently) the panel, water droplets can easily get smeared. Therefore, if the possible presence of water droplets can be detected, it would be preferable to hold off on any periodic local baseline offset adjustment until the water has dried off, because of the likely existence of corrupting negative pixels.
To suppress periodic local baseline offset adjustments in the presence of water droplets, extra filters can first be employed to detect the presence of water droplets. To detect water droplets, a jaggedness/irregularity filter can be used, as described in U.S. application Ser. No. 11/619,490 entitled “Irregular Input Identification” and U.S. application Ser. No. 11/756,211 entitled “Multi-touch Input Discrimination,” both of which are incorporated by reference herein in their entirety for all purposes. This jaggedness/irregularity filter can be used to find touch images having a high spatial frequency, such as those caused by water droplets.
If a moderate (relatively even) mix of negative and positive pixels are found or are within a particular mix threshold at 210, and a certain jaggedness threshold is exceeded at 212, indicating the presence of numerous poorly grounded objects such as water droplets, then the next periodic local baseline offset adjustment can be skipped at 214. For example, a “moderate” mix of negative and positive pixels may be defined as having percentages of negative and positive pixels are within 40% of each other −30% and 70%. All other percentages would not be considered “moderate.” Additionally, if the jaggedness measure is normalized between [0,1], with “0” being not jagged (no ungrounded objects) and “1” being completely jagged (many small ungrounded objects), then the jaggedness threshold could be set to 0.5.
If the jaggedness threshold is not exceeded at 212, but the number of positive and negative pixels is changing rapidly at 216 (which can occur when water droplets are evaporating), periodic local baseline offset adjustments can also be suppressed at 214. To make this determination of whether the number of positive and negative pixels are changing rapidly, the sums of the negative and positive pixels can be passed though a (mathematical) low pass filter (LFP) that produces an auto-regressive average. Instantaneous values can then be subtracted from the average. If the difference is high (greater than a predetermined threshold, such as the instantaneous value being more than 25% different from the computed average), this indicates a large change in the number of negative or positive pixels sufficient to suppress periodic local baseline offset adjustments. On the other hand, if the number of positive and negative pixels is not changing rapidly at 216, then the next periodic local baseline offset adjustment can occur as scheduled at 218 (including the suppression of an initial baseline capture if fingers are detected at startup, as disclosed in U.S. application Ser. No. 11/650,112 entitled “Periodic Sensor Panel Baseline Adjustment,” the contents of which are incorporated by reference herein in their entirety for all purposes).
If the mix of negative and positive pixels is not moderate at 210 (e.g. many more positive pixels than negative pixels, or vice versa), the jaggedness threshold is not exceeded at 222, and the mix of negative and positive pixels is changing rapidly at 216, periodic local baseline offset adjustments can be suppressed at 214. However, if the mix of negative and positive pixels is not changing rapidly at 216, periodic local baseline offset adjustments can be performed at 218.
After enough water evaporates, no significant number of negative pixels may remain, but some positive pixels may remain. If the positive pixels are scattered spatially, they can still cause the jaggedness measure to be above the threshold. Note that the jaggedness algorithm may only recognize that the jaggedness measure has exceeded a threshold—it does not see actual negative and positive pixels, so it cannot determine that there are few negative pixels remaining. Thus, if the mix of negative and positive pixels is not moderate at 210, but the jaggedness threshold is exceeded at 222, periodic local baseline offset adjustments can be performed at 218. In addition, to compensate for this effect, the increment/decrement rate of the adaptation algorithm can be sped up, so that the positive pixels are compensated more quickly and the effect is reduced.
Global Baseline OffsetAs described above, there are situations in which it can be preferable to delay periodic local baseline offset adjustments so that ungrounded touches do not cause erroneous adjustments to the sensor offset values. Additionally, with conventional keyboards having trackpads, inadvertent touch events can be commonplace while the keyboard is being utilized, presenting another situation where it can be preferable to keep the adaptation rate slower so that patches due to hovering or inadvertent touches do not get incorporated into the sensor offset values. However, it can still desirable to quickly compensate for temperature or other global effects.
Therefore, in addition to the periodic local baseline offset adjustment algorithm described above that can cause sensor offset values to be incrementally adapted or changed on a pixel-by-pixel (local) basis, in other embodiments of the invention a global baseline offset can be applied to the offset values for all pixels. The global baseline offset can be used to effect changes much more quickly than the periodic local baseline offset adjustment algorithm to compensate for large temperature changes or the effects of other global conditions. In some embodiments, the full amount of this global baseline offset can be immediately applied to the offset values for all pixels. In other embodiments, the offset values for all pixels can be incremented or decremented gradually over time (but more often than the individual pixels can be incremented or decremented using local baseline offset adjustments), until the full amount of the global baseline offset has been applied.
An average of all or a portion of the background pixels 306 can then be computed, and this average can then used to globally modify the offset values for all pixels in the touch sensor panel. Because the background pixels 306 are untouched, the average of their untouched output values can provide an indication of rapid changes to the pixel outputs due to factors such as temperature. This average, or some adjustment value that is a function of this average, can then be added to or subtracted from the current sensor baseline to compute the global baseline offset value. This global baseline offset value can then be added to the current offset values for every pixel in the touch sensor panel to effect a global adjustment of the offset values. In some embodiments, this global baseline offset value can be applied immediately to the current offset values for every pixel. In other embodiments, the current offset values can be incremented or decremented gradually until the full global baseline offset values has been applied. To keep the normalized sensor output values from “running away” (e.g. getting excessively large or small) due to unintended artifacts of the algorithm such as an accumulation of roundoff error, the global baseline offset value can optionally decay to zero over time.
However, if the increase in the raw sensor output values remains, even while the global baseline offset value 402 is decaying back down to zero, another mechanism is needed to ensure that an increase to the overall offset value does occur. To accomplish this, the local baseline offset adjustment algorithm described above can periodically incrementally increase the overall offset value 400 as the global baseline offset value 402 is decaying. Although each increment to the overall offset value 400 made by the local baseline offset adjustment algorithm is small, the total contribution of the local baseline offset value 404 gradually increases over time, as shown at 414 in
Although not shown, similar adjustments to the overall sensor offset value of each pixel can be made in the negative direction if the average of the background pixels rapidly decreases.
In the processing of touch images, after touch images (e.g. from two fingers) are captured, identified and tracked over multiple panel scans, motion components can be extracted. In the case of two fingers, motion components can include the X component, the Y component, a scale (zoom) component (the dot product of the two finger motion vectors), and a rotate component (the cross product of the two finger motion vectors). The extracted motion components can provide for two types of control. “Integral control” is defined herein as providing all four degrees of freedom (the ability to control all axes at once). “Separable control” is more limited, and separates motion between either (1) X-Y scrolling as a set, (2) zoom, or (3) rotate (i.e. one axis).
Note that the smooth_translation_speed value includes Vx and Vy because of the desire to lock onto scrolling as a whole, not just the X and Y components. Of these three values, the dominant (largest) computed speed can be used, while the others can be ignored (zeroed or clipped out).
However, in practice it can be difficult to lock on properly, because a scroll motion might initially look like a rotate motion, for example, or vice versa. Therefore, in embodiments of the invention, the three raw values described above can be utilized in conjunction with two new parameters, scale_dominance_ratio (SDR) and rotate_dominance_ratio (RDR), which can be used to apply weights to the various motion components and set a balance point for the motions so that a particular component can be locked onto more accurately. The SDR and RDR values can be established after the various finger contacts are identified at 508. The SDR and RDR values computed at 510 can be based on whether the detected contacts are identified as fingers and/or thumbs. For example, if a thumb is detected, it can be more likely that a user is using a thumb and finger to perform a scaling (zoom) or rotate operation rather than a translation or scroll operation, so the SDR and RDR values can be set to high values (e.g. 2.5) so that the Smooth_scale_speed or the Smooth_rotate_speed values dominate the Smooth_translation_speed value.
However, if two or more fingers are detected, but not a thumb, it is more likely that a user is using the two fingers to perform a translation or scroll operation rather than a scaling or rotate operation, so the SDR and RDR values can be set to lower values to ensure that the Smooth_translation_speed value dominates. The multiple-finger, no-thumb SDR value can further be a function of the horizontal separation of the fingers, because it can be more likely that a user is performing a translation or scroll operation when the fingers are close together, but more likely that a user is performing a two finger scaling operation when the fingers have a greater separation. Thus, for example, the SDR can be set to 0.25 if the finger separation is between 0 and 3 cm, can vary from 0.25 to 1.25 if the separation is from 3-6 cm, and can be set to 1.25 for separations greater than 6 cm.
In further embodiments, an exception can be created for the SDR during a two-finger top-to-bottom translation because of the tendency for a user's fingers to draw together during the translation. The movement of the fingers towards each other during the translation should not be interpreted as a scaling operation. To prevent this, if a downward translation is detected plus a scale contraction, then the SDR can be maintained at 0.25, even if the two finger separation distance is high.
After the SDR and RDR values are computed at 510, the following pseudocode can then be implemented at 512, 514, 516 and 518:
In other embodiments, where the movement of contacts along with contact identifications provides an ambiguous determination of which motion component to lock onto, locking onto a particular motion component can be delayed until enough motion has occurred to make a more accurate determination. To accomplish this, an axis_domination_confidence value can be computed to provide a representation of the unambiguousness of the motion component to be locked onto.
The axis_domination_confidence value as calculated above can be normalized to be between [0,1], where values approaching 1 represent a pure translation (and therefore there is high confidence in locking on to the X-Y motion components) and values approaching 0 indicate that the translation amount is about equal to the scale and rotation amount (and therefore low confidence in locking on to any motion component).
After the axis_domination_confidence value is computed, in one embodiment the motion component locking decision can be delayed by an amount proportional to the inverse of the axis_domination_confidence value at 608. Thus, if the value is high, indicating high confidence, there can be little or no delay. However, if the value is low, indicating low confidence, the locking decision can be delayed to allow for the motion components to become less ambiguous.
In another embodiment, the axis_domination_confidence value (or the square of this value) can be multiplied by any non-clipped motion components (see, e.g., equations (A) and (B) above) at 610. This has the effect of slowing down the ultimate gesture decision. For example, if the axis_domination_confidence value is 1 and this is multiplied by the unclipped motion component, the motion will be locked onto and integrated quickly in gesture detection algorithms. However, if no motion component has been locked onto, and motion is being integrated but the dominant motion component is borderline, when the motion component is multiplied by a low axis_domination_confidence value, this can dampen the motion and extend the integration period. This can delay the triggering of a decision on which motion components to pass and which motion components to clip and ultimately the identification of gestures. During this delay time, the motions can become more unambiguous. Once locked, it is not necessary to apply the axis_domination_confidence value any more.
Embodiments of the invention described above can be implemented, for example, using touch sensor panels of the types described in U.S. application Ser. No. 11/650,049 entitled “Double-Sided Touch Sensitive Panel and Flex Circuit Bonding.”Sense channels of the types described in U.S. application Ser. No. 11/649,998 entitled “Proximity and Multi-Touch Sensor Detection and Demodulation” can be used, for example, to detect touch and hover events. The resulting image of touch can be further processed to determine the location of the touch events, the identification of finger contacts, and the identification of gestures as described, for example, in U.S. application Ser. No. 11/428,522 entitled “Identifying Contacts on a Touch Surface,” U.S. application Ser. No. 11/756,211 entitled “Multi-touch Input Discrimination,” and U.S. application Ser. No. 10/903,964 entitled “Gestures for Touch Sensitive Input Devices.” All of the preceding applications referred to in this paragraph are incorporated by reference herein in their entirety for all purposes.
Touch sensor panel 724 can include a capacitive sensing medium having a plurality of drive lines and a plurality of sense lines, although other sensing media can also be used. Each intersection, adjacency or near-adjacency of drive and sense lines can represent a capacitive sensing node and can be viewed as picture element (pixel) 726, which can be particularly useful when touch sensor panel 724 is viewed as capturing an “image” of touch. (In other words, after panel subsystem 706 has determined whether a touch event has been detected at each touch sensor in the touch sensor panel, the pattern of touch sensors in the multi-touch panel at which a touch event occurred can be viewed as an “image” of touch (e.g. a pattern of fingers touching the panel).) Each sense line of touch sensor panel 724 can drive sense channel 708 (also referred to herein as an event detection and demodulation circuit) in panel subsystem 706.
Computing system 700 can also include host processor 728 for receiving outputs from panel processor 702 and performing actions based on the outputs that can include, but are not limited to, moving an object such as a cursor or pointer, scrolling or panning, adjusting control settings, opening a file or document, viewing a menu, making a selection, executing instructions, operating a peripheral device coupled to the host device, answering a telephone call, placing a telephone call, terminating a telephone call, changing the volume or audio settings, storing information related to telephone communications such as addresses, frequently dialed numbers, received calls, missed calls, logging onto a computer or a computer network, permitting authorized individuals access to restricted areas of the computer or computer network, loading a user profile associated with a user's preferred arrangement of the computer desktop, permitting access to web content, launching a particular program, encrypting or decoding a message, and/or the like. Host processor 728 can also perform additional functions that may not be related to panel processing, and can be coupled to program storage 732 and display device 730 such as an LCD display for providing a UI to a user of the device. Display device 730 together with touch sensor panel 724, when located partially or entirely under the touch sensor panel, or partially or entirely integrated with the touch sensor panel, can form touch screen 718.
Note that one or more of the functions described above can be performed by firmware stored in memory (e.g. one of the peripherals 704 in
The firmware can also be propagated within any transport medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this document, a “transport medium” can be any medium that can communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The transport readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic or infrared wired or wireless propagation medium.
Although embodiments of this invention have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of embodiments of this invention as defined by the appended claims.
Claims
1. A method for processing touch images using separable control, comprising:
- computing a scale_dominance_ratio (SDR) value and a rotate_dominance_ratio (RDR) value as a function of identified contacts on a touch sensor panel, the SDR and RDR values representing dominance values of a scaling component and a rotational component, respectively, of motion associated with the contacts;
- utilizing the SDR and RDR values to determine a motion component to lock onto when performing gesture identification.
2. The method of claim 1, further comprising computing the SDR and RDR values as a function of fingers and thumbs associated with the contacts.
3. The method of claim 1, further comprising:
- capturing multiple images of touch;
- extracting motion components from the captured images of touch;
- computing a smooth translation speed, a smooth rotate speed, and a smooth scale speed from the motion components; and
- utilizing the smooth translation speed, the smooth rotate speed, and the smooth scale speed along with the SDR and RDR values to determine the motion component to lock into when performing gesture identification.
4. The method of claim 3, the motion components comprising an x-direction velocity (Vx), a y-direction velocity (Vy), a rotational velocity (Vr), and a scaling velocity (Vs).
5. The method of claim 4, further comprising applying a mathematical low pass filter (LPF) to compute the smooth translation speed, the smooth rotate speed, and the smooth scale speed as: Smooth_translation_speed = (LPF(Vx)2 + LPF(Vy)2)0.5; Smooth_rotate_speed = LPF(Vr); and Smooth_scale_speed = LPF(Vs).
6. The method of claim 2, further comprising setting the SDR and RDR values to 2.5 if a thumb is detected as one of the identified contacts.
7. The method of claim 2, further comprising setting the SDR and RDR values below 2.5 if two or more fingers but no thumbs are detected as the identified contacts.
8. The method of claim 7, further comprising setting the SDR to about 0.25 if a finger separation between at least two of the fingers is between 0 and about 3 cm, setting the SDR between about 0.25 and about 1.25 if the finger separation is between about 3 cm and about 6 cm, and setting the SDR to between about 1.25 and about 2.5 if the finger separation is greater than about 6 cm.
9. The method of claim 8, further comprising setting the SDR to 0.25 even if the finger separation is greater than about 3 cm if a downward translation is detected along with a scale contraction.
10. The method of claim 3, further comprising:
- locking onto a translation component and clipping the scaling component of the motion associated with the contacts if the smooth translation speed is greater than the SDR multiplied by the smooth scale speed; and
- locking onto the translation component and clipping the rotational component of the motion associated with the contacts if the smooth translation speed is greater than the RDR multiplied by the smooth rotate speed.
11. The method of claim 10, further comprising computing an axis domination confidence value as a representation of an unambiguousness of the motion component to lock onto as: axis_domination _confidence = 1 - smooth translation speed ( smooth_scale _speed + smooth_rotate _speed ), otherwise, axis_domination _confidence = 1 - ( smooth_scale _speed + smooth_rotate _speed ) smooth translation speed.
- if the smooth translation speed is less than the smooth scale speed plus the smooth rotate speed, then
12. The method of claim 11, further comprising delaying the locking onto the motion component by an amount proportional to the axis domination confidence value.
13. The method of claim 11, further comprising multiplying the axis domination confidence value by any non-clipped motion components to delay a locking decision.
14. A computer-readable storage medium storing program code for processing touch images using separable control, the program code for causing performance of a method comprising:
- computing a scale_dominance_ratio (SDR) value and a rotate_dominance_ratio (RDR) value as a function of identified finger and thumb contacts on a touch sensor panel, the SDR and RDR values representing dominance values of a scaling component and a rotational component, respectively, of motion associated with the contacts;
- utilizing the SDR and RDR values to determine a motion component to lock onto when performing gesture identification, the motion components including an x-direction velocity (Vx), a y-direction velocity (Vy), a rotational velocity (Vr), and a scaling velocity (Vs).
15. The computer-readable storage medium of claim 14, the program code further for causing performance of a method comprising:
- capturing multiple images of touch;
- extracting the motion components from the captured images of touch;
- computing a smooth translation speed, a smooth rotate speed, and a smooth scale speed from the motion components; and
- utilizing the smooth translation speed, the smooth rotate speed, and the smooth scale speed along with the SDR and RDR values to determine the motion component to lock into when performing gesture identification.
16. The computer-readable storage medium of claim 15, the program code further for causing performance of a method comprising applying a mathematical low pass filter (LPF) to compute the smooth translation speed, the smooth rotate speed, and the smooth scale speed as: Smooth_translation_speed = (LPF(Vx)2 + LPF(Vy)2)0.5; Smooth_rotate_speed = LPF(Vr); and Smooth_scale_speed = LPF(Vs).
17. The computer-readable storage medium of claim 14, the program code further for causing performance of a method comprising setting the SDR and RDR values to 2.5 if a thumb is detected as one of the identified contacts.
18. The computer-readable storage medium of claim 14, the program code further for causing performance of a method comprising setting the SDR and RDR values below 2.5 if two or more fingers but no thumbs are detected as the identified contacts.
19. The computer-readable storage medium of claim 18, the program code further for causing performance of a method comprising setting the SDR to about 0.25 if a finger separation between at least two of the fingers is between 0 and about 3 cm, setting the SDR between about 0.25 and about 1.25 if the finger separation is between about 3 cm and about 6 cm, and setting the SDR to between about 1.25 and about 2.5 if the finger separation is greater than about 6 cm.
20. The computer-readable storage medium of claim 19, the program code further for causing performance of a method comprising setting the SDR to 0.25 even if the finger separation is greater than about 3 cm if a downward translation is detected along with a scale contraction.
21. The computer-readable storage medium of claim 15, the program code further for causing performance of a method comprising:
- locking onto a translation component and clipping the scaling component of the motion associated with the contacts if the smooth translation speed is greater than the SDR multiplied by the smooth scale speed; and
- locking onto the translation component and clipping the rotational component of the motion associated with the contacts if the smooth translation speed is greater than the RDR multiplied by the smooth rotate speed.
22. The computer-readable storage medium of claim 21, the program code further for causing performance of a method comprising computing an axis domination confidence value as a representation of an unambiguousness of the motion component to lock onto as: axis_domination _confidence = 1 - smooth translation speed ( smooth_scale _speed + smooth_rotate _speed ), otherwise, axis_domination _confidence = 1 - ( smooth_scale _speed + smooth_rotate _speed ) smooth translation speed.
- if the smooth translation speed is less than the smooth scale speed plus the smooth rotate speed, then
23. The computer-readable storage medium of claim 22, the program code further for causing performance of a method comprising delaying the locking onto the motion component by an amount proportional to the axis domination confidence value.
24. The computer-readable storage medium of claim 22, the program code further for causing performance of a method comprising multiplying the axis domination confidence value by any non-clipped motion components to delay a locking decision.
25. A mobile telephone including a computer-readable storage medium storing program code for processing touch images using separable control, the program code for causing performance of a method comprising:
- computing a scale_dominance_ratio (SDR) value and a rotate_dominance_ratio (RDR) value as a function of identified contacts on a touch sensor panel, the SDR and RDR values representing dominance values of a scaling component and a rotational component, respectively, of motion associated with the contacts;
- utilizing the SDR and RDR values to determine a motion component to lock onto when performing gesture identification.
26. A media player including a computer-readable storage medium storing program code for processing touch images using separable control, the program code for causing performance of a method comprising:
- computing a scale_dominance_ratio (SDR) value and a rotate_dominance_ratio (RDR) value as a function of identified contacts on a touch sensor panel, the SDR and RDR values representing dominance values of a scaling component and a rotational component, respectively, of motion associated with the contacts;
- utilizing the SDR and RDR values to determine a motion component to lock onto when performing gesture identification.
27. A personal computer including a computer-readable storage medium storing program code for processing touch images using separable control, the program code for causing performance of a method comprising:
- computing a scale_dominance_ratio (SDR) value and a rotate_dominance_ratio (RDR) value as a function of identified contacts on a touch sensor panel, the SDR and RDR values representing dominance values of a scaling component and a rotational component, respectively, of motion associated with the contacts;
- utilizing the SDR and RDR values to determine a motion component to lock onto when performing gesture identification.
Type: Application
Filed: Sep 25, 2008
Publication Date: Jul 9, 2009
Applicant: Apple Inc. (Cupertino, CA)
Inventor: Wayne Carl WESTERMAN (San Francisco, CA)
Application Number: 12/238,342