Reduction of touch-sensor interference from stable display

- Amazon

An interference suppression module coordinates devices susceptible to interference such as a touch sensor with potentially interference generating devices such as a display drive matrix, an active haptic device, and so forth. As a result of status signals generated by the interference suppression module, controllers of the susceptible devices may modify the input received to mitigate or avoid interference.

Skip to: Description  ·  Claims  ·  References Cited  · Patent History  ·  Patent History
Description
BACKGROUND

Touch sensors are used by electronic devices to accept input from users. These touch sensors may utilize a variety of techniques to determine a touch by a user or an object. Often, these techniques involve the sampling of electrical characteristics such as resistance, capacitance, inductance, and so forth. As a result, touch sensors are subject to interference due to electromagnetic fields from adjacent devices, such as a display drive matrix in a display. Other touch sensor technologies, such as those which utilize acoustic or optical technologies may also suffer interference from adjacent devices. Additionally, physical dislocations due to haptic output may also induce interference in the touch sensor. These and other sources of interference may result in spurious signals which a touch sensor controller may erroneously interpret as a touch input.

Traditionally, this interference has been addressed by oversampling, noise filtering, and so forth. However, these approaches increase complexity and cost of devices, increase power draw, and may reduce the fidelity of the touch input.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is set forth with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different figures indicates similar or identical items.

FIG. 1 depicts an electronic device (here, an electronic book reader device) having a stable display, a touch sensor, an active haptic device, and an interference suppression module.

FIG. 2 is a block diagram of an illustrative electronic device showing internal components of the electronic book reader device of FIG. 1.

FIG. 3 depicts the illustrative electronic device wherein a portion of the stable display is refreshed.

FIG. 4 illustrates a cross section of the device depicting the display, the touch sensor, and interference from the display drive matrix.

FIG. 5 illustrates a cross section of another implementation of the display, the touch sensor, and the active haptic device.

FIG. 6 illustrates a graph of the display and touch sensor operating in coordination with one another to reduce interference in the touch sensor.

FIG. 7 is an illustrative process of reducing interference experienced by the touch sensor and caused by the refreshing of the display.

FIG. 8 illustrates a graph of the display, the touch sensor, and the active haptic device operating in coordination with one another to reduce interference in the touch sensor.

FIG. 9 is an illustrative process of reducing interference experienced by the touch sensor via tags.

FIG. 10 is an illustrative process of reducing interference experienced between devices by coordination.

 DETAILED DESCRIPTION Overview

Electronic devices such as cellular phones, portable media players, tablet computers, netbooks, laptops, personal computers, cash registers, electronic book (“eBook”) readers, and so forth, increasingly incorporate touch-sensors as input devices to enable users to control and otherwise interact with the devices as well as displays to present information to the users. Traditionally a variety of brute force methods such as oversampling and filtering are used to ameliorate interference resulting from adjacent devices such as a display's drive matrix, a haptic output device, and so forth. Such approaches increase the complexity of the electronic device, and may result in greater parts count, cost, and so forth. Furthermore, the traditional methods may result in less accurate touch inputs as intentional touches are incorrectly removed as erroneous inputs.

Described herein are methods and systems for reducing interference between components within an electronic device. The activities of components that generate, or potentially generate, interference are coordinated with the function of one or more components potentially susceptible to the interference. This coordination is accomplished by coupling the potentially interference generating components with the potentially susceptible components. Potentially interference generating sources include a stable display and associated display drive matrix, a haptic output device, external power supply, and so forth.

Stable displays include electrophoretic, cholesteric, interferometric, or other components which maintain an image upon the display either without current, or with significantly reduced current compared to current required during image generation. Furthermore, stable displays may be partially redrawn and may not have a refresh rate, given their ability to retain the image. Instead, stable displays may be refreshed as content changes. The stable display may incorporate a display drive matrix, which is used to set the state of pixels within the display. During a refresh, current flows within the display drive matrix resulting in electromagnetic (EM) fields.

Components potentially susceptible to this type of interference include touch sensors, keypads, radio frequency receivers, and so forth. For example, capacitive and projected capacitance touch sensor components may experience undesired EM coupling to the display drive matrix while the display drive matrix is in operation. Other types of touch sensors which rely on other technologies including, but not limited to, optical or acoustic detection of touches may also experience similar issues.

This undesired EM coupling interferes with the operation of the touch sensor by generating noise in an output of the touch sensor. This touch sensor output is used as an input signal at the touch sensor controller. The touch sensor controller may then incorrectly interpret the noise as a touch input, or may be unable to recover the touch signal from within the noise.

As mentioned above, traditionally, this interference was addressed by oversampling, noise filtering, and so forth. However, these approaches increase complexity and cost of devices, increase power consumption, and may reduce the fidelity of the touch input as intentional touch signals are filtered out.

In one implementation described herein, a touch sensor controller susceptible to interference is coordinated with an interference-generating display drive matrix via an interference suppression module. When the display controller triggers the display drive matrix to update the display, thereby also generating the EM interference, the interference suppression module is aware of the update and triggers the touch sensor controller to modify input from the touch sensor during the update.

By modifying this input, the touch sensor controller is able to avoid treating erroneous input from the touch sensor as reliable. As a result, more accurate touch input is obtained. Modifying the input may include tagging input with various states. For ease of reference, some of these states include “reliable,” “suspect,” and “unreliable.” These states relate an actual or anticipated noise level associated with operation of interference generating components. For example, when no interference generating components are active, the touch sensor controller tags the input as reliable (or potentially not tagged at all). When some interference is experienced, the touch sensor controller tags the input as suspect and may perform additional filtering or weighting to attempt to recover useful input. When a significant level of interference is experienced, the touch sensor controller tags the input as unreliable and may discard the input. The touch sensor controller thus handles the input according to the nature of the tag. For instance, the controller may refrain from modifying reliable input, may filter or weight suspect input, and may discard unreliable input.

Because some stable displays are capable of partial refreshes rather than requiring refresh of an entire display, interference may only be present at a particular area undergoing a refresh. For example, refresh of a rectangle on the screen results in the drive array matrix underlying that area to be active, resulting in EM interference to the touch sensor proximate to that area. Thus, touch sensor controller input received from the touch sensor proximate to this area is tagged as suspect or unreliable while input from the remainder of the display is tagged as reliable.

The extent to which the potentially interfered area extends beyond the particular area being refreshed may be statically or dynamically set. For example, where the touch sensor interference is known to extend 100 pixels beyond the edge of the refresh area, a static setting may be used.

Furthermore, the extent of the potentially interfered area may depend upon the type of refresh. For example, electrophoretic displays may experience flashing updates where the state of each pixel is toggled several times to reduce image ghosting. Such flashing updates call for significant activity of the display drive matrix. As a result, the potentially interfered during a flashing update may extend beyond that for a simple update of the display.

The awareness between the interference generating components and those components susceptible to interference via the interference suppression module improves overall performance. For example, by accepting user input via the touch sensor while the display drive matrix is inactive, such as between refreshes of the stable display, noise received by the touch sensor is reduced. This results in an improved signal-to-noise ratio, which permits the touch sensor controller to tag input during this quiet interval as reliable. As a result, oversampling and filtering become unnecessary, which also simplifies overall design and operation of the device.

Touch sensors may also receive noise from active haptic devices. An active haptic device in operation may generate physical movement, displacement, or other physical manifestation of at least a portion of the device in which the active haptic device resides. A pressure sensitive touch sensor coupled to the active haptic device might inadvertently generate a touch signal when in fact the pressure results from the active haptic device.

The active haptic device may utilize electrical components, such as motors, piezoelectric actuators, memory metals, and so forth. During operation, these electrical components or components associated with supporting components such as a power supply may emit EM fields. As described above, these EM fields may couple inadvertently with interference-susceptible components such as the touch sensor. As a result, in addition to erroneous signals from the physical displacement of the active haptic device, the touch sensor may experience erroneous signals from unwanted EM coupling with the active haptic device.

To address the potential interference from the active haptic device, in another implementation described herein a haptic controller coupled to the haptic output device is coordinated with the touch sensor controller via the interference suppression module. When the haptic output device is active and potentially generating mechanical or EM noise in the touch sensor, the touch sensor controller modifies input from the touch sensor. Modification may include an adaptive threshold which accounts for characteristics of the overall device. Knowing the characteristics of the overall device and the haptic output allows cancellation or mitigation of interference from the active haptic device. Similarly, because haptic events may be confined to a particular area, tagging of input may also be regionally specific as described above.

The coordination between the potentially susceptible components and those which potentially generate interference may allow for modification before the interfering event or after. In one implementation, a priori knowledge of operation by an interfering component via an output status signal indicating impending operation, received by the interference suppression module, allows for subsequent modification of data from the susceptible component. In another implementation, a posteriori knowledge of the activities by the interfering component may be used to modify data previously collected from the susceptible component, such as input within an input buffer. In yet another implementation, both the advance output status signal and the modification of previously collected data may be combined.

Illustrative Touch-Screen Device

FIG. 1 depicts an illustrative electronic device 100 having a stable display, a touch sensor, an active haptic device, and an interference suppression module. The electronic devices 100 include electronic book readers, cellular phones, portable media players, cash registers, personal computers, tablet computers, netbooks, laptops, desktops, kiosks, and so forth.

FIG. 1 depicts that electronic device 100 includes a stable display 102, described in more depth below with regards to FIG. 2, configured to present information to a user and retain the presentation with no or minimal power applied. Approximately perpendicular to the long axis of the display is cross sectional line “X,” with cross sections discussed below with regards to FIGS. 4-5.

As illustrated, the electronic device 100 includes a touch sensor 104 for receiving user input. The touch sensor 104 may comprise a capacitive touch array, a projected capacitance touch array, a resistive touch array, an interpolating force sensitive resistor array, an optical touch sensor, an acoustic touch sensor, and so forth. This touch sensor 104 may be adjacent to or integrated with the stable display 102 to form a touch screen. In some implementations, an active haptic device 106 may provide physical stimulus to the user. This physical stimulus may include simulating the tactile experience of pushing a button and so forth. A power supply 108 provides electrical power to the device for operation, charging, and so forth.

An interference suppression module 110 couples to one or more interference generating components and one or more components susceptible to interference. As shown here, the interference suppression module 110 couples to the stable display 102, the touch sensor 104, the active haptic device 106, and the power supply 108. Briefly, the interference suppression module 110 is coordinates a potentially interfering event such as a refresh of the stable display 102, or a haptic output from the active haptic device 106, and so forth with operation of a susceptible component such as a touch sensor 104.

The touch sensor controller accepts or modifies output from the touch sensor 104 which may contain noise resulting from the interfering EM field. Power consumption may be decreased by deactivating power consuming scans of the touch sensor 104 during periods of interference. The interference suppression module 110 is discussed in more depth below with regards to FIG. 2.

FIG. 2 is a block diagram 200 of the illustrative electronic device 100 showing the internal components. In a very basic configuration, the device 100 includes or accesses components such as a processor 202 and one or more peripherals 204. Each processor 202 may itself comprise one or more processors.

Peripherals 204 couple to the processor 202. A display controller 206 is shown coupled to one or more displays 102. These displays may comprise drive electronics, such as a display drive matrix configured to affect individual pixels within the stable display 102. In some implementations, multiple displays may be present and coupled to the display controller 206. These multiple displays may be located in the same or different enclosures or panels. Furthermore, one or more display controllers 206 may couple to the multiple displays.

The stable display 102 may present content in a human-readable format to a user. The stable display 102 retains an image with no or little power applied to the display drive matrix. For example, an electrophoretic display is stable in retaining an image when power is discontinued to its underlying drive matrix, while an interferometric display may retain an image while a low power freeze signal is applied. The stable display 102 may permit redraws of specific areas of the display, rather than a complete refresh of the entire display area. As a result of the stability in retaining the image, the stable display 102 need not be refreshed at a pre-determined periodic interval, but instead may be refreshed on demand when content for presentation changes.

When multiple displays are present, these displays may be of the same or different types. For example, one display may be an electrophoretic display while another may be interferometric.

In some implementations, the content presented on the stable display 102 may take the form of electronic books or “eBooks.” For example, the stable display 102 may depict the text of the eBooks and also any illustrations, tables, or graphic elements that might be contained in the eBooks. The terms “book” and/or “eBook”, as used herein, include electronic or digital representations of printed works, as well as digital content that may include text, multimedia, hypertext, and/or hypermedia. Examples of printed and/or digital works include, but are not limited to, books, magazines, newspapers, periodicals, journals, reference materials, telephone books, textbooks, anthologies, instruction manuals, proceedings of meetings, forms, directories, maps, web pages, and so forth. Accordingly, the terms “book” and/or “eBook” may include any readable or viewable content that is in electronic or digital form.

The electronic device 100 further includes a touch sensitive input device. In one implementation, the touch sensor 104 may be placed behind the display, such that user input through contact or gesturing relative to the display 102 may be received. In another implementation, the touch sensor may be placed in front of the display 102, or in another part of the device altogether. For convenience only, the display 102 is shown in a generally rectangular configuration. However, it is understood that the display 102 may be implemented in any shape, and may have any ratio of height to width. Also, for stylistic or design purposes, the display 102 may be curved or otherwise non-linearly shaped. Furthermore the display 102 may be flexible and configured to fold or roll.

The electronic device 100 may have an input device controller 208 configured to accept input from the touch sensor, keypad, keyboard, or other user actuable controls 210. These user actuable controls 210 may have dedicated or assigned operations. For instance, the actuatable controls 112 may include page turning buttons, a joystick, navigational keys, a power on/off button, selection keys, joystick, touchpad, and so on.

The peripherals 204 may include a USB host controller 212. The USB host controller 212 manages communications between components attached to a universal serial bus (“USB”) and the processor 202 and other peripherals.

FIG. 2 further illustrates that the electronic device 100 includes a touch sensor controller 214. The touch sensor controller 214 may couple to the processor 202 via the USB host controller 212 (as shown). In other implementations the touch sensor controller 214 may couple to the processor via the input device control 208, inter-integrated circuit (“I2C”), universal asynchronous receiver/transmitter (“UART”), serial peripheral interface bus (“SPI”), or other interface. The touch sensor controller 214 is also coupled to the touch sensor 104.

The touch sensor controller 214 is configured to accept from the touch sensor 104 to determine characteristics of interaction with the touch sensor. These characteristics may include the location of one or more touches on the touch sensor 104, magnitude of the force, shape of the touch, and so forth.

A haptic controller 216 may couple to the USB host controller 212. In another implementation, the haptic controller 216 may couple to another interface within the electronic device 100. The haptic controller 216 couples to the active haptic device 106. As described above, the active haptic device 106 provides a physical sensation to the user.

The USB host controller 212 may also couple to a wireless module 218 via the universal serial bus. The wireless module 218 may allow for connection to wireless local or wireless wide area networks (“WWAN”). The wireless module 218 may include a modem 220 configured to send and receive data wirelessly and one or more antennas 222 suitable for propagating a wireless signal. In other implementations, a wired network interface may be provided.

The electronic device 100 may also include an external memory interface (“EMI”) 224 coupled to external memory 226. The EMI 224 manages access to data stored in the external memory 226. The external memory 226 may comprise Static Random Access Memory (“SRAM”), Pseudostatic Random Access Memory (“PSRAM”), Synchronous Dynamic Random Access Memory (“SDRAM”), Double Data Rate SDRAM (“DDR”), Phase-Change RAM (“PCRAM”), or other computer-readable storage media.

The external memory 226 may store an operating system 228 comprising a kernel 230 operatively coupled to one or more device drivers 232. The device drivers 232 are also operatively coupled to the peripherals 204. The external memory 226 may also store data 234, which may comprise content objects for consumption on the electronic device 100, executable programs, databases, user settings, configuration files, device status, and so forth.

As shown, the external memory 226 may store a portion of the interference suppression module 110. In another implementation, the interference suppression module 110 may comprise components and signal lines present outside of the external memory 226.

The electronic device 100 may include one or more other, non-illustrated peripherals, such as a hard drive using magnetic, optical, or solid state storage to store information, a firewire bus, a Bluetooth™ wireless network interface, camera, global positioning system, PC Card component, and so forth.

One or more batteries 236 may provide operational electrical power to components of the electronic device 100 for operation when the device is disconnected from a power supply 108. Operational electrical power is sufficient to provide for operation of the device, as distinguished from the lesser electrical power requirements of a sleep or state retention mode. Power supply 108 may be internal or external to the electronic device 100. Power supply 108 is configured to provide operational power for electronic device 100, charge battery 236, or both. “Battery” as used in this application includes components capable of acting as a power source to an electronic device. Power sources include chemical storage cells such as lithium polymer batteries, charge storage devices such as ultracapacitors, fuel cells, and so forth.

Couplings, such as that between touch sensor controller 214 and the USB host controller 212, are shown for emphasis. There are couplings between many of the components illustrated in FIG. 2, but graphical arrows are omitted for clarity of illustration.

FIG. 3 depicts the illustrative electronic device 100 wherein a portion of the stable display is refreshed 300. As described above, the stable display 102 may support redraws of specific areas of the display, rather than a complete refresh of the entire display area. As shown here, a user highlight indicator 302 in the form of an underline is presented on the stable display 102.

A refresh area 304 is indicated with a broken line, designating the region of the display which is refreshed to produce the user highlight indicator 302. Within the refresh area 304, a corresponding portion of the display drive matrix is activated to render the user highlight indicator 302. As a result of this rendering, the portion of the touch sensor 104 which is proximate to the refresh area 304 experiences EM interference from the display drive matrix. The interference suppression module 110 instructs the touch controller 214 of the interference. The touch controller 214 then tags and modifies touch input from the refresh area 304 as unreliable. Meanwhile, areas of the stable display 102 which are not experiencing the refresh do not experience the same interference and are tagged as reliable.

FIG. 4 illustrates an enlarged cross section 400 of the device 100 along line “X” depicting the layers of one implementation of the stable display 102 and the touch sensor 104 and interference from the display drive matrix. In this illustration, the touch sensor 104 is presented on the upper surface, proximate to a user during normal use. For example, a capacitive or projective capacitance touch sensor may be disposed as shown. Other layers such as a protective sheet may be disposed between the touch sensor and the user, but are omitted in this illustration for clarity. The touch sensor 104 is also shown coupled to the touch sensor controller 214 which accepts output from the touch sensor 104.

A display layer 402 and display drive matrix 404 comprise the display 102. In a stable display 102 such as an electrophoretic display, the display drive matrix 404 may comprise a thin-film-transistor (TFT) array which, when active, alters the orientation or position of particles within the display layer 402, thus generating a pixel. The display drive matrix 404 couples to the display controller 206.

While active, the display drive matrix 404 generates EM fields 406 shown by broken lines in this illustration. The EM fields radiate from the active elements of the display drive matrix 404. As described above, these EM fields 406 may introduce interference into a susceptible component, such as the touch sensor 104.

As described above, the interference suppression module 110 is coupled to both the display controller 206 and the touch sensor 214. When the display controller 206 refreshes at least a portion of the stable display 102, a status signal is sent to the interference suppression module 110. The interference suppression module 110 is configured to notify the touch sensor controller 214 of the interference. In response, the touch sensor controller 214 modifies input received from the touch sensor 104 corresponding to the refreshed area 304 of the stable display 102. As described, this modification may include tagging and handling the input from the touch sensor 104 as suspect or unreliable. Meanwhile, touch sensor input from areas not proximate to the refresh area are tagged and handled as reliable, because of the absence of EM interference 406.

FIG. 5 illustrates an enlarged cross section 500 of another implementation of the display 102, the touch sensor 104, and the active haptic device 106. In this illustration, the display 102 is disposed proximate to the user during normal use, with the display layer 402 on top and the display drive matrix 404 immediately underneath. As above with regards to FIG. 4, the display drive matrix 404 is coupled to the display controller 206. Beneath the display drive matrix 404 the touch sensor 104 is disposed, coupled to the touch sensor controller 214. The illustrated disposition of the display 102 and touch sensor 104 may be used in situations where a resistive pressure sensor is used, such as an interpolating force sensitive resistor array.

In the implementation shown, the EM fields 406 resulting from activation of the display drive matrix 404 (not shown in this illustration) would be more intense due to the proximity of the display drive matrix 304 and the touch sensor 104. As a result, the coordination between the display controller 206 and the touch sensor controller 214 via the interference suppression module 110 as described above with regards to FIG. 4 would continue.

FIG. 5 further illustrates the active haptic device 106 disposed beneath the touch sensor 104. The active haptic device 106 is coupled to a haptic controller 216. The active haptic device 106 may be configured to generate a physical movement, displacement, or other physical manifestation of at least a portion of the device in which the device resides. As shown here, a portion of the active haptic device 106 has generated a physical displacement 502. This displacement has in turn displaced the touch sensor 104, display drive matrix 404, and the display layer 402, resulting in a bump 504 on the portion of the display 102 proximate to the user. Other layers such as a protective sheet may be disposed between the display layer 402 and the user, but are omitted in this illustration for clarity.

In situations where the touch sensor 104 is pressure sensitive, the physical dislocation from the haptic output 402 could result in an erroneous touch signal. In other words, the touch sensor controller 214 may interpret the “push” from the active haptic device 106 on the touch sensor 104 as a “push” from the user. Furthermore, operation of the active haptic device 106 may generate EM interference, which may create interference in the touch sensor 104 and, in some configurations, within the display 102.

To ameliorate the interference, both physical and EM, the interference suppression module 110 couples to the haptic controller 216, the touch sensor controller 214, and the display controller 206. In addition to the coordination between the display controller 206 and the touch sensor controller 214 discussed above with respect to FIG. 4, activities of the haptic controller 216 are introduced into this coordination. For example, during operation of the active haptic device 106, the interference suppression module 110 provides the touch sensor controller 214 with a status signal indicating the presence, location, and nature of haptic interference. The touch sensor controller 214, in response to this status signal, modifies input received from the touch sensor 104. Where the interference from the active haptic device 106 is localized, the correspondingly affected area of the touch sensor 104 may be selectively modified by the touch sensor controller 214 based on the information in the status signal.

Where the physical characteristics of the overall device are known, the touch sensor controller 214 may be configured to modify input from the touch sensor 104 to compensate for haptic output. This compensation may involve the touch sensor controller 214 using an adaptive threshold where the amount of force required for a touch input is varied at least partly in response to the interference generated by the active haptic device 106. For example, where it has been determined that the physical dislocation from haptic output 502 results in 0.25 newtons of force corresponding to a particular location on the touch sensor 104, the touch sensor controller 214 may be configured to disregard the 0.25 newtons of force at that particular location, but accept as touch input of 0.5 newtons force at that particular location at a 0.25 newton touch.

The cross sections shown in FIGS. 3 and 4 are presented for illustration and not by way of limitation. Other implementations and arrangements of components are possible. For example, in some implementations the active haptic device 106 may be disposed elsewhere within the device 100, rather than as a layer under the display. In another example, the force sensitive touch sensor 104 may be disposed atop the display layer 302, and thus is proximate to the user during use.

FIG. 6 illustrates a graph 600 of the display controller 206 and the touch sensor controller 214 in coordination with one another via the interference suppression module 110 to reduce interference in the touch sensor 104. For the purposes of this graph 600, time increases left to right as indicated by arrow 602. The display controller 206 and touch sensor controller 214 are shown, and the interference suppression module 110 is omitted for clarity. In some implementations the controllers may couple directly to one another such as via a bus, and portions of the interference suppression module 110 incorporated into the controllers.

As shown, the display controller 206 has initiated a display update 604(1). This display update 604(1) may be a partial refresh of one or more portions of the display 102, or a refresh of the entire display. A display update signal 606(1), such as generated by the interference suppression module 110 in response to the display controller 206, is shown provided to the touch sensor controller 214. The display update signal 606 may be provided directly between the controllers or via the interference suppression module 110.

The touch sensor controller 214 receives the display update signal 606(1), and proceeds to disregard input 608(1) from the touch sensor 104. As described above, the touch sensor controller 214 may tag input and process the input based on those tags. For example, as shown here the display 102 is actively updating, resulting in generation of the EM fields 406 which may interfere with the touch sensor 104. Because of the interference, the input is tagged as unreliable and is disregarded.

When the display update 604(1) is complete, the display update signal 606(1) may terminate, or the interference suppression module 110 may generate a display update signal 606 indicating the display update is complete. Due to the inactivity of the display 102, the display controller 206 enters a wait 610(1) indicating that the interfering EM fields 406 are no longer present, and the touch sensor controller 214 acquires input 612(1).

Upon being called to update the display 102 again, the display controller 206 initiates a display update 604(2), and the interference suppression module 110 generates a display update signal 606(2) which is received by the touch sensor controller 214. As above, the touch sensor controller 214 is configured to disregard input 608(1) because interference is being generated. This process of coordinating display updates with touch sensor data acquisition thus significantly reduces or eliminates interference that is encountered during uncoordinated operations.

This reduction in interference is shown in the touch sensor input noise graph 614 also shown in this illustration. In this graph, an amplitude of noise 616 is shown in the “Y” axis, while time continues to be shown along the “X” axis. In this graph, a noise signal 618 is shown with a broken line while a touch signal 620 is shown with a solid line. This touch signal may incorporate a user touch input 622. As shown here, during a noisy interval 624 when the update display 604 is in progress, the noise 618 is quite high. Upon entry into a quiet interval 626 where the display controller is waiting 610, the noise level drops substantially, and a signal-to-noise ratio for the touch signal 620 is greatly improved.

In some implementations, a sampling rate of the touch sensor 104 or another susceptible component may be dynamically varied according to the actual or expected interference. For example, during the noisy intervals 624, the sampling rate may be increased, and during the quiet intervals 626, the sampling rate may be decreased.

The ability of the display 102 to retain an image results in updates to the display being aperiodic, and generally less frequent than displays requiring constant refresh. For example, where the device 100 comprises an electronic book reader device and the user is reading a passage of text on the display 102, a majority of the time the display controller 206 may be waiting 610, allowing time for acquisition of input 612 to predominate.

Furthermore, when the display 102 is updated, the duration of the update of the display 604 may vary. For example, adding an underline to text previously rendered may take a few milliseconds, while a complete screen redraw may require significantly more time.

FIG. 7 shows an illustrative process 700 of reducing interference experienced by the touch sensor and caused by the refreshing of the display. The process 700 (as well as the processes described below with respect to FIGS. 9-10) is illustrated as a collection of blocks in a logical flow graph, which represent a sequence of operations that can be implemented in hardware, software, or a combination thereof. In the context of software, the blocks represent computer-executable instructions stored on one or more computer-readable storage media that, when executed by one or more processors, perform the recited operations. Generally, computer-executable instructions include routines, programs, objects, components, data structures, and the like that perform particular functions or implement particular abstract data types. The order in which the operations are described is not intended to be construed as a limitation, and any number of the described blocks can be combined in any order and/or in parallel to implement the process. For discussion purposes, the process 700 (as well as processes 900 and 1000) is described with reference to the architectures of FIGS. 1-4.

At 702, the interference suppression module 110 identifies one or more interfering events or potentially interfering events. Identification may comprise receiving a signal from an interference generating component, or polling the interference generating components to determine state. The interfering events may include an update of the stable display 102, haptic output, attachment of the power supply 108, and so forth. Interfering events are those which either generate interference, or are likely to generate interference in a susceptible component.

At 704, the interference suppression module 110 generates a status signal in response to the identification of the interfering event. The status signal may be continuous during the interfering event, or intermittent such as indicating the beginning and the end of the interfering event.

At 706, at least partly in response to the status signal from the interference suppression module 110, the touch sensor controller 214 or other component susceptible to interference is configured to modify input received. As described above, this modification may include tagging the input and altering the use or characteristics of the input. For example, the touch sensor controller 206 may be configured to tag as unreliable input received while the status signal indicates an interfering event is taking place, and may accordingly discard the unreliable input. In some implementations, the presence of the status signal may be sufficient to result in the disregarding of touch sensor input or placement of the touch sensor 104 and/or the touch sensor controller 214 into a low power mode without the need for tagging.

At 708, the interfering event completes, such as when a screen refresh or a haptic output completes. The status signal may be discontinued, or an additional status signal indicating completion of the interfering event may be generated. Because the interfering component is inactive, the susceptible component such as the touch sensor is now able to generate output free from the interference.

At 710, the interference now being absent, the touch sensor controller 214 is configured to receive input without modification. For example, the touch sensor controller 214 may tag input as “reliable” and use the reliable input with little or no filtering. In some implementations where some interference continues, such as an ongoing haptic output, the touch sensor controller 214 may tag input as “suspect” and apply additional filtering, weighting, or other operations to the input, adjust sampling rate, and so forth.

FIG. 8 illustrates a graph 800 of the display, the touch sensor, and the active haptic device in coordination with one another to reduce interference in the touch sensor 104. For the purposes of this graph 800, time increases left to right as indicated by arrow 802. The touch sensor controller 214 may modify the input from the touch sensor at least in part according to the state of the interfering components as received from the interference suppression module 110. For example, as described above with regards to FIG. 6, while the display controller 206 updates the display 604, the touch sensor controller 214 is configured to disregard input 608, due to interference generated by the display 102.

As shown in this illustration, the haptic controller 216 may also be present and potentially generating interference. At 804(1) the haptic controller activates the active haptic device 106, which results in the interference suppression module 110 sending a haptic output signal 806(1) to the touch sensor controller 214. The touch sensor controller 214 is configured to modify, in response, the output from the touch sensor 104. In the example presented here, the input is already being disregarded due to the receipt of the display update signal 606(1) from the update of the display 604(1).

At 808(1) the haptic controller 216 has completed the haptic output and is waiting for the next haptic output event. During this interval, the interference suppression module 110 generates a status signal for the touch sensor controller 214 indicating that the interference has ceased. In response, the touch sensor controller 214 is configured to acquire input 612(1). At 804(2) another haptic output is called for by the haptic controller 216, and a haptic output signal 806(2) is ultimately sent to the touch sensor controller 214.

As described above, in some implementations the characteristic response of the device and the noise produced by the active haptic device may allow for correction and mitigation of interference in the touch sensor 106 from the haptic event. As a result, at 810(1) the touch sensor controller 214 may be configured to tag input from the touch sensor 104 as suspect and assign less weight to that input, perform extra filtering, apply compensation factors based on the characteristic response, and so forth to input received during the haptic output.

While coordinated by the interference suppression module 110, the activities of interfering components such as the display controller 206 and the haptic controller 216 are not necessarily synchronous. For example, as shown here the haptic controller 216 remains waiting 808(2), while the display controller 206 begins to update display 604(2). Before the update display 604(2) completes, the haptic controller 216 begins generating output 804(3). The touch sensor controller 214 may then switch from disregarding input 608(1) to modifying input 810(2). Again, when the display controller 206 is in a wait 610(2) at the same time as the haptic controller 216 is in a wait 808(3), the input to touch sensor controller 214 may be considered reliable due to the reduction in noise and the touch sensor controller 214 acquires input 612(3).

The reduction in noise is shown in the touch sensor input noise graph 812 also shown in this illustration. In this graph, an amplitude of noise 814 is shown in the “Y” axis, while time continues to be shown along the “X” axis. A noise signal 816 is shown with a broken line while a touch signal 818 is shown with a solid line. The touch signal 818 may incorporate a user touch input. As shown here, a high noise interval 820 occurs when the update display 604 is in progress as well as the haptic controller is generating output 804(1). When the display controller 206 and the haptic controller 216 are waiting, a quiet interval 822 exists. As shown, during this quiet interval 822 the noise level drops substantially, and a signal-to-noise ratio for the touch signal 818 is greatly improved.

Depending upon the combination of interfering components which are active, the noise 816 may be vary. For example, when the haptic controller 216 is actively generating output 804(3) and the display controller 206 is waiting 610(2), a medium noise interval 824 is shown. As described above, the touch sensor controller 214 tags input acquired during the medium noise interval 824 as suspect and perform additional filtering, change sampling rate, and so forth.

While the graph displays input being disregarded during the update display 604 events, and modified during generating output 804 from the active haptic device 106, the opposite situation may take place. For example, interference generated by the display 102 may be equal to or lesser than that of the interference generated by the haptic output. As a result, input may be modified according to the expected or actual noise exceeding one or more pre-determined noise thresholds. Thus, the touch sensor controller 214 may modify input when an interference generating component is active, but discard input when two or more interference generating components are active.

FIG. 9 is an illustrative process 900 of reducing interference experienced by the touch sensor 104 via tags. As described above, tags may be used to categorize and process touch input generated by the touch sensor 104.

At 902, the interference suppression module 110 identifies an event capable of interfering with interpretation by the touch sensor controller 214 of touch input received from the touch sensor 104. For example, the event may comprise a display update, a haptic output, a battery charge event, or a combination thereof.

An event capable of interfering reduces the signal-to-noise ratio of an output signal generated by the touch sensor 104 and received by the touch sensor controller 214 as input. As a result, the signal of an actual touch is buried within noise resulting from the interference.

The interference suppression module 110 may identify the event as an event capable of interfering by receiving a status signal from a potentially interfering device that initiates the event. For example, the display controller 206 may send a status signal indicating a display update will take place, which would then generate interference.

In some implementations, the event is present at or affects a portion of the touch sensor 104 that is less than the entire touch sensor 104. For example, the wireless module 218 may have the antenna 222 adjacent to a top-left quadrant of the display. When active, the wireless module 218 may introduce interference in the portion of the touch sensor 104 proximate to the antenna 222. In this situation, the touch sensor controller 214 is configured to modify output associated with that portion of the touch sensor 104 while refraining from modifying output associated with a remaining portion of the touch sensor 104 which is not experiencing the interference.

At 904, the interference suppression module 110 configures the touch sensor controller 214 to tag the input received from the touch sensor 104 during the interfering event. For example, the tags may designate the input to the touch sensor controller 214 as reliable, suspect, or unreliable.

At 906, output from the touch sensor controller 214 is modified based at least in part upon the tag. For example, data tagged as suspect may be processed by the touch controller 214 and assigned a lower weight to input from the touch sensor 104 received during the event. Alternatively, the touch controller 214 may modify the input by entirely disregarding data tagged as unreliable.

FIG. 10 is an illustrative process 1000 of reducing interference experienced between components by coordinating operation of these components. Various components may interfere with one another during operation. For example, the wireless module 218 may interfere with operation of the touch sensor 104 while operation of the active haptic device 106 may interfere with the wireless module 218, and so forth. Interference between components may thus be reduced by performing interfering operations at times when the susceptible components are not operating, or modifying the output of the susceptible components while the known interference is occurring.

At 1002, a first device controller and an attached first device couple with a second device controller and an attached second device. Operation of the second device is such that interference is generated that interferes with operation of the first device.

The interference comprises a reduction in a signal-to-noise ratio of signals generated by the first device. As a result, the signals generated by the first device may be buried within the noise, and require additional filtering or processing to recover, if recovery of the signal is even possible. In another example, the interference comprises an increase in a noise floor measured at an input of the first controller coupled to an output of the first device.

At 1004, an interference suppression module 110 coordinates the first device controller and the second device controller. This coordination allows input received from the first device during periods free from the interference to be utilized by the first device controller while the first device controller modifies input received from the first device during periods experiencing interference.

In one implementation, the first device controller may comprise the touch sensor controller 214 and the first device may comprise the touch sensor 104. The second device controller may comprise the display controller 206 and the second device may comprise the stable display 102. In some implementations, the second device controller may comprise the haptic controller 216 and the second device comprises the active haptic device 106.

CONCLUSION

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as illustrative forms of implementing the claims. For example, the methodological acts need not be performed in the order or combinations described herein, and may be performed in any combination of one or more acts.

Claims

1. An electronic device comprising:

a processor;
a touch sensor coupled to a touch sensor controller that is coupled to the processor;
a stable display coupled to a display controller that is coupled to the processor;
a memory coupled to the processor; and
an interference suppression module stored within the memory and executable on the processor to: identify a beginning of a display update to a first portion of the stable display by the display controller; and based at least in part on identifying the beginning of the display update: configure the touch sensor controller to make a modification to input received from the touch sensor in association with the first portion of the stable display; configure the touch sensor controller to make no modification to input received from the touch sensor in association with a second, different portion of the stable display.

2. The electronic device of claim 1, wherein the interference suppression module is further executable on the processor to:

identify an end of the display update by the display controller; and
configure the touch sensor controller to maintain additional input received from the touch sensor without modification while the stable display is free from the display update.

3. The electronic device of claim 1, wherein the stable display comprises at least one of an electrophoretic display, a cholesteric display, or an interferometric display.

4. The electronic device of claim 1, wherein the input received from the touch sensor in association with the first portion of the stable display comprises a touch input event, and wherein the modification comprises disregarding or weighting the touch input event.

5. The electronic device of claim 4, wherein the disregarding or weighting occurs for a pre-determined time interval after the interference suppression module identifies that the display update is in progress.

6. The electronic device of claim 1, wherein the touch sensor comprises at least one of:

a capacitive touch array;
a projected capacitance touch array;
a resistive touch array;
an interpolating force sensitive resistor array;
optical touch sensor; or
an acoustic touch sensor.

7. The electronic device of claim 1, wherein the display controller is configured to generate a signal for use, at least in part, by the interference suppression module to determine when the display update of the first portion of the stable display is in progress.

8. The electronic device of claim 7, wherein the display controller is configured to generate the signal before the display update takes place.

9. A method comprising:

identifying a beginning of an event associated with a stable display, the event interfering with interpretation by a touch sensor controller of an input received from a touch sensor, wherein the input corresponds to an interaction with the touch sensor;
at least in part in response to identifying the beginning of the event, configuring the touch sensor controller to tag inputs received from the touch sensor during the event with a first tag;
modifying output from the touch sensor controller corresponding to the inputs received during the event based at least in part upon the first tag;
identifying an end of the event; and
at least in part in response to identifying the end of the event, configuring the touch sensor controller to tag inputs received from the touch sensor after the end of the event with a second, different tag.

10. The method of claim 9, wherein the event comprises a display update, a haptic output, a battery charge event, or a combination thereof.

11. The method of claim 9, wherein the event reduces a signal-to-noise ratio of an output signal generated by the touch sensor and received by the touch sensor controller as input.

12. The method of claim 9, wherein the modifying the output comprises disregarding the input received from the touch sensor during the event.

13. The method of claim 9, wherein the modifying the output comprises assigning a lower weight to the input received from the touch sensor during the event.

14. The method of claim 9, further comprising receiving a status signal from a potentially interfering device that produces the event, and wherein the identifying of the event is based at least in part on the status signal.

15. The method of claim 9, wherein the event is present at a portion of the touch sensor that is less than the entire touch sensor, and the touch sensor controller is configured to modify output associated with the portion of the touch sensor while refraining from modifying output associated with a remaining portion of the touch sensor.

16. The method of claim 9, wherein the first tag designates the input received from the touch sensor during the event as reliable, suspect, or unreliable.

17. A non-transitory computer-readable storage media storing instructions that when executed instruct a processor to perform acts comprising:

coordinating a touch sensor controller coupled to a touch sensor with a display controller, wherein the display controller is coupled to one or more stable displays;
identifying a start of a haptic output;
receiving a first input from the touch sensor, the first input corresponding to an interaction with the touch sensor during the haptic output via the one or more stable displays;
making a first type of modification to the first input from the touch sensor;
identifying an end of the haptic output;
receiving a second input from the touch sensor, the second input corresponding to an interaction with the touch sensor after the conclusion of the haptic output via the one or more stable displays; and
making a second, different, type of modification to the second input from the touch sensor.

18. The non-transitory computer-readable storage media of claim 17, wherein the coordinating comprises synchronizing the touch sensor controller and the display controller such that touch input is accepted during periods free from the haptic output.

19. A non-transitory computer-readable storage media storing instructions that when executed instruct a processor to perform acts comprising:

determine that a display update of a portion of a stable display by a display controller is in progress, wherein the portion of the stable display comprises a refresh area and is less than all of the stable display;
configure a touch sensor controller to tag input received from a touch sensor and corresponding to a touch in the refresh area during the display update with a first tag;
configure the touch sensor controller to tag input received from the touch sensor and corresponding to a touch outside of the refresh area during the display update with a second tag or no tag; and
based at least in part upon the first tag, modify output from the touch sensor controller that corresponds to the input received from the touch sensor corresponding to the touch in the refresh area during the display update.

20. The non-transitory computer-readable storage media of claim 19, wherein the display update reduces a signal-to-noise ratio of an output signal generated by the touch sensor and received by the touch sensor controller as the input.

21. The non-transitory computer-readable storage media of claim 19, wherein:

the input received from the touch sensor corresponding to the touch in the refresh area during the display update comprises a touch input event; and
modifying the output comprises disregarding or weighting the touch input event.

22. The non-transitory computer-readable storage media of claim 21, wherein the disregarding or weighting occurs for a pre-determined time interval.

23. The electronic device of claim 1, wherein the interference module is further executable on the processor to:

identify an end of the display update by the display controller; and
configure the touch sensor to modify additional input received from the touch sensor when the display update is not in progress and a noise signal exceeds a noise threshold.

24. The electronic device of claim 1, wherein the interference module is further executable on the processor to:

receive a first status signal from the display controller, wherein the identifying of the beginning of the display update to the first portion of the stable display is based at least in part on receiving the first status signal;
receive a second status signal from the display controller; and
identify an end of the display update to the first portion of the stable display.

25. The electronic device of claim 24, wherein the interference module is further executable on the processor to configure the touch sensor controller to make no modification to additional input received from the touch sensor after identifying the end of the display update to the first portion of the stable display.

26. The electronic device of claim 24, wherein the interference module is further executable on the processor to configure the touch sensor controller to modify additional input received from the touch sensor after identifying the end of the display update to the first portion of the stable display using a second, different modification.

Referenced Cited
U.S. Patent Documents
6998545 February 14, 2006 Harkcom et al.
20040227735 November 18, 2004 Pratt et al.
20070085837 April 19, 2007 Ricks et al.
20080158169 July 3, 2008 O'Connor et al.
20090256868 October 15, 2009 Low et al.
20100013761 January 21, 2010 Birnbaum et al.
20100149127 June 17, 2010 Fisher et al.
20110115729 May 19, 2011 Kremin et al.
20150097799 April 9, 2015 Buuck et al.
Other references
  • Office action for U.S. Appl. No. 12/851,029, mailed on Feb. 4, 2013, Buuck et al., “Reduction of Touch-Sensor Interference from Active Display”, # pages.
  • Office action for U.S. Appl. No. 12/851,029, mailed on Aug. 7, 2013, Buuck et al, “Reduction of Touch-Sensor Interference from Active Display”, 12 pages.
Patent History
Patent number: 9329721
Type: Grant
Filed: Aug 5, 2010
Date of Patent: May 3, 2016
Assignee: Amazon Technologies, Inc. (Reno, NV)
Inventors: David C. Buuck (Santa Clara, CA), John Mathew Depew (Sunnyvale, CA)
Primary Examiner: Ariel Balaoing
Application Number: 12/851,088
Classifications
Current U.S. Class: Error Correction (178/18.02)
International Classification: G06F 3/041 (20060101);