HAPTIC EFFECTS USING A HIGH BANDWIDTH THIN ACTUATION SYSTEM
Haptic feedback is provided by rendering haptic effects on a haptically-enabled device that includes a front screen, a back cover coupled to the front screen, and a haptic output device attached to or formed within the front screen or the back cover. The haptic output device is configured to render a high-definition (HD) vibratory haptic effect, a low-frequency vibratory haptic effect, and a deformation haptic effect.
This application claims priority to U.S. Provisional Patent Application No. 62/475,544, filed on Mar. 23, 2017, the entire content of which is incorporated herein by reference.
FIELDEmbodiments are directed to providing haptic feedback using an actuation system, and more particularly, to providing haptic feedback by rendering haptic effects using a high bandwidth thin actuation system.
BACKGROUND INFORMATIONPortable/mobile electronic devices, such as mobile phones, smartphones, tablets, game controllers, personal digital assistants (“PDAs”), etc., typically include output mechanisms to alert a user of certain events that occur with respect to the devices. For example, a cell phone normally includes a speaker for audibly notifying the user of an incoming telephone call event. The audible signal may include specific ringtones, musical ditties, sound effects, etc. In addition, the cell phone can include a display screen that can be used to visually notify the user of incoming phone calls.
In some mobile devices, kinesthetic feedback (such as active and resistive force feedback) and/or tactile feedback (such as vibration, texture, and heat) is also provided to the user, more generally known collectively as “haptic feedback” or “haptic effects.” Haptic feedback can provide cues that enhance and simplify the user interface. Specifically, vibration effects, or vibrotactile haptic effects, can be useful in providing cues to the user of an electronic device to alert the user to specific events, or provide realistic feedback to create greater sensory immersion within a simulated or virtual environment.
SUMMARYOne embodiment is directed to a haptically-enabled device that includes a front screen and a back cover coupled to the front screen of the haptically-enabled device. The device further includes an actuator attached to or formed within the back cover or the front screen. The haptic output device is configured to render a high-definition (HD) vibratory haptic effect, a low-frequency vibratory haptic effect, and a deformation haptic effect.
Embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings.
Embodiments are directed to providing haptic feedback using an actuation system, and more particularly, to providing haptic feedback by rendering haptic effects using a high bandwidth thin actuation system
Haptics is a tactile and/or kinesthetic feedback technology that generates haptic feedback effects (also known as “haptic feedback” or “haptic effects”), such as forces, vibrations, and motions, for an individual using the individual's sense of touch. A haptically-enabled device can include embedded hardware (e.g., an actuation system or other output mechanisms) configured to apply the haptic effects. The embedded hardware is, generally, programmed to apply (or playback) a particular set of haptic effects. When a signal specifying which haptic effect(s) to play is generated or received by a processor of the haptically-enabled device, the embedded hardware of the haptically-enabled device renders the specified haptic effect. For example, when an individual is intended to experience a haptic event, the embedded hardware of the haptically-enabled device receives a play command through control circuitry. The embedded hardware then applies the appropriate haptic effect.
One embodiment uses a thin actuation system, such as a Macro Fiber Composite (“MFC”) actuator attached to an internal surface (or inside) of a back cover of a smartphone or other mobile device to provide deformation haptic effects, low-frequency vibratory haptic effects, and/or high definition vibratory haptic effects on the back cover of the mobile device. The actuation system can be attached by an adhesive such as an epoxy or suspension, in one embodiment. In other embodiments, the back cover itself is used as a thin actuation system to provide the haptic effects by co-molding the actuation system and the back cover.
Referring to
The haptic feedback system includes a processor or controller 12. Coupled to processor 12 is a memory 20 and a drive circuit 16, which is coupled to a thin haptic output device 18. Processor 12 may be any type of general purpose processor, or could be a processor specifically designed to provide haptic effects, such as an application-specific integrated circuit (“ASIC”). Processor 12 may be the same processor that operates the entire system 10, or may be a separate processor. Processor 12 can decide what haptic effects are to be played and the order in which the effects are played based on high level parameters. In general, the high level parameters that define a particular haptic effect include magnitude, frequency and duration. Low level parameters such as streaming motor commands could also be used to determine a particular haptic effect. A haptic effect may be considered “dynamic” if it includes some variation of these parameters when the haptic effect is generated or a variation of these parameters based on a user's interaction.
Processor 12 outputs the control signals to drive circuit 16, which includes electronic components and circuitry used to supply thin haptic output device 18 with the required electrical current and voltage (i.e., “motor signals”) to cause the desired haptic effects to be generated. System 10 can include more than one haptic output device 18, and each haptic output device 18 can include a separate drive circuit 16, all coupled to a common processor 12. Memory 20 can be any type of storage device or computer-readable medium, such as random access memory (“RAM”), read-only memory (“ROM”), flash memory or solid state memory. Memory 20 stores instructions executed by processor 12, such as operating system instructions. Among the instructions, memory 20 includes a haptic effect generation module 14 which is instructions that, when executed by processor 12, generate haptic effects based in conjunction with an application that requires haptic effects to be generated (e.g., in response to any type of events generated by an application executing on system 10). Memory 20 may also be located internal to processor 12, or any combination of internal and external memory.
In embodiments with a touch surface 11, the touchscreen recognizes touches, and may also recognize the position and magnitude of touches on the surface. The data corresponding to the touches is sent to processor 12, or another processor within system 10, and processor 12 interprets the touches and in response generates haptic effect signals. Touch surface 11 may sense touches using any sensing technology, including capacitive sensing, resistive sensing, surface acoustic wave sensing, pressure sensing, optical sensing, etc. Touch surface 11 may sense multi-touch contacts and may be capable of distinguishing multiple touches that occur at the same time. Touch surface 11 may be a touchscreen that generates and displays images for the user to interact with, such as keys, buttons, dials, etc., or may be a touchpad with minimal or no images.
System 10 may be a handheld device, or mobile device, such a cellular telephone, personal digital assistant (“PDA”), smartphone, computer tablet, gaming controller, etc., or may be any other type of device that provides a user interface and includes a haptic effect system that includes one or more haptic output devices. The user interface may be a touch sensitive surface, or can be any other type of user interface such as a physical button, mouse, touchpad, mini-joystick, scroll wheel, trackball, door knob, game pads or game controllers, etc. System 10 may be a flexible/bendable device that generates haptic effects when physically manipulated, in which case the “user interface” is the flexible/bendable portion of the device itself.
Thin haptic output device 18, disclosed in more detail below, is “thin” relative to the side profile of system 10, and is able to generate or render deformation type haptic effects (e.g., deforming the back cover of mobile device 10) and/or vibratory type haptic effects (e.g., vibrating the back cover in addition to other portions of mobile device 10). Specifically, embodiments can generate vibratory haptic effects with a strong low-frequency content (e.g., approximately 10 Hz-150 Hz) and deformation haptic effects (e.g., approximately 10 Hz or less, or 2 Hz-10 Hz). The vibratory frequency of strong low-frequency vibratory haptic effects in embodiments is approximately 10 Hz-150 Hz. The deformation haptic effects can be considered a low frequency (slower) version of a vibratory haptic effect, or it can be considered a single cycle of an expansion/movement outwards and then returning. The frequency of deformation haptic effects in embodiments is approximately 10 Hz or less. Further, embodiments can generate “high definition” (“HD”) haptic effects that control thin haptic output device 18 with a haptic signal that varies the intensity of the haptic effect according to a signal encoded with a value of +/−127 for each sample of the high definition haptic signal supplied typically at 8 kHz. The vibratory frequency of HD vibratory haptic effects in embodiments is approximately 150 Hz-800 Hz. In one embodiment, narrow HD vibratory haptic effects are generated. A vibratory frequency of the narrow HD vibratory haptic effects is approximately 200 Hz.
In one embodiment, the thin haptic output device 18 can be configured to generate strong low-frequency vibratory haptic effects and HD vibratory haptic effects. In one embodiment, the thin haptic output device 18 can be configured to generate deformation haptic effects and strong-low frequency vibratory haptic effects. In one embodiment, the thin haptic output device 18 can be configured to generate deformation haptic effects, strong low-frequency vibratory haptic effects and HD vibratory haptic effects.
Some known actuators used to generate haptic effects generally cannot provide the range of haptic effects disclosed above. For example, a Linear Resonant Actuator (“LRA”) or a Solenoid Resonant Actuator (“SRA”) generally have a narrow band HD effect of approximately 200 Hz and an acceleration of 1 G, peak to peak (“pp”). Further, an LRA generally cannot provide low frequency content and deformation haptics. Further, the thickness of an LRA is approximately 3 mm (i.e., not “thin”), and it is not flexible. Likewise, an Eccentric Rotating Mass (“ERM”) vibration motor cannot generally provide HD haptic effects content and the thickness of an ERM bar is also approximately 3 mm.
In accordance with embodiments, processor 12, memory 20, drive circuit 16 and haptic output device 18 can all be contained within the housing 15.
Referring to
In one embodiment, a pocket cut 23 of approximately 0.050″ on the inside of back cover 22 allows MFC actuator 21 to be positioned substantially flush to the inside of back cover 22 and allows the overall case of device 10 to tightly fit together. Pocket cut 23 further changes the thickness of back cover 22. Further, pocket cut 23 may allow the haptic effect to be generally isolated on the back cover to the thinner portion necessitated by the pocket cut. The device driver and/or processor of device 10 is electrically coupled to MFC actuator 21.
In one embodiment, MFC actuator 21 is the “MFC M5628 P1” from Smart Material Corp. An MFC actuator, in general, is formed by rectangular piezo ceramic rods sandwiched between layers of adhesive, electrodes and polyimide film. The electrodes are attached to the film in an interdigitated pattern which transfers the applied voltage directly to and from the ribbon shaped rods. In one embodiment, the thickness of MFC actuator 21 is approximately 0.5 mm. However, embodiments are not limited thereto, and the thickness of MFC actuator 21 can be less than 0.5 mm such as 10 μm to 100 μm, approximately 10 μm or approximately 100 μm. In other embodiments, the thickness of MFC actuator 21 can be about 2 to 3 mm, about 1 to 2 mm, or less than 1 mm.
In other embodiments, a thin smart material alternative to MFC actuator 21 can be used as the actuation system.
Referring to
As shown in
As shown in
In
As shown, the acceleration (above 0.5 G peak-to-peak (“pp”)) starts from 30 Hz and continues even after 800 Hz. Below 30 Hz, a user can feel deformation haptic effects to about 2 Hz. The maximum acceleration for the front side of device 10 is approximately 12 G pp.
In
In another embodiment, a transparent MFC actuator is bonded under the front screen of mobile device 10 instead of, or in addition to, being bonded inside the back cover.
In
As shown in
In another embodiment, multiple MFC actuators (see
In another embodiment, instead of using an MFC actuator or other separate thin actuator system bonded to the inert plastic of back cover 22 or front screen 26, an actuation system can be formed within the back cover 22 or front screen 26, so that when energy is applied to back cover 22, back cover 22 or front screen 26 vibrates and/or deforms. For instance, an actuation system can be integrally-formed with back cover 22 or front screen 26 by co-molding the actuation system and back cover 22. In one embodiment, back cover 22 or front screen 26 is formed of composite materials formed through co-molding, using inert and active materials. In one embodiment, back cover 22 or front screen 26 itself can have built-in or embedded actuation capability. Back cover 22 or front screen 26 can be a composite material that is impregnated with fibers or thin sheets of material that can expand/contract, causing vibration and deformation, through back cover 22. In another embodiment, back cover 22 or front screen 26 can be formed from a co-molded woven fabric that includes threads in a certain orientation. Any other substance that expands or contracts when energized (for instance, by applying voltage) can be used in embodiments as back cover 22 or front screen 26.
In another embodiment, MFC actuator 21 or similar actuator is attached to an add-on cover that houses mobile device 200. In one embodiment, MFC actuators 21 are added to the side and the back of the add-on cover.
A suspension can be used to attach the add-on cover to the mobile device 200 to tune the dynamic behavior of the haptic feedback provided by the entire system. The suspension can be foam, gel, or smart materials such as MRF. Attaching a suspension can help reduce the highest natural frequency from 450 Hz to 300 Hz, as shown in
As disclosed, an embodiment uses a high bandwidth thin actuator bonded to the cover of a mobile device to generate multiple types of haptic effects. Using the cover itself as a substrate allows for the high bandwidth.
In other embodiments, there is a need to generate haptic effects in conjunction with larger display structures (i.e., larger than on a typical mobile device). These displays may need to conform to the substrate that they are attached to. For example, in an automobile dashboard, a display maybe be curved and may fit within a curved dashboard, which can function as a substrate. One known way to provide haptic effects to this type of display is to shake/vibrate the whole display system, using a large mass, which is not very efficient.
In
In contrast, embodiments use a designed thin actuator (with a small width and a long length), such as an MFC actuator, bonded directly to a substrate in contact with the user to provide strong haptic feedback.
Referring to
Referring to both
The MFC actuator(s) directly on the front cover or the back panel of a touch screen in accordance with embodiments can function as both an actuator and a pressure sensor. The MFC actuators generate voltage as a result of being deformed. The generated voltage can be used to sense pressure applied to the front cover or the back panel to realize 3D haptic effects.
As shown in
In order to optimize haptic feedback generated using a front screen or back panel with MFC actuators in accordance with embodiments, the amplifying force (e.g., from vibratory haptic effect) or the deformation force (e.g., from a deformation haptic effect) that will be rendered by the haptic effects should be taken into consideration when determining the design and stiffness distribution of the front screen or back cover. If the amplifying forces are important, the front screen or back panel should be relatively thin, and formed of a material having a high Young's modulus such as glass fiber composite or carbon fiber composite.
Referring to
Referring to
Alternatively, or in addition to the actuators/patches 1510, 1511, two additional thin actuators (e.g., MFC actuators) 1530, 1531 can be located on an outer surface of touch surface 1500, as shown in
Referring to
Alternatively, or in addition to the actuators 1610, 1611, 1612 and 1613, four additional thin actuators (e.g., MFC actuators) 1630, 1631, 1632 and 1633 can be located on an outer surface of touch surface 1600, as shown in
Referring to
At step 1720, a high-definition (HD) vibratory haptic effect, a low-frequency vibratory haptic effect or a deformation haptic effect is rendered using the haptic output device.
In one embodiment, the method further includes generating the haptic signal using a processor coupled to the haptic output device, prior to the applying of the haptic signal. The haptic output device is attached to or formed within an inner surface of the back cover. The haptic signal is applied to the haptic output device to cause the high-definition (HD) vibratory haptic effect, the low-frequency vibratory haptic effect or the deformation haptic effect to be rendered on an outer surface of the back cover.
In one embodiment, a frequency of the low-frequency vibratory haptic effect is approximately 10 Hz to-150 Hz, and a frequency of the HD vibratory haptic effect is 150 Hz-800 Hz.
In one embodiment, a frequency of the deformation haptic effect is 10 Hz or less.
In one embodiment, the haptic output device can be a Macro Fiber Composite actuator. However, as discussed above, embodiments are not limited thereto.
In one embodiment, the rendering of the haptic effect includes using a plurality of actuators directly bonded to an inner surface of the back cover. A first set of the plurality of actuators can be on a first side of a neutral axis of the back cover, and a second set of the plurality of actuators can be on a second side of the neutral axis of the back cover.
The method can optionally include, at step 1730, sensing, at the haptic output device, pressure applied to the front screen or the back cover using voltage generated from user contact to generate pressure information. The pressure information could be used to render the high-definition (HD) vibratory haptic effect, the low-frequency vibratory haptic effect and/or the deformation haptic effect as a 3D haptic effect.
Referring to
Although shown as a single system, the functionality of system 1800 can be implemented as a distributed system. System 1800 includes a bus 1804 or other communication mechanism for communicating information, and a processor 1814 coupled to bus 1804 for processing information. Processor 1814 can be any type of general or specific purpose processor. System 1800 further includes a memory 1802 for storing information and instructions to be executed by processor 1814. Memory 1802 can be comprised of any combination of random access memory (“RAM”), read only memory (“ROM”), flash memory, solid state memory, static storage such as a magnetic or optical disk, or any other type of non-transitory computer-readable medium.
A non-transitory computer-readable medium can be any available medium that can be accessed by processor 1814, and can include both a volatile and nonvolatile medium, a removable and non-removable medium, and a storage medium. A storage medium can include RAM, flash memory, ROM, solid state memory, erasable programmable read-only memory (“EPROM”), electrically erasable programmable read-only memory (“EEPROM”), registers, hard disk, a removable disk, a compact disk read-only memory (“CD-ROM”), or any other form of a storage medium known in the art.
According to an example embodiment, memory 1802 stores software modules that provide functionality when executed by processor 1814. The software modules include an operating system 1806 that provides operating system functionality for system 1800, as well as the rest of the haptically-enabled device. The software modules can also include a haptic system 1805 that provides haptic functionality (as described above). However, example embodiments are not limited thereto. For instance, haptic system 1805 can be external to the haptically-enabled device, for example, in a central gaming console in communication with the haptically-enabled device. The software modules further include other applications 1808, such as, a video-to-haptic conversion algorithm.
System 1800 can further include a communication device 1812 (e.g., a network interface card) that provides wireless network communication for infrared, radio, Wi-Fi, or cellular network communications. Alternatively, communication device 1812 can provide a wired network connection (e.g., a cable/Ethernet/fiber-optic connection, or a modem).
Processor 1814 is further coupled via bus 1804 to a visual display 1820 for displaying a graphical representation or a user interface to an end-user. Visual display 1820 can be a touch-sensitive input device (i.e., a touch screen) configured to send and receive signals from processor 1814, and can be a multi-touch touch screen.
System 1800 further includes a haptic output device 1835. Processor 1814 can transmit a haptic signal associated with a haptic effect to haptic output device 1835, which in turn outputs haptic effects (e.g., vibratory haptic effects and/or deformation haptic effects).
While example embodiments have been described in an automobile dashboard and a mobile device, the haptically-enable device is not limited thereto. For example, the haptically-enabled device may be a device used in a virtual reality (“VR”) or augmented reality (“AR”) system or in a gaming system such as a computer, a game pad or a tablet.
According to example embodiments, example embodiments use a high bandwidth thin actuator bonded to the cover of a haptically-enabled device to generate multiple types of haptic effects. Using the device itself as a substrate allows for the high bandwidth.
Several embodiments are specifically illustrated and/or described herein. However, it will be appreciated that modifications and variations of the disclosed embodiments are covered by the above teachings and within the purview of the appended claims without departing from the spirit and intended scope of the invention.
Claims
1-20. (canceled)
21. A haptically-enabled device, comprising:
- a front screen;
- a back cover coupled to the front screen; and
- a haptic output device attached to or formed within one of the front screen and the back cover, the haptic output device being configured to render a high-definition (HD) vibratory haptic effect, a low-frequency vibratory haptic effect, and a deformation haptic effect based on the detected contact.
22. The haptically-enabled device of claim 21, wherein the haptic output device is a Macro Fiber Composite actuator.
23. The haptically-enabled device of claim 22, wherein the haptic output device comprises a transparent Macro Fiber Composite actuator.
24. The haptically-enabled device of claim 23, wherein the transparent Macro Fiber Composite actuator is bonded under the front screen.
25. The haptically-enabled device of claim 24, wherein the transparent Macro Fiber Composite actuator is further bonded inside the back cover.
26. The haptically-enabled device of claim 21, further comprising a processor coupled to the haptic output device, wherein the haptic output device is attached to an inner surface of the back cover, and the processor is configured to generate a haptic signal that is applied to the haptic output device to cause the high-definition (HD) vibratory haptic effect, the low-frequency vibratory haptic effect or the deformation haptic effect to be rendered on an outer surface of the back cover.
27. The haptically-enabled device of claim 21, wherein a frequency of the low-frequency vibratory haptic effect is approximately 10 Hz-150 Hz, a frequency of the HD vibratory haptic effect is approximately 150 Hz-800 Hz, or a frequency of the deformation haptic effect is approximately 10 Hz or less.
28. The haptically-enabled device of claim 21, wherein the HD vibratory haptic effect is a narrow HD vibratory haptic effect, and a frequency of the narrow HI) vibratory haptic effect is approximately 200 Hz.
29. The haptically-enabled device of claim 21, wherein the haptic output device is attached to the front screen.
30. The haptically-enabled device of claim 21, wherein a pocket cut is formed on an inner surface of the back cover, and the haptic output device is directly bonded within the pocket cut.
31. The haptically-enabled device of claim 21, wherein the back cover comprises a neutral axis, the haptically-enabled device further comprising a plurality of actuators directly bonded to an inner surface of the back cover, wherein a first set of actuators of the plurality of actuators are disposed on a first side of the neutral axis, and a second set of actuators of the plurality of actuators are disposed on a second side of the neutral axis, and wherein the haptic output device is one of the plurality of actuators.
32. The haptically-enabled device of claim 21, wherein the haptic output device is integrally formed with or built in one of the front screen and the back cover.
33. The haptically-enabled device of claim 21, wherein the haptic output device is a fiber, a thin sheet or a thread, the haptic output device expanding and contracting when voltage is applied thereto, and wherein the back cover is formed of a composite material including the fiber, the thin sheet or the thread.
34. A method of providing haptic feedback on a haptically-enabled device, comprising the steps of:
- applying a haptic signal to a haptic output device configured to render to a high-definition (HD) vibratory haptic effect, a low-frequency vibratory haptic effect and a deformation haptic effect, the haptic output device being attached to or formed within one of a front screen and a back cover of the haptically-enabled device, Wherein the front screen is coupled to the back cover; and
- rendering the high-definition (HD) vibratory haptic effect, the low-frequency vibratory haptic effect or the deformation haptic effect using the haptic output device.
35. The method of claim 34, wherein the haptic output device is a Macro Fiber Composite actuator.
36. The method of claim 34, further comprising the step of generating the haptic signal using a processor coupled to the haptic output device, prior to the applying of the haptic signal, wherein the haptic signal is applied to the haptic output device to cause the rendering of the high-definition (HD) vibratory haptic effect, the low-frequency vibratory haptic effect or the deformation haptic effect on an outer surface of the back cover, and wherein the haptic output device is attached to an inner surface of the back cover.
37. The method of claim 34, wherein a frequency of the low-frequency vibratory haptic effect is approximately 10 Hz-150 Hz, a frequency of the HD vibratory haptic effect is approximately 150 Hz-800 Hz, or a frequency of the deformation haptic effect is approximately 10 Hz or less.
38. The method of claim 34, wherein the step of rendering of the haptic effect includes using a plurality of actuators directly bonded to an inner surface of the back cover, wherein the back cover comprises a neutral axis, a first set of actuators from the plurality of actuators being disposed on a first side of the neutral axis, and a second set of actuators from the plurality of actuators being disposed on a second side of the neutral axis, the haptic output device being one of the plurality of actuators.
39. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to perform a set of operations comprising:
- applying a haptic signal to a haptic output device configured to render to a high-definition (HD) vibratory haptic effect, a low-frequency vibratory haptic effect and a deformation haptic effect, the haptic output device being attached to or formed within one of a front screen and a back cover of a haptically-enabled device, the front screen being coupled to the back cover; and
- rendering the high-definition (HD) vibratory haptic effect, the low-frequency vibratory haptic effect or the deformation haptic effect using the haptic output device.
40. The non-transitory computer readable medium of claim 39, wherein the haptic output device is a Macro Fiber Composite actuator, the haptic output device is attached to an inner surface of the back cover, and the HD vibratory haptic effect, the low-frequency vibratory haptic effect or the deformation haptic effect is rendered on an outer surface of the back cover.
Type: Application
Filed: Jan 3, 2020
Publication Date: May 7, 2020
Inventors: Mansoor ALGHOONEH (Toronto), Robert LACROIX (Saint-Lambert), Juan Manuel CRUZ-HERNANDEZ (Montreal), Neil OLIEN (Montreal), Vahid KHOSHKAVA, V (Montreal)
Application Number: 16/733,843