Abstract: Various techniques for driving phased array systems are described, specifically intended for acoustic phased arrays with applications to mid-air haptics, parametric audio, acoustic levitation and acoustic imaging, including a system: 1) that is capable of mitigating the effect of the changes in the air to provide a consistent haptic experience; 2) that produces trap points in air; 3) that defines phased-array optimization in terms of vectors for the production of more consistent haptic effects; 4) that defines one or more control points or regions in space via a controlled acoustic field; 5) that uses a reduced representation method for the construction of acoustic basis functions; 6) that performs efficient evaluation of complex-valued functions for a large quantity of throughput; 7) that generates a Krylov sub-space of a matrix; and 8) that maximizes an objective described by different control points and/or regions to those used to create the acoustic basis functions.

Abstract: To resolve an issue related to the calibration of optical cameras in transducer-based mid-air haptic systems, the magnification of the motion induced on an optical camera by an acoustic field modulated at specific frequencies reveals very small temporal variations in video frames. This quantized distortion is used to compare different acoustic fields and to solve the calibration problem in an automatized manner. Further, mechanical resonators may be excited by ultrasound when it is modulated at the resonant frequency. When enough energy is transferred and when operating at the correct frequency, a user in contact with the device can feel vibration near areas of largest displacement. This effect can be exploited to create devices which can produce haptic feedback while not carrying a battery or exciter when in the presence of an ultrasonic source.

Abstract: Described is a solution for an unlabeled target domain dataset challenge using a domain adaptation technique to train a neural network using an iterative 3D model fitting algorithm to generate refined target domain labels. The neural network supports the convergence of the 3D model fitting algorithm and the 3D model fitting algorithm provides refined labels that are used for training of the neural network. During real-time inference, only the trained neural network is required. A convolutional neural network (CNN) is trained using labeled synthetic frames (source domain) with unlabeled real depth frames (target domain). The CNN initializes an offline iterative 3D model fitting algorithm capable of accurately labeling the hand pose in real depth frames. The labeled real depth frames are used to continue training the CNN thereby improving accuracy beyond that achievable by using only unlabeled real depth frames for domain adaptation.

Abstract: A system providing various improved processing techniques for haptic feedback is described. An acoustic field is defined by one or more control points in a space within which the acoustic field may exist. Each control point is assigned an amplitude value equating to a desired amplitude of the acoustic field at the control point. Transducers are then controlled to create an acoustic field exhibiting the desired amplitude at each of the control points. When human skin interacts with the acoustic field, vibrations of the skin are interpreted by mechanoreceptors being excited and sending signals to the brain via the nervous system. Improved processing techniques allow for more efficient real-world operation.

Abstract: The present invention concerns a method and apparatus for the modulation of an acoustic field for providing tactile sensations. A method of creating haptic feedback using ultrasound is provided. The method comprises the steps of generating a plurality of ultrasound waves with a common focal point using a phased array of ultrasound transducers, the common focal point being a haptic feedback point, and modulating the generation of the ultrasound waves using a waveform selected to produce little or no audible sound at the haptic feedback point.

Abstract: A phased array of ultrasonic transducers may create arbitrary fields that can be utilized to manipulate fluids. This includes the translation of drops on smooth surfaces as well speeding the evaporation of fluids on wetted hands. Proposed herein is the use airborne ultrasound focused to the surface of the hand. The risk is that coupling directly into the bulk of the hand may cause damage to the cellular material through heating, mechanical stress, or cavitation. Using a phased array, the focus may be moved around, thus preventing acoustic energy from lingering too long on one particular position of the hand. While some signaling may penetrate into the hand, most of the energy (99.9%) is reflected. Also disclosed are methods to couple just to the wetted surface of the hand.

Abstract: A system providing various improved calibration techniques for haptic feedback is described. An acoustic field is defined by one or more control points in a space within which the acoustic field may exist. Each control point is assigned an amplitude value equating to a desired amplitude of the acoustic field at the control point. Because complete control of space is not possible, controlling the acoustic field at given points yields erroneous local maxima in the acoustic field levels at other related positions. In relation to mid-air haptic feedback, these can interfere in interactions with the space by creating secondary effects and ghost phenomena that can be felt outside the interaction area. The level and nature of the secondary maxima in the acoustic field is determined by how the space is controlled. By arranging the transducer elements in different ways, unwanted effects on the acoustic field can be limited and controlled.

Abstract: An acoustic field may be produced from a transducer array having known relative positions and orientations In this acoustic field, one or more control points may be defined. An amplitude may be assigned to the control point. Mid-air haptic effect for a virtual object on a human body part may be generated by moving the control point in a single closed curve comprising a plurality of curve segments. The single closed curve traverses at least one location where the human body part intersects with the virtual object. Additionally, a user may interact with virtual three-dimensional content using the user's hands while a tracking system monitoring the user's hands, a physics engine updates the properties of the virtual three-dimensional content and a haptic feedback system provides haptic information to the user.

Abstract: Disclosed are methods to manipulate a given parametrized haptic curve in order to yield a smooth phase function for each acoustic transducer which minimizes unwanted parametric audio. Further, the impulse response of a haptic system describes the behavior of the system over time and can be convolved with a given input to simulate a response to that input. To produce a specific response, a deconvolution with the impulse response is necessary to generate an input.

Abstract: The present invention concerns a method and apparatus for the modulation of an acoustic field for providing tactile sensations. A method of creating haptic feedback using ultrasound is provided. The method comprises the steps of generating a plurality of ultrasound waves with a common focal point using a phased array of ultrasound transducers, the common focal point being a haptic feedback point, and modulating the generation of the ultrasound waves using a waveform selected to produce little or no audible sound at the haptic feedback point.

Abstract: The present invention concerns a method and apparatus for the modulation of an acoustic field for providing tactile sensations. A method of creating haptic feedback using ultrasound is provided. The method comprises the steps of generating a plurality of ultrasound waves with a common focal point using a phased array of ultrasound transducers, the common focal point being a haptic feedback point, and modulating the generation of the ultrasound waves using a waveform selected to produce little or no audible sound at the haptic feedback point.

Abstract: Described is a method for instilling the haptic dimension of texture to virtual and holographic objects using mid-air ultrasonic technology. A set of features is extracted from imported images using their associated displacement maps. Textural qualities such as the micro and macro roughness are then computed and fed to a haptic mapping function together with information about the dynamic motion of the user's hands during holographic touch. Mid-air haptic textures are then synthesized and projected onto the user's bare hands. Further, mid-air haptic technology enables tactile exploration of virtual objects in digital environments. When a user's prior and current expectations and rendered tactile texture differ, user immersion can break. A study aims at mitigating this by integrating user expectations into the rendering algorithm of mid-air haptic textures and establishes a relationship between visual and mid-air haptic roughness.

Abstract: A system providing various improved perceptions techniques for haptic feedback above interactive surfaces that require no contact with either tools, attachments or the surface itself is described. A range of receptors in a perceiving member which is part of the human body is identified to create substantially uniformly perceivable feedback. A vibration frequency that is in the range of the receptors in the perceiving member is chosen and dynamically altered to create substantially uniformly perceivable feedback throughout the receiving member.

Abstract: The present invention concerns a method and apparatus for the modulation of an acoustic field for providing tactile sensations. A method of creating haptic feedback using ultrasound is provided. The method comprises the steps of generating a plurality of ultrasound waves with a common focal point using a phased array of ultrasound transducers, the common focal point being a haptic feedback point, and modulating the generation of the ultrasound waves using a waveform selected to produce little or no audible sound at the haptic feedback point.

Abstract: To resolve an issue related to the calibration of optical cameras in transducer-based mid-air haptic systems, the magnification of the motion induced on an optical camera by an acoustic field modulated at specific frequencies reveals very small temporal variations in video frames. This quantized distortion is used to compare different acoustic fields and to solve the calibration problem in an automatized manner. Further, mechanical resonators may be excited by ultrasound when it is modulated at the resonant frequency. When enough energy is transferred and when operating at the correct frequency, a user in contact with the device can feel vibration near areas of largest displacement. This effect can be exploited to create devices which can produce haptic feedback while not carrying a battery or exciter when in the presence of an ultrasonic source.

Abstract: An acoustic matching structure is used to increase the power radiated from a transducing element with a higher impedance into a surrounding acoustic medium with a lower acoustic impedance. The acoustic matching structure consists of a thin, substantially planar cavity bounded by a two end walls and a side wall. The end walls of the cavity are formed by a blocking plate wall and a transducing element wall separated by a short distance (less than one quarter of the wavelength of acoustic waves in the surrounding medium at the operating frequency). The end walls and side wall bound a cavity with diameter approximately equal to half of the wavelength of acoustic waves in the surrounding medium. In operation, a transducing element generates acoustic oscillations in the fluid in the cavity.

Abstract: Phased array systems rely on the production of an exact carrier frequency to function. Reconstructing digital signals by specified amplitude and phase is accomplished explicitly by inducing frequency shifts away from a base frequency implied by phase changes. Shifting the carrier frequency of a digitally controlled phased array while preserving the timing of the individual phase pulses enables more efficient driving of the phased array system when the phase of the drive signals change dynamically in time.

Abstract: Described herein are techniques for tracking objects (including human body parts such as a hand), namely: 1) two-state transducer interpolation in acoustic phased-arrays; 2) modulation techniques in acoustic phased-arrays; 3) fast acoustic full matrix capture during haptic effects; 4) time-of-flight depth sensor fusion system; 5) phase modulated spherical wave-fronts in acoustic phased-arrays; 6) long wavelength phase modulation of acoustic field for location and tracking; and 7) camera calibration through ultrasonic range sensing.

Abstract: An acoustic field may be produced from a transducer array having known relative positions and orientations. In this acoustic field, one or more control points may be defined. An amplitude may be assigned to the control point. Mid-air haptic effect for a virtual object on a human body part may be generated by moving the control point in a single closed curve comprising a plurality of curve segments. The single closed curve traverses at least one location where the human body part intersects with the virtual object. Additionally, a user may interact with virtual three-dimensional content using the user's hands while a tracking system monitoring the user's hands, a physics engine updates the properties of the virtual three-dimensional content and a haptic feedback system provides haptic information to the user.

Abstract: A system providing various improved processing techniques for haptic feedback is described. An acoustic field is defined by one or more control points in a space within which the acoustic field may exist. Each control point is assigned an amplitude value equating to a desired amplitude of the acoustic field at the control point. Transducers are then controlled to create an acoustic field exhibiting the desired amplitude at each of the control points. When human skin interacts with the acoustic field, vibrations of the skin are interpreted by mechanoreceptors being excited and sending signals to the brain via the nervous system. Improved processing techniques allow for more efficient real-world operation.