Abstract: A laparoscopic tool or minimally invasive device is augmented with a forward looking ultrasonic transducer that is processed to extract information regarding subsurface structures and to generate haptic, audio, or visual effects to provide relevant feedback to a user that is operating the tool. In one embodiment, the ultrasonic transducer detects the distance or depth of subsurface structures such as a luminal hollow structure or a tumor mass. In another embodiment, the ultrasonic transducer extracts tissue identification information, tissue stiffness, velocity, or other pertinent information regarding subsurface structures that is subsequently communicated to the operator as haptic, audio, and/or visual feedback. The ultrasonic transducer may be operable in one or more modes, including A-mode or Doppler mode.

Abstract: Systems and methods for providing haptic effects are disclosed. For example, one disclosed system includes a computer-readable medium having program code, the program code including program code defining a haptic widget. The haptic widget includes program code defining a haptic effect; program code defining an interface for the haptic widget; program code for receiving, via the interface, a configuration of at least one parameter of the haptic widget; program code for receiving, via the interface, a play command for the haptic effect; and program code for outputting, via the interface, a signal configured to cause the haptic effect, the signal based on the at least one parameter and in response to the play command.

Abstract: In an embodiment, a system and method for automatically converting a plurality of events in a plurality of channels in a structured representation sequence into haptic events. The method comprises calculating an event score for each event of the sequence in one or more channels. The method also comprises calculating a cumulative score based on the event scores in the one or more channels. The method includes selectively designating haptic events to the events based on the event scores in one or more selected channels, wherein the haptic events are output by a haptic actuator. This may be done by the system by calculating properties of the sound or by taking already existing values associated with those properties to efficiently produce haptic events.

Abstract: The system and method described is directed to receiving digital audio files and automatically converting the received files into haptic events. In an embodiment, the received files are of sampled digital or digitized analog audio files. The system and method separates the audio signal into a plurality of sub-band signals and segments the sub-band signals into a plurality of events. The system and method then assigns haptic effects to the events to produce haptic event signals which are to be output by an actuator. The system and method utilizes clipping and minimum time separation parameters along with physical parameters of the actuator and frequency characteristics in the audio signal to analyze and provide discrete haptic events which correspond with the audio.

Abstract: In an embodiment, a system and method for automatically converting a plurality of events in a plurality of channels in a structured representation sequence into haptic events. The method comprises calculating an event score for each event of the sequence in one or more channels. The method also comprises calculating a cumulative score based on the event scores in the one or more channels. The method includes selectively designating haptic events to the events based on the event scores in one or more selected channels, wherein the haptic events are output by a haptic actuator. This may be done by the system by calculating properties of the sound or by taking already existing values associated with those properties to efficiently produce haptic events.

Abstract: Systems and methods for minimally invasive surgical tools with haptic feedback are disclosed. One disclosed embodiment of a system includes an insertion sheath configured to be partially inserted within a patient's body, the insertion sheath configured to receive a surgical tool; a roller disposed at least partially within the insertion sheath, the roller configured to contact a surgical tool inserted within the insertion sheath; and an actuator coupled to the roller, the actuator configured to receive an actuator signal and to output a haptic effect based on the actuator signal.

Abstract: The system and method described is directed to receiving digital audio files and automatically converting the received files into haptic events. In an embodiment, the received files are of sampled digital or digitized analog audio files. The system and method separates the audio signal into a plurality of sub-band signals and segments the sub-band signals into a plurality of events. The system and method then assigns haptic effects to the events to produce haptic event signals which are to be output by an actuator. The system and method utilizes clipping and minimum time separation parameters along with physical parameters of the actuator and frequency characteristics in the audio signal to analyze and provide discrete haptic events which correspond with the audio.

Abstract: Haptic output devices and related systems and methods are described in the present disclosure. In various implementations, a haptic output device includes a reservoir filled with a liquid. At least one side of the reservoir includes a flexible membrane. The haptic output device also includes a first actuator in physical contact with the reservoir and configured to impart pressure waves to the liquid. The pressure waves interact with the flexible membrane to supply a haptic effect to a user.

Abstract: Systems and methods for actuating a tactile stimulation in response to detecting a specific event associated with exposure to a particular environmental or physiological condition are described herein. A tactile stimulation device, according to one of several implementations, comprises a sensing layer, an actuating layer, and an adhesive layer. The sensing layer, which is sensitive to exposure to a particular condition, is configured to sense when a specific event associated with exposure to the particular condition occurs. The actuating layer is configured to provide a tactile stimulation to a human subject when the specific event occurs. The adhesive layer is configured to affix the sensing layer and actuating layer with respect to a surface portion of the skin of the human subject such that the human subject can sense the tactile stimulation provided by the actuating layer. The sensing layer, actuating layer, and adhesive layer can be bonded together to form a relatively flat structure.

Abstract: In an embodiment, a system and method for automatically converting a plurality of events in a plurality of channels in a structured representation sequence into haptic events. The method comprises calculating an event score for each event of the sequence in one or more channels. The method also comprises calculating a cumulative score based on the event scores in the one or more channels. The method includes selectively designating haptic events to the events based on the event scores in one or more selected channels, wherein the haptic events are output by a haptic actuator.

Abstract: Systems and methods for interfacing a mobile device and a host computer are described in the present disclosure. In one embodiment, among several, an interfacing system comprises a mobile device, which has a sensor, and a host computer. The sensor of the mobile device detects gestures that are translated to cursor control commands for a display of the host computer.

Abstract: A method is disclosed for transferring digital information from a first electronic device to a second electronic device. In one example, the first device is a computer having a touch screen and the second device is a personal memory device carried or worn by an individual. The method includes selecting information on the first electronic device to be transferred, which can be done by touching the touch screen and performing a predefined finger gesture on the screen. Next, communication is established between the first electronic device and the second electronic device, preferably through a wireless connection such as Bluetooth. The selected information from the first electronic device then begins to upload to the second electronic device. As the information is transferred, vibrotactile sensations are imparted to the body of an individual with the vibrotactile sensations being indicative of the upload of information.

Abstract: Systems and methods for actuating a tactile stimulation in response to detecting a specific event associated with exposure to a particular environmental or physiological condition are described herein. A tactile stimulation device, according to one of several implementations, comprises a sensing layer, an actuating layer, and an adhesive layer. The sensing layer, which is sensitive to exposure to a particular condition, is configured to sense when a specific event associated with exposure to the particular condition occurs. The actuating layer is configured to provide a tactile stimulation to a human subject when the specific event occurs. The adhesive layer is configured to affix the sensing layer and actuating layer with respect to a surface portion of the skin of the human subject such that the human subject can sense the tactile stimulation provided by the actuating layer. The sensing layer, actuating layer, and adhesive layer can be bonded together to form a relatively flat structure.

Abstract: A minimally invasive surgical tool includes a sensor that generates a signal in response to an interaction with the tool. The tool further includes a haptic feedback system that generates a haptic effect in response to the signal.

Abstract: A haptic device includes a processor, a communication module coupled to the processor for receiving a shape input, and a housing for housing the communication module and including a deformable portion. The deformable portion includes a deformation actuator, and the processor provides a signal to the deformation actuator in response to the shape input to deform the housing. The shape of other areas of the device may also change in response to the signal. The shape changes may provide haptic effects, provide information, provide ergonomic changes, provide additional functionality, etc., to a user of the device.

Abstract: Various systems, devices, and methods for shape deformation of a haptic deformation display device are provided. For example, the haptic deformation display device may receive an input signal when the shape of the haptic deformation display device is in a first shape configuration. In response to the input signal, the haptic deformation display device may activate an actuator of the haptic deformation display device. The actuator may move a deformation component of the haptic deformation display device. The deformation component may at least partially defining a shape of the haptic deformation display device, thereby causing the shape of the haptic deformation display device to deform into a second shape configuration different from the first shape configuration. The second shape configuration may be substantially maintained.

Abstract: A method and system for performing minimally invasive tissue examination with a computer-assisted hand tool. The computer-assisted hand tool is moved into contact with the tissue under examination. An indication is received from a first sensor in the computer-assisted hand tool of each feature detected in a time interval during movement of the hand tool in contact with the tissue under examination. Each feature detected in the preset time interval is processed to determine a haptic feedback to provide to the user. A haptic feedback is generated and provided to the user via an actuator that is responsive to at least one feature detected in the time interval.

Abstract: Tools, such as surgical tools, are normally designed to interact with an object, such as a patient. As disclosed herein, one particular tool is implemented such that it comprises a handle having a feedback portion configured to contact one or more digits of a user's hand. The tool also includes a sensor positioned near or in contact with an object. The sensor is configured to measure a property of the object. Also, the tool includes a haptic output mechanism supported by the feedback portion of the handle. The haptic output mechanism is configured to communicate the measured property of the object to the user.

Abstract: A gaming concept in which each user in a single-player or a multi-player game is enabled to create artwork or graffiti work virtually or on actual surfaces using haptic-enhanced controllers. The controllers can emulate the experience of using a marker, a paint brush, a paint spray-can or the like. The components of various controllers may be modularized for easily interchanging components to extend the art or graffiti creation experience. The real life experience of using ink or paint on a surface is simulated by haptic feedback. When a paint spray-can controller is used, the experience of paint consumption is recreated by various peripheral enhancements including audio and haptic sensations communicated to the user.

Abstract: Systems and methods described herein include an array of sensors positioned on a tool. In one embodiment, among others, a tool includes a handle configured to be manipulated by a user. The tool also includes an end portion arranged in mechanical communication with the handle. In addition, the tool includes an array of sensors mounted on the end portion, in which the array of sensors is configured to sense a property of an object. The tool also comprises a processing device configured to process the properties of the object sensed by the array of sensors and to obtain spatial information of the object. The processing device is further configured to communicate the spatial information to the handle.