Abstract: A tactile graphic display for providing a display representation of a graph or image generated by a graphic device for visually impaired users or other users who wish to access tactile information. The tactile graphic display includes a control and interface module in communication with a dot matrix, which is associated with pin nut assemblies including caps that serve as dots in the dot matrix. The control and interface module provides motor drive signals that raise selected dots above the top surface of a top panel to form the dot matrix display. Proximity sensors in or associated with the top panel sense touching of one or more dots and/or proximate presence of a finger or hand near the top surface of the top panel. The proximity sensors provide dot matrix engagement signals to the control and interface module for processing.

Abstract: When the sight impaired become mobile, they often bump their heads on unseen objects and/or hazards that could result in injury. The object detection device uses signal emitting proximity sensors that alert the user to unseen objects. The object detection device notifies the user of detected objects. Stimulators contact the user to warn the user that an object has been detected and the distance between the object and the user. Each stimulator contacts the user at a specific contact point. The stimulator finger contacting the user at a specific contact point informs the user of the distance between the user and the detected object.

Abstract: Computer-readable media, computerized methods, and a touchscreen device manipulating user-input elements are provided. Generally, manipulation includes identifying a predefined configuration associated with a request received from a user and/or application, deriving configuration settings from the predefined configuration, and transmitting the configuration settings to an electromechanical device that adjusts a portion of user-input elements to an extended orientation and activates a portion of user-input elements. In embodiments, the extended user-input elements positioned in the extended orientation are activated, while the remainder are set to an idle condition. Typically, the extended user-input elements produce outwardly-extending protrusions expressed at a flexible touchpad incorporated in the touchscreen device. These outwardly-extending protrusions may replicate keys of a standard keyboard and correspond with the presently-running application implemented on the touchscreen device.

Abstract: According to the present invention, there is provided an improved refreshable tactile display apparatus including a housing, bias compression springs, sliding blocks, pins, and a shape memory alloy wire. The sliding block is actuated by the interaction between the bias compression spring and the shape memory alloy wire. The shape memory alloy wire is then activated by current driven from a power supply in either a modulated or unmodulated fashion.

Abstract: A refreshable tactile reader apparatus for Braille text and graphics, utilizing a plurality of compressible tactile pins that can absorb strong downward forces. Such strong forces transmitted through tactile pins can damage pin actuation mechanisms. The physical enclosure of the reader provides open channels that allow the apparatus to be more easily cleaned than prior art enablements.

Abstract: A system for conceptualizing spatial concepts comprised of a plurality of elongated barriers having magnets imbedded therein for magnetically coupling the barriers to a planar member such as a magnetic white board and to one another for providing horizontally and vertically extending barriers for defining upper and lower partitioned work areas and left and right partitioned work areas such that a visual and/or tactile medium can be placed in each of the partitioned work areas and partially behind the horizontally extending barriers for locating one or more mediums above and below the horizontally extending barriers and to the left and right of the vertically extending barriers for conveying spatial concepts to students and for aiding students in the conceptualization of these spatial concepts and, in particular, wherein the students are blind, visually impaired, and/or kinesthetic learners.

Abstract: Systems and methods provide tactile assistance to a consumer completing a transaction at a point of sale terminal. A tactile overlay, either permanent or removable, couples with a consumer interface such as a touch screen of the point of sale terminal. The tactile overlay includes one or more overlay inputs that provide a distinct tactile impression in comparison with the remainder of the overlay. For example, the overlay inputs can be depressions, apertures, protrusions, dimples, or the like, or provide a different texture such as a rougher or smoother texture than the surrounding overlay. The overlay inputs are configured to correspond with underlying touch screen inputs such that the consumer using the tactile overlay can discern the proper location on the touch screen for providing the desired input.

Abstract: A method of automatically converting alphabetic text written in a text based language into a non-text based language. The method can include parsing the text to identify at least one word. The method also can include via a processor, identifying within a lexicon database data corresponding to the word, wherein the data corresponding to the word identifies at least one pictograph or symbol selected from a group of pictographs or symbols consisting of between twenty seven and thirty three distinct pictographs or symbols that visually look different than the text, wherein each pictograph or symbol corresponds to a unique speech sound of the text based language. The pictograph or symbol can be rendered in a view.

Abstract: A visually impaired person may be taught verbal communication skills using specimen display assemblies that present tactile specimens representing words that are to be learned. The specimens are attached to and project from a surface of a specimen display card. The specimen display card may be used in conjunction with a teaching device such as an easel or an electronic device having a touch sensitive surface and a speaker, whereby the electronic device broadcasts a programmed verbal message from the speaker when a force is imparted to the touch sensitive surface.

Abstract: A device for communicating, preferably between two people who could not normally orally communicate, by at least one user pointing to pictograms on the device. The device can be a static medium having a plurality of icons thereon or can be part of a computer generated program having a graphic display that is either moving or stationary so that a user can select at least one icon to communicate an idea. When two or more people use the device to communicate, the device enables a dialogue to develop between the people. A first responder to an emergency situation could use the device in any country to gather information to quickly respond to the situation.

Abstract: A dot unit includes an opening formed in a housing and a protruding member disposed in the opening. The protruding member is rotatably supported by a support shaft. The protruding member is rotated by a polymer actuator in a direction that follows a reading direction in which a unit of information is read, and the protruding member is stabilized in a protruding position by contacting a restricting portion. When a finger is moved in the reading direction and contacts the protruding member, the protruding member is likely to be stabilized in the protruding position.

Abstract: A method and apparatus for mapping a moving direction by using sounds for people with visual impairments, in which a moving direction can be expressed multi-dimensionally by using sound information and can effectively assist people with visual impairments and the like in navigation tasks. A moving direction of a person carrying a device configured to output sounds is mapped by using a combination of sounds outputted from the device. A plurality of different sound information pieces are stored in association with three or more predetermined directions, respectively, a current position of the moving target device is identified, and then a moving direction of the device is identified. A sound obtained by combining two sounds in a ratio according to the identified moving direction is outputted on the basis of sound information pieces associated respectively with two adjacent directions sandwiching the identified moving direction among the predetermined directions.

Abstract: Provided are a method and apparatus for recognizing sign language using an electromyogram sensor and a gyro sensor. The method includes the steps of (a) receiving a gyro measurement signal and an electromyogram measurement signal from the gyro sensor and the electromyogram sensor which are attached to the body of a subject, (b) determining to which of groups clustered with similar fingerspelling motions the gyro measurement signal belongs, (c) acquiring a Gaussian model for the electromyogram measurement signal, and (d) comparing the acquired Gaussian model with Gaussian candidate models for candidate fingerspelling motions which belong to the group determined in step (b), and recognizing the candidate fingerspelling motion corresponding to the Gaussian candidate model that is most similar to the acquired Gaussian model as the fingerspelling motion of the subject.

Abstract: A tactile display may comprise an array of pins that may be raised in height relative to one another to represent contours of objects in a graphic image or picture when touched. Various physical attributes may be given to individual pins to represent color or brightness. For example, pins may be heated or cooled to represent cool or warm colors in the original image. Pins may also be vibrated or otherwise enhanced to represent color or brightness information in the original image.

Abstract: A method of representing information to a person comprising displaying an image viewable by a person, the image comprising visual markers representative of portions of a human body minimally necessary to communicate with the person, the visual markers, when viewed by the person, causing the person to extrapolate the human body, a remainder of the image being visually silent with respect to the person. The method is particularly applicable to represent information so as to be perceivable by a hearing-impaired person (e.g. deaf person) wherein a plurality of images, when displayed, one after another on a display device, represent information perceivable by the hearing-impaired person via sign language.

Abstract: An apparatus for analyzing a sound signal is based on an ear model for deriving, for a number of inner hair cells, an estimate for a time-varying concentration of transmitter substance inside a cleft between an inner hair cell and an associated auditory nerve from the sound signal so that an estimated inner hair cell cleft contents map over time is obtained. This map is analyzed by means of a pitch analyzer to obtain a pitch line over time, the pitch line indicating a pitch of the sound signal for respective time instants. A rhythm analyzer is operative for analyzing envelopes of estimates for selected inner hair cells, the inner hair cells being selected in accordance with the pitch line, so that segmentation instants are obtained, wherein a segmentation instant indicates an end of the preceding note or a start of a succeeding note. Thus, a human-related and reliable sound signal analysis can be obtained.

Abstract: This invention generally relates to a communication system founded on character recognition utilizing a graphical display and method of use thereof. The invention is primarily directed to enable communication with disabled individuals in conjunction with a communication partner or receiver who manipulates a graphical display. The primary focus of the present invention is to provide a communication system that enables expeditious discovery of the sender selected series of characters, thereby permitting time-effective communications. The present invention utilizes a graphical display where characters are grouped into quadrants, chunks, or the like. The characters comprising the quadrants are further organized based on a set of character guidelines. The set of character guidelines include, but not limited to character frequency of occurrence, consonant blend considerations, and the like.

Abstract: A touch language to be used by handicapped persons, such as deaf people, blind people, and deafblind people, is provided by the present invention. A method for communicating visual images, such as those of a television program, to a handicapped person comprises the steps of providing at least one device for physically transmitting information about the visual images to the handicapped person and delivering a key word describing a portion of the visual images to the handicapped person using the at least one device.

Abstract: A 3D pin tactile device has a device housing, an imaging radar operatively installed in the device housing for detecting surface contours of the object, and an array of pins mounted in a pin mounting screen. An actuation system is adapted for moving each of the array of pins such that a head of the each of the array of pins collectively match the contours of the object. In this manner, the blind person can perceive the object by feeling the heads of the array of pins.

Abstract: A mobile terminal is used to assist individuals with disabilities. The mobile terminal (e.g., a “smartphone” or other commercially available wireless handheld device) may be loaded with software. The software may be configured to: (i) receive information about a sensory deficit associated with a user, (ii) receive information about a sensory proficiency associated with the user, (iii) determine whether an event associated with a sensory deficit satisfies a criterion, and if so (iv) provide an assistive output based on a sensory proficiency and the event.

Abstract: Embodiments of the present invention include a device and a method for providing a haptic motion feedback to user interacting with a simulated three-dimensional (“3D”) environment. In one embodiment, the device includes a base and a belt assembly, coupled to the base. The belt assembly includes a housing having an opening and a belt adapted to rotate within the housing for conveying a motion of an object moving in the simulated 3D environment. To indicate a horizontal component of object's motion, in one embodiment, the base is rotated, thus causing the belt assembly to rotate around its central axis. To indicate a vertical component of the object's motion, in one embodiment, the belt assembly is tilted. Optionally, the belt may include a plurality of protrusions and/or indentations on its surface for indicating to the user distances covered by the object within the simulated 3D environment.

Abstract: The present invention is a visual prosthesis which restores partial vision to patients blinded by outer retinal degeneration. While visual prosthesis users have achieved remarkable visual improvement to the point of reading letters and short sentences, the reading process is still fairly cumbersome. In the present invention the visual prosthesis is adapted to stimulate visual braille as a sensory substitution for reading written letters and words. The visual prosthesis system, used in the present invention, includes a 10×6 electrode array implanted epiretinally, a tiny video camera mounted on a pair of glasses, and a wearable computer that processes the video and determines the stimulation current of each electrode in real time.

Abstract: An electronic device for analyzing signal content derived from audible events, the device aiding the hearing impaired by annunciating events of interest including dangerous events. The device detects the presence of an event of interest by comparing characteristics of detected acoustic events with pre-determined reference characteristics, provides non-audible annunciators to indicate the presence of an event of interest, the type of event, and the direction from which the event is detected.

Abstract: A sign language action generating device includes: a word string input unit; a trace creation unit that extracts a sign language action data for each word of a pair of words inputted as a word string and creates a trace between an end point position of a sign language action having the same meaning as a prior word of the pair of words and a start point position thereof having the same meaning as a posterior word; an interference determination unit that determines whether or not interference is generated between parts of a robot on each trace; an action connection unit that connects sign language actions; and an action adjustment unit that adjusts a position coordinate or a velocity of the pair of words within a prescribed threshold of a shift amount or an evaluation function within which meanings of the prior word and the posterior word can be maintained.

Abstract: An approach is provided for enhancing verbal communication sessions. A verbal component of a communication session is converted into textual information. The converted textual information is scanned for a text string to trigger an application. The application is invoked to provide supplemental information about the textual information or to perform an action in response to the textual information for or on behalf of a party of the communication session. The supplemental information or a confirmation of the action is transmitted to the party.

Abstract: For providing a tactile feedback to a user of a device, textual or graphical information is converted into instructions for a sequence of pulses representing the information. An actuator is then caused to move at least a part of a display according to the obtained instructions.

Abstract: A screen reader software product including a pattern store containing at least one user-definable array of keywords relating to a subject of interest and skim reading module adapted to apply the at least one array of keywords to a target document whereby only portions of the target document matching the at least one array of keywords are output by the screen reader software to an end user.

Abstract: An electromechanical Braille cell assembly includes a plurality of parallel bimorph reeds. A first plurality of bimorph reeds is mounted to a first side of a printed circuit board by a first plurality of clips and a second plurality of bimorph reeds is mounted to a second side of the printed circuit board by a second plurality of clips. A frame has a top wall, a bottom wall, a first side wall in the form of an angle wall and a second side wall in the form of a flat wall. Pinholes are formed in the angle wall to accommodate Braille pins and the flat wall is slotted to accommodate a plurality of printed circuit boards. A monolithic cap covers all of the Braille pins. Pinholes formed in the cap receive the respective tips of the Braille cells when actuated bimorph reeds cause displacement of the Braille pins.

Abstract: A method and device for generating haptic feedback over a touch surface using plasma actuation are disclosed. A haptic device includes a touch surface, plasma, and a substrate. In one embodiment, the touch surface, which can be made of flexible and/or deformable materials, is capable of sensing one or more events. The substrate is situated adjacent to the touch surface with a separation gap, which physically separates the substrate from the touch surface. The substrate provides haptic feedback in response to the event(s). The plasma is capable of accumulating at one or more pockets located in the separation gap, and configured to facilitate the haptic feedback via energy transfer.

Abstract: In one embodiment, the invention is a haptic motion feedback mechanism. One embodiment of an apparatus for communicating motion in a virtual space includes a base and a feedback mechanism coupled to the base, the feedback mechanism using forced air to convey motion in the virtual space. In another embodiment, a method for communicating motion in a virtual space using a feedback mechanism includes receiving a signal indicative of user motion from a computing device on which the virtual space is running and forcing air through the feedback mechanism in order to convey the user motion.

Abstract: A system and method for providing learning information for visually impaired people based on a haptic electronic board is disclosed. The system for visually impaired people includes a learning information server in conjunction with a lecture and authoring program; a first information output device (PC) for receiving learning information for people with low vision from the learning information server through a wired/wireless network (LAN or WLAN) and having a viewer program for people with low vision, which is install therein, for providing functions of enlarging and reducing a screen; and a second information output device (haptic electronic board) for accessing to the learning information server through a local wireless network (ZigBee or Bluetooth) by using unique device IDs, converting learning information for blind people received from the learning information server to the haptic electronic board into haptic information, and transferring the haptic information to blind people.

Abstract: An aid for developmentally disabled individuals takes the form of a mobile terminal having software capable of creating graphical schedules, graphical countdown timers, and graphical choice selections. A caregiver may dynamically program and save schedules which present a graphical sequence of events to the disabled individual to assist the disabled individual in adjusting the changing events of the day. Likewise, the countdown timer may assist the individual in preparing for an upcoming transition in environment or activity. Still further, the graphical choice selections may help a nonverbal individual express themselves to a caregiver.

Abstract: A reading machine has processing for detecting common text between a pair of individual images. The reading machine combines the text from the pair of images into a file or data structure if common text is detected, and determines if incomplete text phrases are present in the common text. If incomplete text phrases are present, the machine signals a user to move an image input device in a direction to capture more of the text.

Abstract: The change of the status of a traffic light at a crosswalk is controlled based on an impaired individual's location with respect to the crosswalk. An appropriate alert indicating the status of the traffic light is determined based at least on the location of the impaired individual. The type of impairment may also be used in determining the appropriate alert. The appropriate alert is generated to inform the impaired individual of the status of the traffic light.

Abstract: A reflex training system operates on a computer or other processing system, having hand and foot controls for response to stimuli. The use of a computer allows the system to be portable and used in a variety of locations. The system is highly configurable and can be used for training for individuals having different needs and at different levels. The configurability relates to the types of stimuli presented to the user, the types of responses required by the user, and the characteristics of different levels. The system provides a variety of reports relating to performance so that progress can be reviewed. The system can be operated on-line to create a community of users.

Abstract: An individual that is speech impaired, such as a patient in a dentist's office, is provided with means to communicate with a service provider, such as a dentist, without the individual using their own voice. In one embodiment, a computing system initiates display of user interfaces on a display device that is visible to the speech impaired individual. The speech impaired individual may then select text phrases displayed on the display device using an input device, such as a wireless remote control. The communication systems selects one or more audio files that correspond with the selected text phrases and plays the audio file(s) so that the dentist hears the audible representation of the selected text phrase, such as via a headset that is worn by the dentist. In some embodiments, the patient is further able to select one or more educational and/or entertainment media items via the user interface.

Abstract: In some embodiments, disclosed is reading device that comprises a camera, at least one processor, and a user interface. The camera scans at least a portion of a document having text to generate a raster file. The processor processes the raster file to identify text blocks. The user interface allows a user to hierarchically navigate the text blocks when they are read to the user.

Abstract: An electromechanical Braille cell assembly includes a plurality of parallel bimorph reeds. A first plurality of bimorph reeds is mounted to a first side of a printed circuit board by a first plurality of clips and a second plurality of bimorph reeds is mounted to a second side of the printed circuit board by a second plurality of clips. A frame has a top wall, a bottom wall, a first side wall in the form of an angle wall and a second side wall in the form of a flat wall. Pinholes are formed in the angle wall to accommodate Braille pins and the flat wall is slotted to accommodate a plurality of printed circuit boards. A monolithic cap covers all of the Braille pins. Pinholes formed in the cap receive the respective tips of the Braille cells when actuated bimorph reeds cause displacement of the Braille pins.

Abstract: A method and apparatus provide feedback of facial expressions of participants during communication by capturing facial expressions of participants; extracting facial information from the captured facial expressions; transmitting the extracted facial information to communication terminals; and displaying the transmitted facial information by the communication terminals in a symbolic form.

Abstract: A method in one example has: applying, for a telephone having a plurality of number buttons having at least a nine button and a one button, a first predetermined color to the nine button and a second predetermined color to the one button, the remaining number buttons having a third predetermined color, the first, second, and third predetermined colors being three different colors; and pushing the number buttons in a sequence first predetermined color—second predetermined color—second predetermined color to dial an emergency telephone number. In one embodiment the first predetermined color may be red, and the second predetermined color may be yellow. Therefore, a 911 emergency telephone number may be dialed by pushing the number buttons in the order red-yellow-yellow.

Abstract: A user interface for software applications enables the full use of graphical user interface (GUI) software, particularly engineering design software, by visually impaired individuals. The interface combines tactile representations of graphical elements, non-visual cues, and a hardware element to allow the effective placement and interconnection of graphic elements using design software.

Abstract: A method for sending data to a sight impaired user, the method comprising, receiving data from a data resource, determining whether the data is compatible with a Symbian API, transcoding the data into a first format compatible with the Symbian API, determining whether the data is compatible with a TALKS filter, transcoding the data into a second format compatible with the TALKS filter, determining whether the data is usable by a sight impaired user, transcoding the data into a third format usable by a sight impaired user responsive to determining that the data is not usable by a sight impaired user, converting a data type definition associated with the data into a format compatible with a user profile, sending the received data to a user mobile device, wherein the mobile device is operative to convert the data into an audible output.

Abstract: A psychological testing and treatment system according to the present disclosure employs a computer to provide objective, unbiased language, independent interaction with users to circumvent natural human psychological defenses and gather information about traumatic or troubling events of the user. A user's interaction with relevant icons permits the computer to gather data to permit diagnosis and treatment. At the same time, the system enables the extraction, archiving and measurement of this data from the user. Subsequent and consequent to this communication via the system, the disturbance in the user is ameliorated to a degree by virtue of the interaction.

Abstract: A wayfinding device is provided for giving directions to a desired destination within a building having a plurality of wayfinding beacons configured to transmit data using an ultrasound signal. The ultrasound signal can include a plurality of bursts, wherein a sequence of predefined time intervals between consecutive bursts within the plurality of bursts uniquely identifies each wayfinding beacon. The wayfinding device is separate from the wayfinding beacons and includes a wayfinding beacon recognition component configured to identify a wayfinding beacon when the device receives the data through the ultrasound signal from a wayfinding beacon. The device is further programmed to provide directions to a user of the device in a direction toward the desired destination in response to identifying a wayfinding beacon.

Abstract: Methods and apparatuses to provide improved Braille support are described herein. A connection to a Braille device is received, and a Braille caption panel that includes a Braille code is displayed to simulate an output to the Braille device. The Braille caption panel can include a text translated to the Braille code. The Braille caption panel can include a control element. An accessibility service can be automatically launched to provide the output to the Braille device.

Abstract: A system and method for facilitating conversation. In particular, the system discloses a handheld device suitable for use in engaging conversation. The device includes a data store for storing a plurality of conversation starters. The plurality of conversation starters is associated with a theme. The device includes a selector that is associated with a subset of the plurality of conversation starters. The subset defines a category of conversation starters consistent with the theme. The device includes a processor configured to receive and acknowledge activation of the selector. Upon activation, the processor selects a conversation starter of the subset of the plurality of conversation starters, as a selected conversation starter. A communicator, such as a speaker, is included for presenting the selected conversation starter.

Abstract: A reading device for blind or visually impaired persons for recognizing and reading text passages comprises an image capturing unit being configured to capture an image of an environment of a blind or visually impaired person and to output image data corresponding thereto, an image processing unit being configured to process the image data such that text is recognized and extracted from the image data and to output text data corresponding thereto, a text outputting unit being configured to output data corresponding to the text data in a form noticeable or convertable to be noticeable by the blind or visually impaired person, and a housing comprising a first part and a second part, the first part having the image capturing unit attached thereto and the second part accommodating the image processing unit and the text outputting unit.

Abstract: An individual that is speech impaired, such as a patient in a dentist's office, is provided with means to communicate with a service provider, such as a dentist, without the individual using their own voice. In one embodiment, a computing system initiates display of user interfaces on a display device that is visible to the speech impaired individual. The speech impaired individual may then select text phrases displayed on the display device using an input device, such as a wireless remote control. The communication systems selects one or more audio files that correspond with the selected text phrases and plays the audio file(s) so that the dentist hears the audible representation of the selected text phrase, such as via a headset that is worn by the dentist. In some embodiments, the patient is further able to select one or more educational and/or entertainment media items via the user interface.

Abstract: A laptop computer, a system and/or a method for using the same are provided. The laptop computer, the system and/or the method has a monitor, input boards, a base, an intelligent pen and a headset. The monitor has a screen, a magnetic pen guidance system, an on/off switch for the magnetic pen guidance system, a taskbar area, braille signs and compartments for storing the input boards. The input boards may be, for example, a braille board, a standard keyboard, and/or a geometry board. The base may have a receiving surface, permanent input keys, permanent braille keys, speakers and a holder for the intelligent pen. The speakers and/or the headset may provide the user with audio feedback.

Abstract: An apparatus for providing information about a physical surrounding environment to a user includes an elongate body having first and second opposing ends and a mast, at least one sensor mountably coupled to the mast, at least one dual purpose, bi-directional haptic force feedback device including first and second haptic force feedback mechanisms and a vibrator, and a processor, which receives signals from the at least one sensor and operatively controls the at least one dual purpose, bi-directional haptic force feedback device.