Abstract: Disclosed is a method comprising the steps of: receiving an input of content motion data included in VR content; transmitting, to a motion device, motion control data corresponding to the input content motion data to control movement of the motion device; receiving, from a predetermined sensing apparatus, motion detection data corresponding to a movement state of the motion device; selecting a motion sickness-causing section by using a difference between the motion control data and the motion detection data; generating final motion control data according to a preset algorithm such that the level of motion sickness in the selected motion sickness-causing section is minimized during a preset content reproduction section, and storing the generated final motion control data; and when 3D VR content is reproduced, transmitting, to the motion device, the final motion control data stored in the previous step so as to control the movement of the motion device.

Abstract: An apparatus to analyze and manipulate biofeedback data is described. The apparatus includes a display that renders a simulated environment. The simulated environment is experienced by a user. The simulated environment is generated by a software program executing on a computer. A biofeedback sensor is coupled to the scalp of the user. The biofeedback sensor measures the electrical activity of the brain of the user when the user experiences the simulated environment. The biofeedback sensor generates electrical signals corresponding to the electrical activity such that the user is able to modify the simulated environment by manipulating the electrical activity in the brain.

Abstract: The technology disclosed introduces two types of neural networks: “master” or “generalists” networks and “expert” or “specialists” networks. Both, master networks and expert networks, are fully connected neural networks that take a feature vector of an input hand image and produce a prediction of the hand pose. Master networks and expert networks differ from each other based on the data on which they are trained. In particular, master networks are trained on the entire data set. In contrast, expert networks are trained only on a subset of the entire dataset. In regards to the hand poses, master networks are trained on the input image data representing all available hand poses comprising the training data (including both real and simulated hand images).

Abstract: A convenient device control apparatus for a vehicle and a method thereof are provided. The convenient device control apparatus includes a light source that emits light at a specified frequency and an electroencephalogram (EEG) sensor that measures an EEG signal of a user. An EEG analyzer analyzes a frequency of the EEG signal measured by the EEG sensor and a controller operates a convenient device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.

Abstract: The present disclosure includes generally relates to scrolling and selecting items. An electronic device having a display and a touch-sensitive surface displays a user interface with a list of items. The items can be scrolled and selected using different techniques. Some embodiments include a technique for entering an edit mode to select and scroll items on the user interface. Some embodiments include a technique for scrolling to select items on the user interface. Some embodiments include a technique for displaying a scroll progress indicator for scrolling items on the user interface.

Abstract: Movement information indicating movement of the display device is obtained, and a warning is notified when the movement information is information indicating a sickness-inducing movement set in advance as movement likely to induce motion sickness.

Abstract: The present disclosure provides a method, an apparatus, a device and a system for sign language translation, where a server receives video information sent by a terminal device, and preprocesses the video information to obtain at least one sign language action; the at least one sign language action is input into a sign language model for classification and prediction to obtain a word corresponding to the at least one sign language action; each word is input into a language model to determine whether an intention expression is complete; and each word is sent to the terminal device when the intention expression is complete, so that the terminal device displays each word, thereby realizing the translation of the sign language action into text, enabling the ordinary persons to better understand intentions of the hearing impaired, thus improving efficiency of communications.

Abstract: A method is provided, performed by a wearable computing device comprising at least one bio-signal measuring sensor, the at least one bio-signal measuring sensor including at least one brainwave sensor, comprising: acquiring at least one bio-signal measurement from a user using the at least one bio-signal measuring sensor, the at least one bio-signal measurement comprising at least one brainwave state measurement; processing the at least one bio-signal measurement, including at least the at least one brainwave state measurement, in accordance with a profile associated with the user; determining a correspondence between the processed at least one bio-signal measurement and at least one predefined device control action; and in accordance with the correspondence determination, controlling operation of at least one component of the wearable computing device, such as modifying content displayed on a display of the wearable computing device.

Abstract: Video relay services, communication systems, non-transitory machine-readable storage media, and methods are disclosed herein. A video relay service may include at least one server configured to receive a video stream including sign language content from a video communication device during a real-time communication session. The server may also be configured to automatically translate the sign language content into a verbal language translation during the real-time communication session without assistance of a human sign language interpreter. Further, the server may be configured to transmit the verbal language translation during the real-time communication session.

Abstract: An automated teller machine includes a camera, a memory, and a hardware processor. The camera captures video data from a user, including at least one hand movement. The processor receives the video data from the camera and splits it into a sequence of images. The processor then splits each image into a set of features and forms vectors from the features. The processor uses the vectors to determine if each image belongs to a subset of images corresponding to a motionless sign-language pattern, or to a subset of images corresponding to a moving sign-language pattern. The processor stores the words and/or phrases assigned to each identified sign-language pattern in an input phrase. The processor determines that the input phrase represents a user request and then processes the request.

Abstract: A natural language processing apparatus configured to analyze a plurality of natural language elements, includes processing configured to input for each natural language element, multiple sign language images for a certain natural language together with the respective natural language, extract multiple feature points of a first sign language motion from the input sign language images and analyze a common point or a differing point between the first sign language motion and a second sign language motion, for each of the extracted feature points, deduce semantic content of the natural language element from the analyzed common point or the differing point, and a storage configured to store in association with the natural language element, information regarding the deduced semantic content. The processing circuitry analyzes the natural language using an artificial intelligence algorithm.

Abstract: The invention proposes a wearable device. The wearable device includes an information capturing device and a processing device. The information capturing device is configured to dynamically capture a plurality of partial detected object information of a detected object in a sub-action of a dynamic event. The processing device is coupled to the information capturing device. The processing device is configured to perform an accumulation operation according to the plurality of partial detected object information, so as to obtain a plurality of location information corresponding to the sub-action of the dynamic event. The processing device compares the plurality of location information in the sub-action of the dynamic event with the plurality of location information in a previous sub-action, so as to obtain a sub-object distribution information corresponding to the sub-action of the dynamic event. In addition, a dynamic event recording system and a dynamic event recording method thereof are also provided.

Abstract: A visualization and analysis tool is provided for an insulin delivery system, such as an artificial pancreas, in which insulin is delivered based upon a system algorithm using a pump that is patient controllable in order to adjust insulin delivery relative to a baseline delivery rate; e.g., pre-set basal rate and a sensor for measuring glucose levels. The tool is configured with a controller of the system to detect and log events that are based on differences between actual insulin delivered by the system and the baseline delivery rate. These detected events are metrics that provide information relating to the therapeutic value of the system which, without such metrics, may be overlooked or unnoticed, thereby fostering trust and confidence in the delivery system. In addition, information is provided which may enable further improved glucose control.

Abstract: An electronic apparatus, a method, and computer-readable medium are disclosed. The electronic apparatus includes a communicator, a display, and a processor. The communicator is configured to obtain a brainwave signal. The processor is configured to display on the display a character input window and a keyboard UI including a plurality of character keys. The processor is also configured to identify a character key to input to the character input window from the plurality of character keys based on at least one channel signal from the obtained brain wave signal. The channel signal includes a F7 channel, a F8 channel, and an AF3 channel. The processor is also configured to display a character corresponding to the identified character key to the character input window.

Abstract: A system and method for remotely and accurately generating a 3D model of a complex object is provided through the use of laser scan data and a plurality of overlapping images taken of the complex object. To generate the 3D model first, second, and third 3D point clouds may be derived from laser scan data obtained from one or more LiDAR scanners at a first, second, and, third location, respectively, near a complex object. A fourth 3D point cloud of a first portion of the complex object may be derived from a plurality of overlapping images, wherein at least a section of the first portion of the complex object is partially or wholly occluded. The first, second, third, and fourth 3D point clouds may be combined into a single 3D point cloud and a 3D model of the complex object may be generated from the single 3D point cloud.

Abstract: A head-mounted display (HMD) system includes an HMD device worn on a head of a user. The HMD device incorporates electroencephalography (EEG) interfaces for monitoring the brain of the human subject during interaction with the HMD device. Fluctuations in electrical potential that are observed via the EEG interfaces may be used to detect event-related potentials (ERPs). The HMD system may programmatically perform one or more operations in response to detecting ERPs.

Abstract: Described are techniques for enabling pointer devices to be used by users with vision impairment to interact with rendered content. Sounds may be output to a user to indicate the presence of one or more features within rendered content. Characteristics of the sounds may be used to indicate the position of the features within a user interface, the distance between the features and a pointer associated with a pointer device, and the direction of the features relative to the pointer. Sounds may also be used to indicate the type or size of rendered content. Responsive to the sounds, a user with impaired vision may manipulate the pointer device to reposition the pointer. Additional or modified sounds may be provided to the user based on the subsequent position of the pointer.

Abstract: A sign language recognizer is configured to detect interest points in an extracted sign language feature, wherein the interest points are localized in space and time in each image acquired from a plurality of frames of a sign language video; apply a filter to determine one or more extrema of a central region of the interest points; associate features with each interest point using a neighboring pixel function; cluster a group of extracted sign language features from the images based on a similarity between the extracted sign language features; represent each image by a histogram of visual words corresponding to the respective image to generate a code book; train a classifier to classify each extracted sign language feature using the code book; detect a posture in each frame of the sign language video using the trained classifier; and construct a sign gesture based on the detected postures.

Abstract: A sign language recognizer is configured to detect interest points in an extracted sign language feature, wherein the interest points are localized in space and time in each image acquired from a plurality of frames of a sign language video; apply a filter to determine one or more extrema of a central region of the interest points; associate features with each interest point using a neighboring pixel function; cluster a group of extracted sign language features from the images based on a similarity between the extracted sign language features; represent each image by a histogram of visual words corresponding to the respective image to generate a code book; train a classifier to classify each extracted sign language feature using the code book; detect a posture in each frame of the sign language video using the trained classifier; and construct a sign gesture based on the detected postures.

Abstract: In one example, a magnification display system may alert a user to event notifications that are presented outside the magnification area. The magnification display system may apply a magnification area with a magnification module to a section of a viewing area presented by a display. The magnification display system may receive an event notification outside the magnification area. The magnification display system may introduce a notification indication alerting a user to the event notification.

Abstract: A method, a virtual reality apparatus and a recording medium for displaying fast moving frames of virtual reality are provided. The method is adapted to a virtual reality apparatus including a head-mounted display (HMD), a locator and a computing device. In the method, the computing device executes an application of virtual reality, and displays frames of the application on the HMD. When fast moving of the frames of the application is about to be occurred, the computing device prompts the fast moving to guide a user wearing the HMD to turn a line of sight to a direction of gravity, and then fast moves a field of view of the frames to the direction of gravity.

Abstract: A sign language recognizer is configured to detect interest points in an extracted sign language feature, wherein the interest points are localized in space and time in each image acquired from a plurality of frames of a sign language video; apply a filter to determine one or more extrema of a central region of the interest points; associate features with each interest point using a neighboring pixel function; cluster a group of extracted sign language features from the images based on a similarity between the extracted sign language features; represent each image by a histogram of visual words corresponding to the respective image to generate a code book; train a classifier to classify each extracted sign language feature using the code book; detect a posture in each frame of the sign language video using the trained classifier; and construct a sign gesture based on the detected postures.

Abstract: A sign language recognizer is configured to detect interest points in an extracted sign language feature, wherein the interest points are localized in space and time in each image acquired from a plurality of frames of a sign language video; apply a filter to determine one or more extrema of a central region of the interest points; associate features with each interest point using a neighboring pixel function; cluster a group of extracted sign language features from the images based on a similarity between the extracted sign language features; represent each image by a histogram of visual words corresponding to the respective image to generate a code book; train a classifier to classify each extracted sign language feature using the code book; detect a posture in each frame of the sign language video using the trained classifier; and construct a sign gesture based on the detected postures.

Abstract: Provided is an apparatus for bi-directional sign language/speech translation in real time and method that may automatically translate a sign into a speech or a speech into a sign in real time by separately performing an operation of recognizing a speech externally made through a microphone and outputting a sign corresponding to the speech, and an operation of recognizing a sign sensed through a camera and outputting a speech corresponding to the sign.

Abstract: An eye lens worn on a user's cornea monitors deformations of the cornea. The eye lens includes a substrate and at least one deformation sensor secured to the substrate. The deformation sensor is configured to monitor the curvature of cornea and any deformations, convert the deformations into digital signals, and transmit the digital signals out. A cornea monitoring system using the eye lens is also provided.

Abstract: Systems and methods for authorizing a user of a portable communications device entail sampling a user utterance via both an air mic (audio mic) and a conduction mic (surface mic or bone conduction mic). The difference between these signals is unique to each user since the tissues of each user will differ with respect to audio conduction. This difference may be characterized via a transform including magnitude, phase and time delay components. If the transform for a prospective user matches a stored transform for an authorized user, then the prospective user may be granted access.

Abstract: A sign language recognizer is configured to detect interest points in an extracted sign language feature, wherein the interest points are localized in space and time in each image acquired from a plurality of frames of a sign language video; apply a filter to determine one or more extrema of a central region of the interest points; associate features with each interest point using a neighboring pixel function; cluster a group of extracted sign language features from the images based on a similarity between the extracted sign language features; represent each image by a histogram of visual words corresponding to the respective image to generate a code book; train a classifier to classify each extracted sign language feature using the code book; detect a posture in each frame of the sign language video using the trained classifier; and construct a sign gesture based on the detected postures.

Abstract: A sensor system and method for determining if an environment is provocative, measuring a human response to this environment, and controlling a vehicle or device is disclosed. The system and method comprise a human head-worn unit with an orientation sensing element, a head-attachable display comprising a first image not responsive to pitch and roll and a display element responsive to the orientation sensing element. The system and method also comprises at least one human response sensor such as a galvanic skin response sensor, a blood pressure sensor, or an electroencephalograph. The system and method further comprise an algorithm that computes a signal that is a measure of the condition of the human based on input from the orientation sensing element and the human response sensor or sensors. The system and method also comprise an electronic interface configured for transmitting the human physical condition signal.

Abstract: An audio adaptor and method of communication is provided. The audio adaptor includes a first connector for connecting to a source of audio, a second connector for connecting to a telephone, a third connector for connecting to an audio output device, and a microcontroller. The method involves receiving a first audio signal at a line level from the source of audio, receiving a second audio signal at the line level from a telephone, transmitting the first audio signal and the second audio signal at the line level to an audio output device, attenuating the first audio signal from the line level to a microphone level and transmitting the attenuated first audio signal.

Abstract: An integrated and reactive music control system designed for silencing music in an operating room during critical events. The preferred system contains a music input, a hardware interface to integrate real-time patient physiologic data, a software application to process the data, a user interface, and a music output, any portion or all of which may be hardwired or wireless. Through the user interface, medical personnel may adjust pre-set limits on physiologic parameters that indicate abnormality or risk to a particular patient. To reduce ambient noise pollution and permit communication and concentration of the surgical team, volume is reduced as a patient's condition deteriorates. Resulting in additional safety to patients in the operating room, the cessation of music may capture the attention of health care professionals who suffer from alarm desensitization. The system's integration includes an anesthesia monitor, but may extend to include a hospital data server and EMR systems.

Abstract: According to one or more aspects of the present disclosure operations related to performing captioning may include receiving, from a first user device, first audio data. The operations may further include directing the first audio data to a remotely located call-assistant device and receiving, from the call-assistant device, second audio data that is related to the first audio data and that is derived from speech of a call assistant. The operations may also include accessing, with a captioning software application, voice profile data of the call assistant and generating caption data that includes a transcription of the second audio data. The operations may also include generating, based on the transcription, screen data related to the captioning software application, in which the screen data includes the transcription. In addition, the operations may include directing the screen data to the call-assistant device and directing the caption data to the first user device.

Abstract: A multiple media module receives data indicating a status of a tab of a graphical user interface (GUI) presented on a user device. The multiple media module determines, based on the data indicating the status of the tab, whether the tab is active, the tab comprising a streaming media player. If the tab of the web browser is not active, the multiple media module mutes an audio component of a streaming media file playing in the streaming media player.

Abstract: An operation input unit detects an operation position corresponding to an operation input; a display processing unit changes a display item to be displayed on a display unit of a plurality of items, depending on a change of the operation position; a processing control unit continues a process of changing the display item to be displayed on the display unit until a predetermined input is received, while a vehicle is moving, and when an operation speed of moving the operation position is higher than a preset threshold of the operation speed, or an operation acceleration at which the operation speed changes is higher than a preset threshold of the operation acceleration; and an item selecting unit selects any of the plurality of items based on the predetermined input.

Abstract: In one aspect, there is provided an embodiment of a calibration system for use with a vision tester having a display. In this particular embodiment, the calibration system comprises a calibration stand and a reflective surface. The calibration stand is configured to hold the vision tester. The reflective surface is coupled to the calibration stand and is oriented substantially parallel to the display. The calibration stand is configured to hold the display of the vision tester at a fixed distance from the reflective surface.

Abstract: A system and method for communicating a pre-stored emergency message from a TTY to a PSAP may include, in response to receiving an emergency call signal, accessing a pre-stored emergency message stored in a memory. A PSAP may be dialed. In one embodiment, the PSAP may be dialed by the user dialing 911 or the TTY may automatically dial 911 in response to the user selecting a hard or soft-button associated with communicating an emergency message to a PSAP. The pre-stored emergency message may be communicated to a PSAP using a TTY communications protocol. A TTY compatible device utilized by a PSAP operator may be configured to provide the PSAP operator with pre-stored messages available for selection and communication to the emergency caller. By providing pre-stored messages on TTY devices, emergency communications between users of the TTY devices may be expedited, thereby potentially saving lives.

Abstract: With a sign language computer interface, a user may perform one or more gestures in accordance with a recognized sign language, and have the gestures translated into information or instructions for use by one or more computers. Such interfaces may capture video imagery of a user performing gestures using one or more cameras, sense the gestures expressed in the video imagery, search a library for phrases corresponding to the gestures, and display one or more of the phrases to the user, who may indicate whether the phrases are consistent with his or her intended communication. The interfaces permit a user to communicate with computer-based systems the exclusive use of gestures, and without a single keystroke or mouse click.

Abstract: An image sensor can have a first orientation. If the first orientation differs from a second orientation, values can be read from the image sensor in a manner so as to generate image data having the second orientation.

Abstract: An apparatus for use in a verbal communication between a speaker and at least one listener, where the speaker and the at least one listener are spatially separate from each other, the apparatus provides the listener with a sensory output associated with the identity of the speaker, the apparatus including an identification device including a vibration sensor for detecting vibrations associated with speech of the speaker, is configured to store identification data representative of the identity of the speaker or the identification device, is associable with the identity of the speaker, and, in response to detecting vibrations, transmits an identification signal comprising or generated from the stored identification data, and a display device operable to receive the identification signal and to generate from the received identification signal a sensory output indicating the identity of either or both of the speaker and the identification device.

Abstract: An haptic interface including a knob manipulated by a user, a rotation shaft with a longitudinal axis to which the knob is fixed in rotation, an interaction element with a magneto-rheological fluid in rotation with the shaft, the fluid, a system for generating a magnetic field in the fluid, and a control unit capable of generating orders to the system for generating the magnetic field to modify the magnetic field. The system includes a coil type mechanism generating a variable magnetic field, and a permanent magnet type mechanism generating a permanent magnetic field.

Abstract: Systems and methods for communicating emergency alerts to a hearing-impaired user are disclosed. Queries are performed to one or more emergency alert databases to develop emergency alert notifications. At least some of the emergency alert notifications are filtered responsive to user selected criteria to select one or more filtered emergency alerts. An attention desired indicator is transmitted to a hearing-impaired user device that subscribes to a hearing-impaired relay service supported by the server if the one or more filtered emergency alerts are present. The filtered emergency alerts are transmitted to the hearing-impaired user device in response to a emergency information query from that user device.

Abstract: Methods and systems are provided herein for reducing or eliminating motion sickness in users of devices, such as mobile devices, in a variety of environments, including methods and systems for sensing motion in the user's environment and providing feedback that encourages a user to orient in a motion-reducing manner.

Abstract: A method for visual indication of the function of wireless receivers where a wireless signal is transmitted to a group of receivers, and where each receiver intermittently flashes a visual indicator when a wireless signal is received, whereby the intermittence and flashing of the visual indicators of the receivers are synchronized.

Abstract: An out of product indicator is provided. The out of product indicator includes a power generator, a sensor and an alarm. The power generator is configured to generate power based on an interaction with at least one aspect of the device it is coupled thereto. The sensor is configured to determine when a product is low. The alarm is coupled to receive power generated by the power generator. Moreover the alarm is activated based on an output of the sensor.

Abstract: Embodiments of the present invention include a device and a method for providing a haptic motion feedback to user interacting with a simulated three-dimensional (“3D”) environment. In one embodiment, the device includes a base and a belt assembly, coupled to the base. The belt assembly includes a housing having an opening and a belt adapted to rotate within the housing for conveying a motion of an object moving in the simulated 3D environment. To indicate a horizontal component of object's motion, in one embodiment, the base is rotated, thus causing the belt assembly to rotate around its central axis. To indicate a vertical component of the object's motion, in one embodiment, the belt assembly is tilted. Optionally, the belt may include a plurality of protrusions and/or indentations on its surface for indicating to the user distances covered by the object within the simulated 3D environment.

Abstract: A computerized method for inputting numbers 0-9 using a communication device, the communication device includes an input unit defining a touch sensitive circular guideway thereon configured for inputting the numbers 0-9. The circular guideway is divided into a plurality of identical segments. A movement distance of a slide action applied on the circular guideway along a predetermined direction from a predetermined starting point on the circular guideway is detected. An inputted number is determined according to the movement distance of the slide action and a length of each of the segments, when the slide action on the circular guideway is completed.

Abstract: A remote control system of the present invention is provided with a TV apparatus and a remote controller, and performs two-way communication. The remote controller is provided with a microphone and a speaker, and generates and outputs sound source data. Furthermore, by the use of wireless communication modules, the sound source data produced by the remote controller is transmitted to the TV apparatus, and the sound source data is transmitted from the TV apparatus to the remote controller, that is, the sound source data is exchanged, with the result that the sound source data is outputted from the TV apparatus and the remote controller.

Abstract: A system which uses movement of a human body to control a function of a terminal comprises: a detecting device for detecting variation of the movement of the human body depending on an intention of a user so as to transmit a detection signal; and a terminal for storing a reference signal according to at least one class of movement and a control signal corresponding to the reference signal, for searching for a reference signal the same as the detection signal received from the detecting device, and for processing a function based on the control signal corresponding to the reference signal when the reference signal the same as the detection signal is identified. Thereby, a user not only controls the terminal or a driving device, but also performs authentication processing using simple movement of his/her body without any hand operation. A corresponding method for controlling a function using movement of the human body is disclosed.

Abstract: This disclosure relates to a vibrotactile mobile device which induces a tactile sense at various positions in an interface method of operating the mobile device so that a user may intuitively interact with the mobile device while seeing a program execution status, and to a method of driving the vibrotactile mobile device. The method of driving the vibrotactile mobile device includes: providing a user interface for inputting a command signal on a screen operated in accordance with a program; calculating a target vibration position and a direction and a speed of a vibration flow with time so as to recognize a trajectory of the command signal displayed on the screen and supply a vibration stimulus corresponding to the trajectory of the command signal; and driving the vibration module by controlling a supply of power to be applied to vibration modules based on the calculated result.

Abstract: A control device for a vehicle or mechanism includes a portable displacement controller which permits a non-technical user to achieve effective control of the vehicle or mechanism, by moving the portable displacement controller intuitively with little learning effort. A first sensing device, attached to the displacement controller, detects the user's controlling motion. A second sensing device, attached to the object being controlled, detects motion thereof. An interface device receives signals from the sensing devices, processes those signals to determine relative motion of the controlling motion and the object's motion and outputs a control signal in accordance with the processed signals. The sensing devices each detect motion in six degrees of freedom; the sensing devices each include a three-axis accelerometer, a three-axis gyroscope, and a three-axis magnetometer. In specific embodiments, the accelerometers, gyroscopes, and magnetometers include micro-electromechanical system (MEMS) devices.