Abstract: A telepresence robot includes a mobile platform, a camera, and a computer in communication with the platform and the camera. The computer receives video information from a remotely located camera relating to a gesture made by a remote human operator, and the robot is configured to operate based on the gesture. The computer may further predict an emotional state of a person interacting with the robot, based on video information received from the robot camera. A telepresence robot system includes: a telepresence robot having a mobile platform, a robot camera, a robot display, and a robot computer; and a control station, located remote to the robot, having a control station camera, a control station display, and a control station computer.

Abstract: An electronic apparatus and a control method thereof are provided, which displays first voice guide information indicating voice commands available to control the electronic apparatus, and if a command to control an external device connected to the electronic apparatus is received, changes the first voice guide information and displays second voice guide information to indicating voice commands available to control the external device.

Abstract: With a vehicle-mounted equipment operating device, upon receipt of an input from an operator by an operation input unit, and when any one of a plurality of vehicle-mounted instruments, for example, an air conditioner, exists on a line of sight of the operator, a control unit sets the vehicle-mounted instrument that exists on the line of sight as an operation target device, and thereafter, the control unit controls the operation target device based on the input of the operator that has been received by the operation input unit.

Abstract: The present disclosure provides an information processing method and an electronic device. The information processing method is applied in an electronic device comprising or being connected to a display unit.

Abstract: Methods for enabling hands-free selection of objects within an augmented reality environment are described. In some embodiments, an object may be selected by an end user of a head-mounted display device (HMD) based on detecting a vestibulo-ocular reflex (VOR) with the end user's eyes while the end user is gazing at the object and performing a particular head movement for selecting the object. The object selected may comprise a real object or a virtual object. The end user may select the object by gazing at the object for a first time period and then performing a particular head movement in which the VOR is detected for one or both of the end user's eyes. In one embodiment, the particular head movement may involve the end user moving their head away from a direction of the object at a particular head speed while gazing at the object.

Abstract: The subject disclosure is generally directed towards eye gaze detection based upon both eyes being fixated on the same gaze location. In one aspect, an image including a subject's left and right eyes is captured, from which left and right glint and pupil center information are extracted. The left and right glint data and the left and right pupil data are used with left and right bias correction matrices to jointly determine a gaze location.

Abstract: Systems and methods for presenting actual data on a display device based on eye-tracking data. An eye-tracking engine receives sensed data from an eye-tracking device, determines a movement status of an eye based on the sensed data, and determines a display configuration based on the determined movement status. The display configuration is output on the display device and includes masking data when the determined movement status indicates the eye is in motion.

Abstract: A method of controlling an electronic device having a transparent display. The method includes controlling the electronic device to provide a first image through an optical display mode operation of the transparent display in which light incident from an object is transmitted, controlling the electronic device to acquire a second image through a video display mode operation of the transparent display in which an image captured from the object is displayed, and selectively displaying the first and second images using the transparent display by a mixing, by the electronic device, of the first and second images. The mixing may be dependent on a distance between the electronic device and the object or a display ratio between the first and second images. An image for an object may be displayed in a region of interest and an image for another object in a remaining region.

Abstract: Methods, systems, and devices are disclosed for optical sensing and tracking of eye movement. In one aspect, a device for obtaining a user's eye dynamics data includes a display screen to present at least one content. The device includes an eye sensing module to obtain the user's eye dynamics data including the user's eye movement while presenting to the user the at least one content on the display screen. The device includes a processor in communication with the eye sensing module. The processor can determine the user's reaction to the at least one content presented on the display screen based at least partly on the obtained user's eye dynamics data.

Abstract: A dynamic tactile interface including a tactile layer defining a first region and a deformable region adjacent the first region; a substrate coupled to the tactile layer at the first region, defining a variable volume adjacent the deformable region and defining a fluid channel fluidly coupled to the variable volume; a set of rigid structures distributed across the tactile layer defining an anti-reflective coating over the tactile layer; and a displacement device fluidly coupled to the fluid channel, the displacement device displacing fluid into the fluid channel to transition the deformable region from a retracted setting to an expanded setting, the deformable region tactilely distinguishable from the first region in the expanded setting, the set of rigid structures conforming to the tactile layer, each rigid structure in the set of rigid structures shifting relative to an adjacent rigid structure in the set of rigid structures.

Abstract: A drive control apparatus includes a storage storing first or second waveform data representing a drive signal, and a drive controller reading the first or the second waveform data, and output the drive signal to the actuator. The first waveform data applying vibration m×Q times (Q is a natural number other than 0) and obtained by multiplying a sine wave (f1=(m/n)×f0 (m and n are mutually different natural numbers other than 0)) by a damping ratio of a vibration system to an actuator, and the second waveform data applying a vibration (m/2)×Q times (Q is a natural number other than 0) and obtained by multiplying a sine wave (a frequency f1=(m/n)×f0 (m and n are mutually different positive odd numbers)) by the damping ratio to the actuator, where f0 represents a resonant frequency of the actuator.

Abstract: An electronic device can be enhanced to enable its user to navigate about and view, on the device's display, different portions of a page or document while the device remains in a zoomed-in mode that magnifies the portion of the document that the device is currently displaying. Upon entering the zoomed-in mode, the device can magnify a portion of the document on the display. While in this mode, the device can react to user-produced gestures in a manner that is different to the manner in which the device would react to the same gestures otherwise. Responsive to user-produced gestures while in the zoomed-in mode, the device can navigate to other portions of the document while remaining in the zoomed-in mode, so that those other portions are also presented magnified. The device's user is not forced to first zoom-out from one document portion in order to zoom-in on another document portion.

Abstract: A gesture detection system according to embodiments includes an input device including a touch sensitive surface and a contact-free detection system; and a controller configured to determine characteristic parameters for the position in three-dimensional space of a user input object and select an operational mode of the input device based on the position of the user input object.

Abstract: The description relates to 3D gesture recognition. One example gesture recognition system can include a gesture detection assembly. The gesture detection assembly can include a sensor cell array and a controller that can send signals at different frequencies to individual sensor cells of the sensor cell array. The example gesture recognition system can also include a gesture recognition component that can determine parameters of an object proximate the sensor cell array from responses of the individual sensor cells to the signals at the different frequencies, and can identify a gesture performed by the object using the parameters.

Abstract: Tracking hand or body pose from image data is described, for example, to control a game system, natural user interface or for augmented reality. In various examples a prediction engine takes a single frame of image data and predicts a distribution over a pose of a hand or body depicted in the image data. In examples, a stochastic optimizer has a pool of candidate poses of the hand or body which it iteratively refines, and samples from the predicted distribution are used to replace some candidate poses in the pool. In some examples a best candidate pose from the pool is selected as the current tracked pose and the selection processes uses a 3D model of the hand or body.

Abstract: There is provided an information processing apparatus according to the present invention including a detection unit for detecting a moving direction and a moving amount of a finger on an operation panel, and a moving control unit for changing the moving amount of an object on a display unit for a finger's unit moving amount depending on the moving direction of the finger which moves the object displayed on the display unit. According to the present invention, the moving amount of the object within a display region changes based on the moving direction of the finger to be operated on the operation panel. In this manner, the object moving amount is corrected depending on the finger moving direction, thereby eliminating the factors for reducing the operability during the object moving operation and improving the operability.

Abstract: In an image projection device in which a projected image can be controlled or operated by gesture, the responsiveness (operability) and/or the usability are improved. The image projection device includes a sensor element to detect a gesture and a control section to generated an operation signal to control (for example, to scroll images or to feed image frames) a projected image projected according to a gesture detected by the sensor element, wherein the control section generates the operation signal when the sensor element detects a gesture in a first direction parallel to the projection surface of the projected image, and when the sensor element detects a gesture in a second direction perpendicular to the projection surface, the control section suspends generation of the operation signal.

Abstract: There is provided an electronic device including a plurality of sensing devices and a host. The sensing devices are connected in parallel or series. A part of the sensing devices and the host may remain in a power saving mode or a standby mode in operation so as to reduce the power consumption.

Abstract: A method and a system for generating user feedback of a gesture capturing device with content projection capability are provided herein. The method may include the following steps: projecting content, by a content projector, onto a projection surface; projecting patterned light, by a pattern projector, onto said projection surface and onto a maneuverable object controlled by a user; capturing reflections of the patterned light coming from said projection surface and said maneuverable object; calculating, based on said reflections, at least one of: a relative position and a relative orientation of at least two of: said projection surface, said maneuverable object, said content projector and said pattern projector; and generating a feedback, based on said calculated relative positions and/or orientations, wherein said feedback relates to a proper operation of the system, based on said relative position and a relative orientation, in view of predefined criteria.

Abstract: Methods and systems for processing input from an image-capture device for gesture-recognition. The method further includes computationally interpreting user gestures in accordance with a first mode of operation; analyzing the path of movement of an object to determine an intent of a user to change modes of operation; and, upon determining an intent of the user to change modes of operation, subsequently interpreting user gestures in accordance with the second mode of operation.

Abstract: An information processing device is disclosed. The information processing device includes an inclination detection unit configured to generate a first signal regarding inclination of the device. The information processing device also includes a display processing unit configured to, based on the first signal, generate a second signal to initiate a change in orientation of a display of content, and generate a third signal to cancel the change in orientation in response to receipt of a CANCEL command after initiation of the change.

Abstract: A user interface or control includes a cushion-type support member and a user input member that is interconnected with and carried by the support member. The support member defines an upwardly facing recess, and the input member may be a user interface or control device that is contained within the upwardly facing recess. The support member may be formed to surround the recess about the user interface or control device. The support member may include an air vent that vents air exhausted from the user interface or control device. The user interface or control device may be a laptop computer having a body including a keyboard contained within the recess, and a screen carried by the body. The user interface or control device may alternatively be an electronic input member having an upwardly facing screen, a convertible input member movably mounted to a mounting member, or a game controller.

Abstract: A safety navigation device and an executing method thereof in the present disclosure are based on an integrated circuit module and a server for safety certification. According to an algorithm or instantaneous time, the integrated circuit module which is electrically connected to electronic equipment creates an IP address, controlling the electronic equipment to enable the IP address via a virtual keypad. Then, the dominating server in which a certification mechanism is installed will check validity of the IP address and issues corresponding information.

Abstract: A method, electronic device, and system for remote text input in the electronic device are provided. A display signal may be outputted in the electronic device, displaying a text field for inputting text (e.g., by the user of the electronic device). A request for text input may be sent from the electronic device to another device (e.g., a communication device) which may be addressed by an identifier of the other device (e.g., a SIM of the communication device). The electronic device may then receive the requested text input from the other device (e.g., once the user of the other device enters the requested text).

Abstract: In one example, a method includes outputting, at a presence-sensitive display operatively coupled to a computing device, a graphical keyboard comprising a plurality of keys and receiving an indication of a gesture to select a group of keys of the plurality of keys. The method may further include determining, in response to the indication, a candidate word based at least in part on the group of keys. The method may further include determining a group of alignment points traversed by the gesture and respective cost values for each of at least two keys of the plurality of keys. The method may further include comparing the respective cost values for at least each of at least two keys of the plurality of keys to determine a combination of keys having a combined cost value and outputting the candidate word that is based on the respective cost values.

Abstract: An example system includes a computing device located proximate to a physical activity surface, a video capture device, and a detector. The video capture device is coupled for communication with the computing device and is adapted to capture a video stream that includes an activity scene of the physical activity surface and one or more interface objects physically intractable with by a user. The detector processes the video stream to detect the one or more interface objects included in the activity scene, to identify the one or more interface objects that are detectable, to generate one or more events describing the one or more interface objects, and to provide the one or more events to an activity application configured to render virtual information on the one or more computing devices based on the one or more events.

Abstract: Input devices allow a hand and/or fingers to relay input to machines. Input devices include an operation unit coupled with an X-, Y-, and/or Z-axis sensor that detects movement of the operation unit by a human hand for input. The operation unit includes a base configured to receive a thumb on the hand of a human operator and a cover that covers the thumb. A frontwall blocks further movement in front of the cover. Input devices may further include a base or cover nail configured to hook the thumb for backward pulling.

Abstract: A multi-function touch pen for a portable electronic device includes a pen body and an audio output module. The pen body includes a touching input terminal, located at a first end of the pen body for inputting information to the portable electronic device, and an audio input unit located adjacent to the touch input terminal for inputting audio signals to the portable electronic device. The audio output module is located at a second end of the pen body for outputting audio signals generated from the portable electronic device.

Abstract: A manner of reducing the power consumption is utilized in a tablet terminal equipped with a digitizer for inputting with an electronic pen. When another tablet terminal or a smartphone approaches the tablet terminal, each digitizer detects input. When the digitizer detects the input, it is determined whether the input is electronic pen input from the electronic pen or proximity input caused by the proximity of the other tablet terminal or the smartphone. In the case of electronic pen input, coordinate information is transferred to a system, while in the case of proximity input, the system takes an action such as shifting a tablet terminal to a sleep state.

Abstract: A window panel for a display apparatus is provided comprising a first reinforced layer formed at a first predetermined depth from entire upper and lower surfaces, a second reinforced layer formed at a second predetermined depth from a side surface connecting an edge of the upper surface and an edge of the lower surface, and a non-reinforced portion formed at least a portion of the side surface.

Abstract: An image processing device may include a display control module, an input module and a communication module. The display control module may be configured to cause a display unit to display a character string input screen. The input module may be configured to input a character string to the input item corresponding to the character string input screen displayed on the display unit. The communication module may be configured to communicate with an information processing terminal. The communication module may send item identification information to the information processing terminal and receive character string information from the information processing terminal. The display control module may display a character string based on the character string information in the character string input screen that corresponds to the input item identified by the item identification information, in a case where the communication module receives the item identification information and the character string information.

Abstract: In a multi-layer body with a carrier and at least one conduction layer first areas and second areas are galvanically isolated from each other by third areas. In the third area sections are omitted from conductor traces and replaced by replacement pieces. The multi-layer body thereby has an optically homogeneous effect (e.g. is uniformly transparent or uniformly reflective).

Abstract: The invention relates to a combined display and input device for a vehicle, wherein a virtual first input unit is provided, which is designed as a touch-sensitive screen for operating a plurality of functions and for displaying information. According to the invention, a physical second input unit is provided, wherein the functions can be selected by means of the first input unit and/or the second input unit, and target values of the functions can be set by means of the first input unit and/or the second input unit, wherein the functions and/or target values can be displayed on the touch-sensitive screen.

Abstract: An electrode matrix that is used for capacitive sensing may be integrated into a display panel of an input device. In one embodiment, source drivers may be mounted on the display panel which drive the display signals and capacitive sensing signals into the display panel. In one embodiment, the capacitive sensing signals may be routed on traces or lines that are interleaved on the same layer as the source lines used for setting a voltage on the pixels in the display panel during display updating. Using the interleaved traces, the source drivers may drive the capacitive sensing signals in parallel to a plurality of the electrodes in the matrix in a predefined pattern that spans one or more sensing cycles.

Abstract: A touch panel includes a substrate; a sensing electrode provided on the substrate to sense a position. A wire is electrically connected to the sensing electrode and a ground wire is provided adjacent to the wire. The ground wire includes a first dummy part which extends in one direction.

Abstract: There is provided a display driving circuit, including: a touch signal terminal, a first clock terminal, a second clock terminal, a power supply terminal, a drive signal enabling terminal, a drive electrode signal terminal, a common electrode signal terminal, and a plurality of sub-circuits connected in cascades, each of the sub-circuits including: a logic unit, a driving unit and a transmission unit, wherein the logic unit is connected to the touch signal terminal, the first clock terminal, the second clock terminal, the power supply terminal, the drive signal enabling terminal, and the driving unit, the driving unit is connected to the transmission unit, and the transmission unit is connected to the drive electrode signal terminal and the common electrode signal terminal. The present application realizes co-electrode time-division multiplexing of the in-cell capacitive touch screen in the narrow-fame display apparatus.

Abstract: The present disclosure relates to a display device including a touch sensor and a manufacturing method thereof, and more particularly, to a display device including a touch sensor using a piezoelectric material and a manufacturing method thereof. The display device includes a first substrate, wherein a plurality of thin film transistors are disposed on the first substrate; a second substrate disposed facing the first substrate; a plurality of piezoelectric elements disposed on the second substrate; and a first sensing electrode overlapping the piezoelectric elements, the first sensing electrode being configured to transfer a sensing voltage generated as a result of pressure applied to the piezoelectric elements.

Abstract: An apparatus and method are presented for selecting a surface for user input. The apparatus includes an information handling device having at least two surfaces and at least two sensors, as least one of the sensors being associated with one or more of the surfaces, a determination module, and a selection module. The determination module determines a current surface that is likely facing a user. The selection module selects one or more sensors associated with the current surface for user input.

Abstract: An electronic device with a touch screen display that includes capacitive sensing to determine the point of contact between the display and an input device. The device also includes a graphics circuit for rendering images on the touch screen display. The graphics circuit may be inactivated when not in use. The inactive mode provides a variety of advantages, such as a lower power drain on the power source. The device is further configured to sense the approach of an input device in proximity to the display. The device is configured to start activating the graphics circuit upon sensing the approach of the input device prior to contact with the display. The timing of the activation improves responsiveness of the electronic device.

Abstract: A touch panel control device may be provided that includes: a touch panel which generates at least one touch signal in response to a touch of an object; a displayer; and a controller which performs a first touch action mode in which the change of the touch position of the object is displayed on the displayer by a line in response to the object which has touched the touch panel, and performs a second touch action mode in which, in response to the position change of the object which corresponds to the position of the line displayed on the displayer, it is to carry out at least one of the removal of at least a portion of the line displayed on the displayer and the change of the color coordinate of the line. Also, a method for controlling the touch panel may be also provided.

Abstract: Disclosed herein are a display device and a manufacturing method thereof, in which a sensing signal generated by touch input is received through at least two receiving channels. The display device includes a touch panel in which a plurality of driving electrodes receive a plurality of driving signals and a plurality of sensing electrodes generate a plurality of sensing signals by a touch input, wherein the driving electrodes and the sensing electrodes are arranged to intersect each other, and a sensing circuit device in which a plurality of receiving channels receive the sensing signals. The sensing circuit device is configured to receive one sensing signal generated by the touch input through at least two receiving channels.

Abstract: Techniques are described to discern between intentional and unintentional gestures. A device receives a first input from one or more sensors that are coupled to a flexible material to detect input from the user provided by manipulation of the flexible material. In addition, the device receives a second input from one or more environmental sensors that are coupled to the user to detect environmental conditions associated with the user. The device correlates the first input and the second input to determine whether the first input is an intentional input by the user.

Abstract: A mobile device and a corresponding proximity detection method are provided. The mobile device includes an infrared emitter and a proximity sensor. The infrared emitter emits an infrared using first power in a first mode or emits the infrared using second power in a second mode. The first power and the second power are different. The proximity sensor detects the reflection of the infrared and determines whether or not there is an object in close proximity to the mobile device based on the reflection.

Abstract: There is provided a portable terminal including a display panel having a display surface with a touch pad, an area management unit which defines a plurality of display areas formed by dividing the display surface, and a display control unit which performs control on an image display in each display area. In a state where two display areas are defined with a first boundary line, in response to a touch operation on the touch pad, the area management unit determines, based on a touch position of the touch operation, a second boundary line passing one point on the first boundary line and one point within a predetermined range from the touch position and defines two areas which are formed by dividing an object area of the two display areas with the second boundary line, as first and second display areas in place of the object area.

Abstract: Apparatus and methods are disclosed for simultaneously tracking multiple finger and palm contacts as hands approach, touch, and slide across a proximity-sensing, multi-touch surface. Identification and classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Abstract: The present invention relates to a touch screen panel and a touch screen assembly including the touch screen panel, the touch screen panel including a substrate; a transparent electrode layer formed on the substrate and defined by a touch area; a plurality of conductive wires electrically connected to the transparent electrode layer; and an insulation film stacked on an upper surface of the transparent electrode layer, wherein each of the plurality of conductive wires is electrically connected to a conductive line inside the insulation film, and the conductive line is extended to an outside of the insulation film and exposed therefrom, whereby a PCB and conductive wires can be improved in electrical reliability.

Abstract: A touch panel sensor system that can dynamically measure noise and automatically switch to a frequency with minimal noise is described. The touch panel sensor system includes a sensor configured to detect a change in capacitance associated with a touch upon a touch panel. The system also includes a drive module configured to generate a drive signal having a first waveform characteristic (e.g., signal having a periodic waveform characteristic) during a first phase (e.g., sensor phase) and a second drive signal having a second waveform characteristic (e.g., constant voltage signal) during a second phase (e.g., noise detection phase). The first and second drive signals are configured to drive the sensor. The system also includes a measuring module coupled to the sensor that is configured to measure noise having the first waveform characteristic (e.g., periodic waveform characteristic) during the second phase.

Abstract: A touch-sensitive apparatus comprises a light transmissive panel, an illumination arrangement and a detection arrangement. The illumination arrangement is configured to couple light into the panel via an incoupling site such that the light propagates by total internal reflection in opposite top and bottom surfaces of the panel and such that an object touching the top or bottom surface causes a change in the propagating light. The detection arrangement comprises a light detector arranged to detect the change in the propagating light. A compact and robust incoupling site is defined by a sheet-like micro-structured surface portion which is fixedly arranged on one of the top and bottom surfaces and configured to transmit light having an angle of incidence that enables light propagation by TIR inside the panel.

Abstract: An optical touch-sensitive device is able to determine the locations of multiple simultaneous touch events. The optical touch-sensitive device includes multiple emitters and detectors. Each emitter produces optical beams which are received by the detectors. Touch events disturb the optical beams. Touch event templates are used to determine the actual touch events based on which optical beams have been disturbed.

Abstract: A display device having a multi-touch recognition function includes an integration module having a plurality of cameras integrated at an edge of a display panel; and a processor that detects a touch area using at least first and second images captured by the plurality of cameras, respectively.