Abstract: A system performs stable control of moving devices (such as a helicopter or robot) with attached camera(s), providing live imagery back to a head-mounted computer (HMC). The HMC controls the moving device. The HMC user specifies a desired path or location for the moving device. Camera images enable the user-specified instructions to be followed accurately and the device's position to be maintained thereafter. A method of controlling a moving device with a headset computer includes analyzing, at the headset computer, at least one image received from the moving device to form an indication of change in position of the moving device. The method displays to a user of the headset computer the indication of change in position of the moving device. The method can additionally include enabling the user to control the moving device.

Abstract: Disclosure is related to a control system with an input method using recognition of facial expressions. The system includes an image capturing unit, an image processing unit, a database, and a computing unit. The image capturing unit captures an input image having a facial expression when a user uses lip language. The image processing unit, connected with the image capturing unit, is used to receive and recognize the facial expression shown in the input image. The database stores a plurality of reference images and each of which indicates a corresponding control command. The computing unit, connected with the image processing unit and the database, performs comparison between the facial expression recognized by the image processing unit and the reference images retrieved from the database. The result of comparison finds out the control command which is used to operate an electronic device by this control system.

Abstract: Provided are an apparatus and method for controlling an electronic device. The apparatus includes a plurality of sensors to detect manipulation by a user, a control unit to recognize a motion pattern based on the user manipulations detected by the plurality of sensors and to determine an operation to be executed in accordance with the recognized user's motion pattern, and a transmitting unit to transmit a digital signal for an electronic device to execute the operation determined by the control unit.

Abstract: Methods and systems for unlocking a screen using eye tracking information are described. A computing system may include a display screen. The computing system may be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the computing system. The user may attempt to unlock the screen. The computing system may generate a display of a moving object on the display screen of the computing system. An eye tracking system may be coupled to the computing system. The eye tracking system may track eye movement of the user. The computing system may determine that a path associated with the eye movement of the user substantially matches a path associated with the moving object on the display and switch to be in an unlocked mode of operation including unlocking the screen.

Abstract: The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.

Abstract: A display control device 1 is provided, which suppresses a display content from being scrolled when a viewer does not consciously pay attention to the display content. The display control device 1 includes: a display unit 16; an image pickup unit 11 that detects an eye position of a viewer from a taken image of the viewer; an attention state determination unit 12 that determines an attention state to the display content, based on movement of the detected viewer's eye position; a gaze position specifying unit 14 that specifies a gaze position on the display content, based on the detected viewer's eye position and the display content; and a display control unit 15 that causes the display unit 16 to display a non-displayed portion of displayed program information, based on the determined attention state and the specified gaze position, when the viewer pays attention to the non-displayed portion.

Abstract: A technique for executing a plurality of applications on a GPU. The technique involves establishing a first connection to a first application and a second connection to a second application, establishing a universal processing context that is shared by the first application and the second application, transmitting a first workload pointer to a first queue allocated to the first application, the first workload pointer pointing to a first workload generated by the first application, transmitting a second workload pointer to a second queue allocated to the second application, the second workload pointer pointing to a second workload generated by the second application, transmitting the first workload pointer to a first GPU queue in the GPU, and transmitting the second workload pointer to a second GPU queue in the GPU, wherein the GPU is configured to execute the first workload and the second workload in accordance with the universal processing context.

Abstract: Various embodiments for hit testing of visual objects are described herein. Data of visual objects is generated in a two-dimensional clip space. The data of visual objects includes two-dimensional projections of the visual objects. Cursor coordinates are transformed into the clip space and bounding box calculations are performed using the transformed cursor coordinates and the generated data. Hit testing is performed when there is a hit on a bounding box of at least one of the visual objects in the clip space. The hit testing is performed in a three-dimensional space. A result is then presented on a user interface based on the hit testing.

Abstract: A user replaceable case for a touch operated handheld device, the case being arranged for at least partially enveloping the device when the case is applied to the device, the case comprising a device interface for digitally interfacing with the device when the case is applied to the device; a physical control means arranged on an outer surface of the case for providing tactile feedback to a user when operating the physical control means; and a controller for i) sensing an operation of the physical control means by the user, and ii) based on the operation, sending an instruction to the device via the device interface for controlling the device.

Abstract: An image display system includes: an image display unit that displays an image indicated by image data on a display surface; a trajectory data generation unit that specifies a position on the display surface indicated by a pointer and generates trajectory data indicating a trajectory of the pointer; and a trajectory data processing unit that performs processing in a mode corresponding to the pointer for the trajectory data generated by the trajectory data generation unit, wherein the image display unit displays an image of a trajectory, which is indicated by the trajectory data generated by the trajectory data generation unit, on the display surface.

Abstract: Recognizing a command may include monitoring a tangible reference with a depth sensor, maintaining a virtual reference approximately on calibrated three dimensional coordinates of the tangible reference, maintaining a touch space adjacent the virtual reference, and recognizing a command when a predetermined object enters the touch space.

Abstract: A cursor control system is provided. A cursor position information is calculated according to a position information and an axial information of a hand held device. The display displays the cursor or executes a corresponding operating instruction according to the cursor position information.

Abstract: The present invention provides for a touch-sensitive electronic device having at least first and second touch screens, interface control means for touch selection of content displayed on the screens and wherein the interface control means is arranged such that as touch-selection on the first screen reaches an end location, the selected portion of content is saved and touch-selection functionality is arranged to continue at a start location on the second screen, and also provides for a related method allowing for touch selection of content extending across both screens so that such content can be selected in a unitary manner.

Abstract: A control system with a gesture-based input method is introduced. The system includes an image capturing unit, an image processing unit, a database, and a computing unit. The image capturing unit captures an input image with a user's gesture. The gesture may be sign-language gesture or gesture of the user holding an object. The image processing unit, connected to the image capturing unit, is used to receive and recognize the gesture shown in the input image. The database stores a plurality of reference images and each of which indicates at least one control command. The computing unit, connected to the image processing unit and database, is used to compare the gesture recognized by the image processing unit with the reference images in the database. The comparison is used to determine a control command corresponding to the reference image. The control command is used to operate an electronic device.

Abstract: A power-saving sensing module includes a light source, a first and a second sensor, a first and a second detection unit, and a controller. The first sensor detects a first image corresponding to a working plane in response to at least a part of the light ray from the light source to generate a first sensing signal. The first detection unit generates a displacement signal in response to the first sensing signal. The second sensor detects a second image corresponding to an object in response to at least a part of light ray to generate a second sensing signal. The second detection unit generates a touch signal corresponding to the object in response to the second sensing signal. The controller outputs a control signal in response to the touch signal. The first detection unit operates at a dormant state or a sensing state in response to the control signal.

Abstract: Methods, systems, computer-readable media, and apparatuses for providing a vertical candidate bar with an on-screen keyboard are presented. In some embodiments, a computing device may display a keyboard on a touch-sensitive display screen. The keyboard may be a split keyboard that includes two panels of keys displayed on opposite sides of the display screen. The device also may display a candidate bar on the display screen, and the candidate bar may be vertically aligned with the keyboard. As character input is received via the keyboard, the device may update the candidate bar to include various candidate characters that are determined based on the received character input.

Abstract: A method of character entry includes detecting a spacebar adjacent input from a keyboard, the spacebar adjacent input corresponding to a key adjacent to a spacebar; and determining whether to accept the spacebar adjacent input based on whether a preceding inputted string, the preceding inputted string comprising a string of inputted characters preceding the spacebar adjacent input, corresponds to a first stored object.

Abstract: A method may include receiving a keyed input from a user in a user device, wherein the keyed input indicates a letter of a word. The method may also include receiving an audio input from the user in the user device, wherein the audio input indicates the word. The method may also include generating a first list of predicted words based on the audio input and the keyed input from the user and displaying the first list of predicted words to the user.

Abstract: An adjustable ergonomic keyboard includes keyboard segments coupled by a joint allowing the keyboard segments to pivot relative to one another. A retainer secures a corresponding keyboard segment with respect to a base support and allows the corresponding retained keyboard segment to rotate thereabout and to travel laterally with respect to the base support. The base support may be part of a portable laptop chassis or body or may be a stand alone base for use of the keyboard as a peripheral data input device.

Abstract: Grip-based device adaptations are described in which a touch-aware skin of a device is employed to adapt device behavior in various ways. The touch-aware skin may include a plurality of sensors from which a device may obtain input and decode the input to determine grip characteristics indicative of a user's grip. On-screen keyboards and other input elements may then be configured and located in a user interface according to a determined grip. In at least some embodiments, a gesture defined to facilitate selective launch of on-screen input element may be recognized and used in conjunction with grip characteristics to launch the on-screen input element in dependence upon grip. Additionally, touch and gesture recognition parameters may be adjusted according to a determined grip to reduce misrecognition.

Abstract: An input control unit includes: a keyboard storage unit for storing keyboard screens each corresponding to a set of characters or symbols; a keyboard display unit for reading one of the keyboard screens and displaying the read keyboard screen on the screen; an input receiving unit for receiving a selection of the character or the symbol by the user; and a switching control unit for reading keyboard screens from the keyboard storage unit, displaying the read keyboard screens on the screen as selection candidates, and switching the selection candidate from among the plurality of keyboard screens. When the switching control unit receives a user control input to confirm the candidate being selected from the user, the keyboard display unit displays the keyboard screen selected on the screen, and receives a selection of the character or the symbol selected from the user.

Abstract: The present disclosure provides a stylus for enabling inputs to be made to a host electronic device. The stylus has multiple antennas that are displaced from each other and the tip of the stylus body. In operation, the antennas are excited to each radiate an electromagnetic field directed towards the tip of the stylus. The radiated electromagnetic fields may be sensed by the host electronic device to determine the position of the tip relative to a sensing surface.

Abstract: A display system with image sensor based display orientation is provided. The display system comprises: a display device; a sensor for acquiring at least one electronic image from a field of view proximal the display device; and a processor enabled to: control at least a subset of the display device to a display orientation associated with a given edge of the display device when a portion of the at least one electronic image associated with the given edge comprises a given reference image.

Abstract: Palm input rejection on a touch screen of an electronic device is provided by selecting a rejection region of the touch screen dependent upon the orientation of a pointing device. A predicted palm position relative to the touch screen is predicted and touch-input functionality of a rejection region of the touch screen is disabled, with the rejection region selected dependent upon the predicted palm position and the predicted palm position based on an orientation of a pointing device. The orientation of the pointing device may be determined, for example, from the handedness of a user or from an orientation detector of a stylus pointing device.

Abstract: A handheld device and an unlocking method thereof are provided. The handheld device comprises a touch panel, a motion sensor and a processor. The touch panel senses a touch to generate a touch signal. The motion sensor senses a motion of the handheld device to generate a motion signal. The processor, which is electrically connected to the touch panel and the motion sensor, receives the touch signal and the motion signal and unlocks the handheld device according to the touch signal and the motion signal.

Abstract: A display device comprises a display panel including a display region configured to display one or more image objects and an overscan region configured to prevent the display of images within the overscan region, a touchscreen panel overlying the display region and the overscan region configured to detect and generate engagement data indicative of detected engagement, and a computer processor configured to access first engagement data, determine that the first engagement data reflects engagement with at least one portion of the touchscreen panel correspondingly overlapping with the overscan region, identify a first particular engagement input type based on the first engagement data, and instruct the display panel to invoke the display of the one or more image objects in the display region or to change the display of the one or more image objects in the display region.

Abstract: According to one embodiment, the electronic device displays on the screen the locus of each of a plurality of strokes which are handwritten by a handwriting input operation which is executed on the touch-screen display. The electronic device stores, in the storage medium, first time-series information including a plurality of stroke data corresponding to the plurality of strokes and indicating an order in which the plurality of strokes were handwritten. The electronic device selects the process-target time-series information part from the first time-series information in accordance with the range designation operation which is executed on the touch-screen display.

Abstract: According to one embodiment, a electronic device includes a touch-screen display, a display process module, a retrieve module, and an emphasis-display module. The display process module displays loci of strokes in a first color on the touch-screen display, based on time-series information. The retrieve module retrieves, from the time-series information, a time-series information part. The emphasis-display module sets a proximity area of loci corresponding to the time-series information part, to display loci corresponding to the time-series information part in a second color, and to display the proximity area loci corresponding to other than the time-series information part, in a third color.

Abstract: A flexible display device includes: a flexible display unit configured to display an image; a flexible touch screen unit disposed over the flexible display unit; an insulating film interposed between the flexible display unit and the flexible touch screen unit, and a spacer formed between the flexible touch screen unit and the insulating film in order to maintain a distance between the flexible touch screen unit and the insulating film. A conductive layer is further formed over the insulating film and configured to touch the flexible touch screen unit when the flexible display device is bent. A degree of warpage of the flexible display device can be measured and thus can be utilized in various warpage events of the flexible display device by using warpage values.

Abstract: A flexible touch screen panel includes a flexible thin-film substrate including an active region and an inactive region, the inactive region being at an outer side portion of the active region, and the thin-film substrate being configured to bend along at least one bending axis, sensing patterns in the active region of the thin-film substrate, the active region being divided into a plurality of electrically independent regions by the at least one bending axis, and sensing lines in the inactive region of the thin-film substrate, the sensing lines being connected to the sensing patterns.

Abstract: A pouch for receiving a main body of a portable electronic device having a touch screen provided on a front surface thereof includes: a first part for receiving a rear surface of the main body; and a second part rotatably connected to the first part to close or open the touch screen, wherein the second part is formed to expose visual information of the touch screen to the outside in a state in which the touch screen is covered, and has conductivity allowing the touch screen to sense a touch input applied thereto in the closed state.

Abstract: A display device includes a display unit for displaying an image, a first retarder provided on the display panel, a first polarizing plate provided on the first retarder, a touch unit provided on the first polarizing plate, a second retarder provided on the touch unit, and a second polarizing plate provided on the second retarder. With this arrangement, external light entering into the display may either be transmitted or reflected off of the touch unit, and in either case, be absorbed by the second polarizing plate without leaving the display device.

Abstract: Gate driver circuitry that controls an array of display elements is described. The gate driver circuitry has gate drivers that apply a control pulse to each of a number of gate lines in sequence, from a previous gate line to a current gate line, during a frame interval in which the array of display elements is filled with pixel values. Each gate driver has a latch stage followed by an output stage. The output stage is coupled to drive a current gate line, and the latch stage is coupled to drive a) a first hold circuit that holds the current gate line at a predetermined voltage, and b) a second hold circuit that holds a previous gate line at a predetermined voltage. Other embodiments are also described and claimed.

Abstract: Provided is a mobile terminal that includes a flexible display configured to bend a prescribed amount, a sensor configured to sense bending of the flexible display, and a controller configured to control the flexible display based on the sensed bending. The controller may detect an event associated with an application program, control the sensor to sense the bending of the flexible display in response to the detected event, and control the flexible display to display event information corresponding to the event on the flexible display according to the sensed bending.

Abstract: A system that produces a dynamic haptic effect and generates a drive signal that includes a gesture signal and a real or virtual device sensor signal. The haptic effect is modified dynamically based on both the gesture signal and the real or virtual device sensor signal such as from an accelerometer or gyroscope, or by a signal created from processing data such as still images, video or sound. The haptic effect may optionally be modified dynamically by using the gesture signal and the real or virtual device sensor signal and a physical model, or may optionally be applied concurrently to multiple devices which are connected via a communication link. The haptic effect may optionally be encoded into a data file on a first device. The data file is then communicated to a second device and the haptic effect is read from the data file and applied to the second device.

Abstract: A method of executing multiple applications in an apparatus including a touch screen is provided. The method includes displaying a first window in which a first application is executed on the touch screen, detecting a division screen display event of the first application and a second application, and decreasing a size of the first window on the touch screen when the division screen display event is detected and displaying, together with the first window, a second window in which the second application is executed on the touch screen.

Abstract: An operation method of a touch panel includes the following steps. A touch signal generated when the touch panel senses a touch is received. According to the touch signal, whether a location of the touch moves from a triggering zone to a working zone on the touch panel is determined. When the location of the touch moves to the working zone from the triggering zone, the touch panel is controlled to operate under a multi-touch mode. When the location of the touch does not move to the working zone form the triggering zone, the touch panel is controlled to operate under a mouse mode.

Abstract: A mobile terminal including a flexible display unit and a control method thereof are provided. The mobile terminal includes a flexible display unit bendable in response to force applied to the mobile terminal. The mobile terminal includes a sensing unit configured to sense bending of the flexible display unit and a controller configured to generate a control signal for performing a function associated with information output to the flexible display unit in response to the bending.

Abstract: A portable device including double-sided displays and a method for controlling the same are provided. The method includes detecting an unlock command for the portable device, which is a command to switch the first display unit to an active state and to switch the second display unit to a ready-to-activate state, switching the first display unit to an active state and switching the second display unit to a ready-to-activate state when the unlock command is the second command, detecting an unlock trigger for the second display unit, which serves to switch a display unit, which is in a ready-to-activate state, to an active state, and switching the second display unit from the ready-to-activate state an active state according to the detected unlock trigger.

Abstract: There is provided an information processing apparatus including a position detector configured to detect a position of an operating object as a detection position, a state detector configured to detect a state of the operating object as a detection state, and a selection part configured to select any one of a plurality of objects based on the detection position, the detection state, and a priority calculation technique associated with each of the plurality of objects.

Abstract: A method for controlling a portable device and which includes detecting one of a first unlock command for switching a state of a first display unit to an active state and maintaining a state of a second display unit in a locked state or a second unlock command for switching the state of the first display unit to the active state and switching the state of the second display unit to a ready-to-activate state; switching the states of the first and second display units to the active state and the ready-to-activate state, respectively, when the second unlock command is detected; detecting an unlock trigger; and switching the second display unit to the active state according to the detected unlock trigger.

Abstract: The present invention discloses a control circuit of a touch screen and a noise removing method. The present invention provides a technique for performing differential sensing on two adjacent detection lines of a touch screen panel and integrating a differential sensing signal to filter noise. The control circuit and the noise removing method may remove display noise having an effect on two adjacent detection lines, three-wavelength lamp noise having a predetermined frequency, 60 Hz noise, and charger noise caused by battery charging.

Abstract: A touch panel includes a substrate, first and second electrode units, and an auxiliary electrode unit. The substrate has first and second touch areas. The first electrode unit includes a plurality of first electrodes arranged spacedly in one of rows and columns, and disposed on the substrate to span the first and second touch areas. The second electrode unit includes a plurality of second electrodes arranged spacedly in the other of rows and columns to intersect without contacting the first electrodes. The auxiliary electrode unit is disposed proximate to and without contacting the second electrode unit such that the second electrode unit is able to detect a signal passing through the auxiliary electrode unit.

Abstract: The present invention discloses a signal processing circuit and a signal processing system for processing an input signal provided from a touch screen in response to a driving signal.

Abstract: A writing instrument is disclosed which includes a cylindrical barrel and an end cover having a robust structure and attached to the cylindrical barrel. The end cover comprises a cylindrical base attached to a rear end portion of the cylindrical barrel, a cover body fitted around an outer peripheral surface of the cylindrical base, a stopper ring fitted around an outer peripheral surface of at least a fitted portion between the cylindrical base and the cover body, and a cooperation structure for facilitating enhancing of holding force which is exerted on the cover body by the cylindrical base and the stopper ring.

Abstract: A stylus barrel includes a barrel tip configured to input handwritten user data into or on an electronic input field. A chamber is defined within the stylus barrel and is configured to accommodate and retain a stylus that is also configured to input handwritten user data into or on an electronic input field. The stylus and/or the stylus barrel may include a fastener that detachably fastens the stylus within the chamber of the stylus barrel.

Abstract: A matrix switching type pressure-sensitive touch detecting device has a simple configuration. The matrix switching type pressure-sensitive touch detecting device may include an upper substrate, a lower substrate, and a unified sensor module disposed between the upper substrate and the lower substrate.

Abstract: A method for classifying input provided to a digitizer sensor includes sampling output over one or more sampling periods, identifying a location of intentional input to the digitizer sensor from the output sampled over the one or more sampling periods, identifying an area of potential palm input based on the identified location of the intentional input, and classifying output detected in the area of the potential palm input as output potentially obtained from undesired input to the digitizer sensor. The area of potential palm input is defined to have a defined spatial relation to the location of the intentional input. The output classified is sampled over one or more sampling periods other than the one or more sampling periods from which the area of potential palm input is identified.

Abstract: A portable terminal having a bended display divided into a main region of a front surface and a sub-region of a side of the portable terminal and operating functions of the portable terminal in connection with the main region and the sub-region, and a method of operating the same are provided. The method of operating functions of a portable terminal having a bended display, includes receiving an input of an event, determining a type of the input event, outputting event information, according to an internal event input based on the bended display, through at least one of a main region and a sub-region of the bended display when the input event is the internal event, and outputting event information, according to an external event input from an outside source, through the sub-region of the bended display when the input event is the external event.

Abstract: An information processing device includes: a display unit having a touch panel on its front surface; a movement amount calculation unit that calculates the movement amount of a touch operation based on a touch point at which the touch operation is performed with respect to the touch panel and a touch release point at which the touch operation is released from the touch panel; an operation determination unit that determines whether the touch operation is a depression operation or a gesture operation depending on the calculated movement amount; and a command recognition unit that recognizes whether a received command is a command corresponding to the depression operation or the gesture operation.