Abstract: A display control apparatus displays a cursor based on an operation performed by an operator on a screen of a display device. The display controlling unit corrects the in-screen position of the instruction image based on a relationship between a first position indicated by the hand having a first shape and a second position indicated by the hand having a second shape in a case where a second operation is detected after a first operation is detected and displays the instruction image at the in-screen position corresponding to the second position.

Abstract: A manipulation panel that is a user interface includes a display unit that displays a screen, a touch panel that detects a tap performed to the display unit, and an abnormality detector that detects a situation, in which a message is displayed on the display unit, until the touch panel detects a second tap constituting a double tap since detecting a first tap. Manipulation panel displays a warning message about the situation detected by the abnormality detector on the display unit after the touch panel detects the second tap.

Abstract: In a state where an extended input device is secured to a data transmission device, an image capturing unit of the data transmission device captures an image of a light emitting unit that emits light, an image of which is allowed to be captured by the image capturing unit in accordance with a user input and/or a user operation, and data generated based on at least the captured image is transmitted to an information processing apparatus. The information processing apparatus executes an information process based on the transmitted data.

Abstract: An I/O device, an I/O program, and an I/O method that can add a sense of distance from the position of visually recognizing eyes to a stereoscopic image that is a virtual image, through an object that is a real image and provide visual recognition as if the stereoscopic image were associated with the object are provided. An I/O device of the present invention includes a display device that can generate a stereoscopic image, a depth level sensor that measures a distance to an object, and an event generating unit that generates an event according to a mode of the object at least either in a stereoscopic region of the stereoscopic image generated by the display device or in a depth level detection region of the depth level sensor.

Abstract: Devices and method are provided that facilitate improved input device performance. Specifically, the systems and methods are configured to identify a portion of an image of sensor values as corresponding to at least one sensed object in the sensing region, determine a polygon corresponding to the identified portion of the image, and determine a contact characterization of the at least one sensed object based on the polygon. The determination of a polygon corresponding to a sensed object facilitates improved contact characterization of the sensed object. For example, the determined polygon may be used to determine if the sensed object is actually more than one object. As a second example, the determined polygon may be used to determine the orientation of the sensed object. In addition, determined polygons may be used to more accurately track changes in the position of the sensed object.

Abstract: A method of operating the video display device according to the embodiment of the present invention comprises acquiring a video of a video display device associated with a user; recognizing a gesture of the user in the acquired video; calculating a control amount with regard to the gesture based on the recognized gesture; and performing the control operation corresponding to the recognized gesture and the calculated control amount.

Abstract: A mobile electronic device comprises a display, an operation detector, and a processor. The operation detector is capable of detecting a first touch operation and a second touch operation on the display performed by a part of a human body. The processor is configured to execute a control process responsive to the first touch operation and the second touch operation. The part of the human body performing the second touch operation is located in a position farther from the display than a position of the part of the human body performing the first touch operation. The processor is configured to execute the control process while handling the first touch operation and the second touch operation performed continuously as a single touch operation, depending on a time lag between the first touch operation and the second touch operation.

Abstract: The systems described herein integrate virtual keyboard technology and gesture-based controllers into a single module or into a laptop or other mobile computing device in order to make laptops, personal computers, and other mobile computing devices more convenient, more versatile, and with less clutter or fewer peripheral devices than is typically the case with a traditional combination of a physical keyboard with a mouse, touchpad, or track ball. Users of the embodiments disclosed herein will be able to enter data or commands merely by typing or making hand gestures or hand movements, which will lead to greater flexibility, creativity, and productivity, while reducing user ennui and fatigue.

Abstract: Disclosed are a method for controlling a terminal device, a terminal device and an electronic device. The method comprises: acquiring a first input; determining, in the locked state, a first instruction of the first instruction set corresponding to the first input, the first instruction being an unlocking instruction; controlling a switching from the locked state to the unlocked state according to the unlocking instruction; determining, in the unlocked state, a second instruction of the second instruction set corresponding to the first input; and responding to the second instruction. With the present invention, user operations are simplified, and intelligence of the terminal device is improved.

Abstract: A method for providing a mechanism by which different user interface effects may be performed for different motion events may include receiving an indication of a motion event at a motion sensor, determining a motion gesture of the motion event, determining a motion property of the motion event, and enabling provision a user interface effect based on the motion property of the motion event. A corresponding apparatus and computer program product are also provided.

Abstract: The purpose is to provide a terminal device that can be operated by a virtual operation key which is easy to use. The terminal device according to an aspect of the present invention comprises a display unit for displaying a virtual operation key, a touch panel for detecting contact by an inputting object on the virtual operation key, and a control unit for assessing whether a drag operation by the inputting object has been carried out on the basis of contact with the virtual operation key by the inputting object detected via the touch panel and controlling the display position of the virtual operation key, wherein the control unit modifies the display position of the virtual operation key in accordance with the contact position of the inputting object if the contact position of the inputting object exceeds a display area of the virtual operation key due to the drag operation.

Abstract: An input apparatus having a touch module and an input identification method applied to the apparatus are described. The method includes during the collection of a touch track on the touch module, when a first partial track of the touch track satisfies a first preset condition, a first command corresponding to the first partial track is obtained; the first command is executed; and during the collection of the touch track, when a second partial track following the first partial track satisfies a second preset condition, a second command corresponding to the second partial track is obtained; and the second command is executed. The method and apparatus can quickly identify a gesture operation of a user on the touch screen, and can continue to perform the corresponding operation after the identification of the gesture operation of the user and before the completion of the gesture operation.

Abstract: Architecture that enables single and multi-modal interaction with computing devices, as well as interpreting user intensity (or liveliness) in the gesture or gestures. In a geospatial implementation, a multi-touch interaction can involve the detection and processing of tactile pressure (touch sensitive) to facilitate general navigation between two geographical points. This is further coupled with providing detailed information that facilitates navigation and turn-by-turn directions. This includes the use of time and/or pressure to release or increase the zoom level of map tiles, the touching of the two geographical points and speaking to obtain directions between these two geographical points, and the blending of tiles to create a compelling user experience, where the map is in different levels of zoom on the same view.

Abstract: Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, a scale indicative of an actual gesture distance traversed in performance of the gesture is identified, and a movement or action is displayed on the device based, at least in part, on a ratio between the identified scale and the scale of the displayed movement. In some embodiments, a degree of completion of the recognized gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.

Abstract: A system, method, and computer program product are provided for operating a mobile device including a touch screen, a memory, and a vibratory feedback mechanism coupled to at least one processor. A plurality of applications including an application is stored, utilizing the memory. Indicia is displayed, utilizing the touchscreen. A first pressure signal indicative of a first magnitude of pressure being applied to the touch screen is identified in connection with the indicia. In response to the first pressure signal indicative of the first magnitude of pressure being applied to the touch screen, a first state is identified, utilizing the at least one processor. In response to the identification of the first state, an operation is performed, utilizing the at least one processor. A second pressure signal is identified indicative of a second magnitude of pressure being applied to the touch screen that is greater than the first magnitude, in connection with the indicia.

Abstract: An electronic device includes: a communication module configured to receive a content; a direction detection unit configured to detect a direction that a screen of the electronic device faces; a control unit configured to determine whether to display the received content on the basis of a least one of whether the received content corresponds to a designated content and whether the detected direction corresponds to a designated direction; and a display module configured to display a notification notifying the reception of the content without displaying the content if the detected direction does not correspond to the designated direction and the received content corresponds to the designated content according to a determination result of the control unit.

Abstract: An access control method and a terminal device are disclosed. The method includes: receiving an unlock password after receiving an instruction for opening an application program; determining an access type corresponding to the unlock password; obtaining display information corresponding to the access type among current display information of the application program; and displaying the obtained display information. An access type is distinguished according to an unlock password, and display information is determined according to the access type, so that the display information can match the unlock password input by a user, and the user can flexibly and secretly control information to be displayed, thereby preventing a risk that private or other important information of the user is seen by a visitor and improving information security.

Abstract: A method of an electronic device including a touch panel for determining a control command is provided. The method includes the operations of receiving at least one touch input, receiving a hovering input, determining the control command corresponding to a combination of the at least one touch input and the received hovering input, and controlling the electronic device according to the determined control command.

Abstract: Aspects of the disclosure provide a method for icon based application control. The method includes receiving, by a processor, a detection signal indicative of a pre-defined user action on an icon in a graphical user interface (GUI). The icon has an associated application. Further, the method includes extracting adjustable settings of the associated application with the icon, and providing, by the processor, a setting interface for the icon in the GUI to enable adjustments of the settings for the application to be performed via the setting interface.

Abstract: A mobile terminal and controlling method thereof are disclosed, which facilitates a terminal to be used in further consideration of user's convenience. According to at least one of embodiments of the present invention, a strict authentication procedure for expense payment can be performed via a simple and convenient user interface between a mobile terminal and a terminal user. In particular, since at least one of a selection and authentication of a payment means of the mobile terminal can be performed via at least one of an aligned direction, a moving direction and a moving track of the mobile terminal, the user interface between the mobile terminal and the terminal user for the expense payment can be further simplified.

Abstract: The technology disclosed provides systems and methods for reducing the overall power consumption of an optical motion-capture system without compromising the quality of motion capture and tracking. In implementations, this is accomplished by operating the motion-detecting cameras and associated image-processing hardware in a low-power mode (e.g., at a low frame rate or in a standby or sleep mode) unless and until touch gestures of an object such as a tap, sequence of taps, or swiping motions are performed with a surface proximate to the cameras. A contact microphone or other appropriate sensor is used for detecting audio signals or other vibrations generated by contact of the object with the surface.

Abstract: Methods for dimensioning a 3D item are described. A FOV is mapped over three spatial dimensions, each of the three spatial dimensions oriented orthogonally in relation to each of the others and graduated according to a linear scale. The 3D item is scanned relative to the mapped FOV. Each of the 2D surfaces of the scanned 3D item is identified. A dimension is measured for each of the identified 2D surfaces of the scanned 3D item. A perspective-correct representation of the measured dimension is rendered, in real time or near real time, with respect to the measuring the dimension step, onto each of the identified 2D surfaces of the scanned 3D item.

Abstract: A menu application provides an integrated interface for launching multiple mobile applications from a dynamically configurable menu. Each of the mobile applications is associated with a servlet that provides the application's menu data to the menu application. The servlet may query design-time data and application run-time data to generate the menu data for the application. Additionally, the set of applications included by the menu application in a menu list may be based on a user authorization level, such that the menu list only includes applications that the user is authorized to access.

Abstract: A system, method, and computer program product are provided for computing operations based on a first and second user input. In use, a first user input in a first region of a graphical user interface is received. Next, while receiving the first user input, a second user input is received in connection with one or more portions of displayed content in a second region of the graphical user interface. Lastly, one or more operations are computed in connection with the one or more portions of the displayed content, based on the first input and the second input. Additional systems, methods, and computer program products are also presented.

Abstract: Technologies are described for configuring user input using physical gestures. For example, a user can be prompted to perform a physical gesture to assign to a software application command (e.g., an action within a video game or a command in another type of application). In response, a physical gesture can be received from the user via a physical gesture input device. The received physical gesture can then be associated with the software application command so that when the user performs the physical gesture the software application command can be initiated.

Abstract: A system presents close-loop controlled display states on the lockscreen of a mobile device. Contextual information may be collected at the mobile device. The system may access subscriber identity register data to determine subscription registry status for a mobile subscriber associated with the device. The subscriber identity register data and contextual information may be processed by closed-loop display state selection circuitry and next action selection logic to generate a display state selection. The display state selection is sent to the mobile device. The selected display state may be displayed during lockscreen invocations at the mobile device.

Abstract: According to the invention, a method for entering text into a computing device using gaze input from a user is disclosed. The method may include causing a display device to display a visual representation of a plurality of letters. The method may also include receiving gaze information identifying a movement of the user's gaze on the visual representation. The method may further include recording an observation sequence of one or more observation events that occur during the movement of the user's gaze on the visual representation. The method may additionally include providing the observation sequence to a decoder module. The decoder module may determine at least one word from the observation sequence representing an estimate of an intended text of the user.

Abstract: Temporally segmenting an instrumented gesture executed by a user with a terminal having an inertial navigation module, which measures a vector of inertial characteristics representative of movement of the terminal. Segmenting includes, at each current instant: calculating an instantaneous power value of the vector; estimating a gesture indicator based on variation between the instantaneous power value and a mean power value estimated over a preceding time window; determining a start of gesture at a first instant, when the estimated gesture indicator is greater than or equal to a first threshold during a time interval greater than or equal to a first interval; and determining an end of gesture at a second instant when, at the current instant, the estimated gesture indicator is less than or equal to a second threshold during a time interval greater than or equal to a second time interval.

Abstract: Methods for dimensioning a 3D item are described. A FOV is mapped over three spatial dimensions, each of the three spatial dimensions oriented orthogonally in relation to each of the others and graduated according to a linear scale. The 3D item is scanned relative to the mapped FOV. Each of the 2D surfaces of the scanned 3D item is identified. A dimension is measured for each of the identified 2D surfaces of the scanned 3D item. A perspective-correct representation of the measured dimension is rendered, in real time or near real time, with respect to the measuring the dimension step, onto each of the identified 2D surfaces of the scanned 3D item.

Abstract: In at least some embodiments, a mechanism is provided for web developers to request specific default behaviors, such as touch behaviors, on their webpages. In at least some implementations, a Cascading Style Sheets (CSS) rule is utilized to enable or disable manipulations such as panning, pinch zoom, and double-tap-zoom manipulations. The mechanism can be extensible to accommodate additional default behaviors that are added in the future. In various embodiments, the behaviors are declared up front and thus differ from solutions which employ an imperative model. The declarative nature of this approach allows achievement of full independence from the main thread and deciding the correct response using independent hit testing.

Abstract: An interactive projector includes a projection section adapted to project a projected screen on a screen surface, an imaging section adapted to take an image of an area of the projected screen, and a pointing element detection section adapted to perform a detection process for detecting the pointing element based on the taken image, which is taken by the imaging section, and includes the pointing element, and the pointing element detection section sections the taken image into a plurality of small areas, and performs the detection process in at least one of the small areas using a parameter different from parameters in the rest of the small areas.

Abstract: An application processes user input with respect to a geographic map to generate annotations associated with locations on that geographic map. Such annotations can include user entered characters and graphics, including curves and lines. The application distinguishes between user inputs that are annotations and user inputs that indicate a request for a route between two locations. In response to user input with respect to a geographic map, the application determines whether the user input is a request for a route. When performing such comparisons, the application uses locations and road segments that are presented at a zoom level corresponding the zoom level applied at the time the user input for the annotation was received. After determining that a user input corresponds to a request for a route, the application generates data describing a route. The application can present a plurality of candidate routes to the user for selection.

Abstract: An apparatus, a method, and a computer program product for gesture recognition. The apparatus classifies a gesture based on a movement of a body part as detected by a primary sensor. The apparatus determine a reliability level of a secondary sensor and obtains corroborating information associated with the movement of the body part using the secondary sensor when the reliability level satisfies a criterion. The apparatus then confirms or negates the classification of the gesture based on the corroborating information. The secondary sensor may be a sensor already known to the apparatus, i.e., the sensor is currently being worn by the user, or it may be a sensor that is worn by a user at a later time. In the latter case, the apparatus detects for the presence of a new sensor, determines the gesture recognition capabilities of the new sensor and integrates the new sensor into the gesture recognition process.

Abstract: As disclosed herein a computer-implemented method includes detecting a gesture applied to a touch display that corresponds to an object, determining a direction for the gesture and determining if a gesture pressure is greater than a threshold pressure required to move the object. The method further includes determining a surface profile of the display and selecting a rate of transfer according to the surface profile of the display, determining if a surface profile of a receiving device is compatible with the surface profile of the display, and transferring the object to the receiving device. A computer program product and a computer system corresponding to the above method are also disclosed herein.

Abstract: A mobile terminal and a method of controlling therefor are disclosed. The method includes activating a memo mode while displaying a screen of a first application; displaying a first touch pattern in response to a first pattern input including the first pattern; displaying a plurality of primary graphic user interface (GUI) items respectively corresponding to a plurality of primary content items associated with the first touch pattern; and displaying content associated with a primary content item corresponding to a selected primary GUI item, wherein the selected primary GUI item is selected from among the displayed plurality of primary GUI items in response to an input, and wherein the displaying of the content is at a position proximate to the displayed first pattern.

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

Abstract: An electronic device and method is disclosed. The electronic device includes a storage module, a recognition module, and a control module. The storage module is configured to store a first and second movement of one or more fingers of a user, and a first and second process. The first movement is different from the second movement. The first process comprises executing an application. The second process is configured to notify information related to the first process. The recognition module is configured to recognize a gesture of one or more fingers as the first movement or the second movement. The control module configured to perform the first process when the gesture is recognized as the first movement. The control module is further configured to perform the second process when the gesture is recognized as the second movement.

Abstract: Embodiments discussed herein include: accessing by a user terminal a recording of a communication session in the form of a media file wherein the media file comprises at least an audio component; accessing by the user terminal, metadata associated with the media file, wherein the metadata comprises an indication of a respective one or more visual representations of each of a plurality of events determined to have occurred during the communication session, wherein at least some of the visual representations comprise text converted from at least one communication stream of the recorded communication session, and wherein the metadata further comprises timing information linking the respective visual representations to the events; playing the media file using a media playing application running on the user terminal; and controlling play back of the media file so that a play back rate of the audio component is synchronized with a rate of a user scrolling through the visual representations.

Abstract: A mobile terminal including a display unit configured to switching between an On state and an Off state, a touch sensor configured to sense touch on the display unit in the On or Off state, and a controller configured to switch at least a portion of the display unit to the On state when displacement of a drag input, dragging a pointer in a predetermined direction, in a first direction reaches a first reference value, output first information in a first area of the display unit when at least the portion of the display unit turns to the ON state, and switch the display unit to the Off state when the pointer, which has dragged in the predetermined direction, is released from the display unit after the display unit is switched to the On state. Further, the display unit is maintained in the On state after the display unit is switched to the On state in response to the drag input while the pointer, which has dragged in the predetermined direction, is touching the display unit.

Abstract: There are provided methods and devices for improving a shopping experience of a user, including methods and devices for creating, updating, and maintaining a list such as a shopping list and methods and devices for automatically identifying a suitable substitute to a user selected product.

Abstract: Provided is an information processing device including a detection unit configured to detect a user operation, and a display control unit configured to display a list including list items, and perform display of, in response to a detected user operation, causing new list items to gradually appear in the list.

Abstract: A method for controlling an electronic device comprises performing a first function and displaying a screen of the electronic device corresponding to the first function, receiving an incoming call, displaying a window on a portion of the screen in response to the reception of the incoming call, the window displaying predetermined information relating to the incoming call, receiving a control signal from a user of the electronic device, and performing a second function in response to the reception of the control signal.

Abstract: A series of depth maps image a scene including a human subject. Each depth map includes a plurality of pixels, where each of the plurality of pixels defines a depth of a surface imaged by that pixel. The human subject is modeled with a virtual skeleton including a virtual hand joint. A position of the virtual hand joint is mapped to a corresponding portion of one or more depth maps in the series of depth maps. One or more fingers are modeled from depth map information of the corresponding portion of the one or more depth maps. A finger gesture is interpreted from the modeled fingers.

Abstract: An operating method of a terminal based on multiple inputs and a portable terminal supporting the same are disclosed. The operating method includes: receiving a sensor signal in a state that a touch-down event having at least one touch point is being maintained, generating respective distinct commands according to at least one of a number of touch points of the touch-down event, and a type and a form of the certain sensor signal, activating one of a user function or controlling an operation of a currently activated user function according to the generated commands; and controlling variation in a screen output on a display panel according to the activation or the control of the user function.

Abstract: The present disclosure relates to a method and an apparatus for controlling a smart device. The method includes: when a first hand gesture is detected, preparing to switch a control relationship according to the first hand gesture and a first mapping relationship, the first mapping relationship including a corresponding relationship between hand gestures and respective control functions; when a second hand gesture is detected, determining a target controlled device according to the second hand gesture and a second mapping relationship, the second mapping relationship including a corresponding relationship between hand gestures and locations of respective controlled devices; establishing a first control relationship with the target controlled device; acquiring a third hand gesture; and controlling, according to the third hand gesture and the first mapping relationship, the target controlled device to perform an operation corresponding to the third hand gesture.

Abstract: When a touch sensor is approached or touched by an object having a small area, the corresponding approach or touch signal might be slightly less than the threshold originally used for normal detection. By comparing the sum of the corresponding approach or touch signal and some adjacent signals with the threshold, the approach or touch of a small-area object that otherwise would not be detected by the original method can be determined.

Abstract: In one example, a method includes determining, by a processor (104) of a wearable computing device (102) and based on motion data generated by a motion sensor (106) of the wearable computing device, one or more strokes. In this example, the method also includes generating, by the processor and based on the motion data, a respective attribute vector for each respective stroke from the one or more strokes and classifying, by the processor and based on the respective attribute vector, each respective stroke from the one or more strokes into at least one category. In this example, the method also includes determining, by the processor and based on a gesture library and the at least one category for each stroke from the one or more strokes, a gesture. In this example, the method also includes performing, by the wearable device and based on the gesture, an action.

Abstract: The invention relates to a method for the detection of the selection of a character of a character string to be input from a character set on an input surface, wherein the selection of at least one character of the character string is detected by evaluating a direction vector and/or by recognizing a shape of a gesture which is input on the input surface.

Abstract: A method for sharing a view presented on a touchscreen of a processing system. Whether a show gesture state is enabled on the processing system and whether a gesture event gate is open on the processing system are determined. The show gesture state determines whether a gesture detected by the touchscreen is depicted onto a version of the view shared with another processing system. The gesture event gate determines whether a corresponding gesture event is passed to an application that is active in the view.

Abstract: A display system that is configured to select one of multiple display regions as an active region and which can avoid complicated operations for selecting an icon is provided. In the display system, one of the display regions is selected as an active region by an input operation to an input screen, and an icon in the active region is selected by another input operation to the input screen. The display system stores a specific input operation in advance as a switching operation, and determines whether an input operation is the switching operation. When the input operation is determined as the switching operation, the display region corresponding to the switching operation is selected as the active region, and the icon in the active region is displayed in a selectable state.