Abstract: Embodiments of a system and method for processing and recognizing non-contact types of human input to prevent contamination are generally described herein. In example embodiments, human input is captured, recognized, and used to provide active input for control or data entry into a user interface. The human input may be provided in variety of forms detectable by recognition techniques such as speech recognition, gesture recognition, identification recognition, and facial recognition. In one example, the human input recognition techniques are used in connection with a device cleaning workflow used to obtain data and human input during cleaning procedures while minimizing cross-contamination between the contaminated device or person and other objects or persons. In another example, the human input recognition techniques are used in connection with a device tracking workflow used to obtain data and human input while tracking interactions with and locations of the contaminated or uncontaminated device.

Abstract: A plurality of characters that are candidates for entry are displayed on a display surface of a display corresponding to an operation surface of a touch panel as character buttons. A touch detector judges whether a user touches the operation surface either with a single point or plural points, and detects a position touched by the user. An input receiver receives an entry of a character associated with a character button in the position touched by the user among the plurality of characters displayed on the display surface of the display. Then, the input receiver receives the entry of the character which varies in type depending on whether the user touches an area in the operation surface corresponding to an identical character button with a single point or plural points.

Abstract: A user interface allows one or more gestures to be devised by a user and mapped or associated with one or more commands or operations of a TV or other device. The user can select the command/operation that is to be associated with each gesture that he/she devised or created. The user is not limited to the use of pre-set gestures that were previously programmed into a system and is not limited to using pre-set commands/operations that were previously associated with pre-set gestures. In alternative embodiments, voice commands or other audible signals are devised by a user and are mapped or associated with commands/operations of a device.

Abstract: A single user interface (UI) handle element is displayed in response to a selection of content. For example, in response to selecting a piece of content (e.g. cell, word, item . . . ), the single UI handle element is displayed near the selection of the content (e.g. near a corner of the selected content). The display of the single UI handle element assists in keeping the display uncluttered as opposed to initially displaying more user interface elements with a content selection. In response to an indication to expand the selection, one or more additional UI handle elements may be displayed to assist the user in changing the selection of content (e.g. an additional handle displayed near another corner of the selection).

Abstract: A mobile device enables refined selections of displayed virtual objects by responding to a user's tapping actions on the sides of the device. The device can move the object by a small increment in a direction opposite the tapped surface, as though the tapping were gently nudging the object away from that surface. For example, if the user taps on the right side of the device, then the device can responsively move a currently selected object leftward by one pixel. Conversely, if the user taps on the left side of the device, then the device can responsively move the currently selected object rightward by one pixel. Similar movements of similar magnitude and in expected directions can be achieved by tapping the top or bottom of the device. Thus, a currently selected object can be moved in a more refined and precise manner than might be possible using a touchscreen alone.

Abstract: A computing device arranged for tracking an object in an image stream provided by a camera, said computing device comprising a memory and a controller, wherein said controller is configured to: track at least one object, identify a gesture, wherein said gesture is defined by said tracked at least one object in free space in front of said camera, retrieve an associated command, and execute said associated command, wherein said associated command is a command for controlling access to the computation device.

Abstract: A terminal device including an operation unit configured to receive an operation instruction performed by an external object; an operation disabling controller which performs control such that when the terminal device is in a disabled state, the operation instruction performed on the operation unit is ignored or the disabled state is cancelled; an operation detector which outputs, when a touch operation by the external object is detected, content of the touch operation as the operation instruction; an operation speed determination unit which determines whether a movement speed of the touch operation is higher than a predetermined threshold; and an operation controller which instructs the operation disabling controller to cancel the disabled state and control execution of a predetermined function when it is determined that the touch operation is an operation instruction to cancel the disabled state and in accordance with the movement speed of the touch operation.

Abstract: In-context compatibility of one or more services or application instances running as services with currently active work is monitored. Respective context-sensitive icons indicate contextual compatibility and availability of corresponding services. The context-sensitive icon is displayed in a graphical user interface of a web application. Availability of one or more services or application instances running as services is indicated in the graphical user interface using different states of the context-sensitive icon. A user may select the icon corresponding to an available and compatible service to be applied to the currently active work in the web application. A single user gesture type command releases the corresponding service.

Abstract: Methods and systems for displaying content on a webpage are disclosed. The method may include receiving an application indication to open a first application on a touch device. The method may further include displaying the first application on the touch device as a panel overlaid on a portion of a viewable area of a webpage that is currently displayed on the touch device, and displaying a first icon on the touch device relative to the panel and the webpage, the icon representative of the first application. The content of the webpage may be viewable and accessible on a single display window for ease of convenience when navigating from the first application to the second application.

Abstract: A device, method and system or performing visual set operations to modify and generate lists, and methods thereof are provided. Provided at a display of a device, are: a first graphical representation indicative of a first list and a second graphical representation indicative of a second list, the first list and the second list comprising common elements, and a graphical intersection of the first graphical representation and the second graphical representation is indicative of the common elements. Via a processor of the device, the graphical intersection is separated from one or more of the first graphical representation and the second graphical representation, such that one or more additional lists are generated based on the separating, each of the one or more additional lists comprising a respective one of: the common elements; the first list minus the common elements; and, the second list minus the common elements.

Abstract: According to one aspect of the present disclosure an apparatus for navigation through historical stored interactions associated with a multi-user view includes a communications fabric, a memory connected to the communications fabric containing computer executable program code, and a processor unit connected to the communications fabric and executing the program code to direct the apparatus to: receive a previously saved multi-user view, wherein the multi-user view comprises a set of artifact attributes; receive an identified filter from a user; present a filtered view to the user; determine whether to amend the filtered view; responsive to a determination to amend the filtered view, generate an amended view from the filtered view; and responsive to a determination to save the amended view, save the amended view as one of a new view or an updated view.

Abstract: A user interface configured to display a screen view representing an application and to receive motion data representing a detected movement, said user interface being further configured to update said displayed screen view to visually counteract said detected movement.

Abstract: A method for setting a two hand mode to operate a touchscreen includes: receiving, via the touchscreen, at least one point of contact on the touchscreen generated by one or more fingers of a user, the touchscreen including a plurality of icons; detecting, by at least one processing device, a total number of the points of contact on the touchscreen and respective coordinates of the points of contact; determining, based on the total number of the points of contact and the respective coordinates of the points of contact, whether the user intends to use two hands to operate the touchscreen; and controlling the touchscreen to display the plurality of icons according to a result of the determining.

Abstract: A method of capturing an image in a device and the device thereof are provided. The method comprises displaying a preview of an image to be captured on a screen of the device; allowing a user to execute an action input through a spatial relationship with a region, wherein the region is any area on the surface of the screen; sensing the action input; comparing the action input to a template stored in a memory of the device, wherein the template is associated with image capturing; and capturing the image if the action input substantially matches the template. The method of capturing images in the device and the device thereof provided by the present disclosure permit a user to easily capture images without clicking a fixed area on the screen.

Abstract: Methods for providing visual feedback when an end area of content is reached are provided. In one aspect, a method includes receiving an input in a first direction to at least one of scroll, rotate, or scale a portion of content provided for display, and determining whether an edge of the content in the first direction is reached in response to the input. The method also includes applying a stretch effect to the displayed portion of content when the determination indicates an edge of the content in the first direction is reached. Systems and machine-readable media are also provided.

Abstract: The creation of augmented reality is described using a real scene. In one example, a process includes observing a real scene through a camera of a device, observing a user gesture through the camera of the device, presenting the scene and the gesture on the display of the device, generating a virtual object and placing it in the scene based on the observed user gesture, and presenting the virtual object in the real scene on the display.

Abstract: An electronic device (1) prevents unintended operations when a contact position shifts, by having a display unit (20) that displays an object, a contact detection unit (10) that detects contact by a contacting body, a pressure detection unit (30) that detects pressure on the detection unit (10), and a control unit (60) that performs processing associated with the object displayed on the display unit (20) in accordance with a contact position of the contacting body in a region of the detection unit (10) corresponding to an receiving region of the object and with data based on pressure on the detection unit (10) acquired from the pressure detection unit (30), such that when the contact position of the contacting body changes as the data based on pressure increases, the control unit (60) changes the receiving region of the object in a direction of change of the contact position.

Abstract: Computer-readable media, computerized methods, and computer systems for intuitively invoking a panning action (e.g., moving content within a content region of a display area) by applying a user-initiated input at the content region rendered at a touchscreen interface are provided. Initially, aspects of the user-initiated input include a location of actuation (e.g., touch point on the touchscreen interface) and a gesture. Upon ascertaining that the actuation location occurred within the content region and that the gesture is a drag operation, based on a distance of uninterrupted tactile contact with the touchscreen interface, a panning mode may be initiated. When in the panning mode, and if the application rendering the content at the display area supports scrolling functionality, the gesture will control movement of the content within the content region. In particular, the drag operation of the gesture will pan the content within the display area when surfaced at the touchscreen interface.

Abstract: In an information terminal including a touch panel defining a plurality of touch points for security data entry by selecting and designating the touch points forming a prescribed graphic security pattern, the first touch point is confirmed only when a pointing member has continued to remain within a prescribed region surrounding the touch point for more than a first prescribed time period while the remaining touch points can be confirmed on a less rigorous condition so that the first touch point can be confirmed only when the user intentionally designates the first touch point, and an inadvertent confirmation of an unintended touch point as the first touch point can be effectively avoided.

Abstract: What is disclosed is a system and method for determining whether a subject is in atrial fibrillation. A video is received of a region of exposed skin of a subject. The video is acquired of a region where a videoplethysmographic (VPG) signal can be registered by at least one imaging channel of a video imaging device. For each batch of image frames, pixels associated with the region of exposed skin are isolated and processed to obtain a time-series signal. A VPG signal is extracted from the time-series signal. The power spectral density (PSD) is computed across all frequencies within the VPG signal. A pulse harmonic strength (PHS) is calculated for this VPG signal. The pulse harmonic strength is compared to a discrimination threshold, defined herein. A determination is made whether the subject in the video is in atrial fibrillation or in normal sinus rhythm.

Abstract: For unlocking touch control of a touch control terminal, it is detected if any unlock object is selected, then the selected unlock object is tracked to see if the selected unlock object has slid to any of a plurality of unlocking positions outside the corresponding locking zone. If positive, the touch control for a function corresponding to the selected unlock object is unlocked.

Abstract: An information processing device includes: a display unit that displays a display screen; an operation unit that accepts a specified operation made on the display screen of the display unit; and a control unit that causes the display unit to display an unlocking screen including an indicator corresponding to a predetermined information processing function, and controls the operation unit into a state of accepting a specified operation on the indicator, based on a request for releasing a locking function of prohibiting a predetermined specified operation from being made on the operation unit, in a state where the locking function is active. The control unit determines that an unlocking operation for releasing the locking function has been input, in a case of accepting a specified operation indicating release of the locking function on the unlocking screen via the operation unit.

Abstract: In an embodiment, a user input defining an enclosed, graphical shape on a video display is received. A number of graphical items are identified as being included within the enclosed, graphical shape. Here, each graphical item is displayed on the video display and represents a data object that has a number of properties. A property is extracted from the number of properties that the data objects have in common based on the identification. A number of other manipulation techniques are also described.

Abstract: A system and method for processing a touch input are provided. An initial press action that is associated with a number of simultaneous touches is detected on a touch interface. One or more commands that are mapped to one or more sequences of user interaction is determined based on the number of simultaneous touches, where each of the one or more sequences of user interaction is initiated by the initial press action. One or more graphical interface components, where each of the one or more graphical interface components correspond to a different one of the one or more sequences of user interaction are provided for display. Each of the one or more graphical interface components indicate at least part of the corresponding sequence of user interaction and indicates respective command mapped to the corresponding sequence of user interaction.

Abstract: Systems and computer program products may provide drilling of displayed content in a touch screen device. A system or computer program may provide detecting a touch gesture by a user on a first portion of displayed content on a touch display. The first portion may include a drillable data element having at least a first dimension, a second dimension and a third dimension. The system or computer program may further provide detecting information associated with the touch gesture, determining a requested drilling action based at least in part on the detected information, the requested drilling action including at least one of a change of a displayed drill dimension and a change of a displayed drill degree, sending the requested drilling action of the first portion to a report server and presenting a drilled first portion on the touch display.

Abstract: An obtainer obtains information indicating a distance between a display and a user picked up by a camera. A display controller displays, in the display screen of the display, an operation screen having the size set in accordance with the information obtained by the obtainer. A determiner determines an operation instruction from the user based on at least one of the motion of the user and the shape picked up by the camera. An executor executes a process in accordance with the operation instruction determined by the determiner.

Abstract: A method of identifying edge swipe gesture has steps of respectively reading sensing signals on an edge area under a hover mode and on a non-edge area under a touch mode; determining if a touch object has appeared on the edge area after determining that the object has appeared on the non-edge area, calculating a displacement of the object moving from the edge area to the non-edge area within a preset time and determining if the displacement exceeds a preset distance, and determining that the movement of the touch is identified as an edge swipe gesture if the displacement meets the condition. Accordingly, the present invention can perform valid touch on the edge area, rendering effective identification of edge swipe gesture and an increased success rate of the identification.

Abstract: A method of modifying an annotation input on an interactive display in an interactive input system is described. Reference pixel values in a region of interest of a reference frame are determined. The region of interest is associated with the annotation. The reference pixel values are stored in memory. It is determined whether current pixel values in the region of interest of a current frame differ from the reference pixel values. The annotation is faded if the current pixel values in the region of interest differ from the reference pixel values. A computing device configured to implement the method and a computer-readable medium having stored thereon instruction to implement the method are also described.

Abstract: A first plurality of contact locations may be determined in view of a first scan of a touch-sensing surface and a second plurality of contact locations may be determined in view of a second scan of the touch-sensing surface. A number of total contact locations may be identified in view of the first plurality of contact locations and the second plurality of contact locations. Furthermore, a first correlation process may be performed when the number of total contact locations satisfies a threshold number and a second correlation process may be performed when the number of total contact locations does not satisfy the threshold number.

Abstract: A method for unlocking a touch screen device includes providing a touch screen device in an idle mode. An area or region displayed on a screen of the device in the idle mode is contacted or activated to reveal at least one application icon associated with an active/unlocked state of the device. The region is moved, expanded or dragged to an edge of the device to change a state of the device to an active/unlocked mode and activate the revealed application.

Abstract: Methods and systems for inputting tone and diacritic marks by gesture are provided. A method may include displaying a keypad for text input. Selection of a key and a gesture may be received. The gesture input may be semantically linked to a phonological property, a diacritic property, and/or a tone. A gesture input may include a substantially horizontal movement to the right associated with a first tone, a movement up and to the right associated with a second tone, a movement down and to the right, then up and to the right associated with a third tone, and a movement down and to the right associated with a fourth tone. A grapheme may be displayed based upon the selected key and the received gesture. With the diacritic and/or tone information, a grapheme may be predicted which may help to reduce the effort and speed of input.

Abstract: A device and method for filtering messages is provided. The device comprises: a processor; a memory storing messages, at least a subset of the messages designated as unread messages; and a touchscreen including a display. A sliding touch input is detected at the touchscreen, the sliding touch input including a change in direction, the sliding touch input terminating in a static touch input proximal an edge of the touchscreen. In response to detecting the static touch input, a list of the unread messages is provided at the display.

Abstract: In one embodiment, a method includes displaying an input tool comprising a first touch icon and a first input icon. The first touch icon may be visually separated from the first input icon by a predetermined distance. The first input icon may provide a graphical indication of an input associated with the first touch icon. The method may include determining an input based on a touch at or substantially near a location on a touch sensor associated with the first touch icon. The method may also include effecting the input as determined.

Abstract: An image display system includes: an image display unit that displays an image indicated by image data on a display surface; a trajectory data generation unit that specifies a position on the display surface indicated by a pointer and generates trajectory data indicating a trajectory of the pointer; and a trajectory data processing unit that performs processing in a mode corresponding to the pointer for the trajectory data generated by the trajectory data generation unit, wherein the image display unit displays an image of a trajectory, which is indicated by the trajectory data generated by the trajectory data generation unit, on the display surface.

Abstract: An interactive content delivery system (10) includes means for displaying visual content (20) to a group of individuals (14), means for detecting a collective gesture (12) of the group, and a control system (26), coupled to the means for displaying visual content (20) and the means for detecting a collective gesture (12). The control system (26) is configured to modify the content in response to the collective gesture.

Abstract: A function execution method and apparatus thereof for displaying one or more sub-functions included in a function selected by a first touch on a trace according to a second touch input based upon the first and the second touches inputted with a timing difference, and executing the relevant sub-function selected among the displayed one or more sub-functions. For this purpose, a function execution method according to the present invention is performed by comprising: detecting a first touch input touched on a display unit; detecting a drag created by a second touch inputted while maintaining the first touch; and displaying one or more sub-functions included in a function selected by the first touch along a trace of the detected drag on the display unit.

Abstract: At least some aspects of the present disclosure feature a computing device configured to receive an input image of an environment having a plurality of physical notes. The computing device automatically processes the input image to identify at least some of the plurality of the physical notes in the input image and displays the input image and indications indicative of the identified physical notes on a user interface. The computing device receives a user input indicating a position within the input image via a user interface and, responsive to the user input, recognizes proximate to the position a missed one of the physical notes that was not identified by the computing device when initially processing the input image.

Abstract: An electronic device, while in an interaction configuration mode for a first application, concurrently displays: a first user interface, one or more interaction control user interface objects, and an application restriction controls display user interface object for the first application. The device detects a first gesture, and in response, displays application restriction control user interface objects for the first application. A respective application restriction control user interface object indicates whether a corresponding feature of the first application is configured to be enabled in a restricted interaction mode. The device detects a second gesture, and changes display of a setting in the first application restriction control user interface object for the first application. The device detects a second input, and in response, enters the restricted interaction mode for the first application.

Abstract: Aspects of the disclosure may relate to detecting, by a computing device, a first user input comprising a first gesture to interact with a touch-sensitive screen of the computing device. Aspects may also include detecting a second user input comprising a second gesture using the touch-sensitive screen of the computing device. Aspects may also include, responsive to detecting the first user input, initiating a hover mode of interaction in a graphical user interface.

Abstract: According to an aspect, a portable electronic apparatus includes a display unit for displaying an image; an input detection unit for detecting contact with an area in which the image is displayed by the display unit as input; and a control unit for causing the display unit to display a plurality of item objects and a group object surrounding the item objects. If the input detection unit detects first input of coming into contact with two different points in an area in which the group object is displayed and moving the contact with at least one of the two different points in a direction away from the other while maintaining the contact, the control unit causes the display unit to display the item objects in an aligned manner in a direction in which the distance between the two points increases.

Abstract: A mechanism for allowing a user to prove their identity on touch-based devices employing the use of a touch surface in firmware-controlled environments is discussed. The user may prove his or her identity by entering a series of strokes on the touch-based device to form a word or image. Characteristics of the entered strokes such as stroke order and stroke direction are compared to stored stroke characteristics that were gathered from a drawing of the same word or image during a user enrollment process. If the stroke characteristics comparison is acceptable, the user identity is verified.

Abstract: A method and system are presented which will detect combinations of user touches on a touch screen device as nodes, and will create shapes, areas and windows from these nodes. Where the device has a communications capability, the locally defined shapes, areas and windows can be shared with remote users and databases, and similarly shapes, areas and windows created by others can be viewed on a local display. The method and system are of particular benefit to drawing applications, windows definition on touch screen devices, real estate management, navigation, and exploitation of mapping resources.

Abstract: Information from a position and/or gesture detection system can be transmitted to various devices in order to enable users to interact and/or view others users. In some embodiments, video is captured that includes a current view of the body of a user. In order to prevent an unauthorized, unintended, or undesired transmission of at least part of the body image data, one or more settings or policies can be specified that can control which portions are transmitted, received, and/or displayed. For example, a user can be prompted before body image or position data is transmitted, which enables a user to control the type of data that is sent. A recipient or intermediate entity or component can also specify one or more settings or policies to control the type of data that is transmitted and/or received. In some embodiments, an external service can be utilized to manage the transmission of data.

Abstract: An image forming apparatus, as a displaying device, displays the 2nd printing page out of a plurality of printing pages on an operation panel when the 1st to 10th images were allocated to each of the printing pages. The image forming apparatus maintains an allocation state of the 1st printing page anterior to the 2nd printing page and changes an allocation state of at least one of images corresponds to the contact points with the operation panel, when the image forming apparatus receives a gesture operation moves the contact points. The starting points of the contact points are in the 2nd printing page displayed on the operation panel.

Abstract: A gamma compensation method and a display device using the same are disclosed. The gamma compensation method includes: sensing a level of external illuminance; determining whether the sensed level of external illuminance is equal to or lower than a predetermined illuminance, wherein when the sensed level is equal to or lower than the predetermined illuminance, the luminance of the display device is reduced to an optimum luminance; and modulating gray levels of input data of the display device based on a first gamma curve when the sensed level of external illuminance is equal to or lower than the predetermined illuminance, and modulating based on a second gamma curve when the sensed level of external illuminance is greater than the predetermined illuminance, wherein the first gamma curve includes a concave curve set in a low gray level area and a convex curve set in a high gray level area, and the concave curve and the convex curve are connected via an inflection point.

Abstract: A method for providing a graphical user interface on a display of a device includes displaying a photograph image on the display of the device, detecting a touch on the display, providing a plurality of control guides at a location corresponding to the touch over the displayed photograph image, in response to detecting the touch, detecting a first drag in a first direction corresponding to a first one of the plurality of control guides provided on the display, removing the plurality of control guides from the display in response to detecting the first drag, detecting a second drag in a second direction different from the first direction of the first drag and corresponding to a second one of the plurality of control guides, the second drag is performed while maintaining touch on the display after the first drag is performed, adjusting a display characteristic of the photograph image corresponding to the second one of the plurality of control guides corresponding to the second drag, and displaying the photograp

Abstract: An input display apparatus includes the following elements. A display unit has a display area. A receiver receives plural types of gestures which are performed on the display area. A setting unit sets plural settings for an apparatus in accordance with the types of gestures received by the receiver. A display controller controls the display unit to display at least one of the plural settings and gesture guidance information for guiding an input of a gesture which is associated with the setting to be displayed.

Abstract: An input display apparatus includes the following elements. A display unit has a display area. A receiver receives plural types of gestures which are performed on the display area. A setting unit sets plural settings for an apparatus in accordance with the types of gestures received by the receiver. A display controller controls the display unit to display at least one of the plural settings and gesture guidance information for guiding an input of a gesture which is associated with the setting to be displayed.

Abstract: A method for sharing a view presented on a touchscreen of a processing system. Whether a show gesture state is enabled on the processing system and whether a gesture event gate is open on the processing system are determined. The show gesture state determines whether a gesture detected by the touchscreen is depicted onto a version of the view shared with another processing system. The gesture event gate determines whether a corresponding gesture event is passed to an application that is active in the view.

Abstract: A user is able to triage information on a touch-enabled computing device. Information objects are displayed on a touch-sensitive screen of the device. Whenever the user makes a first gesture on the screen using a first user input modality, the first gesture and that it was made using this first modality are identified, a first information management operation specifically associated with the first gesture being made with this first modality is also identified, and this first operation is implemented on the objects. Whenever the user subsequently makes a second gesture on the screen using a second user input modality which is different than the first modality, the second gesture and that it was made using this second modality are identified, a second information management operation specifically associated with the second gesture being made with this second modality is also identified, and this second operation is implemented on the objects.