Abstract: An apparatus, that may include a processor configured to receive a touch input associated with a first information item, determine a first set of at least one additional information item associated with said first information item, based at least in part on said touch input, generate a first visual representation based at least in part on said first set, and display said first visual representation is disclosed. A corresponding method and computer-readable medium are also disclosed.

Abstract: Generating a situation-dependent library comprising a user's expected response to tokens representing stimuli that influence the user's affective state, including: receiving samples comprising temporal windows of token instances to which the user was exposed, wherein the token instances have overlapping instantiation periods and are spread over a long period of time that spans different situations; wherein at least one token is expected to elicit from the user a noticeably different affective response in the different situations; receiving target values corresponding to the temporal windows of token instances; the target values represent the user's responses to the token instances from the temporal windows of token instances; training a machine learning-based user response model using the samples and the corresponding target values; and analyzing the machine learning-based user response model to generate the situation-dependent library comprising the user's expected response to tokens, which accounts for the

Abstract: In an example embodiment, a method of presenting marketplace listings is provided. Search parameters are received from a user interface on an electronic device. A search on marketplace listings is then performed using the search parameters, returning marketplace results. The marketplace results are then organized into a plurality of web pages, each web page corresponding to a different marketplace result, with each page organized so that a row on any one of the web pages corresponds to the same type of product attribute as that row on any of the other of the plurality of web pages. Then one of the plurality of web pages is displayed on the electronic device. When a swipe left or swipe right gesture is received, another of the plurality of web pages is displayed.

Abstract: A mobile terminal capable of giving an instruction for a device linkage by simple operations, without any special hardware. The mobile terminal which is connected to a TV through a communication path includes: a communication I/F unit for communicating with the TV, a storage unit which stores content to be displayed on the TV; a display unit having a touch pad and a display screen; and a control unit which displays, on the display screen, a content icon associated with the content. When detecting that the content icon is pressed and held and then is flicked on the display unit, the control unit reads the content from the storage unit and transmit it to the TV through the communication I/F unit, so that the content is displayed on the TV.

Abstract: In one embodiment, a method includes displaying a digest of messages and notifications without launching applications associated with the messages or notifications, receiving a user input selecting an interactive element in the digest corresponding to a message or notification, displaying the message or notification corresponding to the selected interactive element without launching the application associated with the message or notification, receiving a second user input interacting with the message or notification, executing a messaging or notification function corresponding to the interaction without launching the application associated with the message or notification.

Abstract: Technologies are generally described for pausing and resuming a gesture-based game. In some examples, a method performed under control of a gesture-based game system includes receiving a pause command that indicates pausing play of a gesture-based game and in response to the receipt of the pause command, capturing a first image of a player currently playing the gesture-based game, the first image being associated with a first posture of the player substantially at the time of the pause command and generating an outline of the player corresponding to the first image of the player.

Abstract: A method and apparatus of providing a mouse function in a touch device includes displaying a mouse interface which is divided into a panning area and a pointer move area. An input of a mouse gesture is received through the mouse interface, processing a panning operation of a contents screen which is displayed in a display device when the mouse gesture is inputted in the panning area, and processing a move operation of a mouse pointer which is displayed in the display device when the mouse gesture is inputted in the pointer move area. The touch device at the time of execution of the mouse mode, and generates a control event for panning the contents screen and moving the mouse pointer according to a mouse gesture which is inputted from the panning area and the pointer move area may provide a mouse function for a display device.

Abstract: The disclosed embodiments include a mobile client device for automatically performing a mobile financial service function, including a memory storing software instructions, the software instructions including a mobile financial service application configured to perform financial service processes. The system may also include and one or more processors configured to execute the software instructions to detect a physical action performed on the mobile client device, and determine a first financial service function to perform based on the detected physical action, wherein the first financial service function is a function provided by the mobile financial service application. The one or more processors may also determine whether verification of a user is required, verify the user if verification of the user is required, and automatically initiate the first financial service function.

Abstract: Systems and methods are provided to record and play back computer-based sessions including events and accompanying audio information. Recording computer-based sessions includes recording an event received at a computer device, the event being recorded in a format that does not involve a video screen shot of the event, recording audio information received at the computer device, the audio information being received in temporal proximity to the event, and storing the recorded event and the recorded audio information as a recorded session. Playing a recorded session includes accessing the recorded session, stepping through the recorded session in a time-based fashion while playing any audio information corresponding to a particular time, detecting a recorded event at a particular point in time, and playing back the recorded event in conjunction with any audio information corresponding in time to the recorded event, such that the recorded event is recreated on a playback device.

Abstract: A method of controlling a mobile apparatus having a hand writing function using a multi touch includes detecting a hand writing input that is input to a hand writing input window on a touch screen of the mobile apparatus, determining whether the detected hand writing input is a multi touch input or a single touch input, generating a hand writing output including multi touch output corresponding to the multi touch input and single touch output corresponding to the single touch input; and displaying the hand writing output in an output window on the touch screen.

Abstract: A touch screen assembly including a glass screen, LEDs, photo diodes, a transparent plastic frame surrounding the screen, and a light guide that guides light emitted by the LEDs to the photo diodes along light paths that go under the frame on one side, over the screen, and under the frame on the opposite side, and a processor operative to selectively activate LEDs and photo diodes, to identify location of an object touching the screen, based on amounts of light detected by activated photo diodes when light emitted by activated LEDs is blocked along its light path by the object, and to recognize the object touching the frame, based on amounts of light detected by activated photo diodes when light emitted by activated LEDs is absorbed along its light path by the object, thereby providing light-based touch sensitivity to the screen and to the frame.

Abstract: A flexible touch screen panel includes a substrate, sensing patterns, sensing lines, and at least one bending sensor. The substrate is divided into an active area and a non-active area around the active area. The sensing patterns are on the active area of a first surface of the substrate. The sensing lines are on the non-active area of the first surface of the substrate and connected to the sensing patterns. The at least one bending sensor is implemented with a plurality of sensing patterns at an edge region in the active area. In the flexible touch screen panel, the substrate is configured to be bent along a folding axis in a first direction, and the at least one bending sensor is at a region along the folding axis.

Abstract: Embodiments that relate to providing a low-latency interaction in a virtual environment are provided. In one embodiment an initial image of a hand and initial depth information representing an initial actual position are received. The initial image is projected into the virtual environment to an initial virtual position. A segmented version of the initial image is provided for display in the virtual environment at the initial virtual position. A subsequent image of the hand and depth information representing a subsequent actual position are received. The subsequent image is projected into the virtual environment to a subsequent virtual position. A segmented version of the subsequent image is provided for display at the subsequent virtual position. A collision is detected between a three-dimensional representation of the hand and a virtual or physical object.

Abstract: A touch screen system including a reflective display surface, a camera mounted so as to capture an image of (i) the reflective display surface, (ii) a pointer approaching the reflective display surface, and (iii) a reflection of the pointer on the reflective display surface, and a processor coupled with the camera that determines a three-dimensional location of the pointer relative to the reflective display surface, based on the positions of the pointer and the reflection of the pointer in the image captured by the camera.

Abstract: Methods and devices for selectively presenting a user interface for an email application are provided. More particularly, a change in the operating mode of a multiple virtual display smartpad device from a multiple virtual display operating mode to a single virtual display operating mode, or from a single virtual display operating mode to a multiple virtual display operating mode, can be determined. Moreover, a change in the operating mode can effect a change in a presentation of a user interface associated with an email application. More particularly, a presentation of a user interface can be retained, where the number of virtual displays of the device in view of the user is changed, provided a user interface for the email application remains in view of the user after the change in operating mode.

Abstract: User-based control over the operation of a mobile terminal is provided in response to detecting a user's touched position on one or more grip sensors in the mobile terminal. At least one icon set by the user to be displayed in response to detection of at least a predetermined amount of pressure on an actuated grip sensor is displayed depending on the detected touch position.

Abstract: Methods and systems for configuring on touch screen enabled devices custom gestures and custom soft buttons that are equivalent to default gestures configured on such devices allow equivalent custom gestures and soft buttons to be configured seamlessly on such devices without invoking a configuration tool or widget, enable multiple custom gestures and soft buttons equivalent to a particular default gesture to coexist on such devices and permit sets of personal equivalent custom gestures and soft buttons to be saved and loaded on such devices by particular users.

Abstract: Disclosed are a display device and a control method thereof. The display device and the control method include a camera acquiring an image including a gesture made by a user, and a controller extracting an object making the gesture from the image acquired by the camera, and setting a specific spot in the extracted object to be a reference point of a movement of the object, the controller fixing the reference point to a set location regardless of a change in a shape of the extracted object. Accordingly, a reference point is set at a specific spot of an object having made a gesture corresponding to the acquisition of control thereon, thereby allowing for the accurate and effective recognition of a gesture made by a user.

Abstract: In accordance with one embodiment, a navigation system includes a display device configured to detect user gestures, a data storage device including program instructions stored therein, a map stored within the data storage device, and a controller operatively coupled to the data storage device and the display device and configured to execute the program instructions to receive first user gesture data associated with a first portion of a first user gesture from the display device, generate a first predicted user gesture data based upon the stored map and the first user gesture data, and control the display device to render the first predicted user gesture data as the user is continuing the first user gesture.

Abstract: A data structure stored in memory including: token instances representing stimuli that influence a user's affective state; the token instances are spread over a long period of time that spans different situations, and a plurality of the token instances have overlapping instantiation periods; data representing levels of user attention in some of the token instances used by an application program to improve the accuracy of a machine learning based affective response model for the user; annotations representing emotional states of the user; the annotations are spread over a long period of time that spans different situations; and linkage information between the token instances, the data representing levels of user attention, and the annotations.

Abstract: A system includes, but is not limited to: one and one or more display control modules configured to direct controlling display of one or more portions of the bendable interface containing electronic device regarding display of second information in response to the information associated with the one or more changes in one or more sequences of two or more conformations of the one or more portions of the one or more regions of the bendable interface containing electronic device. In addition to the foregoing, other related system/system aspects are described in the claims, drawings, and text forming a part of the present disclosure.

Abstract: A method for selecting multiple content items in a list of content items is presented. In an embodiment, the method first displays a list of content items along the first direction on a display of the computing device. Then, the method detects a first portion of gesture for selecting a first content item in the list of content items. While the first content item is selected, the method detects a trigger for a second portion of the gesture, and then selects at least one second content item based on the second portion of the gesture. The trigger for the second portion of the gesture is a scroll gesture, and while the first content item is selected the scrolling of the list is disabled. A method for manipulating multiple content items in a list of content items is also presented.

Abstract: A system is provided for detecting an effective section of a gesture by recognizing the gesture, pose information and motion information included in the gesture from an acquired image. In addition, a controller determines whether a pose has been recognized based on the pose information and when the pose has been recognized, an effective section is detected based on a start point and an end point of the pose. Further, when the effective section for the pose is detected, the gesture is recognized based on the motion information.

Abstract: An information input device includes a display, an input unit, an input direction determining unit, a tag arranging unit and a movable direction determining unit. The movable direction determining unit specifies, based on a first operation position on an input area of the input unit, a division part including the first operation position from among plural division parts on the input area. The tag arranging unit displays a tag indicating a slide operation pattern of an operator associated with the specified division part in the vicinity of a selection operation object or on the selection operation object on a display area of the display. The input direction determining unit detects, based on a second operation position on the input area, a slide operation pattern of the operator, and determines whether or not the detected slide operation pattern matches the slide operation pattern indicated by the tag within a certain range.

Abstract: The present invention is directed toward a method and apparatus in which one or more user specific windows may be launched within a single computing session executed and displayed on the display of an interactive table. More specifically, the present invention is directed toward detecting the position of one or more users around an interactive table and generating one or more user-specific windows proximate to one or more user/s on the display of the interactive table within a single session.

Abstract: Disclosed with are a display device and a control method thereof. The method includes recognizing a first motion of a user; and assigning a control right to perform functions of the display devices through motions to the user in response to the recognized first motion.

Abstract: A personal information communicator may include a remote device detector, a display, a remote device location detector, an information collection module, a presentation module, a selection module, a linking module, and an expression module. The remote device detector may receive an indicator from remote device(s) in an external region of space. The display may present a representation of a field of view of the region of space. The remote device location detector may determine the location of remote device(s). The information collection module may collect data associated with the remote device(s) within the field of view. The presentation module may present identifying information for each of the one or more remote devices on the display, the identifying information determined at least in part using the data. The selection module may pick selected remote device(s) from the remote device(s). The linking module may link to the selected remote device(s).

Abstract: A system and method for facilitating adjusting a displayed representation of a visualization. An example method includes employing a touch-sensitive display to present a user interface display screen depicting a first visualization; and providing a first user option to apply touch input to a region of the user interface display screen coinciding with a portion of the first visualization to facilitate affecting an arrangement of data displayed via the first visualization, wherein the touch input includes a multi-touch gesture. In a more specific embodiment, the touch gesture includes a rotation gesture, and the method further includes displaying a visual indication of a change, e.g., a pivot operation, to be applied to a second visualization as a user performs the rotation gesture, and updating the second visualization as a user continues perform the rotation gesture. The first visualization is updated based on the second visualization upon completion of the rotation gesture.

Abstract: There is disclosed an electronic device comprising a receiver, a display, an application processor and a sensor hub. The receiver is configured to receive notifications from a remote device. The display is configured to provide information including notifications. The application processor and the sensor hub are in communication with the display. The application processor is configured to provide instructions for displaying full screen information at the display during a non-sleep mode of the electronic device. The full screen information includes a first notification associated with information received by the electronic device during the non-sleep mode. The sensor hub is configured to provide instructions for displaying partial screen information at the display during a sleep mode of the electronic device. The partial screen information includes a second notification associated with information received by the electronic device during the sleep mode.

Abstract: An electronic device, a controlling method thereof, and a non-transitory storage medium are provided. The method includes displaying a first user interface of a first mode in a first area of a touch screen of the electronic device and one or more snapshots of a second user interface of a second mode in a second area of the touch screen while the electronic device is in the first mode. The method also includes detecting a first sliding gesture on or near the touch screen. The method further includes switching the electronic device from the first mode into the second mode if the first sliding gesture complies with a predetermined switching condition.

Abstract: [Structure] A mobile phone (10) includes a touch panel (38) and a touch control circuit (36) detecting a touch operation, and can set a lock state that a telephone function or the like is restricted. If the lock state is set and a key operation is performed, a message urging to long-depress a touch is displayed on a display (30), and when the touch is detected, a changing object representing an elapse of time is displayed on the display (30). If five (5) seconds elapse in a touched state, a completion image is displayed on the display (30). Then, if a finger is released from the touch panel (38) within three (3) seconds after the completion image is displayed, the lock state is canceled.

Abstract: A mobile terminal and controlling method thereof are disclosed, by which a terminal can be used in further consideration of user's convenience. The present invention includes displaying at least one object on a display unit of a touchscreen type provided to a front side of a housing of a bar type, if a first touch gesture is performed on the object, enabling the object to move from the main display unit via a first subdisplay unit provided to one lateral side of the housing to a second subdisplay unit of the touchscreen type provided to a backside of the housing, and if a second touch gesture is performed on the object displayed on the second subdisplay unit, enabling the object to move to the main display unit via the first subdisplay unit from the second subdisplay unit. Accordingly, when a touchscreen is attached to at least two sides of a mobile terminal, a terminal user is facilitated to use the mobile terminal in a manner of utilizing how to display the touchscreen provided to the at least two sides.

Abstract: Techniques are provided for displaying electronic communications using a head mounted display (HMD). Each electronic communication may be displayed to represent a physical object that indentifies it as a specific type or nature of electronic communication. Therefore, the user is able to process the electronic communications more efficiently. In some aspects, computer vision allows a user to interact with the representation of the physical objects. One embodiment includes accessing electronic communications, and determining physical objects that are representative of at least a subset of the electronic communications. A head mounted display (HMD) is instructed how to display a representation of the physical objects in this embodiment.

Abstract: A head mounted device provides an immersive virtual or augmented reality experience for viewing data and enabling collaboration among multiple users. Rendering images in a virtual or augmented reality system may include performing operations for capturing an image of a scene in which a virtual object is to be displayed, recognizing a body part present in the captured image, and adjusting a display of the virtual object based upon the recognized body part. The rendering operations may also include capturing an image with a body mounted camera, capturing spatial data with a body mounted sensor array, recognizing objects within the captured image, determining distances to the recognized objects within the captured image, and displaying the virtual object on a head mounted display.

Abstract: A computer implemented method, system and computer program product features “Info Dial UI,” a degree-based and tactilely-initiated dialing gesture for providing product information to a user. This feature allows the user to tactilely control the amount of product information displayed to the user as the user tactilely moves an indicia along an arc. It also features a related “Circle a Product” feature. This method, system and computer program product provides the user with prompts and guidance for improving product purchases via mobile encoding technology and personal computing devices.

Abstract: A system to manage operation of plural devices has an acquiring unit configured to acquire information from a user giving a physical signal to use one of the devices, a user identification unit configured to identify the user based on the information acquired by the acquiring unit, a device identification unit configured to identify a device the user intends to use based on the information acquired by the acquiring unit, a signal identification unit configured to identify the physical signal based on the information acquired by the acquiring unit, and a control unit configured to recognize the meaning of the physical signal based on the identified user, identified device, and identified physical signal, and transmit a control signal corresponding to the physical signal to the identified device.

Abstract: Techniques are disclosed for providing a content selecting mode in electronic touch screen devices. The content may be, for instance, text, graphics, images, files, and/or other consumable content. The user can engage the mode with a combination of gestures and touch points on the touch screen. The combination may include, for example, one or two initial touch points at a desired starting location of the target content, followed by a dragging gesture with two or more touch points moving from that location to the desired end location of the target content, wherein content between the starting and end locations is highlighted or otherwise selected. In one example case, if the initial touch includes multiple touch points then selecting of the target content may commence immediately, while a single initial touch point causes selecting to commence after a brief hold or the addition of another touch point at the starting location.

Abstract: An aspect provides a method, including: detecting, on a touch screen of an information handing device, user input; determining, using a processor, that the user input occurs within a predetermined edge region of the touch screen; adjusting, using a processor, display output of the touch screen based on the user input that occurs within a predetermined edge region; and filtering, using a processor, the user input that occurs within a predetermined edge region such that the user input does not commit an input action on the information handling device. Other aspects are described and claimed.

Abstract: A gesture input device includes: a coordinate input detecting unit which sequentially detects coordinate set sequences of a user hand position; a gesture start detecting unit which detects a component indicating a first hand movement for starting a gesture, from a detected first coordinate sequence; a guide image generating unit which generates a gesture guide image for guiding the user to make a gesture including a second hand movement, when the first hand movement component is detected; an intended action component detecting unit which detects a second hand movement component as an intended action component, from a second coordinate sequence detected after the gesture guide image is displayed on the display screen; and a control signal generating unit which detects a component indicating a hand movement corresponding to the gesture from the second coordinate sequence when the intended action component is detected, and generate a control signal according to the detection result.

Abstract: Aspects relate to detecting gestures that relate to a desired action, wherein the detected gestures are common across users and/or devices within a surface computing environment. Inferred intentions and goals based on context, history, affordances, and objects are employed to interpret gestures. Where there is uncertainty in intention of the gestures for a single device or across multiple devices, independent or coordinated communication of uncertainty or engagement of users through signaling and/or information gathering can occur.

Abstract: A method and an apparatus for operating an electronic device for changing a setting value are provided. In the method, a touch input for a set region is detected, so that a mode is switched to a setting change mode for changing a stored setting value. At least one guide interface for receiving a change of at least one setting value among stored setting values is displayed. A predetermined gesture for an arbitrary region of the displayed at least one guide interface is detected, so that whether to store a changed at least one setting value is determined.

Abstract: A mobile terminal and touch recognizing method therein are disclosed, by which a multi-touch can be recognized. The present invention includes receiving a plurality of touches simultaneously using a touchscreen, consecutively receiving a plurality of images including a plurality of the received touches for a predetermined time using a camera provided under the touchscreen, determining patterns and pattern changes of a plurality of the touches included in a plurality of the images, respectively, and recognizing a gesture by a plurality of the touches in accordance with a result of the determining step. Moreover, the touch pattern includes at least one selected from the group consisting of a touch number, a touch point, a touch size and a touch figure.

Abstract: A method, system and non-transitory computer-readable medium are provided for controlling display of content on an electronic device with a touch screen display, which content may, in response to detection of a squeeze gesture, be reduced on the display screen to reveal additional content, tools and features associated with the one or more pages of the content.

Abstract: When a device is rotated from a portrait orientation to landscape orientation, or vice versa, the display device rotates the content items within distinct respective content regions of a page template (“slots”) that each appear to stay in their same position with respect to a frame of reference of the display device. While the content regions stay in their same positions, the content within each content region counter-rotates in place to offset the rotation of the display device. Thus, the content within the content regions maintains an orientation with respect to a constant (non-rotating) frame of reference, regardless of the orientation or rotation of the display device. In one embodiment, a slot's position, height, and width in a template in a second orientation are determined from the slot's position, height, and width in the template in a first orientation.

Abstract: One or more computing devices may detect the presence of a user, determine default communication mode for communicating with the user, use the default communication mode to elicit a communicative gesture from the user, receive a signal identifying at least one communicative gesture from the user, and convert the identified communicative gestures into a command. The default communication mode may be based on the identity of the user. Alternatively, the default communication mode can be determined by using a first mode of communication to prompt the user to make a mode-selection gesture, and if a mode-selection gesture is detected from the user within a threshold period of time, setting the first mode of communication as the default communication mode. Otherwise, if no mode-selection gesture is detected within a threshold period of time, using an alternative mode of communication to prompt the user to make a mode-selection gesture.

Abstract: Disclosed herein are methods for presenting speech from a selected text that is on a computing device. This method includes presenting text on a touch-sensitive display and having that text size within a threshold level so that the computing device can accurately determine the intent of the user when the user touches the touch screen. Once the user touch has been received, the computing device identifies and interprets the portion of text that is to be selected, and subsequently presents the text audibly to the user.

Abstract: An electronic device with a display and a touch-sensitive surface displays, on the display, a first visual indicator. The electronic device receives a first single touch input on the touch-sensitive surface at a location that corresponds to the first visual indicator; and, in response to detecting the first single touch input on the touch-sensitive surface at a location that corresponds to the first visual indicator, replaces display of the first visual indicator with display of a first menu. The first menu includes a virtual touches selection icon. In response to detecting selection of the virtual touches selection icon, the electronic device displays a menu of virtual multitouch contacts.

Abstract: Techniques are provided for allowing a user to select a region within virtual imagery, such as a hologram, being presented in an HMD. The user could select the region by using their hands to form a closed loop such that from the perspective of the user, the closed loop corresponds to the region the user wishes to select. The user could select the region by using a prop, such as a picture frame. In response to the selection, the selected region could be presented using a different rendering technique than other regions of the virtual imagery. Various rendering techniques such as zooming, filtering, etc. could be applied to the selected region. The identification of the region by the user could also serve as a selection of an element in that portion of the virtual image.

Abstract: A native application can be deployed that obtains configuration information for the native application at run-time. Digital marketing users or other marketing users can view or control the behavior of the native application by displaying or setting the configuration information of the native application. The native application can report tracked end user interactions and events with the native application according to the configuration information to tag management systems for data compilation by the tag management systems. In addition, the native application can enable digital marketing users or other marketing users to view or control the behavior of the native application from within the native application using an integrated configuration utility. The configuration utility can be activated using a two-stage activation process or an activation and authorization process to prevent an end user from accidentally encountering the configuration utility during routine use of the native application.

Abstract: This document describes techniques and apparatuses for determining an audience's state or interest using passive sensor data. The techniques receive sensor data that measures an audience during presentation of a media program. The techniques, based on this sensor data, then determine a state or interest of the audience members during the media program.