Abstract: A haptic device includes a display configured to display an image, a haptic output device configured to generate a haptic effect to a user when the user interacts with the display, and a processor configured to receive information related to the image displayed on the display. The processor is also configured to create a friction based haptic effect map associated with the image displayed on the display, and generate a signal to the haptic output device to output the haptic effect when the user interacts with the display when the image is displayed on the display, the haptic effect being configured to simulate a feel of the image in three dimensions.

Abstract: Computer-readable media, computerized methods, and a touchscreen device manipulating user-input elements are provided. Generally, manipulation includes identifying a predefined configuration associated with a request received from a user and/or application, deriving configuration settings from the predefined configuration, and transmitting the configuration settings to an electromechanical device that adjusts a portion of user-input elements to an extended orientation and activates a portion of user-input elements. In embodiments, the extended user-input elements positioned in the extended orientation are activated, while the remainder are set to an idle condition. Typically, the extended user-input elements produce outwardly-extending protrusions expressed at a flexible touchpad incorporated in the touchscreen device. These outwardly-extending protrusions may replicate keys of a standard keyboard and correspond with the presently-running application implemented on the touchscreen device.

Abstract: A computer-implemented method for use at a portable multifunction device with a touch screen display includes displaying a web page or portion thereof on the touch screen display. An activation of an options icon is detected. In response, a plurality of icons including a web-clip widget creation icon is displayed. An activation of the web-clip widget creation icon is detected; in response, a web-clip widget is created corresponding to the displayed web page or portion thereof.

Abstract: Provided is an information processing apparatus including an operation display unit for displaying a display screen and detecting an operation location on the display screen based upon a user operation on the display screen, a pressure detecting unit including a plurality of pressure sensors for detecting a pressure value according to the user operation on the operation display unit for each of the plurality of pressure sensors, an operation type determining unit for determining a type of the user operation, a deriving unit for selectively deriving a barycentric location on the display screen based upon detection results from the plurality of pressure sensors, based upon a determination result from the operation type determining unit, and an estimating unit for estimating a pressure value on the operation location, based upon a derivation result from the deriving unit and upon information of barycentric location candidates.

Abstract: In one example, a method includes outputting, for display at a presence-sensitive display, a graphical user interface including a text display region and a graphical keyboard. The method further includes receiving an indication of a first gesture detected at a location within the text display region, and selecting, based at least in part on the location within the text display region, at least a portion of a character string included in the text display region. The method further includes receiving, while the first gesture is detected at the presence-sensitive display, an indication of at least a portion of a second gesture to select at least one key of the graphical keyboard, and outputting, responsive to receiving an indication of a termination of at least the second gesture, a replacement character string for display within the text display region to replace the portion of the character string.

Abstract: Apparatus, systems and methods are provided for simulating a material. In particular, the disclosed apparatus, systems and methods involve modeling deformation characteristics of a material and generating a virtual representation of a physical interaction with the material based on the modeled deformation characteristics of the material and data representative of the physical interaction.

Abstract: The present invention relates to a method for differentiating haptic feelings by a selection menu of a rotary switch, in which haptic feelings of the switch or rotary switch can be differentiated by each menu when scrolling the rotary switch in order to setup or select a variety of functions of an electronic product. Specifically, the haptic feelings by vibration and resistance against turning the switch are transferred to a user at different strengths when the user scroll-manipulates a switch to select a variety of menus, selects items of a first menu, transits first menu from the first menu to a second menu, and selects items of each second menu, so that the user can easily perceive the positions of the respective menus even without watching a cluster display window.

Abstract: A user interface method for use with a touch gesture user interface in a system implementing global or universal gestures and application-specific gestures for the control of software executing on a device comprising a touch user interface and a computational processor wherein the touch gestures are responsive to at least one finger angle. In an example implementation, wherein when a gesture with an application-specific association is recognized, the user interface operation is determined by the software application that has a currently active user-interface focus. In an example implementation, a global or universal gesture is used to control the system. In an example implementation, a global or universal gesture is used to control a software application executing on the system. In an example implementation, the user interface operation is context-specific.

Abstract: A system and method for on-demand user control may detect a user's intend to interact with a currently undisplayed user control. The user's intent may include, for example, a hand approaching a touch-sensitive screen device. In response to the detected intent, the currently undisplayed user control may be displayed. The choice and location of the displayed user control may be derived from a location associated with the detected intent. The user control may be displayed progressively giving the appearance of morphing, emerging or being extruded from the display screen. The user may interact with the displayed user control using, for example, gestures on the touch-sensitive screen device.

Abstract: Systems, methods, and associated software are described herein for enabling a regular user of an end user device, such as a cellular telephone, to customize parameters associated with haptic effects applied to the user by the end user device. In one implementation, among several, a method described herein includes enabling a user of an end user device to access software adapted to design or modify haptic effects of the end user device. The method further includes enabling the user to open a haptic track file and enter or modify parameters associated with the haptic effects of the opened haptic track file.

Abstract: Embodiments of systems and methods for interpreting physical interactions with a graphical user interface are disclosed. For example, one system for interpreting physical interactions with a graphical user interface is a device having a housing configured to be grasped by a user, a display disposed in the housing, the display configured to display a graphical user interface, and a sensor disposed in the housing, the sensor configured to detect a movement of the housing in a degree of freedom. The device also includes a processor disposed in the housing and in communication with the display and the sensor, the processor configured to receive a sensor signal from the sensor, the sensor signal comprising a parameter associated with the movement, to determine a command associated with the graphical user interface based on the parameter, to determine a function to be executed based on the command, and to execute the function.

Abstract: Improved multi-input gesture control for a display screen is enabled by using a first screen input to determine control operations that result from a second screen input that is followed by a gesture. A gesture that corresponds to a path traced on a display screen may define a new screen input or manipulate existing screen objects depending on some specific feature of the path or the entirety of the path.

Abstract: The subject specification provides a system, method, and computer readable storage medium directed towards allocating digital canvasses for digital graffiti. The specification discloses receiving data corresponding to digital graffiti formed from a gesture undergone by a device. The specification also discloses identifying a digital canvas corresponding to the digital graffiti as a function of the received data.

Abstract: An HVAC controller is described that is configured to be more intuitive and user friendly to program and operate than convention HVAC controllers. In some instances, the HVAC controller may include a touch screen interface that provides greater flexibility in displaying information to the user and/or soliciting information from the user.

Abstract: Embodiments of tactile stimulation apparatuses and components of such apparatuses are generally described herein. For example, in one embodiment, a tactile stimulation apparatus is provided. This tactile stimulation apparatus has a composite section comprising an insulation region and a semiconducting region that is proximate to the insulation region. This insulation region is touchable by a body member. Additionally included is a voltage source proximate to the semiconducting region. Here, the voltage source is configured to charge the semiconducting region to an electric potential, which produces an electrosensory sensation on the body member.

Abstract: The purpose of this invention is to provide computer or smartphone users with a self-adapting user interface and shortcuts to most frequently used actions (visual or audio). The invention may be applied to menus and to search queries. User has a choice of recent, most frequently used, group, regional or global configuration for either menu or search query defaults. These configurations can be accessed either locally on a disconnected device, synchronized between devices directly or indirectly through a third device such as a local or remote server. The search query can be visually configured to interact with any search engine. The uniqueness of this invention is in access to the last or most frequent uses. The resulting queries can extend from single-term to complex multi-term, multi-range combinations of inclusions and exclusions. The balancing of included search terms with excluded ones helps to eliminate unwanted finds in any database.

Abstract: A display control apparatus that enables to reliably and quickly search for a desired image. When a wheel is operated by a user by an amount less than a predetermined operation amount, image feeding is made in a first display mode where a plurality of images are displayed on an image display unit. When the wheel is operated by the user by an amount equal to or greater than the predetermined operation amount, image feeding is made in a second display mode where a larger number of images than in the first display mode are displayed on the image display unit in a smaller size than in the first display mode.

Abstract: In one or more embodiments, a device includes a surface and an actuator mechanism operably associated with the surface. The actuator mechanism is configured to provide tactile feedback to a user responsive to an electrical signal. In at least some embodiments, the actuator mechanism comprises a pair of spaced-apart substrates each of which supports a conductive layer of material. A dielectric material and an adjacent air gap may be interposed between the substrates. Drive circuitry is operably connected to the spaced-apart substrates and is configured to drive the conductive layers of material with an electrical signal. This signal may be responsive to sensing a touch input on the surface or other appropriate event.

Abstract: A method for providing payer information on a payer device includes providing a payer device that includes at least one physical state change component moveably coupled to the payer device. Payer information is received over a network. The payer information is then determined to be associated with a physical state change instruction in a non-transitory, machine-readable medium of the payer device. The at least one physical state change component is then actuated according to the physical state change instruction to provide the payer information to a payer by changing the physical state of the payer device.

Abstract: A user interface method is provided for use in a device having a touchscreen. The method includes maintaining the state of content displayed on the device, determining a display image, applying a transformation to at least a portion of the display image based on the maintained state of the displayed content on the device, and displaying the transformed image on the device. The user interface detects transitions, such as, for example, page transitions, and the like, and updates the state based on detected transitions.

Abstract: A method performed on a device includes receiving, from a user, a finger-touch-initiated request for access to a layer of a multi-layer application on the device, the multi-layer application having a plurality of user interface layers. The method may also include identifying a finger of the user used to provide the finger-touch-initiated request, the finger associated with one of the layers of the multi-layer application. The layer associated with the identified finger of the user may be operated on. Each finger of the user can be associated with a different layer of the multi-layer application. Fingerprints can be used to differentiate each finger and/or to identify the user by fingerprint recognition techniques. Fingerprints can be used to vary the access parameters of a layer of the application and/or to provide security levels for accessing the layers of the multi-layer application.

Abstract: A computing device is described that receives an indication of a first gesture received at an input device. Responsive to receiving the indication of the first gesture, the computing device outputs, for display, a first information panel having a size. The computing device receives an indication of a second gesture received at the input device. The second gesture has a gesture length. Responsive to receiving the indication of the second gesture, the computing device outputs, for display, an updated graphical user interface that includes the first information panel and a second information panel. The second information panel has a panel length that corresponds to the gesture length of the second gesture.

Abstract: A request to display a portion of a full-screen content overlay options menu of a multiple media player device is detected by the multiple media player device that represents less than all of the full-screen content overlay options menu. A media type of content media currently accessed by the multiple media player device is determined. A current setting status of an available adjustment of the multiple media player device associated with the portion of the full-screen content overlay options menu based upon the determined media type of content media currently accessed by the multiple media player device is determined. A first graphical menu pane of the full-screen content overlay options menu, including the current setting status of the available adjustment, is displayed over full-screen content on a display. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Abstract: In some embodiments, a device displays content on a touch screen display and detects input by finger gestures. In response to the finger gestures, the device selects content, visually distinguishes the selected content, and/or updates the selected content based on detected input. In some embodiments, the device displays a command display area that includes one or more command icons; detects activation of a command icon in the command display area; and, in response to detecting activation of the command icon in the command display area, performs a corresponding action with respect to the selected content. Exemplary actions include cutting, copying, and pasting content.

Abstract: A system and method are provided for dynamically generating a query using touch gestures. A virtual magnet is movable on a display device of a tactile user interface in response to touch. A user selects one of a set of text documents for review, which is displayed on the display. The system is configured for recognizing a highlighting gesture on the tactile user interface over the displayed document as a selection of a text fragment from the document text. The virtual magnet is populated with a query which is based on the text fragment selected with the highlighting gesture. The populated magnet is able to cause a subset of displayed graphic objects to exhibit a response to the magnet as a function of the query and the text content of the respective documents which the objects represent and/or to cause responsive instances in a text document to be displayed.

Abstract: An electronic device is an electronic device including: a detection unit configured to detect movement of a housing; a vibration unit configured to vibrate the housing; a determination unit configured to calculate movement of a virtual container and movement of a virtual object, and detect a relative distance between an inner wall of the virtual container and the virtual object, the virtual container being moved according to the movement of the housing, the virtual object being moved in the virtual container according to the movement of the virtual container; and an output information generation unit configured to output vibration information used to vibrate the vibration unit to the vibration unit when the determination unit determines that the relative distance between the inner wall of the virtual container and the virtual object satisfies a predetermined distance relationship.

Abstract: A technique for preventing malicious observance of private information includes receiving an instruction of entering a mode of inputting private information; determining a correspondence between actual inputs and expected inputs; receiving an actual user input; and converting the actual input into an expected input as private information inputted by the user according to the correspondence. This security technique can prevent discovery of the private information of a user through observation.

Abstract: A technique for preventing malicious observance of private information includes receiving an instruction of entering a mode of inputting private information; determining a correspondence between actual inputs and expected inputs; receiving an actual user input; and converting the actual input into an expected input as private information inputted by the user according to the correspondence. This security technique can prevent discovery of the private information of a user through observation.

Abstract: A mobile terminal and a method of controlling the mobile terminal are provided. The method includes displaying an operation screen on a display module capable of identifying a fingerprint; if a multi-fingerprint-touch input including first and second fingerprint-touch inputs is received through the display module, selecting a locked operation menu from the operation screen; and if fingerprint information of the multi-fingerprint-touch input is authenticated, unlocking and then executing the selected operation menu. Therefore, it is possible to perform fingerprint authentication and the execution of an operation at the same time in response to a multi-fingerprint-touch input.

Abstract: A three-dimensional data set is accessed. A two-dimensional plane is defined that intersects a space defined by the three-dimensional data set. The two-dimensional plane defines a two-dimensional data set within the three-dimensional data set and divides the three-dimensional data set into first and second subsets. A three-dimensional view based on the three-dimensional data set is rendered on such that at least a portion of the first subset of the three-dimensional data set is removed and at least a portion of the two-dimensional data set is displayed. A two-dimensional view of a first subset of the two-dimensional data set also is rendered. Controls are provided that enable visual navigation through the three-dimensional data set by engaging points on the multi-touch display device that correspond to either the three-dimensional view based on the three-dimensional data set and/or the two-dimensional view of the first subset of the two-dimensional data set.

Abstract: A display device provides a user with tactile feedback using a tactile user interface. The display device includes a display unit, a tactile feedback unit, and a controller. The controller detects a first control input selecting a first object displayed on the display unit, detects a second control input controlling the first object that is consecutive to the first control input, controls the first object in response to the second control input, generates first tactile feedback according to properties of the first object in response to the second control input, detects a third control input controlling the first object that is consecutive to the second control input, the third control input being detected in a region of a second object displayed on the display unit, and maintains the first tactile feedback in response to the third control input while the first object is controlled by the third control input.

Abstract: The disclosure provides systems and methods of use of an HVAC graphical interface dashboard. In various embodiments, the dashboard includes a weather tab, wherein invoking the weather tab advances to a weather screen. The dashboard also includes an indoor humidity tab. A programs tab and a home tab are also provided. The indoor humidity tab can further be used to set current indoor humidity setpoints.

Abstract: Embodiments of the present disclosure relate to multi device pairing and sharing via non-touch gestures. In an embodiment, a method comprises detecting, by a parent device, an initiating non-touch gesture performed by a user towards the parent device. The method also comprises initiating an action based on the detecting. The method further comprises triggering, by the parent device, a gesture recognition mode on one or more secondary devices based on the detecting. And the method further comprises completing the action upon a positive gesture recognition by the one or more secondary devices.

Abstract: Devices using tactile feedback to deliver silent status information are described. One embodiment includes an electronic device comprising a housing comprising a user contactable region, a tactile element coupled to the user contactable region, and an actuator coupled to the tactile element and capable of outputting a haptic sensation localized to the tactile element.

Abstract: An electronic device includes a housing, a first display unit, a second display unit, a sensing input unit and a processor. The first display unit and the second display unit are both disposed on the housing. The sensing input unit is coupled to the first display unit and the second display unit, and is used for sensing and receiving a user input. The user input enables a transferring behavior of displaying a second object in the second display unit according to a first object displayed in the first display unit. The processor is coupled to the first display unit, the second display unit and the sensing input unit, and is used for controlling the second display unit according to the user input to display the second object.

Abstract: A mobile terminal including a speaker configured to output sound data, a microphone configured to receive voice data, a sensing unit configured to sense a touching operation of at least one of 1) the speaker or the microphone and 2) a neighborhood area of the speaker or the microphone, and a controller configured to control a volume of the speaker or the microphone based on the sensed touching operation of said at least one of 1) the speaker or the microphone and 2) the neighborhood area of the speaker or the microphone.

Abstract: An operating system providing multi-touch support for (user) applications in a mobile device. In one embodiment, a check of whether the touch screen (in the mobile device) has multi-touch capability is performed. A first interface with multi-touch capability is provided to the (user) applications if the touch screen has multi-touch capability and a second interface with single touch capability being provided if the touch screen does not have multi-touch capability. The first and second interfaces may be provided by corresponding device drivers loaded when the mobile device is initialized with the operating system. A device driver (providing the second interface) is also designed to perform the check and execute another device driver (providing the first interface) if the touch screen has multi-touch capability.

Abstract: A mark-based containment system, in one aspect, may include a graphical user interface operable to receive an indication of a mark as a container marking, attribute one or more container attributes to the container marking, and store the container mark and the container attributes associated with the container mark.

Abstract: A method for actuating a tactile interface layer for a device that defines a surface with a deformable region, comprising the steps of detecting a gesture of the user along the surface of the tactile interface layer that includes a movement of a finger of the user from a first location on the surface to a second location on the surface; interpreting the gesture as a command for the deformable region; and manipulating the deformable region of the surface based on the command.

Abstract: A computer implemented method, system and computer program product features “Info Dial UI,” a degree-based and tactilely-initiated dialing gesture for providing product information to a user. This feature allows the user to tactilely control the amount of product information displayed to the user as the user tactilely moves an indicia along an arc. It also features a related “Circle a Product” feature. This method, system and computer program product provides the user with prompts and guidance for improving product purchases via mobile encoding technology and personal computing devices.

Abstract: An electronic device includes a touch screen for inputting text and hardware buttons for performing functions. A user inputs a sequence of letters and then actuates the hardware button which causes the system to perform an auto-correction if the input text is not recognized as a word and a space after the word. The hardware button can have multiple actuation modes including a touch actuation and a depression actuation. Each actuation mode can perform different system functions.

Abstract: A display control device that facilitates an operation on a touch panel, for the timeline display of a moving image. A synthesis section controls display on a touch panel. A touch state-detecting section detects any touched position on the touch panel, and determines whether two touched positions are detected on a single display object displayed on the touch panel. Determining that two touched positions are detected on the single display object, the touch state-detecting section determines whether the detected touched positions are moved while keeping their touched states. When the touched positions are determined to be moved while keeping their touched states, an overall controller extracts frame images of which the number depends on a distance between the two touched positions after the movement thereof, and controls the synthesis section to display the extracted frame images between the two moved touched positions.

Abstract: A design interface tool for designing force sensations for use with a host computer and haptic feedback interface device. A haptic feedback device communicates with a host computer that displays the interface tool. The user selects and characterizes force sensations using the interface tool, and a graphical representation of the characterized force sensation is displayed. The characterized force sensation is output to a user manipulatable object of the force feedback device so that the user can feel the designed force sensation The user can include multiple force sensations in a compound force sensation, where the compound sensation is graphically displayed to indicate the relative start times and duration of each of the force sensations. The user can also associate a sound with the force sensation, such that the sound is output in conjunction with the output of the force sensation.

Abstract: Methods and apparatus to provide haptic feedback are disclosed. One example method includes receiving a goal condition at a mobile device, requesting information from a host device using a first close-proximity communication, receiving the information at a mobile device using a second close-proximity communication, determining a level of haptic feedback based on the received information and the goal condition, and causing a haptic effect on the mobile device based on the level of haptic feedback. Other implementations are possible.

Abstract: A mobile terminal capable of sensing a touch input, and a control method thereof are provided. The mobile terminal includes: a display unit configured to display screen information; a sensing unit configured to sense a touch input applied to the display unit; and a controller configured to display an indicator bar including at least one icon together with the screen information, and select any one of icons displayed in the indicator bar.

Abstract: A method of controlling a mobile terminal is presented. The method includes detecting a first touch on the mobile terminal for a predetermined time when the mobile terminal is in a locked state, simultaneously displaying a locking icon and an unlocking icon in response to the detected first touch, and detecting a second touch on the locking icon or the unlocking icon, wherein touching the locking icon for a predetermined time will partially unlock the mobile terminal, and wherein touching and dragging the unlocking icon to the locking icon will fully unlock the mobile terminal.

Abstract: One embodiment of the user interface system comprises: a volume of fluid; a tactile layer; a retaining wall substantially impermeable to the fluid; a permeable layer; a displacement device; and a touch sensor. The tactile layer, with a back surface, defines a second region, operable between: a retracted state, wherein the second region is substantially flush with a first region; and an expanded state, wherein the second region is substantially proud of the first region. The permeable layer, joined to the back surface of the first region, includes a plurality of fluid ports that communicate a portion of the fluid through the permeable layer to the back surface of the second region. The displacement device directs the fluid through the fluid ports to the back surface to transition the second region from the retracted state to the expanded state. The touch sensor detects a user touch on the tactile layer.

Abstract: The present invention is directed toward a system and process that controls a group of networked electronic components using a multimodal integration scheme in which inputs from a speech recognition subsystem, gesture recognition subsystem employing a wireless pointing device and pointing analysis subsystem also employing the pointing device, are combined to determine what component a user wants to control and what control action is desired. In this multimodal integration scheme, the desired action concerning an electronic component is decomposed into a command and a referent pair. The referent can be identified using the pointing device to identify the component by pointing at the component or an object associated with it, by using speech recognition, or both. The command may be specified by pressing a button on the pointing device, by a gesture performed with the pointing device, by a speech recognition event, or by any combination of these inputs.

Abstract: Embodiments of a multi-screen hold and page-flip gesture are described. In various embodiments, a hold input is recognized at a first screen of a multi-screen system, and the hold input is recognized when held to select a journal page that is displayed on the first screen. A motion input is recognized at a second screen of the multi-screen system, and the motion input is recognized while the hold input remains held in place. A hold and page-flip gesture can then be determined from the recognized hold and motion inputs, and the hold and page-flip gesture is effective to maintain the display of the journal page while one or more additional journal pages are flipped for display on the second screen.

Abstract: Various technologies pertaining to provision of haptic feedback to users of computing devices with touch-sensitive displays are described. First haptic feedback is provided to assist a user in localizing a finger or thumb relative to a graphical object displayed on a touch-sensitive display, where no input data is provided to an application corresponding to the graphical object. A toggle command set forth by the user is subsequently identified; thereafter, an input gesture is received on the touch-sensitive display, and second haptic feedback is provided to aid the user in setting forth input data to the application.