Abstract: There is disclosed a mobile terminal including a body comprising a predetermined flexible portion, a display provided in the body to output image information and to receive an input touch gesture, a plurality of actuators provided in the body to change a shape of the body, and a controller controls the actuators in accordance with an operation condition set corresponding to the event, when an event is generated, wherein the operation condition comprises at least one of a driving actuator of which a shape is changed, a shape-variation level of the driving actuator, a shape-variation speed of the driving actuator and a shape-variation frequency of the driving actuator. The body of the mobile terminal includes the actuator to change the shape of the mobile terminal. Accordingly, the user can be informed of a message by the shape variation of the mobile terminal, such that use convenience may be enhanced.

Abstract: A multiuser, multi-interface computing system includes a computer system, and a continuous substrate including a first surface and a second surface. The substrate includes at least two touch sensitive regions, each touch sensitive region including a continuous touch sensitive surface that covers at least a portion of at least one display and an individual interface for selecting applications. The touch sensitive surface is configured to serve as the primary input to the computer system. The continuous substrate is transparent within the touch sensitive regions. The multiuser, multi-interface computing system is configured so that the at least two users can use the touch sensitive regions simultaneously.

Abstract: In a user interface and to a method for signaling a position of an input mechanism with respect to an area for 3D gesture detection for a user interface, the method includes the following steps: input mechanism of a user are detected in the area for 3D gesture detection, and the position of the input mechanism is signaled by an indicator in the area of the edge of a display unit of the user interface.

Abstract: A display device for displaying an application in an execution area according to a user input is disclosed. The display device includes a user interface configured to receive a user input corresponding to a shape, a display, and a controller configured to determine an application corresponding to the shape and determine an execution area for the application on a screen of the display in response to the user interface receiving the user input, and control the display of the application in the execution area.

Abstract: A method of navigating between a plurality of different views of a home screen of a mobile communications device is provided. The mobile communications device includes a home button, a processor, and a display panel configured to cooperate with the processor to display one of the views of the home screen. The method includes selectively displaying one of the views of the home screen on the display panel based on a number of times the home button is activated within a predetermined time period. A non-transitory computer-readable medium and a mobile communications device of navigating between a plurality of different views of a home screen of a mobile communications device are also provided.

Abstract: In order to perform processing corresponding to an instruction or a reaction at appropriate timing when a predetermined instruction is given or a reaction by a user is made while content is being outputted, a CPU detects instruction timing when a predetermined user instruction is given for data outputted while pieces of data constituting content are being sequentially outputted; stores the detected instruction timing in an instruction information memory; specifies predetermined timing that comes later than the instruction timing stored in the instruction information memory as timing for performing processing in accordance with the user's instruction; and performs the processing.

Abstract: There is provided a display control apparatus capable of maintaining visibility regarding a display item during a drag operation. The display control apparatus includes a detection unit configured to detect a position input on a screen displayed on a display unit, a display control unit configured to display the display item on the display unit and to perform control to scroll of the display item with a display effect according to a scroll instruction, and a control unit configured to, if the detection unit detects the position input on the screen during the scroll, perform control to stop the scroll with the display effect displayed when the position input has been detected.

Abstract: There is provided an information processing apparatus, including: a display panel for displaying at least one object in a selected state or in unselected state; a detection area setting unit for setting, per object on the display panel, a first detection area covering a display area of the object and a second detection area covering the first detection area and being larger than the first detection area; an operating tool detecting unit for detecting an operating tool which is in proximity to the display panel; and a state managing unit for changing the object into the selected state when the operating tool is detected within the first detection area of the object in the unselected state, and for changing the object into the unselected state when the operating tool is not detected within the second detection area of the object in the selected state.

Abstract: A mobile terminal and a touchscreen and a method of controlling the mobile terminal may be provided. The mobile terminal may cause the touchscreen to display a first item; cause the touchscreen to display a first indicator on at least part area of the first item upon receiving a first input of the first item; and cause the touchscreen to display a second item upon receiving a second input of the first indicator. Furthermore, the first item can be changed into the second item by expanding the first item. Additionally, the first item and the second item indicate items for executing a specific application. The second item has a bigger size than a size of the first item, and the second item displays first information associated with execution results of the specific application.

Abstract: Methods, systems, and computer programs are presented for implementing a multi-function button in a Graphical User Interface (GUI). One method includes an operation for presenting a button in a compact state when a mouse cursor is away from the button. The button in the compact state is displayed in a first button format when options associated with the button are in an unselected state, and in a second button format when at least one option has been selected. The options are hidden when the button is presented in the compact state. The button is presented in an expanded state when the mouse cursor is over the button, where unselected options are presented in a first option format and selected options are presented in a second option format. Selection of any option is enabled while the button is in the expanded state.

Abstract: A display device and a method for driving the same are disclosed. The display device includes a display unit configured to display a pointer and a controller configured to differently control a motion of the pointer corresponding to a moving distance of a pointing part depending on a distance from the pointing part inputting a gesture command.

Abstract: Object tracking for device input can be improved by utilizing various tracking parameters to correlate objects between analyzed image frames. In some embodiments, relatively low resolution infrared cameras can be used for object tracking, in order to conserve resources on the device. Intensity segmentation can be used to identify potential objects of interest to be analyzed in captured image data. One or more tracking parameters, such as size, shape, and/or distance, can be specified for each of the objects in order to correlate objects between images. The correlations can be ranked by confidence or other such metrics in order to improve overall accuracy. Tracking data can also be stored for a period of time such that objects that are not clearly distinguishable for a while but then reappear can again be correlated with objects from earlier images.

Abstract: The disclosed technology addresses the need in the art for determining whether a selection of an invitational content item was accidental or intentional based on selection signals that describe the selection. For example, a selection signal can be a selection point, response time, multiple selection count, context of the selection, user preference data, etc. A response to the selection can be based on whether the selection was determined to be accidental or intentional. If the selection was determined to be intentional, the response can be the regular response associated with selection of the invitational content item, i.e. registering the selection for billing and presenting secondary content to the user. If the selection was determined to be accidental, the selection can be ignored. Thus, the selection would not register for billing purposes and secondary content would not be presented to the user.

Abstract: A touch device and a control method and a method for determining unlocking thereof are provided. The touch device includes image capturing units configured nearby a touch surface respectively, and light-reflected objects are configured around the touch surface. In this method, the image capturing units are used to detect a reflected signal to receive a first gesture on the touch surface when the touch device is operated in a touch-lock mode. The image capturing units emit a detecting signal along the touch plane and detect the reflected signal reflected from the detecting signal. It is determined whether the first gesture matches a first specific gesture. When the first gesture matches the first specific gesture, the touch device is operated in a touch-on mode. Touch information is provided when the touch device is operated in the touch-on mode but not provided when the touch device is operated in the touch-lock mode.

Abstract: A system, device and method for providing context sensitive content on a computing device is provided. In an embodiment, a computing device in the form of a portable computing device is configured to execute a primary web-browser application and a secondary web-browser application. The primary web-browser application is configured to generate a web-page containing context sensitive items and receiving focus on one of the context sensitive items. The secondary web-browser application is configured to generate the context sensitive content related to the one of the context sensitive items.

Abstract: A client computing device receives cursor graphics information from a server computing device. The client computing device transforms the cursor graphics information from a received format to a new format supported by the client computing device. The client computing device displays a client-side cursor at a current position on a client desktop based on the received cursor graphics information.

Abstract: A mobile phone comprises a display provided with a touch panel, etc. When an end portion of the touch panel is touched, a touch icon that indicates a touch position is displayed. Furthermore, if a distance between the touch position and the end portion of the touch panel becomes larger than a first threshold value, a cursor is displayed based on the touch position. This cursor moves if a touch position changes with a touch operation. At this time, if a moving amount of the cursor is large, an afterimage object that indicates the last position (locus) of the cursor is displayed. On the other hand, a moving amount of the cursor is small, the above-described afterimage object is not displayed.

Abstract: Systems and methods of performing a process are provided, including receiving a live document video stream of a remote collaboration session, detecting a cursor action in the live document video stream, classifying the detected cursor action into an action category, detecting key frames of the live document video stream, indexing the detected key frames based on the action category, detecting a keyword in the indexed key frames, indexing the key frames using the category, visualizing the cursor action in the key frames based on the action category, and displaying the visualized cursor action.

Abstract: A video display device provides multispeed video search, and a control method thereof. The device includes a video display unit to display a video, and a sensor unit to detect user input and transmit an input signal based on the detected user input to a processor that provides a video search interface. The video search interface includes an image display interface, a thumbnail search interface displaying thumbnails of a video, and a thumbnail control interface controlling the image display interface and/or the thumbnail search interface. The thumbnail control interface includes a circular controller, and controls display of an image on the image display interface based on rotation of the circular controller.

Abstract: A display apparatus configured to move a drag object on a screen in accordance with an operation of a pointer. The display apparatus can include a detection unit configured to detect a target object on the screen, the target object being a destination of the drag object, and a display control unit configured to display the drag object in a position closer to the target object than a display position of the pointer moved in accordance with an operation performed by a user.

Abstract: A touch device and a control method thereof are provided. In the control method, a sensing signal generated by a sensor is received. When an operating object is present, a touch screen is configured for touchable regions and untouchable regions, wherein the untouchable regions cannot generate a response through a touch by the operating object. A gesture is received on the untouchable regions of the touch screen, a processor determines whether the gesture is conformed to a default gesture setting, and the processor decides whether or not to adjust part or all of the untouchable regions to the touchable regions according to the determining result. Accordingly, the touch device and the control method thereof of the embodiments of the invention can prevent or lower the occurrence of an accidental touch by a user and enhance the operating convenience of the user.

Abstract: Technologies are described herein for providing users of a messaging application with controls that perform one or more selected actions with a message. Any number of default custom action controls may be displayed in a gallery. The selection of a custom action control performs various actions to an active message. New custom action controls may be created and existing controls modified to provide any number of desired actions. Dialogs provide user-friendly interfaces that allow a user to assign the desired functionality to a custom action control. The custom action controls may be organized into groups and shared between messaging applications and computers.

Abstract: With a vehicle-mounted equipment operating device, upon receipt of an input from an operator by an operation input unit, and when any one of a plurality of vehicle-mounted instruments, for example, an air conditioner, exists on a line of sight of the operator, a control unit sets the vehicle-mounted instrument that exists on the line of sight as an operation target device, and thereafter, the control unit controls the operation target device based on the input of the operator that has been received by the operation input unit.

Abstract: An apparatus, system, and method are disclosed to collect metrics from a non-monolithic website having external content. The method includes monitoring a pointer movement in a web page. The web page displays a content feed of the external content. The method also includes identifying a pointer movement representative of an interaction gesture. The interaction gesture is indicative of a type of interaction with the content feed of the external content. The method also includes generating a score for the content feed in response to the pointer movement including an interaction gesture. The score includes a quantity of each of the reported types of interaction with the content feed.

Abstract: The present invention discloses a gesture detecting apparatus which includes an image capturing device and a processing unit. The image capturing device is for capturing an object light beam reflected by an object and outputting corresponding image information accordingly. The processing unit is for processing the image information and generating a first command or a second command accordingly. The steps of generating the first command and the second command by the processing unit include: outputting a first command if an image size of the image information increases with a relatively higher velocity and decreases with a relatively lower velocity in a sequential time series; and outputting a second command if the image size of the image information increases with a relatively lower velocity and decreases with a relatively higher velocity in the sequential time series.

Abstract: Two-handed interactions with a natural user interface are disclosed. For example, one embodiment provides a method comprising detecting via image data received by the computing device a context-setting input performed by a first hand of a user, and sending to a display a user interface positioned based on a virtual interaction coordinate system, the virtual coordinate system being positioned based upon a position of the first hand of the user. The method further includes detecting via image data received by the computing device an action input performed by a second hand of the user, the action input performed while the first hand of the user is performing the context-setting input, and sending to the display a response based on the context-setting input and an interaction between the action input and the virtual interaction coordinate system.

Abstract: A mobile terminal and a method for controlling the operation of the mobile terminal are provided. In the method, a stereoscopic 3D image that utilizes binocular disparity between a left-eye image and a right-eye image is displayed on a display and a stereoscopic 3D pointer is displayed in the stereoscopic 3D image when a user's hand is detected according to analysis of visual data acquired by a camera. The position of the stereoscopic 3D pointer is moved according to movement of the hand when the movement of the hand is detected according to analysis of the visual data. According to this method, the operation of the mobile terminal can be controlled by the user's hand movement or gesture.

Abstract: Technologies are described herein for optimizing page output by performing run-time reordering of the content of a page. A request for a content page is received from a client application. A page layout corresponding to the requested content page is transmitted to the client application. The page layout contains a number of placeholder elements corresponding to the content sections of the content page arranged in a particular layout. Upon receiving the page layout, the client application renders the content page to the display with the placeholder elements occupying the positions of the content sections. The content sections corresponding to the placeholder elements are generated and transmitted to the client application in an order independent of the order of rendering of the content sections. As the client application receives each content section, the corresponding placeholder element in the page layout is replaced with the content section.

Abstract: A data mashup system having information extraction capabilities for receiving multiple streams of textual data, at least one of which contains unstructured textual data. A repository stores annotators that describe how to analyze the streams of textual data for specified unstructured data components. The annotators are applied to the data streams to identify and extract the specified data components according to the annotators. The extracted data components are tagged to generate structured data components and the specified unstructured data components in the input data streams are replaced with the tagged data components. The system then combines the tagged data from the multiple streams to form a mashup output data stream.

Abstract: A method for providing a graphical user interface (GUI) to receive a user command on a touch screen, and a multimedia apparatus using the same. The method for providing a GUI includes determining whether an enlargement command for a GUI item is received, and enlarging the GUI item. Therefore, it is possible to enable a user to operate the GUI item more correctly, and to provide the superior visual effect when the GUI item is operated.

Abstract: A method, a device, and a non-transitory storage medium having instructions to detect, via an ultrasound transducer, an ultrasound event that includes an ultrasound signal that is transdermally propagated on the body of a user and generated by an on-body touch in an area in which the ultrasound signal has propagated; detect a state of a limb of the user on which the device is worn, wherein the state is a contracted state or a relaxed state; and select an input based on the receipt of the ultrasound signal and the state of the limb. An accelerometer may be used to detect muscle tremor and determine whether the state of the limb.

Abstract: Approaches to analyze image data to detect a blob corresponding to a user's hand (or other feature) and analyze the depth information associated with the blob to determine a location on a display screen. For example, the user may be pointing one or more fingers towards a particular location on the screen and the computing device may analyze the depth information associated with the user's finger and hand to compute the corresponding location on the screen that finger should be mapped to. Additionally, the computing device may track the movement of the user's finger with respect to other portions of the user's hand (e.g., center of the hand) and adjust the mapped location on the screen based on the tracked movement.

Abstract: An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.

Abstract: A display device includes: an input controller configured to detect a first contact coordinate input by a drag operation on a touch panel on a surface of a display and record the first contact coordinate in a memory in association with an acquisition time of the first contact coordinate; and a display controller configured to calculate a second contact coordinate at a time preceding a current time by a given time based on the first contact coordinate and the acquisition time corresponding to the first contact coordinate and control a display operation on the display with defining the second contact coordinate as a display coordinate.

Abstract: An information processing apparatus that displays a numeric value input area having multiple digit positions and changes a numeric value of the input area in accordance with a user operation on the input area, as well as a control method and a storage medium. The information processing apparatus calculates, when a movement of the plurality of digit positions of the numeric value input area is instructed by the operation of the user, a movement direction and a movement amount, performs a moving, in accordance with the movement direction and the movement amount of each numeral of the plurality of digit positions of the input area, and inserts a predetermined numeral into a digit position whose numeral became undefined by the moving of the numeral of each digit position in the moving.

Abstract: A computerized device can comprise a touch-enabled surface and a data processing hardware element configured by a gesture input engine to recognize an input gesture using data from the touch-enabled surface. A parameter value can be set based on determining a path traversed by the input gesture. The data processing element can comprise a processor and the gesture input engine can comprise program logic in a memory device and/or the engine may be implemented using hardware logic. Regardless, the radial input gesture can be used to set one or more parameter values without use of a direct mapping of interface coordinates to parameter values. A method can comprise tracking a plurality of input points, identifying a path defined by the plurality of input points, identifying a closed curve including the path, determining a percentage of the curve traversed by the path, and setting a parameter value based on the percentage.

Abstract: A method, system, and computer program product for accessible chart navigation using object neighborhood are provided. An input is received to navigate a focus away in a direction from a first object, the first object being a member of a set of objects depicted in a graphical visual chart. A set of inputs is designed to access the chart without using a pointing device or requiring visual inspection of the chart and the set of objects. The set of inputs includes the input and a second input to allow return to a previous step in navigating the chart. A second object is identified to which to navigate responsive to the input, the second object being located within a neighborhood of the first object at a shortest neighborhood distance from the first object. Navigation is performed to the second object to keep the focus within the neighborhood.

Abstract: Systems, methods, and apparatus are herein disclosed for controlling a display brightness based on user action or user interest in the display. In particular, the display brightness can be dimmed upon identification of a first marker indicative of a user action such as a request for a webpage. The brightness of the display can be increased or returned to its original state upon identification of a second marker indicative of completion of a user equipment activity triggered by the user action. In some embodiments, another brightness state between these two can be used as an intermediary and is triggered when a third marker, indicative of a progression of the user equipment activity, is identified.

Abstract: A method for displaying of a touch cursor is provided. The method is adapted to an electronic apparatus having a touch display unit. The touch display unit has a display area. The method includes the following steps. At least one first dimension boundary and at least one second dimension boundary are defined in the display area. A cursor, which has a pointing area and a touchable area, is displayed. When a touch event occurs in the touchable area, the cursor is correspondingly moved according to a touch coordinate of the touch event. When a reference point of the cursor passes two of the at least one first dimension boundary or two of the at least one second dimension boundary, the cursor is rotated for adjusting a relative position of the pointing area and the touchable area.

Abstract: A method and system is provided for creating a new video stream having an electronic pointer rendered therein. The disclosed system includes a receiver that continuously receives position data from a wireless pointing device; a calibration unit that calculates positions for the electronic pointer relative to a viewing device based on the position data received from the wireless pointing device; a processor that renders the electronic pointer in an original video feed received from a video source to create the new video stream as a single data stream, such that the electronic pointer is positioned at locations in the new video stream that correspond to the calculated positions for the electronic pointer; and a server that transmits the new video stream to the wireless pointing device to be rendered on a screen of the wireless pointing device.

Abstract: An image processing apparatus includes: a processor configured to: store information on a reference area that has been extracted from a first image not including a target object by using a condition regarding color, generate, by using the condition, information on a target area in a second image that has been captured at a point in time different from a point in time at which the first image has been captured, determine, by using the target area and the reference area, whether or not there is an overlap between the reference area and the target object, when the overlap exists, identify an overlap area, and extract, by using the difference area between the reference area and the target area, and the overlap area, the target object from the second image.

Abstract: A control unit for an automatic device for preparing a beverage, which control unit is provided with a display panel and an input wherein the control unit is provided furthermore with an operating unit for displaying by the display panel a visually observable reaction to designations provided by the user, and for controlling a preparation unit of the automatic device, wherein the display panel has selection fields for mutually exclusive settings for formulations of the beverage to be prepared, wherein the control unit enables the user to select one of the settings by designation of one of the selection fields, wherein a collecting field with at least one setting field shows the chosen setting of the formulation, and wherein the non-designated selection fields remain visible and selectable.

Abstract: Interaction between an application, a user interface framework, and a graphics module to render a portion of an application surface. The application requests a surface corresponding to a particular range of the application surface from the user interface framework. In response, the user interface framework provides the requested ranged surface to the application. The application instructs the graphics module to populate the ranged surface by drawing into the ranged surface. The application then instructs the user interface framework to compose the ranged surface using the drawn ranged surface and other information available to the user interface framework. The user interface framework composing a composed surface using the drawn surface provided by the application, and additional information available to the user interface framework. The user interface framework may cache information from previously composed surface to allow for faster re-rendering should those portions later come into view on the display.

Abstract: Joystick display data is generated for display on a touch screen of an electronic device. The joystick display data creates a visual representation of a virtual joystick when displayed on the touch screen. Touch data from the touch screen is processed to determine when the touch data indicates user interaction with the virtual joystick. When the touch data indicates user interaction with the virtual joystick, the joystick display data is adjusted to reflect the user interaction with the virtual joystick, based on the touch data, and joystick data is generated based on the user interaction with the virtual joystick. The display of at least one other element on the touch screen can be adjusted based on the joystick data.

Abstract: Systems, methods and computer readable media are disclosed for manipulating virtual objects. A user may utilize a controller, such as his hand, in physical space to associate with a cursor in a virtual environment. As the user manipulates the controller in physical space, this is captured by a depth camera. The image data from the depth camera is parsed to determine how the controller is manipulated, and a corresponding manipulation of the cursor is performed in virtual space. Where the cursor interacts with a virtual object in the virtual space, that virtual object is manipulated by the cursor.

Abstract: An image display apparatus and a method for operating the same are discussed. According to an embodiment, the method for operating the image display apparatus having a display screen, includes processing a signal for displaying a first object; associating, by the image display apparatus, the first object with a pointer to be displayed, the pointer being movable according to a pointing operation of a pointing device associated with the image display apparatus; and automatically displaying, by the image display apparatus on the display screen, the first object and the pointer on the first object based on the associating step.

Abstract: Detecting click fraud that includes a client device capable of accessing a server hosting a web page containing an advertisement. The client device includes a network interface allowing access to the server and code on the client device. The code accesses and displays a web page containing an advertisement, provides mechanisms (e.g., an applet, an ActiveX control, a plugin, a JavaScript, a browser scripting language, browser extensions, or code native to the browser) associated with each pixel cluster where each mechanism captures information regarding the transit of the pixel cluster by a cursor on the web page, and collects information based on the capturing by each associated mechanism regarding the transit of the pixel cluster by a cursor on the web page.

Abstract: A pointer controlling apparatus, a control method, and a pointer controlling program are provided which can protect a button from erroneous operation without interrupting the operational flow or using excessive display area. The pointer controlling apparatus permits a pointer to move into a predetermined region after a predetermined period of time has elapsed from a point in time when the pointer comes into contact with a boundary line of the predetermined region. Accordingly, the predetermined area can be securely protected from a point in time at which the pointer comes into contact with the boundary line of the predetermined region for the predetermined amount of time. Furthermore, since the pointer is permitted to enter the predetermined region immediately after the predetermined time has elapsed, the predetermined region can be protected without interrupting the operational flow, and without using an excess of a display region.

Abstract: A user input to a system is processed by receiving reflections of signals from a moving input object. Information relating to the direction of movement of the input object and information relating to the speed of the input object are determined from the reflections. Continual sensory feedback is provided to the user, controlled by a parameter that is repeatedly updated based on the direction and speed of the input object. When no new determination of information relating to the speed or direction of the input object has been made since a previous update, a time-dependent change is made to the parameter.

Abstract: Described herein are systems and techniques for projecting content, periodically or continuously, onto a rear surface of a display medium from behind. The rear projected image is presented on an opposing or front surface of the display medium to a human audience for viewing. Additionally, non-visible light (e.g., IR light) is passed through the display medium to an area in front of the medium. The non-visible light is used to detect human gestures. In this manner, the rear projection arrangement avoids viewer obstruction during projection, yet detects and recognizes gestures made by the viewer in front of the display medium. In one implementation, the display medium comprises a thin sheet of transparent plastic material with arrays of curved optical features to redirect light received on the rear surface out the front surface toward the human audience.