Abstract: The present invention discloses a gesture detecting apparatus which includes an image capturing device and a processing unit. The image capturing device is for capturing an object light beam reflected by an object and outputting corresponding image information accordingly. The processing unit is for processing the image information and generating a first command or a second command accordingly. The steps of generating the first command and the second command by the processing unit include: outputting a first command if an image size of the image information increases with a relatively higher velocity and decreases with a relatively lower velocity in a sequential time series; and outputting a second command if the image size of the image information increases with a relatively lower velocity and decreases with a relatively higher velocity in the sequential time series.

Abstract: A mobile terminal and a method for controlling the operation of the mobile terminal are provided. In the method, a stereoscopic 3D image that utilizes binocular disparity between a left-eye image and a right-eye image is displayed on a display and a stereoscopic 3D pointer is displayed in the stereoscopic 3D image when a user's hand is detected according to analysis of visual data acquired by a camera. The position of the stereoscopic 3D pointer is moved according to movement of the hand when the movement of the hand is detected according to analysis of the visual data. According to this method, the operation of the mobile terminal can be controlled by the user's hand movement or gesture.

Abstract: Technologies are described herein for optimizing page output by performing run-time reordering of the content of a page. A request for a content page is received from a client application. A page layout corresponding to the requested content page is transmitted to the client application. The page layout contains a number of placeholder elements corresponding to the content sections of the content page arranged in a particular layout. Upon receiving the page layout, the client application renders the content page to the display with the placeholder elements occupying the positions of the content sections. The content sections corresponding to the placeholder elements are generated and transmitted to the client application in an order independent of the order of rendering of the content sections. As the client application receives each content section, the corresponding placeholder element in the page layout is replaced with the content section.

Abstract: A data mashup system having information extraction capabilities for receiving multiple streams of textual data, at least one of which contains unstructured textual data. A repository stores annotators that describe how to analyze the streams of textual data for specified unstructured data components. The annotators are applied to the data streams to identify and extract the specified data components according to the annotators. The extracted data components are tagged to generate structured data components and the specified unstructured data components in the input data streams are replaced with the tagged data components. The system then combines the tagged data from the multiple streams to form a mashup output data stream.

Abstract: A method for providing a graphical user interface (GUI) to receive a user command on a touch screen, and a multimedia apparatus using the same. The method for providing a GUI includes determining whether an enlargement command for a GUI item is received, and enlarging the GUI item. Therefore, it is possible to enable a user to operate the GUI item more correctly, and to provide the superior visual effect when the GUI item is operated.

Abstract: A method, a device, and a non-transitory storage medium having instructions to detect, via an ultrasound transducer, an ultrasound event that includes an ultrasound signal that is transdermally propagated on the body of a user and generated by an on-body touch in an area in which the ultrasound signal has propagated; detect a state of a limb of the user on which the device is worn, wherein the state is a contracted state or a relaxed state; and select an input based on the receipt of the ultrasound signal and the state of the limb. An accelerometer may be used to detect muscle tremor and determine whether the state of the limb.

Abstract: Approaches to analyze image data to detect a blob corresponding to a user's hand (or other feature) and analyze the depth information associated with the blob to determine a location on a display screen. For example, the user may be pointing one or more fingers towards a particular location on the screen and the computing device may analyze the depth information associated with the user's finger and hand to compute the corresponding location on the screen that finger should be mapped to. Additionally, the computing device may track the movement of the user's finger with respect to other portions of the user's hand (e.g., center of the hand) and adjust the mapped location on the screen based on the tracked movement.

Abstract: An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.

Abstract: A display device includes: an input controller configured to detect a first contact coordinate input by a drag operation on a touch panel on a surface of a display and record the first contact coordinate in a memory in association with an acquisition time of the first contact coordinate; and a display controller configured to calculate a second contact coordinate at a time preceding a current time by a given time based on the first contact coordinate and the acquisition time corresponding to the first contact coordinate and control a display operation on the display with defining the second contact coordinate as a display coordinate.

Abstract: An information processing apparatus that displays a numeric value input area having multiple digit positions and changes a numeric value of the input area in accordance with a user operation on the input area, as well as a control method and a storage medium. The information processing apparatus calculates, when a movement of the plurality of digit positions of the numeric value input area is instructed by the operation of the user, a movement direction and a movement amount, performs a moving, in accordance with the movement direction and the movement amount of each numeral of the plurality of digit positions of the input area, and inserts a predetermined numeral into a digit position whose numeral became undefined by the moving of the numeral of each digit position in the moving.

Abstract: A computerized device can comprise a touch-enabled surface and a data processing hardware element configured by a gesture input engine to recognize an input gesture using data from the touch-enabled surface. A parameter value can be set based on determining a path traversed by the input gesture. The data processing element can comprise a processor and the gesture input engine can comprise program logic in a memory device and/or the engine may be implemented using hardware logic. Regardless, the radial input gesture can be used to set one or more parameter values without use of a direct mapping of interface coordinates to parameter values. A method can comprise tracking a plurality of input points, identifying a path defined by the plurality of input points, identifying a closed curve including the path, determining a percentage of the curve traversed by the path, and setting a parameter value based on the percentage.

Abstract: A method, system, and computer program product for accessible chart navigation using object neighborhood are provided. An input is received to navigate a focus away in a direction from a first object, the first object being a member of a set of objects depicted in a graphical visual chart. A set of inputs is designed to access the chart without using a pointing device or requiring visual inspection of the chart and the set of objects. The set of inputs includes the input and a second input to allow return to a previous step in navigating the chart. A second object is identified to which to navigate responsive to the input, the second object being located within a neighborhood of the first object at a shortest neighborhood distance from the first object. Navigation is performed to the second object to keep the focus within the neighborhood.

Abstract: Systems, methods, and apparatus are herein disclosed for controlling a display brightness based on user action or user interest in the display. In particular, the display brightness can be dimmed upon identification of a first marker indicative of a user action such as a request for a webpage. The brightness of the display can be increased or returned to its original state upon identification of a second marker indicative of completion of a user equipment activity triggered by the user action. In some embodiments, another brightness state between these two can be used as an intermediary and is triggered when a third marker, indicative of a progression of the user equipment activity, is identified.

Abstract: A method for displaying of a touch cursor is provided. The method is adapted to an electronic apparatus having a touch display unit. The touch display unit has a display area. The method includes the following steps. At least one first dimension boundary and at least one second dimension boundary are defined in the display area. A cursor, which has a pointing area and a touchable area, is displayed. When a touch event occurs in the touchable area, the cursor is correspondingly moved according to a touch coordinate of the touch event. When a reference point of the cursor passes two of the at least one first dimension boundary or two of the at least one second dimension boundary, the cursor is rotated for adjusting a relative position of the pointing area and the touchable area.

Abstract: A method and system is provided for creating a new video stream having an electronic pointer rendered therein. The disclosed system includes a receiver that continuously receives position data from a wireless pointing device; a calibration unit that calculates positions for the electronic pointer relative to a viewing device based on the position data received from the wireless pointing device; a processor that renders the electronic pointer in an original video feed received from a video source to create the new video stream as a single data stream, such that the electronic pointer is positioned at locations in the new video stream that correspond to the calculated positions for the electronic pointer; and a server that transmits the new video stream to the wireless pointing device to be rendered on a screen of the wireless pointing device.

Abstract: An image processing apparatus includes: a processor configured to: store information on a reference area that has been extracted from a first image not including a target object by using a condition regarding color, generate, by using the condition, information on a target area in a second image that has been captured at a point in time different from a point in time at which the first image has been captured, determine, by using the target area and the reference area, whether or not there is an overlap between the reference area and the target object, when the overlap exists, identify an overlap area, and extract, by using the difference area between the reference area and the target area, and the overlap area, the target object from the second image.

Abstract: A control unit for an automatic device for preparing a beverage, which control unit is provided with a display panel and an input wherein the control unit is provided furthermore with an operating unit for displaying by the display panel a visually observable reaction to designations provided by the user, and for controlling a preparation unit of the automatic device, wherein the display panel has selection fields for mutually exclusive settings for formulations of the beverage to be prepared, wherein the control unit enables the user to select one of the settings by designation of one of the selection fields, wherein a collecting field with at least one setting field shows the chosen setting of the formulation, and wherein the non-designated selection fields remain visible and selectable.

Abstract: Joystick display data is generated for display on a touch screen of an electronic device. The joystick display data creates a visual representation of a virtual joystick when displayed on the touch screen. Touch data from the touch screen is processed to determine when the touch data indicates user interaction with the virtual joystick. When the touch data indicates user interaction with the virtual joystick, the joystick display data is adjusted to reflect the user interaction with the virtual joystick, based on the touch data, and joystick data is generated based on the user interaction with the virtual joystick. The display of at least one other element on the touch screen can be adjusted based on the joystick data.

Abstract: Interaction between an application, a user interface framework, and a graphics module to render a portion of an application surface. The application requests a surface corresponding to a particular range of the application surface from the user interface framework. In response, the user interface framework provides the requested ranged surface to the application. The application instructs the graphics module to populate the ranged surface by drawing into the ranged surface. The application then instructs the user interface framework to compose the ranged surface using the drawn ranged surface and other information available to the user interface framework. The user interface framework composing a composed surface using the drawn surface provided by the application, and additional information available to the user interface framework. The user interface framework may cache information from previously composed surface to allow for faster re-rendering should those portions later come into view on the display.

Abstract: Systems, methods and computer readable media are disclosed for manipulating virtual objects. A user may utilize a controller, such as his hand, in physical space to associate with a cursor in a virtual environment. As the user manipulates the controller in physical space, this is captured by a depth camera. The image data from the depth camera is parsed to determine how the controller is manipulated, and a corresponding manipulation of the cursor is performed in virtual space. Where the cursor interacts with a virtual object in the virtual space, that virtual object is manipulated by the cursor.

Abstract: An image display apparatus and a method for operating the same are discussed. According to an embodiment, the method for operating the image display apparatus having a display screen, includes processing a signal for displaying a first object; associating, by the image display apparatus, the first object with a pointer to be displayed, the pointer being movable according to a pointing operation of a pointing device associated with the image display apparatus; and automatically displaying, by the image display apparatus on the display screen, the first object and the pointer on the first object based on the associating step.

Abstract: Detecting click fraud that includes a client device capable of accessing a server hosting a web page containing an advertisement. The client device includes a network interface allowing access to the server and code on the client device. The code accesses and displays a web page containing an advertisement, provides mechanisms (e.g., an applet, an ActiveX control, a plugin, a JavaScript, a browser scripting language, browser extensions, or code native to the browser) associated with each pixel cluster where each mechanism captures information regarding the transit of the pixel cluster by a cursor on the web page, and collects information based on the capturing by each associated mechanism regarding the transit of the pixel cluster by a cursor on the web page.

Abstract: A pointer controlling apparatus, a control method, and a pointer controlling program are provided which can protect a button from erroneous operation without interrupting the operational flow or using excessive display area. The pointer controlling apparatus permits a pointer to move into a predetermined region after a predetermined period of time has elapsed from a point in time when the pointer comes into contact with a boundary line of the predetermined region. Accordingly, the predetermined area can be securely protected from a point in time at which the pointer comes into contact with the boundary line of the predetermined region for the predetermined amount of time. Furthermore, since the pointer is permitted to enter the predetermined region immediately after the predetermined time has elapsed, the predetermined region can be protected without interrupting the operational flow, and without using an excess of a display region.

Abstract: A user input to a system is processed by receiving reflections of signals from a moving input object. Information relating to the direction of movement of the input object and information relating to the speed of the input object are determined from the reflections. Continual sensory feedback is provided to the user, controlled by a parameter that is repeatedly updated based on the direction and speed of the input object. When no new determination of information relating to the speed or direction of the input object has been made since a previous update, a time-dependent change is made to the parameter.

Abstract: Described herein are systems and techniques for projecting content, periodically or continuously, onto a rear surface of a display medium from behind. The rear projected image is presented on an opposing or front surface of the display medium to a human audience for viewing. Additionally, non-visible light (e.g., IR light) is passed through the display medium to an area in front of the medium. The non-visible light is used to detect human gestures. In this manner, the rear projection arrangement avoids viewer obstruction during projection, yet detects and recognizes gestures made by the viewer in front of the display medium. In one implementation, the display medium comprises a thin sheet of transparent plastic material with arrays of curved optical features to redirect light received on the rear surface out the front surface toward the human audience.

Abstract: An approach is provided for automatically calculating and delivering proportional pointer locations during transition between multiple visual display devices (e.g., in regard to their characteristics, which may be heterogeneous, homogenous, or a mixture thereof). Specifically, the approaches described herein provide a solution for finding proportional locations of a pointer's on-screen graphic as the pointer is being transitioned/moved between multiple display devices (e.g., controlled by a single computer or controller).

Abstract: Embodiments of the invention are directed to interacting with a touch sensitive display screen. A method may include detecting a plurality of interactions with a touch sensitive screen. A display area may be defined based on locations associated with the interactions. An action may be performed with relation to a defined display area. An action may be performed with relation to content presented in a defined display area.

Abstract: A user interface allows a user to input text, numbers and symbols in to an electronic device through a touch sensitive input and perform control functions with one or more swipes gestures, swipe and hold gestures and multiple finger tap gestures. The system can differentiate the swipes and perform functions corresponding to the detected swipes based upon swipe direction, number of fingers used in the swipe and the context of the text input.

Abstract: A method for secured entry of personal data is disclosed. This method comprises for each item of personal data a first step of presentation of a virtual keyboard comprising keys and a first cursor, followed by a step of selection of a key corresponding to the item of personal data wherein the virtual keyboard also comprises at least one dummy cursor and wherein the position on the virtual keyboard of the at least one dummy cursor depends on the position of the first cursor. A device for secured entry of personal data configured to implement the method is further disclosed.

Abstract: The present invention is directed to a system and method for providing interface layout information related to one or more interface objects. As the designer places various design guides on the design canvas to assist in spacing and laying out interface objects, the ADE maintains a list of distances between each guide. When the user selects a desired screen area within the design canvas, the ADE displays selected distances for one or more of the design guides associated with the selected screen area.

Abstract: This document describes techniques and apparatuses for managing an immersive interface in a multi-application immersive environment. In some embodiments, these techniques and apparatuses enable a user to alter sizes and/or a layout of multiple immersive interfaces with as little as one selection.

Abstract: A computer-implemented user notification method includes displaying, in a status area near a perimeter of a graphical interface, a notification of a recent alert event for a mobile device, receiving a user selection in the status area, and in response to the receipt of the user selection, displaying, in a central zone of the graphical interface, detail regarding a plurality of recent messaging events for the mobile device.

Abstract: A touch device is provided that allows users to easily select text in an Electronic Book (e-book), based on a touch interaction. A method is also provided that operates an e-book function in the touch device which includes displaying e-book content, receiving an anchor interaction at a location in text of the e-book content, displaying a number of candidate anchors, based on the location where the anchor interaction is input, determining two selected candidate anchors as definite anchors, and forming a block of text in the definite anchors.

Abstract: A system for generating a user interface for notification includes a notification response server and an activity streams backend. The notification response server receives requests for notification information from client devices. The notification response server provides information including a number of notifications, a list of notifications, and detail about each notification. The notification response server and the client device cooperate to present a notifications menu that is part of a browser window header that is consistent regardless of the tab being displayed. The activity streams backend is coupled to the notification response server and a plurality of other servers with which the user may interact. These other servers generate messages for which the notification response server generates corresponding notifications. The present disclosure also includes a method for displaying a number, list or details about notifications and methods for responding to notifications within the user interface.

Abstract: An augmented reality control system in which the generation and utilization of simple geometric forms of real world objects at the enterprise level are layered onto or based on real world objects. Digital data is aligned to real world objects via surrogate of simplified geometric forms.

Abstract: Provided is an image processing device including a display unit that displays a function setting screen, a recognition unit that recognizes a trail of an operation of a user on the function setting screen displayed on the display unit, a determining unit that determines a function selected by the user based on a position of the trail of the operation recognized by the recognition unit, an identification unit that identifies an operation condition designated by the user with respect to the function determined by the determining unit based on the trail of the operation recognized by the recognition unit, and a setting unit that performs setting for executing image processing of the function determined by the determining unit using the operation condition identified by the identification unit.

Abstract: A screen change control method based on input signals and a mobile terminal supporting the same are disclosed. The mobile terminal includes a display panel for outputting a screen assigned to a user function, and a control unit for collecting screen ratio information based on at least one of a proportion of a current screen on the display panel to a full screen assigned to the user function and a ratio of enlargement or reduction by zooming, and for automatically adjusting an amount of screen changes for an input signal according to the screen ratio information.

Abstract: A method and system is provided that manipulates content displayed on a viewing device. The disclosed system includes a receiver that receives position data from a wireless pointing device and a processor that calculates a current position for the electronic pointer relative to the viewing device and renders the electronic pointer in a video feed received from a video source. Thereafter, the processor identifies a current location in the video feed that corresponds to a calculated current position for the electronic pointer, identifies content in the video feed positioned at the current location, dynamically manipulates additional content in response to a manipulation request from the wireless pointing device, and delivers the manipulated content to the viewing device for display thereon.

Abstract: A sample processing apparatus includes: a first sample processing unit; a second sample processing unit; and a data processing unit connected to the first and the second sample processing units. The data processing unit includes: a display device; an input device; and a controller configured to show a screen image on the display device, wherein the screen image comprises a shared region which is shared for displaying information of each of the first and the second sample processing units, a first operation section operable by a user to control the first sample processing unit and a second operation section operable by the user to control the second sample processing unit, and control the first sample processing unit in response to an operation of the first operation section, and control the second sample processing unit in response to an operation of the second operation section.

Abstract: Methods and apparatus provide for a self-enclosed timeline trimmer to create a circular timeline placed over a video that graphically represents the entire duration of a video. The self-enclosed timeline trimmer generates a self-enclosed timeline to represent a duration of the video incremented according to a first unit of time. The self-enclosed timeline is layered over at least a portion of the video. The self-enclosed timeline trimmer represents a start of the video on the self-enclosed timeline and an end of the video on the self-enclosed timeline. The self-enclosed timeline trimmer displays the duration of the video in its entirety by connecting the start and the end of the video on the self-enclosed timeline. Further, the self-enclosed timeline trimmer is well suited for video editing on mobile computer devices, wireless computer devices, and for portable computer devices.

Abstract: Various embodiments are disclosed for selecting a region of interest within an object. One embodiment is a method for editing a digital image in an image editing device. The method comprises obtaining a first position within a digital image, the first position being specified by a pointer. The method further comprises defining a first selection region based on the first position and obtaining a second position within the digital image, the second position being specified by the pointer. The method further comprises determining movement of the pointer between the first position and the second position and predicting future movement by the pointer based on the determined movement. Based on the determined movement and the predicted future movement, the first selection region is expanded to define a second selection region.

Abstract: A system and method for viewing material displayed on an electronic device. When a user desires to view a document, only a portion of which is viewable on a display at a given moment, the portion is displayed on the display as a primary image. A secondary image is then generated, with the secondary image including the portion and additional material of the document not part of the primary image. The secondary image is superimposed over the primary image on the display when a user scrolls through the document such that both the secondary image and the primary image are visible to the user.

Abstract: Techniques for efficiently capturing, generating and distributing realistic images and dynamic reports with live sources are provided. Among other aspects, the system includes a user interface with identifier tags to create and manipulate dynamic and fixed representational image elements to create high resolution, seamless composite images or image streams with low processing and storage requirements, from databases or other sources. The identifier tags may be provided with Relational Aspects, including physical models governing image elements and their 3-D subjects. Image output may be in digital, analog or direct representational formats, and a new format combining features of each. Element Seeding or Borrowing may be implemented to further enhance elements of the image or report composites.

Abstract: An input device, wherein the screen (18a) of a display device (18) is divided into two regions, a region (A1) and a region (A2), and the icon switch displayed in the region including the position of an invisible pointer (P?) is selected. Thus, one of an icon switch (1) and an icon switch (2) that are displayed on the screen (18a) is selected at any time. Consequently, the user will no longer have to watch the screen carefully and perform an operation for moving an instruction marker such as a visible pointer to a desired icon switch, for example as in conventional devices. Accordingly, the user can enter a desired instruction in a short time by selecting a desired icon switch in a short time.

Abstract: New techniques improving display output and computer system input response are provided. In aspects of the invention, a system assesses whether input gesture(s) occur within an area of an output matrix describing an element, within a time period following a substantial and/or activity-affecting change in that area, and nullifies or alters an affect(s) of the input gesture(s) that would otherwise occur, and may instead or also create the affect that would occur if the output matrix had not experienced the relevant substantial and/or activity-affecting change, and may also reverse, alter, augment or otherwise address the substantial and/or activity-affecting change in that area of the output matrix to enhance the user experience. In other aspects, an object-based projection method increases efficiency and decreases output matrix judder. In additional aspects, a new form of pixel and array, with variably-angled variably-curved pixel subsections, assists in further smoothing edges between objects.

Abstract: An input apparatus of a display apparatus, a display system, and a control method thereof, are provided herein, the input apparatus including: a communication unit which communicates with the display apparatus; a sensing unit which detects angular speed and acceleration from a motion of the input apparatus; a storage unit which stores position information on a position of the input apparatus; and a controller which calculates the motion information based on the detected angular speed and the position information and transmits the calculated motion information through the communication unit if the input apparatus moves, and updates the position information in the storage unit based on the detected acceleration if the input apparatus does not move.

Abstract: An apparatus includes a keyboard and a trackpad, where a spacebar for the keyboard is integrated as a part of the trackpad.

Abstract: A method for providing information in an electronic device is provided. The method includes displaying a digital object through a user interface unit. The method also includes acquiring a pointer-over input regarding the digital object. The method further includes identifying attribute of the pointer-over input. The method includes determining information related to the digital object based on the identified attribute. The method also includes offering the determined information through the user interface unit.

Abstract: A method for communicating control information by a wearable device is disclosed. The method includes determining a first movement according to a first degree of freedom as being gesture-related and a second movement according to a second degree of freedom as being gesture-related; generating a first set of possibly performed gestures based on the first movement; generating a second set of possibly performed gestures based on the second movement; inferring, from the first and second sets, whether the first movement is representative of an intended command; and transmitting information based on the inference. An apparatus for performing the method is also disclosed.

Abstract: Embodiments of the present invention provide a method, system and computer program product for fast mouse pointer location. In an embodiment of the invention, a method for fast mouse pointer location includes determining a contemporaneous location of a mouse pointer in a GUI of a host computer, dimensioning in memory of the host computer different shapes and arranging the shapes to proximately meet at a point of intersection, overlaying the shapes in the GUI at a position proximate to the contemporaneous location of the mouse pointer, displaying the shapes in the GUI for a brief period of time before hiding the shapes from view in the GUI and repeating the determining, dimensioning, overlaying and displaying for different movements of the mouse pointer in the GUI.