Abstract: When a lateral sliding operation is executed starting from a position on a touch panel corresponding to a specific icon being shown, at least one processor shrinks and moves an image being shown in a direction toward an end point of the lateral sliding operation in a showable area. The specific icon includes an icon, when pressed and held, not causing a mobile terminal to perform an operation.

Abstract: Systems, methods, and apparatus for identifying and tracking UAVs including a plurality of sensors operatively connected over a network to a configuration of software and/or hardware. Generally, the plurality of sensors monitors a particular environment and transmits the sensor data to the configuration of software and/or hardware. The data from each individual sensor can be directed towards a process configured to best determine if a UAV is present or approaching the monitored environment. The system generally allows for a detected UAV to be tracked, which may allow for the system or a user of the system to predict how the UAV will continue to behave over time. The sensor information as well as the results generated from the systems and methods may be stored in one or more databases in order to improve the continued identifying and tracking of UAVs.

Abstract: A mobile terminal apparatus can generate data indicating a screen displayed on a display unit using software depending on selection states of the display unit. A first display unit and a second display unit display images. The apparatus causes at least one of the first display unit and the second display unit to display a content. The apparatus selects one or more of the first display unit and the second display unit. The apparatus acquires screen data indicating a screen displayed on the selected display unit. The apparatus generates image data based on the acquired screen data.

Abstract: A touch display apparatus and an operating method of the touch display apparatus are provided. An application icon is converted into a corresponding startup gesture icon if a touch operation conforms to an icon conversion operation. Here, the startup gesture icon indicates a gesture operation required for starting up an application corresponding to the startup gesture icon.

Abstract: The invention relates to a sensor device (2) for a motor vehicle (1). The sensor device has a light source (10) and a detection device (20), said detection device being formed using an array of optical pixels. The light source (10) and the detection device (20) are coupled to a control and evaluation device (30) which activates the light source (10) to emit light pulses and the detection device to carry out the detection process. The control and evaluation device (30), the detection device (20) and the light source (10) together act as a time-of-flight camera (ToF camera), allowing spatial range data to be detected. The control and evaluation device (30) is designed to operate the light source and the detection device in at least two modes, i.e. an initialization mode and a measuring mode. The control and evaluation device (30) activates the detection device in the initialization, mode and interrogates all the pixels at least once to obtain signals.

Abstract: Systems and methods for implementing retail processes based on machine-readable images and user gestures are disclosed. According to an aspect, a method includes capturing one or more images including a machine-readable image and a user gesture. The method also includes identifying the machine-readable image as being associated with a product. Further, the method includes determining whether the user gesture interacts with the machine-readable image in accordance with a predetermined gesture. The method also includes implementing a predetermined retail process in association with the product in response to determining that the user gesture interacts with the machine-readable image in accordance with the predetermined gesture.

Abstract: A method for displaying information by an electronic device is provided. The method includes displaying a first information display area on a touch screen in response to a first user input received through a first part in some areas of the touch screen including the first part and a second part connected or adjacent to the first part, displaying a second information display area on the touch screen in response to a second user input received through the second part, displaying first information received from outside of the electronic device in the first information display area, the first information being associated with first contact information, and displaying second information received from the outside of the electronic device in the second information display area, the second information being associated with second contact information.

Abstract: A display apparatus and a controlling method thereof are provided. The controlling method of a display apparatus includes displaying a mode conversion user interface (UI) that provides a guideline to enter a motion task mode; recognizing a first motion that corresponds to the guideline; entering the motion task mode that enables a second motion to control a function of the display apparatus in response to the first motion being recognized while the guideline is displayed on the display apparatus; and displaying a motion task UI to perform the motion task mode.

Abstract: A head-mounted display device that enables a user to simultaneously visually recognize a virtual image and an outside scene includes a photographing unit configured to photograph at least a part of a visual field direction of the user in a state in which the user wears the head-mounted display device and acquire a motion of the user; a track acquiring unit configured to acquire a track of the motion of the user from the motion photographed by the photographing unit; and an authentication processing unit configured to authenticate, using the track acquired by the track acquiring unit, whether the user is a proper user.

Abstract: When a lateral sliding operation is executed starting from a position on a touch panel corresponding to a specific icon being shown, at least one processor shrinks and moves an image being shown in a direction toward an end point of the lateral sliding operation in a showable area. The specific icon includes an icon, when pressed and held, not causing a mobile terminal to perform an operation.

Abstract: A system, method, and device for providing haptic feedback is presented. The system comprises a first device, a second device, and a third device. The first device has a first haptic output device, a first processor, and a first wireless communication unit. The second device has a second haptic output device, a second processor, and a second wireless communication unit. The third device has a third processor and a third wireless communication unit configured to transfer digital content between the third device and at least the first device. At least one processor of the first processor, second processor, and third processor is configured, when digital content is transferred or is being transferred between the third device and the first device, to cause the first haptic output device to output a first haptic feedback and to cause the second haptic output device to output a second haptic feedback.

Abstract: Provided is an input apparatus, including: a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus; and an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.

Abstract: A display control apparatus displays a cursor based on an operation performed by an operator on a screen of a display device. The display controlling unit corrects the in-screen position of the instruction image based on a relationship between a first position indicated by the hand having a first shape and a second position indicated by the hand having a second shape in a case where a second operation is detected after a first operation is detected and displays the instruction image at the in-screen position corresponding to the second position.

Abstract: A manipulation panel that is a user interface includes a display unit that displays a screen, a touch panel that detects a tap performed to the display unit, and an abnormality detector that detects a situation, in which a message is displayed on the display unit, until the touch panel detects a second tap constituting a double tap since detecting a first tap. Manipulation panel displays a warning message about the situation detected by the abnormality detector on the display unit after the touch panel detects the second tap.

Abstract: In a state where an extended input device is secured to a data transmission device, an image capturing unit of the data transmission device captures an image of a light emitting unit that emits light, an image of which is allowed to be captured by the image capturing unit in accordance with a user input and/or a user operation, and data generated based on at least the captured image is transmitted to an information processing apparatus. The information processing apparatus executes an information process based on the transmitted data.

Abstract: Devices and method are provided that facilitate improved input device performance. Specifically, the systems and methods are configured to identify a portion of an image of sensor values as corresponding to at least one sensed object in the sensing region, determine a polygon corresponding to the identified portion of the image, and determine a contact characterization of the at least one sensed object based on the polygon. The determination of a polygon corresponding to a sensed object facilitates improved contact characterization of the sensed object. For example, the determined polygon may be used to determine if the sensed object is actually more than one object. As a second example, the determined polygon may be used to determine the orientation of the sensed object. In addition, determined polygons may be used to more accurately track changes in the position of the sensed object.

Abstract: An I/O device, an I/O program, and an I/O method that can add a sense of distance from the position of visually recognizing eyes to a stereoscopic image that is a virtual image, through an object that is a real image and provide visual recognition as if the stereoscopic image were associated with the object are provided. An I/O device of the present invention includes a display device that can generate a stereoscopic image, a depth level sensor that measures a distance to an object, and an event generating unit that generates an event according to a mode of the object at least either in a stereoscopic region of the stereoscopic image generated by the display device or in a depth level detection region of the depth level sensor.

Abstract: A method of operating the video display device according to the embodiment of the present invention comprises acquiring a video of a video display device associated with a user; recognizing a gesture of the user in the acquired video; calculating a control amount with regard to the gesture based on the recognized gesture; and performing the control operation corresponding to the recognized gesture and the calculated control amount.

Abstract: A mobile electronic device comprises a display, an operation detector, and a processor. The operation detector is capable of detecting a first touch operation and a second touch operation on the display performed by a part of a human body. The processor is configured to execute a control process responsive to the first touch operation and the second touch operation. The part of the human body performing the second touch operation is located in a position farther from the display than a position of the part of the human body performing the first touch operation. The processor is configured to execute the control process while handling the first touch operation and the second touch operation performed continuously as a single touch operation, depending on a time lag between the first touch operation and the second touch operation.

Abstract: Disclosed are a method for controlling a terminal device, a terminal device and an electronic device. The method comprises: acquiring a first input; determining, in the locked state, a first instruction of the first instruction set corresponding to the first input, the first instruction being an unlocking instruction; controlling a switching from the locked state to the unlocked state according to the unlocking instruction; determining, in the unlocked state, a second instruction of the second instruction set corresponding to the first input; and responding to the second instruction. With the present invention, user operations are simplified, and intelligence of the terminal device is improved.

Abstract: The purpose is to provide a terminal device that can be operated by a virtual operation key which is easy to use. The terminal device according to an aspect of the present invention comprises a display unit for displaying a virtual operation key, a touch panel for detecting contact by an inputting object on the virtual operation key, and a control unit for assessing whether a drag operation by the inputting object has been carried out on the basis of contact with the virtual operation key by the inputting object detected via the touch panel and controlling the display position of the virtual operation key, wherein the control unit modifies the display position of the virtual operation key in accordance with the contact position of the inputting object if the contact position of the inputting object exceeds a display area of the virtual operation key due to the drag operation.

Abstract: A method for providing a mechanism by which different user interface effects may be performed for different motion events may include receiving an indication of a motion event at a motion sensor, determining a motion gesture of the motion event, determining a motion property of the motion event, and enabling provision a user interface effect based on the motion property of the motion event. A corresponding apparatus and computer program product are also provided.

Abstract: The systems described herein integrate virtual keyboard technology and gesture-based controllers into a single module or into a laptop or other mobile computing device in order to make laptops, personal computers, and other mobile computing devices more convenient, more versatile, and with less clutter or fewer peripheral devices than is typically the case with a traditional combination of a physical keyboard with a mouse, touchpad, or track ball. Users of the embodiments disclosed herein will be able to enter data or commands merely by typing or making hand gestures or hand movements, which will lead to greater flexibility, creativity, and productivity, while reducing user ennui and fatigue.

Abstract: An input apparatus having a touch module and an input identification method applied to the apparatus are described. The method includes during the collection of a touch track on the touch module, when a first partial track of the touch track satisfies a first preset condition, a first command corresponding to the first partial track is obtained; the first command is executed; and during the collection of the touch track, when a second partial track following the first partial track satisfies a second preset condition, a second command corresponding to the second partial track is obtained; and the second command is executed. The method and apparatus can quickly identify a gesture operation of a user on the touch screen, and can continue to perform the corresponding operation after the identification of the gesture operation of the user and before the completion of the gesture operation.

Abstract: Architecture that enables single and multi-modal interaction with computing devices, as well as interpreting user intensity (or liveliness) in the gesture or gestures. In a geospatial implementation, a multi-touch interaction can involve the detection and processing of tactile pressure (touch sensitive) to facilitate general navigation between two geographical points. This is further coupled with providing detailed information that facilitates navigation and turn-by-turn directions. This includes the use of time and/or pressure to release or increase the zoom level of map tiles, the touching of the two geographical points and speaking to obtain directions between these two geographical points, and the blending of tiles to create a compelling user experience, where the map is in different levels of zoom on the same view.

Abstract: Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, a scale indicative of an actual gesture distance traversed in performance of the gesture is identified, and a movement or action is displayed on the device based, at least in part, on a ratio between the identified scale and the scale of the displayed movement. In some embodiments, a degree of completion of the recognized gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.

Abstract: A system, method, and computer program product are provided for operating a mobile device including a touch screen, a memory, and a vibratory feedback mechanism coupled to at least one processor. A plurality of applications including an application is stored, utilizing the memory. Indicia is displayed, utilizing the touchscreen. A first pressure signal indicative of a first magnitude of pressure being applied to the touch screen is identified in connection with the indicia. In response to the first pressure signal indicative of the first magnitude of pressure being applied to the touch screen, a first state is identified, utilizing the at least one processor. In response to the identification of the first state, an operation is performed, utilizing the at least one processor. A second pressure signal is identified indicative of a second magnitude of pressure being applied to the touch screen that is greater than the first magnitude, in connection with the indicia.

Abstract: An access control method and a terminal device are disclosed. The method includes: receiving an unlock password after receiving an instruction for opening an application program; determining an access type corresponding to the unlock password; obtaining display information corresponding to the access type among current display information of the application program; and displaying the obtained display information. An access type is distinguished according to an unlock password, and display information is determined according to the access type, so that the display information can match the unlock password input by a user, and the user can flexibly and secretly control information to be displayed, thereby preventing a risk that private or other important information of the user is seen by a visitor and improving information security.

Abstract: An electronic device includes: a communication module configured to receive a content; a direction detection unit configured to detect a direction that a screen of the electronic device faces; a control unit configured to determine whether to display the received content on the basis of a least one of whether the received content corresponds to a designated content and whether the detected direction corresponds to a designated direction; and a display module configured to display a notification notifying the reception of the content without displaying the content if the detected direction does not correspond to the designated direction and the received content corresponds to the designated content according to a determination result of the control unit.

Abstract: A method of an electronic device including a touch panel for determining a control command is provided. The method includes the operations of receiving at least one touch input, receiving a hovering input, determining the control command corresponding to a combination of the at least one touch input and the received hovering input, and controlling the electronic device according to the determined control command.

Abstract: Aspects of the disclosure provide a method for icon based application control. The method includes receiving, by a processor, a detection signal indicative of a pre-defined user action on an icon in a graphical user interface (GUI). The icon has an associated application. Further, the method includes extracting adjustable settings of the associated application with the icon, and providing, by the processor, a setting interface for the icon in the GUI to enable adjustments of the settings for the application to be performed via the setting interface.

Abstract: A mobile terminal and controlling method thereof are disclosed, which facilitates a terminal to be used in further consideration of user's convenience. According to at least one of embodiments of the present invention, a strict authentication procedure for expense payment can be performed via a simple and convenient user interface between a mobile terminal and a terminal user. In particular, since at least one of a selection and authentication of a payment means of the mobile terminal can be performed via at least one of an aligned direction, a moving direction and a moving track of the mobile terminal, the user interface between the mobile terminal and the terminal user for the expense payment can be further simplified.

Abstract: The technology disclosed provides systems and methods for reducing the overall power consumption of an optical motion-capture system without compromising the quality of motion capture and tracking. In implementations, this is accomplished by operating the motion-detecting cameras and associated image-processing hardware in a low-power mode (e.g., at a low frame rate or in a standby or sleep mode) unless and until touch gestures of an object such as a tap, sequence of taps, or swiping motions are performed with a surface proximate to the cameras. A contact microphone or other appropriate sensor is used for detecting audio signals or other vibrations generated by contact of the object with the surface.

Abstract: Methods for dimensioning a 3D item are described. A FOV is mapped over three spatial dimensions, each of the three spatial dimensions oriented orthogonally in relation to each of the others and graduated according to a linear scale. The 3D item is scanned relative to the mapped FOV. Each of the 2D surfaces of the scanned 3D item is identified. A dimension is measured for each of the identified 2D surfaces of the scanned 3D item. A perspective-correct representation of the measured dimension is rendered, in real time or near real time, with respect to the measuring the dimension step, onto each of the identified 2D surfaces of the scanned 3D item.

Abstract: A menu application provides an integrated interface for launching multiple mobile applications from a dynamically configurable menu. Each of the mobile applications is associated with a servlet that provides the application's menu data to the menu application. The servlet may query design-time data and application run-time data to generate the menu data for the application. Additionally, the set of applications included by the menu application in a menu list may be based on a user authorization level, such that the menu list only includes applications that the user is authorized to access.

Abstract: A system, method, and computer program product are provided for computing operations based on a first and second user input. In use, a first user input in a first region of a graphical user interface is received. Next, while receiving the first user input, a second user input is received in connection with one or more portions of displayed content in a second region of the graphical user interface. Lastly, one or more operations are computed in connection with the one or more portions of the displayed content, based on the first input and the second input. Additional systems, methods, and computer program products are also presented.

Abstract: Technologies are described for configuring user input using physical gestures. For example, a user can be prompted to perform a physical gesture to assign to a software application command (e.g., an action within a video game or a command in another type of application). In response, a physical gesture can be received from the user via a physical gesture input device. The received physical gesture can then be associated with the software application command so that when the user performs the physical gesture the software application command can be initiated.

Abstract: According to the invention, a method for entering text into a computing device using gaze input from a user is disclosed. The method may include causing a display device to display a visual representation of a plurality of letters. The method may also include receiving gaze information identifying a movement of the user's gaze on the visual representation. The method may further include recording an observation sequence of one or more observation events that occur during the movement of the user's gaze on the visual representation. The method may additionally include providing the observation sequence to a decoder module. The decoder module may determine at least one word from the observation sequence representing an estimate of an intended text of the user.

Abstract: A system presents close-loop controlled display states on the lockscreen of a mobile device. Contextual information may be collected at the mobile device. The system may access subscriber identity register data to determine subscription registry status for a mobile subscriber associated with the device. The subscriber identity register data and contextual information may be processed by closed-loop display state selection circuitry and next action selection logic to generate a display state selection. The display state selection is sent to the mobile device. The selected display state may be displayed during lockscreen invocations at the mobile device.

Abstract: Temporally segmenting an instrumented gesture executed by a user with a terminal having an inertial navigation module, which measures a vector of inertial characteristics representative of movement of the terminal. Segmenting includes, at each current instant: calculating an instantaneous power value of the vector; estimating a gesture indicator based on variation between the instantaneous power value and a mean power value estimated over a preceding time window; determining a start of gesture at a first instant, when the estimated gesture indicator is greater than or equal to a first threshold during a time interval greater than or equal to a first interval; and determining an end of gesture at a second instant when, at the current instant, the estimated gesture indicator is less than or equal to a second threshold during a time interval greater than or equal to a second time interval.

Abstract: Methods for dimensioning a 3D item are described. A FOV is mapped over three spatial dimensions, each of the three spatial dimensions oriented orthogonally in relation to each of the others and graduated according to a linear scale. The 3D item is scanned relative to the mapped FOV. Each of the 2D surfaces of the scanned 3D item is identified. A dimension is measured for each of the identified 2D surfaces of the scanned 3D item. A perspective-correct representation of the measured dimension is rendered, in real time or near real time, with respect to the measuring the dimension step, onto each of the identified 2D surfaces of the scanned 3D item.

Abstract: An interactive projector includes a projection section adapted to project a projected screen on a screen surface, an imaging section adapted to take an image of an area of the projected screen, and a pointing element detection section adapted to perform a detection process for detecting the pointing element based on the taken image, which is taken by the imaging section, and includes the pointing element, and the pointing element detection section sections the taken image into a plurality of small areas, and performs the detection process in at least one of the small areas using a parameter different from parameters in the rest of the small areas.

Abstract: An application processes user input with respect to a geographic map to generate annotations associated with locations on that geographic map. Such annotations can include user entered characters and graphics, including curves and lines. The application distinguishes between user inputs that are annotations and user inputs that indicate a request for a route between two locations. In response to user input with respect to a geographic map, the application determines whether the user input is a request for a route. When performing such comparisons, the application uses locations and road segments that are presented at a zoom level corresponding the zoom level applied at the time the user input for the annotation was received. After determining that a user input corresponds to a request for a route, the application generates data describing a route. The application can present a plurality of candidate routes to the user for selection.

Abstract: In at least some embodiments, a mechanism is provided for web developers to request specific default behaviors, such as touch behaviors, on their webpages. In at least some implementations, a Cascading Style Sheets (CSS) rule is utilized to enable or disable manipulations such as panning, pinch zoom, and double-tap-zoom manipulations. The mechanism can be extensible to accommodate additional default behaviors that are added in the future. In various embodiments, the behaviors are declared up front and thus differ from solutions which employ an imperative model. The declarative nature of this approach allows achievement of full independence from the main thread and deciding the correct response using independent hit testing.

Abstract: An apparatus, a method, and a computer program product for gesture recognition. The apparatus classifies a gesture based on a movement of a body part as detected by a primary sensor. The apparatus determine a reliability level of a secondary sensor and obtains corroborating information associated with the movement of the body part using the secondary sensor when the reliability level satisfies a criterion. The apparatus then confirms or negates the classification of the gesture based on the corroborating information. The secondary sensor may be a sensor already known to the apparatus, i.e., the sensor is currently being worn by the user, or it may be a sensor that is worn by a user at a later time. In the latter case, the apparatus detects for the presence of a new sensor, determines the gesture recognition capabilities of the new sensor and integrates the new sensor into the gesture recognition process.

Abstract: A mobile terminal and a method of controlling therefor are disclosed. The method includes activating a memo mode while displaying a screen of a first application; displaying a first touch pattern in response to a first pattern input including the first pattern; displaying a plurality of primary graphic user interface (GUI) items respectively corresponding to a plurality of primary content items associated with the first touch pattern; and displaying content associated with a primary content item corresponding to a selected primary GUI item, wherein the selected primary GUI item is selected from among the displayed plurality of primary GUI items in response to an input, and wherein the displaying of the content is at a position proximate to the displayed first pattern.

Abstract: As disclosed herein a computer-implemented method includes detecting a gesture applied to a touch display that corresponds to an object, determining a direction for the gesture and determining if a gesture pressure is greater than a threshold pressure required to move the object. The method further includes determining a surface profile of the display and selecting a rate of transfer according to the surface profile of the display, determining if a surface profile of a receiving device is compatible with the surface profile of the display, and transferring the object to the receiving device. A computer program product and a computer system corresponding to the above method are also disclosed herein.

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

Abstract: Embodiments discussed herein include: accessing by a user terminal a recording of a communication session in the form of a media file wherein the media file comprises at least an audio component; accessing by the user terminal, metadata associated with the media file, wherein the metadata comprises an indication of a respective one or more visual representations of each of a plurality of events determined to have occurred during the communication session, wherein at least some of the visual representations comprise text converted from at least one communication stream of the recorded communication session, and wherein the metadata further comprises timing information linking the respective visual representations to the events; playing the media file using a media playing application running on the user terminal; and controlling play back of the media file so that a play back rate of the audio component is synchronized with a rate of a user scrolling through the visual representations.

Abstract: An electronic device and method is disclosed. The electronic device includes a storage module, a recognition module, and a control module. The storage module is configured to store a first and second movement of one or more fingers of a user, and a first and second process. The first movement is different from the second movement. The first process comprises executing an application. The second process is configured to notify information related to the first process. The recognition module is configured to recognize a gesture of one or more fingers as the first movement or the second movement. The control module configured to perform the first process when the gesture is recognized as the first movement. The control module is further configured to perform the second process when the gesture is recognized as the second movement.