Abstract: A GUI component in a screen is recognized without analyzing a program code of application software. A screen recognition device includes a GUI component form/position determination unit 11 that extracts a GUI component included in a display screen of application software, from the display screen, and that determines the form and position of the GUI component, and a GUI component kind identification unit 12 and a GUI component operation identification unit 13 that determine the kind of the GUI component and an operation that can be performed to the GUI component, based on a change in a mouse cursor and a change in the GUI component when the mouse cursor is superimposed on the GUI component.

Abstract: Disclosed herein are related to a system and a method for providing an artificial reality. In one aspect, a system includes a shared physical memory and a first processor having access to the shared physical memory. In one aspect, the first processor performs, during a first time period, a first rendering process to generate a first image frame of a first view of an artificial reality. In one aspect, the first processor performs, during a second time period, a second rendering process to generate a second image frame of a second view of the artificial reality. In one aspect, the system includes a second processor including a neural network and having access to the shared physical memory. In one aspect, the second processor performs, during a third time period overlapping a portion of the second time period, an image enhancing process on the first image frame.

Abstract: Disclosed herein are related to a system and a method for providing an artificial reality. In one aspect, a system includes a shared physical memory and a first processor having access to the shared physical memory. In one aspect, the first processor performs, during a first time period, a first rendering process to generate a first image frame of a first view of an artificial reality. In one aspect, the first processor performs, during a second time period, a second rendering process to generate a second image frame of a second view of the artificial reality. In one aspect, the system includes a second processor including a neural network and having access to the shared physical memory. In one aspect, the second processor performs, during a third time period overlapping a portion of the second time period, an image enhancing process on the first image frame.

Abstract: A mouse for communication with a processor-based device. The mouse may include a housing having a base portion. The mouse may further include a layer of metal coupled to the base portion. The layer of metal may be connected to an electric reference potential.

Abstract: A method and system for controlling access to a first computing device by a second computing device, said method comprising: detecting whether said first computing device is being used by a local user; receiving an input event for said first computing device, determining whether said received input event is a local input event from said local user or a remote input event from said second computing device; and blocking said received input event if said received input event is determined to be a remote input event and if said first computing device is detected as being used by said local user.

Abstract: The disclosure describes a game system equipped with a game space generating unit generating a virtual game space where the character acts, displays on a display unit connected to a game system together with the character acting in the game space, a character control unit which controls the character's action in the game space, a storing unit which stores a plurality of action pattern routines providing a predetermined action pattern of the character; and an action pattern set generating unit which generates an action pattern set of the character by reading a plurality of action pattern routines from the storing unit and selects more than two action pattern routine from the plurality of action pattern routines determining the order to perform and determining an action modification condition to modify the action pattern routine to be exercised from the selected action pattern routine from more than two action pattern routines.

Abstract: Applying an image overlay to an image is provided. A relationship type and a relationship strength between two or more people identified in a first image is determined based on profile data corresponding to each of the two or more people and a set of data elements determined to be common to the profile data corresponding to each of the two or more people. An image overlay is selected to apply to the first image based on the relationship type and the relationship strength between the two or more people and the set of data elements determined to be common to the profile data corresponding to each of the two or more people. The image overlay is applied to the first image generating a second image that includes the first image and the applied image overlay.

Abstract: A digital camera includes: a display section displaying a photographing image obtained by photographing a subject; a signal processing and control section reading out information related to the subject and information related to surroundings of the subject from a database on the basis of position information and compass direction information about the digital camera; and a display control section selecting the information related to the subject according to the lens condition and performing control so as to display the selected information on the display section by superimposing the selected information on the photographing image.

Abstract: A personal user control device suitable for use in cooperation with information systems, such as vehicle information systems, and methods for manufacturing and using same. The personal user control device provides a user-friendly interface system for interacting with the information system. Unlike conventional control devices, the user interface system includes no dedicated buttons and provides a customizable environment for interacting with the information system. When in communication with the information system, the personal user control device can automatically detect system status information, such as available system functionality, available viewing content, and/or a current system operation mode, of the information system and provides a user interface system that instinctively adapts for use with the information system in light of the detected system status information. The personal user control device thereby provides a versatile and intuitive manner for interacting with the information system.

Abstract: Text correction processing is disclosed. An initial score is assigned to each of a plurality of candidate sequences of one or more characters, based at least in part on a keyboard geometry-based value associated with the received user input with respect to the candidate key. Further processing is performed with respect to a subset of the candidate sequences having the highest initial score(s) to determine for each candidate sequence in the subset a refined score. A candidate sequence is selected for inclusion in a result set based at least in part on a determination that a refined score of the selected candidate is higher than an initial score of one or more candidate sequences that are not included in the subset and with respect to which the further processing has not been performed.

Abstract: A exemplary key assembly for a handheld device includes one or more L-shaped key structures each having a first member configured to receive an input keystroke and a second member substantially orthogonal to the first member; and a frame configured to receive the one or more L-shaped key structures, the frame having a wall aligned with the second member of the key structure, with the wall further comprising a switch for each of the one or more L-shaped key structures associated with an inner surface of the wall, wherein each switch is associated with an actuator associated with the second member of the corresponding key structure such that depression of a given key structure causes the actuator of the second member of the key structure to engage the switch of the wall.

Abstract: Embodiments of the technology involve apparatus and methods for control of displaying of images. In an example, an apparatus may include an image display, a sensor to detect posture of the image display and a processor to control sequentially displaying images of a group of images on the image display based on changes in the detected posture. The processor may control a display of a posture indicator on the image display such that the indicator may represent a relation between a change in the detected posture and an image of the group of images. Optionally, the indicator may be represented by a tilt meter. Moreover, in some embodiments, the sensor may be implemented with a gyroscopic sensor.

Abstract: An interactive presentation system includes: an imaging device; an image analyzer that calculates information regarding a pointed position by using captured-image data; a controller that receives the information and operates based on an input from an input device; a storage device controlled by the controller to store the information; a pattern generator controlled by the controller to generate a pattern image; an image display device that receives an output from the pattern generator; and a projector that enlarges and projects an output from the image display device. Upon initialization based on the input from the input device, the controller defines a pointed position as a boundary position of a command, assigns the command to an area demarcated by the boundary position, and stores the boundary position in the storage device. After initialization, the controller compares a pointed position and the boundary position and executes the command associated to the information.

Abstract: Method and system for generating and processing multiple independent input data streams based on a high priority OS message framework such as an OS provided framework for processing mouse-messages. Multiple input devices generate motion that is sensed by motion sensors located on one or more motion sources, quantify the sensed motion, and provide resulting input data to a computer via one or more communication ports. One or more software subroutines process the provided data, separating them into multiple independent input streams according to their sources, and sending the streams to listening applications. The subroutines are preferably integrated at a low level of the OS architecture, thereby enabling low-latency, fully-functional high priority processing of the input data.

Abstract: An apparatus including at least one processor, and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to receive deformation information from an elastic control device operated by a user. The apparatus is further configured to determine a control signal for the apparatus based on the deformation information, and performing a function associated to the control signal.

Abstract: A remote control system includes a remote control device and an electronic device. The remote control device includes an input element, a wireless transmitter to transmit an absolute coordinate signal and a motion signal and a control unit electrically connected to the input element and the wireless transmitter. The electronic device includes a wireless receiver and a display screen. The wireless receiver receives the absolute coordinate signal and the motion signal, and displays the absolute coordinate signal at the display screen via a cursor. When the electronic device does not receive the motion signal, the absolute coordinate signal is not operated on an application program of the electronic device. When the electronic device receives the motion signal, the absolute coordinate signal is operated on the application program.

Abstract: Methods, devices, and systems are described for bumping a mobile device, such as a smart phone, against a fixed poster board display at a store to initiate a download of coupons, advertisements, or other benefits to the mobile device. Products can be rated by a user's up/down bump or other bump patterns. Using accelerometer-based inertial measurements, multiple users can control multiple mouse cursors on a large display with their mobile devices in order to select information to be downloaded to their mobile devices. The multiple users can bump the display in order to select their items simultaneously.

Abstract: The invention relates to a pointing device and a method for processing signals from such a pointing device, said device comprising a base and an actuator movable with respect to the base, and a detector, said detector adapted for providing at least first and second positional signals indicating a position of the actuator with respect to the base along corresponding first and second axes, wherein said signal processing method comprises the steps of converting the at least two positional signals into a polar coordinate signal comprising a magnitude signal, and thresholding the magnitude signal of the polar coordinate signal to provide a thresholded magnitude signal. In an embodiment the method further comprising the step of applying a conversion curve to the thresholded magnitude signal to produce a velocity magnitude signal.

Abstract: A display apparatus and an image display method thereof are provided. The display apparatus automatically displays images stored in a memory in a pre-set order, and displays the images in various sequences if a change in position of the display apparatus is detected by a motion sensor. Accordingly, the sequence in which the images are displayed is easily changed.

Abstract: Provided is a touch panel which completes touch detection within a specified time even when the maximum number of touch points is set to be large. A control portion assigns priorities for being given a high coordinate precision to the respective touch points based on the state of the touch points. The control portion selects coordinate calculation algorithms having coordinate precisions corresponding to the priorities of the respective touch points from among a plurality of coordinate calculation algorithms, and calculates required calculation time for calculating coordinates of all the touch points. The control portion determines the priorities so that the calculated required calculation time is equal to or shorter than a specified time. The control portion selects coordinate calculation algorithms corresponding to the priorities and calculates the coordinates of the respective touch points.

Abstract: An information handling system is disclosed including a display, a base coupled to the display and a keypad with a plurality of keys disposed on the base. The system further includes a touchpad located proximate the keypad and a point stick located substantially between at least two of the plurality of keys, wherein the point stick is configured to be a scroll control device. A method for manipulating information on a display of an information handling system is further disclosed herein. The method includes moving a cursor on the display using a touchpad proximate a keypad on the information handling system and scrolling the information on the display in a direction corresponding with the direction of pressure applied to a top portion of a point stick located substantially between at least two keys of the keypad.

Abstract: An object is to appropriately transmit operation data from a controller device to an information processing device. The controller device is capable of wirelessly communicating with the information processing device. The controller device includes a generating unit, a communication unit, and a display unit. The generating unit generates operation data based on an operation performed on the controller device. The communication unit receives one image's worth of image data from the information processing device with a first frequency, the image data generated in the information processing device through a process performed based on the operation data, and transmits the operation data to the information processing device with a second frequency that is higher than the first frequency. The display unit displays an image based on the image data.

Abstract: A handheld device includes a housing and a keypad assembly configured within the housing. The keypad assembly includes one or more groups of keys configured for movable positioning between a first orientation in which a top surface of an individual key is exposed to a user, and a second orientation in which the top surface of the key pivotally retracts into the housing so as to expose an edge surface of the key.

Abstract: An operation input system includes a casing and a motion sensor for detecting a movement of the casing inside the casing and calculates a position of the casing in a predetermined space based on an output of the motion sensor. The operation input system includes a position sensor and a correction section. The position sensor directly detects the position of the casing in the predetermined space. The correction section corrects the output of the motion sensor using an output of the position sensor.

Abstract: Touchpad devices emulating button functionality (“click pad” devices) that simultaneously emulates multiple functionalities are described herein. In addition, embodiments provide for click pad emulation of both TrackPoint and touchpad functionality. According to embodiments, a click pad device emulating multiple functionalities may enable or disable certain functionalities based on user interaction with the click pad device. For example, a click pad device emulating both TrackPoint and touchpad functionality may enable TrackPoint functionality and disable touchpad functionality if user gestures on the click pad device indicate that the user is interacting with the click pad as a TrackPoint device.

Abstract: Enhanced camera-based input, in which a detection region surrounding a user is defined in an image of the user within a scene, and a position of an object (such as a hand) within the detection region is detected. Additionally, a control (such as a key of a virtual keyboard) in a user interface is interacted with based on the detected position of the object.

Abstract: Methods and systems for digital control utilizing oversampling.

Abstract: A computer-implemented method is described that includes providing a watch defining a body and a watch face on a surface of the body, the body having one or more sensors arranged to sense user inputs in an area adjacent to the body. The method further comprises sensing a motion of an object in the area adjacent to, but not touching, the body using the one or more sensors and changing a display of a pointing element on a graphical user interface on the watch in coordination with the sensed motion.

Abstract: Described herein are techniques related to a support surface (e.g., a mousepad) for imparting a tactile feedback (e.g., haptics) to a human-machine interactive (HMI) device (e.g., a mouse) supported thereon. This Abstract is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: An auto-focusing apparatus and method, the apparatus including an emission unit, the emission unit being configured to irradiate light on the organic light-emitting display apparatus; an optical system between the organic light-emitting display apparatus and the emission unit, the optical system being configured to adjust a position of the optical system on an optical axis and focus the irradiated light on the pixel unit; a light-receiving unit, the light-receiving unit being configured to receive light reflected by the organic light-emitting display apparatus and measure an intensity and a wavelength of the reflected light; and a controller, the controller being configured to receive the intensity of light measured by the light-receiving unit, control the position of the optical system, determine that the auto-focusing apparatus is focusing light onto the pixel unit when the intensity of light received by the light-receiving unit is a maximum value, and determine the position of the optical system as an opti

Abstract: A controller device transmits operation data to an information processing device. The controller device wirelessly communicates with the information processing device. The controller device includes an operation unit, a generating unit, and a communication unit. The operation unit includes at least a gyrosensor, an acceleration sensor, a direction input unit, and a touch panel. The generating unit generates operation data based on data obtained from the operation unit. The communication unit wirelessly transmits the operation data to the information processing device for each iteration of a predetermined cycle.

Abstract: An information processing apparatus is provided which includes a position acquisition unit for obtaining a display position of an input area in a display area, and a display control unit for controlling, based on the display position of the input area, in the display area a display position of an input operation area in which a character to be displayed in the input area is input. The display control unit displays the input area near the display position of the input area, and makes the input operation area follow the movement of the input area when the display position of the input area is moved.

Abstract: A mobile device is operative to change from a first operational mode to a second or third operational mode based on a user's natural motion gesture. The first operational mode may include a voice input mode in which a user provides a voice input to the mobile device. After providing the voice input to the mobile device, the user then makes a natural motion gesture and a determination is made as to whether the natural motion gesture places the mobile device in the second or third operational mode. The second operational mode includes an augmented reality display mode in which the mobile device displays images recorded from a camera overlaid with computer-generated images corresponding to results output in response to the voice input. The third operational mode includes a reading display mode in which the mobile device displays, without augmented reality, results output in response to the voice input.

Abstract: The present invention is a storage medium storing a game program to be executed by a computer in a game apparatus comprising an input device for detecting positions designated by a player on an input surface. The game apparatus calculates an input graphic drawn on the input surface by using the positions detected by the input device. The game apparatus further calculates a degree of similarity between a share of each reference pattern indicated by previously stored shape data and a shape of the input graphic. Also, the game apparatus sets a reference value to each of the reference patterns. The game apparatus identifies the shape of the input graphic from among a plurality of reference patterns by using a result obtained by performing a predetermined calculation for each of the plurality of reference patterns through using the degree of similarity and the reference value set to one process is performed in accordance with the identified shape.

Abstract: Control of multiple functions of an electronic device is provided by using a single control element (102) including a switch body (312) adjustable between multiple switch positions, a primary actuator (302) with lateral (302b) and distal surface (302a) portions extending from the switch body and configured for adjusting the switch body between the switch positions, and a pressure sensor (314) operable via an activation force at the lateral surfaces of the primary actuator. A first function can be controlled responsive to motion of the primary actuator during an activation of the pressure sensor. Additionally, a second function can be controlled responsive to the motion of the primary actuator of the control element exclusive of the activation of the pressure sensor. Further, a third function can be controlled in responsive to activation of the pressure sensor for at least a first period of time exclusive of motion of the primary actuator.

Abstract: A system and method are provided for drawing graphics, such as to display a user interface on a display of a mobile device. A graphics stack is used to store pre-computed coordinate values to improve performance for drawing graphics, such as to display a user interface on a display of a mobile device.

Abstract: A dual-mode input device includes a relative coordinate generator disposed in a casing for detecting motion of the casing and for generating relative coordinate information based on detected motion of the casing, and a processing unit. The processing unit includes a coordinate storing module for storing absolute coordinate information, an absolute coordinate generator for generating updated absolute coordinate information based on the relative coordinate information received from the relative coordinate generator and the absolute coordinate information received from the coordinate storing module, and for storing the updated absolute coordinate information in the coordinate storing module, and an output selecting module operable in one of a relative coordinate mode, in which the output selecting module outputs the relative coordinate information, and an absolute coordinate mode, in which the output selecting module outputs the absolute coordinate information.

Abstract: A computing system translates a world space position of a hand of a human target to a screen space cursor position of a user interface. When the cursor overlaps a button in the user interface, the computing system actuates the button in response to a movement of the hand in world space that changes the cursor position by a depth threshold along a z-axis regardless of an initial z-axis position of the cursor. When the button includes an activation lock, the computing system unlocks the activation lock, prior to button actuation, if the cursor path satisfies unlocking criteria.

Abstract: A control devices includes a key having a top surface configured to be pressed by a user, and a resistance device coupled to the key and configured to provide a resistance force to the key that opposes a user force applied to the top surface. A force sensor is coupled to the resistance device and is configured to detect the user force applied to top surface. A control circuit is coupled to the resistance device and is configured to change the resistance force of the resistance device according to a force profile.

Abstract: A data processing device includes a cursor position decision unit, a display control unit, a switch operation signal detection unit, a storage unit, an event generation unit and an event execution unit. The storage unit is configured to store, for a predetermined period, at least one of cursor position information outputted from the cursor position decision unit and event information according to one of a plurality of selection options located in a displayed image at a position corresponding to the cursor position decided by the cursor position decision unit. The event generation unit is configured to generate an execution event when a first switch operation signal is detected at a first timing by the switch operation signal detection unit based on the at least one of the cursor position information and the event information stored in the storage unit at a second timing prior to the first timing.

Abstract: Techniques for selecting a portion of a 3D virtual environment are disclosed, where the portion of the 3D virtual environment may be one or more objects in the 3D virtual environment or one of scenes in the 3D virtual environment. A motion sensitive device (controller) is used. The controller generates sensor data sufficient to derive position and orientation of the controller in six degrees of freedom. In one embodiment, when selecting the portion of the 3D virtual environment, the controller generates a ray to an interaction of a display screen provided to display the 3D virtual environment, wherein the ray is further projected into the 3D virtual environment by a ray tracing technique as if the user had a real laser pointer that crosses from the physical world into the 3D virtual environment being displayed. Further a user is optionally to use a secondary input device to select one or more points or objects in a 3D space to control a distance along the ray being used.

Abstract: A haptic signal distribution system capable of distributing haptic synchronous signals includes a master haptic device and groups of slave haptic devices. In one embodiment, the master haptic device is configured to distribute haptic synchronous signals to slave haptic devices. The haptic synchronous signals, for instance, may include information relating to a tempo for a piece of music. A haptic signal distribution system, for example, allows a master wearable haptic device to selectively distribute haptic synchronous signals to one or more groups of slave wearable haptic devices via a wireless communications network. Upon receipt of the haptic synchronous signals, each slave wearable haptic device generates a series of haptic feedback having a rhythm of beats in response to the haptic synchronous signals.

Abstract: An electronic motion-based input device and method for correcting errors in acceleration due to a deviation from a horizontal plane of motion by correcting for gravitational acceleration components due to the deviation in the plane of motion.

Abstract: A mouse with a wire arrangement structure is provided. The mouse includes a housing, a base, a connection unit and a wire. The housing includes an opening and an opening edge. The base corresponds to the housing, wherein the base is moved between a first position and a second position, and when the base is in the first position, the base abuts the opening edge to cover the opening, and when the base is in the second position, the base is separated from the opening edge. The connection unit is connected to the housing and the base, allowing the base to move relative to the housing. The wire includes a joint, wherein when the wire is in a receiving state, the wire is wound up around the connection unit.

Abstract: An instruction input device includes: a first direction detection unit detecting the first direction in which the user is looking; a second direction detection unit detecting a second direction in which the user is performing a pointing operation; a gaze position calculation unit calculating a gaze position of the user on the screen; a reference coordinate group calculation unit calculating a reference line in space corresponding to the gaze position and connecting the user and the screen; an offset amount calculation unit calculating a distance of the second direction between the reference line and the input coordinate indicating the user's hand as an offset amount with respect to the gaze position; and a pointer display position calculation unit calculating a position in which a distance of the first screen predetermined direction between the position and the gaze position is the offset amount on the screen.

Abstract: There is provided a display apparatus which includes a signal processing part which processes a video signal including at a peripheral area thereof a position determining pattern having a plurality of characteristics; a display part which displays a picture on the basis of the video signal processed by the signal processing part; a sensing part which senses the position determining pattern which is included in the video signal; and a control part which controls the signal processing part to adjust a position of the picture displayed on the display part, on the basis of a shift between a characteristic sensed by the sensing part among the plurality of characteristics of the position determining pattern and a predetermined reference characteristic. The position determining pattern has a face shape. Accordingly, the position of the picture can be quickly determined and adjusted.

Abstract: A system and method are provided for drawing graphics, such as to display a user interface on a display of a mobile device. A graphics stack is used to store pre-computed coordinate values to improve performance for drawing graphics, such as to display a user interface on a display of a mobile device.

Abstract: An input processing device comprises a display screen and a pointing device for inputting corresponding 2-dimensional coordinates on the display screen. A 3-dimensional space is displayed on the display screen and the 2-dimensional coordinates inputted from the pointing device are detected. Next, shift amounts, per unit of time, of the detected 2-dimensional coordinates are calculated based on a predetermined calculation start condition. And the calculated shift amounts are converted to 3-dimensional coordinate shift amounts in the 3-dimensional space.

Abstract: A speckle-based trackball apparatus with an optical architecture employing curved-wavefront illumination beam or a modified imaging lens and aperture configuration is provided. The apparatus includes a trackball configured to be rotated by a user. In the curved-wavefront embodiment, an illuminator is configured to illuminate a spot area of the curved surface of the trackball with a curved-wavefront illumination beam so that an ensemble of optical features used for motion sensing interact with the illumination beam at different phase points as a function of a location within the illuminated spot area on the curved surface of the trackball. In the modified imaging lens and aperture configuration, the aperture is positioned between the back focal plane and the image plane of the imaging lens, and the illuminator may be configured to illuminate a portion of the trackball with a planar-wavefront illumination beam. Other embodiments, aspects and features are also disclosed.

Abstract: An input processing device comprises a display screen and a pointing device for inputting corresponding 2-dimensional coordinates on the display screen. A 3-dimensional space is displayed on the display screen and the 2-dimensional coordinates inputted from the pointing device are detected. Next, shift amounts, per unit of time, of the detected 2-dimensional coordinates are calculated based on a predetermined calculation start condition. And the calculated shift amounts are converted to 3-dimensional coordinate shift amounts in the 3-dimensional space.