Abstract: The present invention is directed toward a system and process that controls a group of networked electronic components using a multimodal integration scheme in which inputs from a speech recognition subsystem, gesture recognition subsystem employing a wireless pointing device and pointing analysis subsystem also employing the pointing device, are combined to determine what component a user wants to control and what control action is desired. In this multimodal integration scheme, the desired action concerning an electronic component is decomposed into a command and a referent pair. The referent can be identified using the pointing device to identify the component by pointing at the component or an object associated with it, by using speech recognition, or both. The command may be specified by pressing a button on the pointing device, by a gesture performed with the pointing device, by a speech recognition event, or by any combination of these inputs.

Abstract: A hand-writing input device includes a penholder, a writing head and an infrared light source. The penholder includes a writing end and an opposite top end. The writing head is arranged on the writing end. The writing head is capable of leaving color distinguishable traces on an object. The infrared light source is positioned on the writing end of the penholder adjacent to the writing head. The present invention also relates to a hand-writing input system using the hand-writing input device.

Abstract: Provided is a pointing apparatus, a pointer control apparatus, a pointing method, and a pointer control method to a pointing apparatus, a pointer control apparatus, a pointing method, and a pointer control method capable of recognizing image codes included in an image frame using an image sensor to determine a pointing direction, and continuously updating the gain between the displacement of the motion of the pointing apparatus and the displacement of the motion of a displayed pointer. The pointing apparatus includes an image receiving unit sensing image patterns that exist in a sensed region, among all of the image patterns arranged in a display region; an inertial sensor sensing an input motion using at least one of the acceleration and angular velocity that are generated due to the motion; and a coordinate determining unit determining moving coordinates that are moved from the central coordinates of the sensed image pattern by coordinate displacement corresponding to the sensed motion.

Abstract: Method and apparatus (16) for projecting infrared or near infrared or low intensity visible light from a pen, pointer or other guiding object in the form of a coded pattern image, detectable by a camera and recognition system but invisible, or hardly visible to the user and audience, thus controlling and interacting with a computer (19) during a presentation, computer supported work and/or other interactive use of a computer, including pointing, selecting, drawing and writing, both distantly (11) and closely (10) to the front or rear projection screen or possible other type of display screen, without any distracting visual patterns or spots, while the possible visual feedback to the user and audience can be generated by the computer and display system onto the display screen in a controlled and context-sensitive way.

Abstract: A pointing apparatus and method and a pointer display apparatus and method using a virtual region which generate a virtual region corresponding to a detected display region, convert coordinates of a location, and display a pointer at the converted coordinates. The pointing device includes a region detector detecting a display region, which displays a pointer, using at least one received signal; a virtual region generator generating the virtual region corresponding to the display region and having an aspect ratio equal to that of the display region; a coordinate converter converting coordinates of a location, which is pointed at by the pointing device, in the virtual region into ratios of the coordinates of the location to a size of the virtual region; and a coordinate ratio transmitter transmitting the ratios.

Abstract: Embodiments of the present invention enable stylus input on a display device coupled to a processor. According to one embodiment, a stylus control unit detects the presence of a stylus within a display area of a display device and then displays a pair of frames including luminescent images on the display device. Furthermore, luminescent measurement data is transmitted from the stylus to the stylus control unit, and stylus position information is sent to a computer processor based on the received luminescent measurement data.

Abstract: A system for controlling movement of a cursor on a display device, the system comprising: a substrate having a position-coding pattern disposed on or in a surface thereof; a sensing device comprising: an image sensor for optically imaging the position-coding pattern; and a processor configured for: generating absolute motion data by determining a plurality of absolute positions of the sensing device relative to the surface using the imaged position-coding pattern; generating orientation data indicative of an orientation of the sensing device relative to the substrate; and using the orientation data to translate the absolute motion data into relative motion data, said relative motion data being indicative of relative motion of the sensing device from the perspective of a user; and communication means for communicating the relative motion data to a computer system; and the computer system configured for: receiving said relative motion data from the sensing device; interpreting said relative motion data as curso

Abstract: A sensor for an optical device includes an array of pixels in rows and columns which detect and process illumination falling thereon so as to identify inputs generated by a user on a surface of the optical device. A second reset period of variable length between a black calibration phase and an integration phase occurs in a processing cycle of a frame for each pixel, wherein the length of the second reset period is adjusted based on the ambient light conditions.

Abstract: A method for measuring relative motion between an illuminated portion of a surface and an optical sensing device comprising a coherent light source and a photodetector device comprising an array of pixels and comparators for extracting motion features. The method includes the steps (a)-(d). Step (a) includes illuminating with the coherent light source the surface portion at a determined flash rate. Step (b) includes detecting, using the array of pixels a speckled light intensity pattern of the illuminated portion of the surface for each flash. Step (c) includes extracting edge direction data of two different types from the detected speckled light intensity patterns. Step (d) includes measuring relative motion between the optical sensing device and the illuminated portion of the surface based on extracted edge direction data.

Abstract: A carrier for a digital pen includes a main case with an internal channel to closely receive and align the digital pen with an electronic package contained within the main case. In addition, the carrier includes an upper lid rotationally coupled to the main case. In one embodiment, the upper lid may be both partially and fully opened with a dual-action latch mechanism. In addition, the carrier may include a lower lid that may be opened to provide access to an electronic package. In one embodiment, an extendable serial communication device may be extended from the electronic package when the lower lid is open. Further, the carrier is configured to sufficiently protect the digital pen from harsh environmental conditions and even from harsh user-induced conditions, such as drops onto a hard surface, exposure of the carrier to rain, dust, and sand particulate, brief water submersion, and even temperature extremes.

Abstract: A controller arrangement for an optical sensing pen having a nib, the controller arrangement configured to operatively sense location data by sensing location tags on a page of printed media, and to calculate a nib-to-tag distance indicative of the location data. The controller arrangement includes an infrared (IR) illumination LED and image sensor assembly configured to transmit IR light onto, and receive IR light reflected from, respectively, the page of printed media. The arrangement also includes a force sensing infrared LED and photodiode assembly configured to detect when the nib contacts the page so that the sensor assembly is only activated when the nib is in contact with said page.

Abstract: An input pen (60) of the present invention is an input pen used for performing an input to a touch-panel-integrated liquid crystal display device (100) (display device). The liquid crystal display device (100) includes a plurality of photosensitive elements (30) that senses light transmitted through a panel surface. The photosensitive elements (30) detect a position of input by sensing an image on a surface of a display panel. The input pen (60) includes a retroreflective element (61) at its tip that is to be in contact with the display panel. The retroreflective element (61) is made up of a spherical glass (62) (spherical transparent member) and an elastic reflective element (63). In this way, it is possible to provide an input pen which is to be used with a touch-panel-integrated display device and which makes it possible to perform a more accurate position detection.

Abstract: A control apparatus for controlling an image display includes at least one reference object for generating a predetermined spectrum signal; a modulation unit for modulating the predetermined spectrum signal with a predetermined method; and a remote controller. The remote controller includes an image sensor for receiving the modulated predetermined spectrum signal and generating a digital signal; and a processing unit for receiving the digital signal, demodulating the digital signal so as to generate a digital image which only contains the image of the reference object, and calculating an image variation of the image of the reference object formed on the digital image, wherein the remote controller controls the image display according to the image variation thereby eliminating the interference from a light source which generates a light band overlapping the band of the predetermined spectrum signal. The present invention also provides a control method for controlling an image display.

Abstract: An interactive input system comprises a pointer input region; and a multi-angle reflecting structure located along a single side of the pointer input region and operable to reflect radiation from a pointer within the pointer input region from at least two surface locations of the multi-angle reflecting structure, wherein the at least two surface locations each have different respective angles. An imaging system is operable to capture within at least a portion of the pointer input region images of the reflected radiation located within a field of view of the imaging system. Processing structure is provided for determining the location of the pointer relative to the pointer input region based on the at least one image.

Abstract: A method of estimating a position of nib of a pen relative to an optical sensor mounted on the pen. The method comprises the steps of: (a) placing the nib in contact with a coded surface; (b) capturing, using the sensor, at least two images of the coded surface at different rotations of the pen relative to the surface; (c) determining, from a perspective distortion of the coded surface in each image, an estimated rotation and viewing distance for each image; and (d) estimating, from the estimated rotations and viewing distances, the position of the nib relative to the optical sensor.

Abstract: An optical pen is disclosed. The handwriting input pen includes a housing, a light source module received in the housing, an optical lens, a pen tip. The light source module is configured for emitting light. The optical lens is configured for converging light emitted from the light source module, the optical lens comprising an optical portion and a supporting portion around the optical portion. The pen tip is positioned at an end of the housing and is configured for guiding light out of the housing to project. The shielding member is around the optical portion attached to the optical lens and covering the supporting portion of the optical lens, and is configured for stopping the light passing through the supporting portion from entering into the pen tips.

Abstract: A multi-directional remote control system and method is adapted for use with an entertainment system of a type including a display such as a monitor or TV and having display functions employing a mouse type control. The remote controller may be conveniently held in one hand of a user and still provides full mouse type functionality. The remote control system and method images the controller to detect relative motion between the controller and screen. This position information is used for control of a cursor or other GUI interface with automatic control of cursor speed based on detected controller distance from the screen and characteristic hand movement.

Abstract: A touchpad assembly for use in an electronic device is provided. The touchpad assembly may include a touchpad frame operative to be placed within an opening in an electronic device frame. The touchpad assembly may include a support plate for supporting a touchpad, and a bracket for receiving a pick button. The support plate and bracket may be manufactured into a same component to increase the rigidity of the touchpad assembly. The pick button may include a varying height to prevent the pick button from deflecting and to make the pick button travel for providing a selection instruction uniform. The pick button may be coupled to the frame using any suitable approach, including using springs connected the ends of the pick button to the frame. The frame may also include pads to muffle the sound of the pick button when it returns to its initial position after having been pressed.

Abstract: A touch panel is arranged to enable communication using infrared signals with nearby devices. The touch panel includes an array of infrared sensors, arranged parallel to the touchable surface of the panel and at least one of the sensors is capable of detecting an infrared signal received from a nearby device.

Abstract: The efficient buffering of image data for a plurality of clients is disclosed. One disclosed embodiment comprises an optical touch-sensitive device configured to receive changed portions of a frame of data from a touch data acquisition system comprising a touch-sensitive display, to store the changed portions of the frame of data in a common data frame buffer, and to receive a bitmap header from the touch data acquisition system that specifies locations of the changed portions of the frame of data and store the bitmap header in each of a plurality of client header buffers. Clients can first obtain the bitmap header from buffers corresponding to those clients, and then obtain the changed portions of the frame of data from the common data frame buffer.

Abstract: An optical navigation system with optical imaging of multiple inputs using a single navigation sensor. The optical navigation system includes a tactile interface device, an image sensor, and a processor. The tactile interface device facilitates a navigation input. The image sensor intermittently generates images of a surface of the tactile interface device and images of a contact navigation surface. The image sensor also generates the images of the surface of the tactile interface device exclusive of the images of the contact navigation surface. The processor is coupled to the image sensor. The processor generates a first navigation signal based on the images of the tactile interface device and generates a second navigation signal based on the images of the contact navigation surface.

Abstract: A multi-directional remote control system and method is adapted for use with an entertainment system of a type including a display such as a monitor or TV and having display functions employing a mouse type control. The remote controller may be conveniently held in one hand of a user and still provides full mouse type functionality. The remote control system and method images the controller to detect relative motion between the controller and screen. This position information is used for control of a cursor or other GUI interface with automatic control of cursor speed based on detected controller distance from the screen and characteristic hand movement.

Abstract: The electronic writing instrument is provided with: a writing unit that writes down on a medium where a code indicating identity information and location information of the medium is formed; an emitting unit that emits light to the medium; a photoelectric conversion unit that includes photoelectric conversion element receiving a reflected light from the medium by the light emitted by the emitting unit and outputting an electronic signal after converting the reflected light by photoelectric conversion; a receiving unit that receives a user operation; and a condition changing unit that changes at least any one of an emitting condition of the emitting unit to the medium and an output condition of the photoelectric conversion unit when the receiving unit receives an operation.

Abstract: An apparatus and a method for executing a mouse pointer function in a portable terminal equipped with a camera are disclosed. The method includes: capturing an external image signal by a camera module; sampling the external image signal and converting a sampled image signal into image data; mapping a group of pixels of the image data generated by the sampling to a group of pixels of an image sensor for each unit pixel on a one-to-one basis; detecting coordinate values of image data including a point light source in the group of the mapped pixels; determining if a point light source is actually included in the detected coordinate values of the image data; and displaying the detected coordinate values of the image data determined to include the point light source on a screen.

Abstract: An input/output integrated display apparatus according to an embodiment of the present invention includes a capture device for capturing an image of a user, an information register device for relating users' image information to pen settings information for each scheduled user and registers it, a user identification device for comparing image information of a user captured by the capture device with the users' image information and identifying a user in real time, and a display device for displaying text and lines entered by the user in a display format based on the pen settings information of the user identified by the user identification device on a display screen in real time. With this configuration, a user can be automatically identified, and text and lines are displayed based on the pen settings information of the user.

Abstract: A digital pen of the kind having means to sense and create a digital record of the use made of the pen and a memory in which the digitised record is stored also includes a reader for communication with memory tags by inductive coupling. The means to sense and create a digital record of the use made of the pen may include a camera. Preferably the reader for communication with memory tags is located at the opposite end of the pen from a nib for convention writing, and the pen includes a battery power supply.

Abstract: A retention member holds a tip of a pen received in an inner space of a unit body through an opening. A narrowed path member is placed within the inner space at a position between a large-diameter member of the pen and the opening, when the retention member holds the pen. The large-diameter member expands outward from the outer peripheral surface of the pen by a predetermined amount. The narrowed path member contacts the large-diameter member when the pen is released from the retention member, and creates enough interference to prevent the pen from falling out of the unit body, but otherwise allows the pen to be drawn out of the opening.

Abstract: A pointer light tracking method wherein all black image and white square images located at four corners of the all black image are projected on the display, the display on which the all black image and the white square images are displayed is shot by a camera, a domain corresponding to the white square image is extracted from the obtained image data, central coordinates (x, y) of the extracted domain are computed, and a parameter necessary in performing distortion correction by use of projection conversion for coordinate expressing the position of the pointer light on the display is computed from the computed central coordinates (x, y) and central coordinates (X, Y) of the white square image.

Abstract: Touch panels comprising a bias line biased at a bias voltage, a select line, a readout line, a photo cell and a readout circuit. The photo cell comprises a first photo switch, a second photo switch and a storage capacitor. The first photo switch and the storage capacitor is coupled in series between the readout line and the bias line, and the first photo switch is further controlled by the select line. The second photo switch is connected between the readout line and the bias line. The readout circuit and the select line are managed by a reset mode, an exposure mode and a readout mode. The voltage variation of output terminal of the readout circuit is used in obtaining the state of the photo cell.

Abstract: The invention relates to a method of transferring data from a drawing device, which while utilizing a position-coding pattern, printed on a physical page, digitally records handwritten information, to an application in a computer system. The drawing device transfers recorded data to a memory in the computer system. A registering unit in the system determines from a page from which the recorded data originates and activates, on the basis thereof, one or more applications which are registered as “subscribers” to data from this page. When an application is activated and thus informed of the existence of new data relevant to the application, the application fetches this data. The fetching of data can be made on the basis of the contents of a page description which defines the layout of the physical page.

Abstract: A pen-shaped sensing device is provided for sensing coded data disposed which is substantially invisible to the average unaided human eye on a surface. The device has a region identity sensor configured to sense, when the sensing device is positioned or moved relative to a region of the surface, and using at least some of the coded data, region identity data indicative of an identity of the region, and a transmitter configured to transmit the sensed region identity data to the computer system to a computer system.

Abstract: A method for detecting lift from a surface portion of an optical pointing device comprising a coherent light source, a photodetector device including an array of pixels, and extracting motion features including comparators with an adjustable offset value, the method comprising the steps of: (i) illuminating the surface portion with radiation by the coherent light source; (ii) detecting radiation patterns reflected from the illuminated surface portion with the photodetector device; (iii) comparing light intensity between neighbouring pixels in the detected radiation patterns; (iv) extracting motion features as a function of the result of the comparison; (v) counting the total number of motion features extracted; (vi) increasing or decreasing the comparator offset value when the total number of motion features increases or decreases; (vii) comparing the comparator offset value with an offset threshold; (viii) enabling detection of a lift condition if the comparator offset value is lower than the offset threshol

Abstract: A refined coordinate detection method for a touch panel, which more finely measures coordinates of an object without increasing the number of infrared emitting/receiving elements, and an error correction method, which minimizes position detection errors caused by received optical level errors due to external environment or their inherent characteristics, are provided. In the detection method, received levels of infrared emitting/receiving elements corresponding to left and right ends of object are measured and stored and the levels and a maximum received level are compared to calculate the refined coordinates. In the correction method, a lower limit level at a position where infrared reception is most significantly impeded by object is calculated through a comparison calculation of maximum and minimum received levels and it is detected that an object is present at a position only when a lower limit level at that position is not greater than the calculated one.

Abstract: A light pen. The light pen includes a housing, a base, a nib structure, a switch and a light sensor. The base is movably or deformably connected to the housing. The base has a peripheral portion and a through hole substantially surrounded by the peripheral portion. The nib structure is disposed on the base. The switch is disposed between the base and the housing. The light sensor is disposed in the housing for receiving a light signal transmitted along a light-receiving path into the housing. The light-receiving path is extended through the first through hole. Wherein, when no force is applied on the nib structure, the base is away from the switch without triggering the switch; and when a force is applied on the nib structure, the base is moved or deformed to contact the switch, so that the switch is triggered.

Abstract: A pen-shaped sensing device is provided for sensing coded data disposed which is substantially invisible to the average unaided human eye on a surface. The device has a region identity sensor configured to sense, when the sensing device is positioned or moved relative to a region of the surface, and using at least some of the coded data, region identity data indicative of an identity of the region, and a transmitter configured to transmit the sensed region identity data to the computer system to a computer system.

Abstract: An electronic device comprises a display for displaying data stored on said electronic device; input means; sensing means for sensing the three-dimensional position of the input means relative to said device; and control means for controlling the data displayed on said display in dependence on the three-dimensional position of the input means relative to said device. The input means includes a source of electromagnetic radiation for directing an infrared conical beam onto the display. The sensing means can sense the elliptical eccentricity of the electromagnetic radiation incident on the display to determine the angle at which it strikes the display, and can sense the area of the electromagnetic radiation incident on the display to determine the distance of the input means from the display.

Abstract: A handwriting input system includes a handwriting input device, a visible light sensing member, an infrared sensing member, and a receiving member. The handwriting input device includes a writing head and an infrared light source adjacent to the writing head. The writing head is capable of leaving color distinguishable traces on an object. The visible light sensing member is configured for capturing images of handwriting traces. The infrared sensing member is configured for capturing images of movement track of the infrared light source. The visible light sensing member and the infrared sensing member are slidably installed on the receiving member.

Abstract: An optical pen is disclosed. The handwriting input pen includes a housing, a light source module received in the housing, an optical lens, a pen tip. The light source module is configured for emitting light. The optical lens is configured for converging light emitted from the light source module, the optical lens comprising an optical portion and a supporting portion around the optical portion. The pen tip is positioned at an end of the housing and is configured for guiding light out of the housing to project. The shielding member is around the optical portion attached to the optical lens and covering the supporting portion of the optical lens, and is configured for stopping the light passing through the supporting portion from entering into the pen tips.

Abstract: Provided is a pen-shaped scanning device for scanning a surface having coded data disposed thereon which is substantially invisible to the average unaided human eye. The device is configured to determine at least two dimensions of a rotational orientation of the sensing device relative to the surface, the coded data being indicative of at least two dimensions of the rotational orientation of the sensing device. The device includes an orientation sensor configured to generate, when positioned or moved relative to the surface, using at least some of the coded data, orientation data indicative of the at least two dimensions of the orientation of the sensing device relative to the surface.

Abstract: A display system includes a display, and a projection device configured to project, substantially simultaneously, image pixels onto the display and an optical signal encoding data onto the display.

Abstract: The present invention discloses structure improvement of an LED stylus pen, wherein a button is defined at topmost of the stylus pen. When a user pushes down the button and touches a touch screen, a switch is actuated, providing power to an LED to emit light. When the button is pushed down again and the touch screen is touched, the LED will not emit light.

Abstract: Disclosed are a method, an apparatus, and a computer recording medium for video-based handwriting input for biometric Signature Data Collecting. The invention is implemented by finding out all of the relative positions among all light points of light sources when all light sources mounted on a stylus are turned ON; capturing an image including effective strokes and digital data of pen pressure with a digital camera, when a user writes on a writing surface with a stylus having a light source (e.g. LED) indicating x-y coordinates of strokes, said images are time-stamped; wherein the stylus comprising a micro-switch, when the stylus touches the writing surface, the micro-switch is turned on to let the light source indicating x-y coordinates of strokes ON and generate a “light point”; and extracting effective stroke images and digital data of pen pressure by comparing the captured images with the light point on the stylus.

Abstract: A writing apparatus includes: a voltage application unit that applies a voltage to a display medium whose display changes according to an irradiation of light and an applied voltage; an optical output unit that irradiates light toward the display medium; and a controller that (i) receives a position signal that has been output from an apparatus upon contact with an input device, the position signal indicating a position of the contact with the input device, (ii) specifies, based on the received position signal, a position on the display medium at which a display is to be changed, and (iii) controls the optical output unit so that light is irradiated toward the specified position on the display medium for a predetermined time period.

Abstract: A system for line extraction in digital ink. The digital ink represents handwritten input and is comprised of a stroke sequence. The system comprises a processor configured for: receiving the digital ink from a pen device; segmenting the strokes into a sequence of substrokes; grouping substrokes about a selected substroke into a temporally preceding group of substrokes and a temporally subsequent group of substrokes; calculating a centroid for each substroke or group of substrokes; calculating angular differences between the selected substroke and its temporally neighbouring groups of substrokes; and determining positions of extrema of the angular differences. The extrema correspond to substrokes at line breaks, thereby enabling line extraction in the stroke sequence.

Abstract: The invention concerns a method and system for digitally processing information to be written on an observation form, said form being preprinted with at least one blank chart having at least one line and several columns, each column corresponding to a determined printed time, said form being also preprinted with a pattern adapted to cooperate with a digital pen and a computerized localization system for determining the position of the pen; using a pen having a writing tip and a digital tip; filling in data in one column at a time; reproducing said data in the computerized localization system and associating to said data its recording time; and comparing said recording time with the localized printed time of said data, so as to detect any inconsistency between the recording time and the printed time.

Abstract: A writing implement and system using that writing implement are disclosed. The writing implement includes a pen having an elongated body with a plurality of light sources arranged around an outer surface of the body. Each light source has a unique identity. A pen controller that activates each light source to emit light such that the identity of that source can be ascertained by a detector external to the pen. The number of light sources is greater than or equal to 3, and the light sources are arranged such that at least one of the light sources is visible to a detector external to the pen at any time. The detector can then determine the angle of rotation of the pen relative to a fixed reference direction.

Abstract: Motion of a writing instrument is tracked from sensors located in the vicinity. The signals generated from the sensors are processed and used in a wide variety of ways.

Abstract: A method and system for visually tracking a point of contact of an optical output from a computer input device includes an internal camera configured to visually track the point of contact of the optical output against a surface and an optical source to transmit the optical output from the computer input device. The camera also transmits the position of the point of contact as a computer input. In one form, the computer applies the position of the point of contact as an input to an application operating on the computer, such as a gaming application. In one form, the camera can visually track the movement of the computer input device along a surface.

Abstract: A method of estimating a position of nib of a pen relative to an optical sensor mounted on the pen. The method comprises the steps of: (a) placing the nib in contact with a coded surface; (b) capturing, using the sensor, at least two images of the coded surface at different rotations of the pen relative to the surface; (c) determining, from a perspective distortion of the coded surface in each image, an estimated rotation and viewing distance for each image; and (d) estimating, from the estimated rotations and viewing distances, the position of the nib relative to the optical sensor.

Abstract: A computer tablet includes a wireless receiver, and a pen is configured to be manipulated by a person to ride against the computer tablet and thereby provide input to the computer tablet. The pen includes a wireless transmitter. A processor associated with the computer tablet outputs an alarm when a signal from the transmitter of the pen is not sensed by the computer tablet within a time period.