Abstract: Methods for generating a hybrid reality environment of real and virtual objects are provided. One method includes receiving, by a server, data of a first user located at a first physical location and data of a second user located at a second physical location. The second physical location is different from the first physical location. The method includes generating, by the server, a scene of an augmented reality (AR) based environment for the first user. The AR based environment includes images of the first physical location and one or more virtual objects related to the second user that are generated based on the data received from the second user. The method generates, by the server, a scene of an augmented virtuality (AV) based environment for the second user. The AV based environment includes one or more virtual objects related to the second user and one or more virtual objects related to the first user that are generated based on the data received from the first user.

Abstract: A method for generating a hybrid reality environment includes receiving data of a first user and a second user at different locations. The method also includes generating a scene of an augmented reality (AR) based environment that includes the first user and a virtual object related to the second user; and generating a scene of an augmented virtuality (AV) based environment that includes the virtual object related to the second user and a virtual object related to the first user. The method further includes sending signals for displaying the scene of the AR based environment to the first user and displaying the scene of the AV based environment to the second user such that the first user can interact with the virtual object related to the second user in real time and the second user can interact with the virtual object related to the first user in real time.

Abstract: A wearable device configured to display augmented reality (AR) information to a user wearing the wearable device is disclosed. The wearable device includes a screen and a set of mirrors including a first mirror and a second mirror. The screen is configured to display an overlay AR image including AR information associated with a real world scene of a surrounding environment of the user. The first mirror is configured to reflect the overlay AR image displayed on the screen to the second mirror. The second mirror is configured to simultaneously a) receive and reflect the overlay AR image reflected by the first mirror and b) transmit the real world scene, such that the second mirror displays a mixed image of the AR information and the real world scene to the user.

Abstract: A method for generating a hybrid reality environment includes receiving data of a first user and a second user at different locations. The method also includes generating a scene of an augmented reality (AR) based environment that includes the first user and a virtual object related to the second user; and generating a scene of an augmented virtuality (AV) based environment that includes the virtual object related to the second user and a virtual object related to the first user. The method further includes sending signals for displaying the scene of the AR based environment to the first user and displaying the scene of the AV based environment to the second user such that the first user can interact with the virtual object related to the second user in real time and the second user can interact with the virtual object related to the first user in real time.

Abstract: A method for detecting an augmented reality (AR) target image and retrieving AR content for the detected AR image is disclosed. The method is performed at a computer system having one or more processors and memory for storing programs to be executed by the one or more processors. The method includes receiving data of the AR target image. The method includes detecting, based on the data of the AR target image, a group of markers on the AR target image. The method includes calculating a set of cross ratios based on the group of markers. The method also includes retrieving, based on the set of cross ratios, AR content associated with the AR target image. The method further includes displaying the retrieved AR content and the AR target image in a single AR scene.

Abstract: Techniques of allowing users of computer devices to interact with any augmented reality (AR) based multi-media information using simple and intuitive hand gestures are disclosed. According to one aspect of the present invention, an image capturing device (e.g., a video or photo camera) is used to generate images from which a pre-defined hand gesture is identified in a target image for displaying AR information. In addition, a hand trajectory may be detected from a sequence of images while the hand is moving with respect to the target. Depending on implementation, the target may be a marker or a markerless image.

Abstract: A multi-touch mouse includes a mouse body, a touch pad, and a controlling unit. In a case that the touch pad is not touched and the touch state is OFF, the multi-touch mouse is in a conventional two-dimensional mouse mode. In a case that the touch state of the touch pad is ON in response to a touch action and the mouse body is moved, the controlling unit switches the control mode of the multi-touch mouse to a touch gesture control mode and generates a touch gesture command.

Abstract: A method for generating a TV input command using a remote controller having an imaging sensor is presented. The method identifies the corners of a TV display screen from a graphical image captured by an imaging sensor of the remote controller. The method can then perform edge detection and segmentation of the graphical image using reference TV dimensions of the TV display screen to identify the pixel coordinates of the four corners of the TV display screen in the graphical image. The method can then map a camera center position in the pixel coordinates to virtual TV coordinates using a cross ratio algorithm, and then map a location of a cursor in the virtual TV coordinates to the coordinates of the TV display screen.

Abstract: Techniques related to displaying augmented reality (AR) based multi-media content are described. The AR content is corresponding to a television (TV) program being displayed on a TV screen. One embodiment of the techniques does not need to scan any AR markers or related images to retrieve the specific AR contents. An AR system for TV broadcasting programs comprises a mobile device, a digital TV or an Internet TV set and a cloud computing based TV-AR management server. The TV-AR management server is configured to provide correct AR contents for the TV program that is being broadcasted and received in a TV set being used by a user at the time.

Abstract: A method for combining at least two touch signals in a computer system is disclosed. The method includes receiving touch signals from two touch pads and creating at least two touch signals having coordinates in the same coordinate system. Then, using these coordinates, a computer system generates a touch command message that is recognizable by a computer application program. Also disclosed is, a computer mouse having two touch pads disposed thereon.

Abstract: A touch keyboard includes an overlay frame, a touch pad, and a feedback device. The touch pad and the feedback device are disposed under the overlay frame. The overlay frame has plural openings for providing the keystrokes of the touch keyboard. When the user's finger is penetrated through a corresponding opening to touch the touch pad, the touch pad generates a key signal, and the feedback device generates a feedback signal to the user. The touch keyboard is thin and lightweight, and is easily carried. Moreover, due to the keystrokes provided by the overlay frame and the feedback device, the touch keyboard is more user-friendly.

Abstract: A method for generating a TV input command using a remote controller having an imaging sensor is presented. The method identifies the corners of a TV display screen from a graphical image captured by an imaging sensor of the remote controller. The method can then perform edge detection and segmentation of the graphical image using reference TV dimensions of the TV display screen to identify the pixel coordinates of the four corners of the TV display screen in the graphical image. The method can then map a camera center position in the pixel coordinates to virtual TV coordinates using a cross ratio algorithm, and then map a location of a cursor in the virtual TV coordinates to the coordinates of the TV display screen.

Abstract: A system and method for generating a multi-touch command using a single-touch sensor pad and an imaging sensor is disclosed. The imaging sensor is disposed adjacent to the single-touch sensor pad and captures images of a user's fingers on or above the single-touch sensor pad. The system includes firmware that acquires data from the single-touch sensor pad and uses that data with the one or more images from the imaging sensor to generate a multi-touch command.

Abstract: A multidimensional input device is disclosed. In one embodiment, the multidimensional mouse comprises three sensors and a chassis. Each sensor is suitable for finger operation and capable of generating two control signals which represent motion in two degrees of freedom. The three sensors are coupled to the chassis which is suitable for a user to grasp with one hand. Thus, a user can generate six control input signals representing motion in six degrees of freedom with one hand.

Abstract: A method is disclosed for mapping finger movements on a touch pad to a display screen. The method includes receiving touch data from a touch pad. The touch data identifies the absolute coordinates of one or more finger touch points on the touch pad. The method also designates a portion of the display screen as a portion mapping area. The size of the portion mapping area is less than the size of the entire display screen area. The method then maps the coordinates of the one or more finger touch points of the touch data to the coordinates of the portion mapping area. The method includes use of a primary touch pad and a secondary touch pad to generate multi-touch finger gestures.

Abstract: A method for combining at least two touch signals in a computer system is disclosed. The method includes receiving touch signals from two touch pads and creating at least two touch signals having coordinates in the same coordinate system. Then, using these coordinates, a computer system generates a touch command message that is recognizable by a computer application program. Also disclosed is, a computer mouse having two touch pads disposed thereon.

Abstract: A method for controlling multiple degrees of freedom of a display using a single contiguous sensing region of a sensing device is disclosed. The single contiguous sensing region is separate from the display. The method comprises: detecting a gesture in the single contiguous sensing region; causing rotation about a first axis of the display if the gesture is determined to comprise multiple input objects concurrently traveling along a second direction; causing rotation about a second axis of the display if the gesture is determined to comprise multiple input objects concurrently traveling along a first direction; and causing rotation about a third axis of the display if the gesture is determined to be a type of gesture that comprises multiple input objects. The first direction may be nonparallel to the second direction.

Abstract: A method for controlling multiple degrees of freedom of a display using a single contiguous sensing region of a sensing device is disclosed. The single contiguous sensing region is separate from the display. The method comprises: detecting a gesture in the single contiguous sensing region; causing rotation about a first axis of the display if the gesture is determined to comprise multiple input objects concurrently traveling along a second direction; causing rotation about a second axis of the display if the gesture is determined to comprise multiple input objects concurrently traveling along a first direction; and causing rotation about a third axis of the display if the gesture is determined to be a type of gesture that comprises multiple input objects. The first direction may be nonparallel to the second direction.

Abstract: Example embodiments provide a mouse with a stabilizer. In particular embodiments, the stabilizer includes a U-shaped body which attaches to the bottom of the mouse so that the bottom surface of the U-shaped body forms a horizontal plane with the bottom surface of the mouse. In one embodiment, the U-shaped body includes a heel-rest portion and a pair of leg portions, one of which includes a thumb-rest and one of which includes a finger-rest. The leg portions define an opening for an opto-electric sensor such as a laser. In another embodiment, the stabilizer attaches to the rear of the mouse but does not extend forward to provide a thumb-rest or a finger-rest. In some embodiments, the stabilizer is fixedly attached or formed as part of the mouse, whereas in other embodiments it is detachable.

Abstract: Disclosed is a multiple coordinate controller device having a three-dimensional body with a first surface portion and a second surface portion where the second surface portion is not coplanar with the first surface. A first transducer with a first sensing surface is coupled to the first surface portion of the body and capable of detecting both positions and a range of pressure forces at positions on the first sensing surface. The first transducer is further capable of providing a first range of z coordinates at a detected x,y coordinate in response to the range of pressure forces on said first sensing surface. A second transducer having a second sensing surface is coupled to the second surface portion of the body and capable of detecting both positions and a range of pressure forces at the positions on the second sensing surface.