Abstract: A system and method for automatically adjusting the gain of an audio system as a speaker's head moves relative to a microphone includes using a video of the speaker to determine an orientation of the speaker's head relative to the microphone and, hence, a gain adjust signal. The gain adjust signal is then applied to the audio system that is associated with the microphone to dynamically and continuously adjust the gain the audio system.

Abstract: A method of detecting tasks performed by users wherein a single task is a sequence of web URLs invocation. Task patterns are detected in web logs to identify tasks performed by users and analyze task trends over time, across corporate divisions and geographies. A grammar-based framework is used to model and detect tasks from web log patterns. The framework has two components: a declarative unit—to generate a task grammar, and a processing unit—to detect tasks from access logs by generating a state machine for applying the task grammar to the tokens associated with the access records. By analyzing user tasks, rather than just URLs, useful business information can be extracted.

Abstract: A system, program storage device, and method of buffering an electronic document received from a host computer, wherein the method comprises determining whether an original source code of the electronic document includes executable coding which when executed by a client computer, causes the client computer to perform undesired operations, and producing an alternate source code of the electronic document, which eliminates the coding, wherein the undesired operations are characterized as undesirable based on predetermined settings established by the client computer. The electronic document comprises any of a web page, electronic mail message, an electronic mail attachment, a note in a hypertext format, a text document, a text file, and an application-specific electronic document. Each of the original source code and the alternate source code comprises a hypertext transfer protocol (HTTP) source code.

Abstract: A system and method for automatically adjusting the rate at which recorded speech is played back as a typist manually transcribes the speech. The typing speed is measured and a speech playback rate determined based on the measured speed. The playback rate of the audio is then automatically increased or decreased as appropriate to match the typing speed.

Abstract: Preferred implementations of the invention permit a user to seamlessly switch from a first media stream to a second media stream in a synchronized way, such that the second media stream picks up where the first media stream left off. In this way, the user experiences events chronologically but without interruption. In a preferred implementation, a user watching a skim video switches to a full length video when, for example, the skim video reaches a frame that is of particular interest to the user. The full length video begins at a point corresponding to the frame in the skim video that is of interest to the user, without skipping over video segments, so that the user does not experience any time gaps in the story line.

Abstract: A system and method are provided to alert two mobile communications users in the event they come in close proximity to one another. The present system uses a distributed algorithm denoted as the Strips algorithm, in which a pair of moving friends with mobile telecommunications devices makes an agreement about a static buffering region between them. After the agreement is made, the users do not need to follow each other's location until one of them enters the buffering region for the first time. By doing so, they invalidate the agreement. Consequently, they replace a location update message between them, determine if they got within the vicinity of each other, and otherwise make a new agreement on a new buffering region. When one of them enters the buffering region for the first time, a message is sent to both friends alerting them of the proximity of the other.

Abstract: Browsing of digital video data is performed using a fast forward or fast reverse play mode. The digital video is analyzed and processed to produce a content-based variable-rate video playback sequence for fast browsing. To create the playback sequence, each shot in a video is sped-up at a relatively slow rate at the beginning of the shot by selecting many frames and then the speedup rate is increased as the shot progresses by selecting progressively fewer frames. This method and apparatus of variable-rate frame selection can be used to add and index to a video, play an original video in fast forward/backward mode or to create a new video—a fast forward playback video summary.

Abstract: A system and a corresponding method for temporal modification of audio signals, to increase or reduce the playback rates of an audio and/or a video file in a client-server environment. The system and method improve the efficiency of serving streaming media to a client so that the client can select an arbitrary time-speedup factor. The speedup system performs many of the pre-calculations once, at the server, so that the bandwidth needs are reduced and the client's computational load is minimized. The final time-scale-modification can be either done completely on the server, thus reducing the client's needs, or partly on the client's computer to minimize latency, and to reduce on-the-fly computational load from the server that serves multiple clients concurrently.

Abstract: A system and method for eye gaze tracking without calibrated cameras, direct measurements of specific users' eye geometries, or requiring the user to visually track a cursor traversing a known trajectory. The preferred embodiment includes two uncalibrated cameras imaging the user's eye and haying on-axis lighting. The cameras capture images of a test pattern in real space as reflected from the user's cornea, which is essentially a convex spherical mirror. The invention then extracts parameters required to define a mathematical mapping between real space and image space, including spherical and perspective transformations. The invention processes subsequent images of objects reflected from the user's eye through the inverse of the mathematical mapping to determine a gaze vector and a point of regard. Alternately, a single calibrated camera may be employed with means for estimating the eye-to-camera distance. A head-mounted embodiment that may include a laser pointer is also described.

Abstract: A system enables a user to query for key words and phrases a text document, such as a presentation slide file, and an associated audio stream, such as can be derived from an audio-video recording that is made of a presenter contemporaneously with the showing of the slides to an audience. A graphical user interface is presented in which query results for both the text document and the audio stream are displayed in a time-aligned format, to enable a user to easily and conveniently browse the text document and accompanying time-aligned audio stream based on the key words/phrases.

Abstract: A computing system and method receive a query; separate a plurality of information sources into individual elements of content (EOC); tag each EOC with metadata that indicate source, date, and other relevant information; pattern match each EOC; calculate the distance function from every EOC to every other EOC; and output EOC to a set of virtual buffers (404) containing appropriately related EOC less than a given distance value. The method further creates virtual summary buffers (406); then concatenates the EOC in each virtual buffer (404); applies a comparative analysis filter (318) to remove redundant sub-elements; and presents the results as summary digests (408).

Abstract: A system and method for eye gaze tracking without calibrated cameras, direct measurements of specific users' eye geometries, or requiring the user to visually track a cursor traversing a known trajectory. The preferred embodiment includes two uncalibrated cameras imaging the user's eye and having on-axis lighting. The cameras capture images of a test pattern in real space as reflected from the user's cornea, which is essentially a convex spherical mirror. The invention then extracts parameters required to define a mathematical mapping between real space and image space, including spherical and perspective transformations. The invention processes subsequent images of objects reflected from the user's eye through the inverse of the mathematical mapping to determine a gaze vector and a point of regard. Alternately, a single calibrated camera may be employed with means for estimating the eye-to-camera distance. A head-mounted embodiment that may include a laser pointer is also described.

Abstract: A system and method for calibration-free tracking of a user's eye gaze vector and point of regard even if substantial head movement or rotation occurs. The preferred embodiment includes two synchronized interlaced cameras, each viewing the user's eye and having on-axis lighting that is alternately modulated. An image difference between lighted and unlighted images of the eye is used to identify a user's pupil. A plane containing the gaze vector is defined by rotating a base plane through the angle in a camera image plane between a pupil center, a first glint, and a second glint. The intersection of two such planes (one from each camera), defines the gaze vector. The gaze position is the intersection of the gaze vector with the object being viewed by the user. Alternate embodiments are also described.

Abstract: A system and method for calibration-free tracking of a user's eye gaze vector and point of regard even if substantial head movement or rotation occurs. The preferred embodiment includes two synchronized interlaced cameras, each viewing the user's eye and having on-axis lighting that is alternately modulated. An image difference between lighted and unlighted images of the eye is used to identify a user's pupil. A plane containing the gaze vector is defined by rotating a base plane through the angle in a camera image plane between a pupil center, a first glint, and a second glint. The intersection of two such planes (one from each camera), defines the gaze vector. The gaze position is the intersection of the gaze vector with the object being viewed by the user. Alternate embodiments are also described.

Abstract: A method and apparatus analyzes a scene to determine which pupils correspond to which subjects. First, a machine-readable representation of the scene, such as a camera image, is generated. Although more detail may be provided, this representation minimally depicts certain visually perceivable characteristics of multiple pupil candidates corresponding to multiple subjects in the scene. A machine such as a computer then examines various features of the pupil candidates. The features under analysis include (1) visually perceivable characteristics of the pupil candidates at one given time (“spatial cues”), and (2) changes in visually perceivable characteristics of the pupil candidates over a sampling period (“temporal cues”). The spatial and temporal cues may be used to identify associated pupil pairs. Some exemplary spatial cues include interocular distance, shape, height, and color of potentially paired pupils.

Abstract: Preferred implementations of the invention permit a user to seamlessly switch from a first media stream to a second media stream in a synchronized way, such that the second media stream picks up where the first media stream left off. In this way, the user experiences events chronologically but without interruption. In a preferred implementation, a user watching a skim video switches to a full length video when, for example, the skim video reaches a frame that is of particular interest to the user. The full length video begins at a point corresponding to the frame in the skim video that is of interest to the user, without skipping over video segments, so that the user does not experience any time gaps in the story line.

Abstract: A system and method for automatically adjusting the rate at which recorded speech is played back as a typist manually transcribes the speech. The typing speed is measured and a speech playback rate determined based on the measured speed. The playback rate of the audio is then automatically increased or decreased as appropriate to match the typing speed.

Abstract: A system and method for automatically adjusting the gain of an audio system as a speaker's head moves relative to a microphone includes using a video of the speaker to determine an orientation of the speaker's head relative to the microphone and, hence, a gain adjust signal. The gain adjust signal is then applied to the audio system that is associated with the microphone to dynamically and continuously adjust the gain the audio system.

Abstract: A method and apparatus determine when a subject is looking at a specific target area by estimating a divergence angle between (1) the direction in which the subject is looking and (2) the direction from the subject directly to the target area. This technique accesses whether the subject is looking at a particular area. The invention may further condition this determination according to the subject's distance from the target area, because there is less tolerance for divergent angles when the subject is farther away. In one embodiment, the divergence angle is estimated using the position of a glint of light in the subject's pupil. The glint is created by a light source located in the target area. If the glint is sufficiently central to the pupil, with the camera and light source being near the target area, the subject is looking at the target area. At long distances, when the glint is not sufficiently discernable from the pupil, another technique may be employed to estimate divergence angle.

Abstract: A computer-driven system aids operator positioning of a cursor by integrating eye gaze and manual operator input, thus reducing pointing time and operator fatigue. A gaze tracking apparatus monitors operator eye orientation while the operator views a video screen. Concurrently, the computer monitors an input device, such as a mouse, for mechanical activation by the operator. According to the operator's eye orientation, the computer calculates the operator's gaze position. Also computed is a gaze area, comprising a sub-region of the video screen that includes the gaze position. This region, for example, may be a circle of sufficient radius to include the point of actual gaze with a certain likelihood. When the computer detects mechanical activation of the operator input device, it determines an initial cursor display position within the current gaze area. This position may be a predetermined location with respect to the gaze area, such as a point on the bottom of the gaze area periphery.