Abstract: A system that captures both whiteboard content and audio signals of a meeting using a video camera and records or transmits them in real-time. The Real-Time Whiteboard Capture captures pen strokes on whiteboards in real time using an off-the-shelf video camera. Unlike many existing tools, the RTWCS does not instrument the pens or the whiteboard. It analyzes the sequence of captured video images in real time, classifies the pixels into whiteboard background, pen strokes and foreground objects (e.g., people in front of the whiteboard), and extracts newly written pen strokes. This allows the RTWCS to transmit whiteboard contents using very low bandwidth to remote meeting participants. Combined with other teleconferencing tools such as voice conference and application sharing, the RTWCS becomes a powerful tool to share ideas during online meetings.

Abstract: A whiteboard view camera, which in one embodiment is mounted on a boom, which is fixed above the whiteboard. However, the whiteboard view camera can also be wall or table mounted. The whiteboard view camera differs from an ordinary camera by allowing the lens to tilt with respect to the sensor plane, and shift with respect to the central ray. When the tilt angle ? is zero, then the resolution of whiteboard is uniform (e.g., the top and bottom of the whiteboard have the same resolution). In addition, the focus plane is equal to the whiteboard plane, so depth of field issues are not a problem (e.g., a large aperture can be used). Hence, no image noise is introduced. A key contribution of the whiteboard view camera configuration according to the invention is the use of a view camera to capture whiteboard images at uniform resolutions. One embodiment of the whiteboard view camera employs a microphone array of the invention and uses a computer to optimize the image data and audio signals.

Abstract: Mean shift is a nonparametric estimator of density which has been applied to image and video segmentation. Traditional mean shift based segmentation uses a radially symmetric kernel to estimate local density, which is not optimal in view of the often structured nature of image and more particularly video data. The system and method of the invention employs an anisotropic kernel mean shift in which the shape, scale, and orientation of the kernels adapt to the local structure of the image or video. The anisotropic kernel is decomposed to provide handles for modifying the segmentation based on simple heuristics. Experimental results show that the anisotropic kernel mean shift outperforms the original mean shift on image and video segmentation in the following aspects: 1) it gets better results on general images and video in a smoothness sense; 2) the segmented results are more consistent with human visual saliency; and 3) the system and method is robust to initial parameters.

Abstract: A system and method for turning a regular computer monitor screen into a touch screen using an ordinary camera. It includes an image-screen mapping procedure to correct for the non-flatness of the computer screen. It also includes a segmentation method to distinguish the foreground, for example an indicator such as a finger, from the background of a computer screen. Additionally, this system and method includes a robust technique of finding the tip point location of the indicator (such as the finger tip). The screen coordinates of the tip point are then used to control the position of the system indicator.

Abstract: A system and method for detecting speech utilizing audio and video inputs. In one aspect, the invention collects audio data generated from a microphone device. In another aspect, the invention collects video data and processes the data to determine a mouth location for a given speaker. The audio and video are inputted into a time-delay neural network that processes the data to determine which target is speaking. The neural network processing is based upon a correlation to detected mouth movement from the video data and audio sounds detected by the microphone.

Abstract: A system and method for automatically determining if a computer user is a human or an automated script. Human interactive proofs (HIPs) are currently used to deter automated registration for web services by automated computer scripts. Unfortunately, HIPs entail multiple steps (request service, receive challenge, respond to challenge) that can be burdensome. The system and method of the invention in one embodiment provides a “black-box” to potential users consisting of a challenge generator and a secret key. The challenge is generated for the user and the response can be provided as part of the service request, eliminating the need for a separate challenge from a service provider and response to the challenge.

Abstract: A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image.

Abstract: A system and method for real-time multi-view (i.e. not just frontal view) face detection. The system and method uses a sequence of detectors of increasing complexity and face/non-face discriminating thresholds to quickly discard non-faces at the earliest stage possible, thus saving much computation compared to prior art systems. The detector-pyramid architecture for multi-view face detection uses a coarse-to-fine and simple-to-complex scheme. This architecture solves the problem of lengthy processing that precludes real-time face detection effectively and efficiently by discarding most of non-face sub-windows using the simplest possible features at the earliest possible stage. This leads to the first real-time multi-view face detection system which has the accuracy almost as good as the state-of-the-art system yet 270 times faster, allowing real-time performance.

Abstract: A system and method for encoding and/or decoding a signal, such as an audio signal, employing a reversible transform obtained via matrix lifting. This reversible transform not only converts integer input to integer output, but also reconstructs the exact input from the output. It is one of the key modules for lossless and progressive to lossless audio codecs. The system and method of the invention produces smaller quantization noise and better compression performance of lossless and progressive to lossless codecs previously known. A number of embodiments employing RMDCT solutions are described. Matrix lifting is used to implement a reversible fast Fourier transform (FFT) and a reversible fractional-shifted FFT, respectively, which are further combined with reversible rotations to form a RMDCT. A progressive-to-lossless embedded audio codec (PLEAC) employing RMDCT is implemented with superior results for both lossless and lossy audio compression.

Abstract: This invention is directed toward a system and method for scanning a scene or object such as a whiteboard, paper document or similar item. More specifically, the invention is directed toward a system and method for obtaining a high-resolution image of a whiteboard or other object with a low-resolution camera. The system and method of the invention captures either a set of snapshots with overlap or a continuous video sequence, and then stitches them automatically into a single high-resolution image. The stitched image can finally be exported to other image processing systems and methods for further enhancement.

Abstract: A system and method for compressing digital pen stroke data utilizing curve simplification. Digital pen stroke images (ink images) generate a relatively large amount of data to preserve the ink image generated on a device. Current ink compression algorithms utilize lossless compression algorithm that have limited success. The invention provides a lossy compression algorithm to reduce the amount of data required to store and transmit ink data. The invention utilizes a two-part algorithm to reduce and compress the number of data points representing the ink data. The invention also utilizes curve splines to reconstruct and smooth the lossy ink data image.

Abstract: An omni-directional camera array that is very small and unobtrusive and allows for higher pixel resolution for the face of meeting participants sitting or standing around a conference room table, as would be typical in a video conferencing situation. The camera system of the invention uses N cameras and an N sided mirror to capture images of the surrounding scene. The cameras are arranged to have a small distance between their virtual centers of projection. The images from the N cameras are stitched together to create a 360-degree panorama using a calibration surface. To stitch the images together in real-time, a static image stitcher is used, which stitches images together perfectly for objects on a calibration surface. The calibration surface is typically defined by the boundary of the table the camera is sitting on.

Abstract: A system and method for automatically modeling a three dimensional object, such as a face, from a single image. The system and method according to the invention can construct one or more three dimensional (3D) face models using a single image. Although use of a frontal image simplifies the processing, the system and method according to the invention can also generate a 3D model from a non-frontal image (e.g., an image where the object to be modeled has an out of plane rotation, such a face that is turned to one side to some extent). The system is fully automatic. It is fast compared to the other modeling systems, Furthermore, it is very robust. It can be used to construct personalized models for games, on-line chat, and so on. It can also be used as a tool to generate a database of faces with various poses which are needed to train most face recognition systems.

Abstract: A system and method for editing images. Each image editing operation is described by a few parameters. Multiple users can share image processing changes by sharing a few set of parameters instead of the whole bitmaps of the images. An Editing List describes the parameters defining the image changes. The size of Editing List is very small and is ideal for network transmission and collaboration. Image Editing Lists are independent of the images themselves. By decoupling the Image Editing Lists from the original bitmap images, other advantages are obtained. For instance, the same Editing List can be applied to other images and also to multiple images at the same time. Rendering of the modified images can be performed at a later time and only when necessary. In case of collaborative editing, the transmission time is reduced drastically.

Abstract: Knitwear modeling is disclosed. A macrostructure corresponding to a three-dimensional object is generated, based on a stitch pattern and optionally a color pattern. Yarn microstructure is generated and applied to the macrostructure to yield a knitwear model. The stitch positions of the macrostructure can be perturbed to achieve stitch position irregularities. The fluffiness of the yarn microstructure can be controlled. In an alternative embodiment, a two-dimensional knitwear texture is generated, which can then be mapped to a three-dimensional object to yield a knitwear model.

Abstract: In an aspect of the present invention, methods and systems for providing an input device are disclosed. In an aspect of the present invention, the input device includes a symbol and a UV light source is provided to direct UV light on the symbol. The symbol includes an UV excitable compound. In an aspect of the invention, the UV light from the UV light source is directed onto the symbol with a light pipe. In operation, the UV light causes the symbol to glow so that the symbol is visible in a darkened environment.

Abstract: A system that captures both whiteboard content and audio signals of a meeting using a video camera and records or transmits them in real-time. The Real-Time Whiteboard Capture captures pen strokes on whiteboards in real time using an off-the-shelf video camera. Unlike many existing tools, the RTWCS does not instrument the pens or the whiteboard. It analyzes the sequence of captured video images in real time, classifies the pixels into whiteboard background, pen strokes and foreground objects (e.g., people in front of the whiteboard), and extracts newly written pen strokes. This allows the RTWCS to transmit whiteboard contents using very low bandwidth to remote meeting participants. Combined with other teleconferencing tools such as voice conference and application sharing, the RTWCS becomes a powerful tool to share ideas during online meetings.

Abstract: A system that captures both whiteboard content and audio signals of a meeting using a digital camera and a microphone. The system can be retrofit to any existing whiteboard. It computes the time stamps of pen strokes on the whiteboard by analyzing the sequence of captured snapshots. It also automatically produces a set of key frames representing all the written content on the whiteboard before each erasure. The whiteboard content serves as a visual index to efficiently browse the audio meeting. The system not only captures the whiteboard content, but also helps the users to view and manage the captured meeting content efficiently and securely.

Abstract: A system and method for delivering a presentation electronically. The invention takes advantage of the multiple monitor capabilities of a computer operating system to display a “control panel” on the computer monitor or laptop screen that typically only the presenter will view. The presenter can use this control panel to view and control the presentation while the audience only sees a full screen slideshow. Providing this “presenter” view and control makes computer-based presenting much easier. The presenter can control the specific aspects of the slideshow from the private monitor using control buttons or keyboard shortcuts.

Abstract: A computer-implemented mechanism for comparing information sets is described. The mechanism may include a comparison system that concentrates on the schema in each information set. An alternative embodiment includes an equality comparison mechanism that performs sets of initial comparisons to determine whether the information sets are inherently different and not needing a detailed comparison using the schema-centric comparison technique.