Abstract: A User Interface (UI) for a real-time panoramic image correction system and method that simplifies the use of the system for the user. The UI includes a control panel that allows a user to enter meeting table size and shape, camera position and orientation, and the amount of normalization desired (e.g. 0 to 100%). A window can also be implemented on a display that displays the corrected panoramic image. In this window, the head (either normalized or non-normalized) of a meeting participant, preferably one that is speaking, is extracted and displayed in a separate window. Additionally, the corrected panoramic image, whose size will vary in conjunction with the amount of warping applied, can be displayed and transmitted with extra pixels around its perimeter in order to allow the corrected or normalized panoramic image to adapt to any of the standard display size and resolutions and to simplify network transmission.

Abstract: A practical, real-time calibration of digital omnidirectional cameras in the areas of de-vignetting, brightness, contrast, and white balance control. Novel solutions for the color calibration of an omnidirectional camera rig, and an efficient method for devignetting images are presented. Additionally, a context-specific method of stitching images together into a panorama or a mosaic is provided.

Abstract: Techniques are described for embedding a panoramic image in standard resolution. A panoramic image is received from a panoramic camera and a location of a speaker is determined, either automatically or manually. A portion of the panoramic image is cropped to isolate the speaker and the cropped portion of the image is enlarged to standard video resolution. The panoramic image is combined with the cropped portion and transmitted via a standard video streaming format. In at least one implementation, the panoramic image is normalized so that face sizes of persons in the image appear approximately equal regardless of the distance each person is situated relative to the camera.

Abstract: A camera lens shuttering mechanism includes an image conducting unit disposed within a shutter housing when the camera is in a closed position so that the camera cannot record images. When moved to an open position, the shutter housing does not block the image conducting unit from imaging objects. The image conducting unit may be one or more lenses or one or more mirrors that reflect images to one or more lenses. When in the closed position, it is apparent to users that the camera is unable to transmit images.

Abstract: A location history is a collection of locations over time for an object. A stay is a single instance of an object spending some time in one place, and a destination is any place where one or more objects have experienced a stay. Location histories are parsed using stays and destinations. In a described implementation, each location of a location history is recorded as a spatial position and a corresponding time at which the spatial position is acquired. Stays are extracted from a location history by analyzing locations thereof with regard to a temporal threshold and a spatial threshold. Specifically, two or more locations are considered a stay if they exceed a minimum stay duration and are within a maximum roaming distance. Each stay includes a location, a starting time, and an ending time. Destinations are produced from the extracted stays using a clustering operation and a predetermined scaling factor.

Abstract: Improved camera calibration techniques, including an improved up look angle and an improved method for calibrating a virtual center of projection. By using a view camera technique for the up look angle, the image sensors can be mounted flat to a Printed Circuit Board (PCB). By using a sub-region of the image sensor for the active area of the camera it is possible to calibrate the virtual center of projection (C?).

Abstract: Systems and methods for maintaining orientation of a non-cylindrical panorama is described wherein an initial magnetometer reading is obtained for a panoramic camera. If the panoramic camera is rotated from an initial position, a new magnetometer reading is obtained and a magnitude of rotation is determined. The magnitude of rotation is factored into an image stitching and warping process to create a panoramic image that maintains the initial orientation.

Abstract: A panoramic camera design that is lower cost, robust, stable and more user friendly than prior art designs. The camera design makes use of a unified molded structure of optical material to house a mirror, aligned sensor, and lens assembly. The unified molded structure of the camera keeps the sensed optical path enclosed to minimize dust and user's fingers and maintain optical alignment.

Abstract: A system for communicating audio data signals comprises a source computer that performs an action, generates an event message corresponding to the action, converts the event message into an audio data signal, and communicates the audio data signal through its speaker. A source telephone receives a voice signal from a participant and the audio data signal through its microphone and communicates the audio data signal and voice as coherent sound via an audio communications medium. A recipient telephone receives the audio data signal from the coherent sound communicated via the audio communications medium and communicates the audio data signal via its speaker. A recipient computer receives the audio data signal through its microphone, extracts the event message from the audio data signal, and performs an action based on the event message from the audio data signal. The audio communications medium can comprise a telephone communications system or air.

Abstract: Faces of speakers in a meeting or conference are automatically detected and facial images corresponding to each speaker are stored in a faces database. A timeline is created to graphically identify when each speaker is speaking during playback of a recording of the meeting. Instead of generically identifying each speaker in the timeline, a facial image is shown to identify each speaker associated with the timeline.

Abstract: An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

Abstract: An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

Abstract: A system and process for highlighting the current speaker on an on-going basis in each frame of a low frame-rate video of an event having multiple people in attendance is presented. In general, this is accomplished by periodically identifying an attendee that is currently speaking at a rate substantially faster than the video frame rate, and updating each frame of the video to highlight the current speaker. More particularly, an A/V source provides a video stream to a client computing device that includes delta frames interspersed between the frames of the low frame-rate video. The full video frames act as keyframes, and the delta frames provide the changes needed to modify the last displayed version of the last keyframe to highlight just the region associated with the location of a current speaker. This allows the client device to operate as a standard A/V rendering and display unit.

Abstract: A system and process for highlighting the current speaker on an on-going basis in each frame of a low frame-rate video of an event having multiple people in attendance, such as a video teleconference, is presented. In general, this is accomplished by periodically identifying an attendee that is currently speaking at a rate substantially faster than the video frame rate, and for each frame of the video updating the frame to highlight the attendee currently speaking. More particularly, an A/V source provides video and audio data streams to the client computing device, with current speaker data embedded into the audio stream via audio watermarking techniques. The client device extracts the current speaker data from the audio stream, and then renders and displays the video while using the current speaker data to periodically update the frame being displayed to highlight the current speaker.

Abstract: A system and process for highlighting the current speaker on an on-going basis in each frame of a low frame-rate video of an event having multiple people in attendance, such as a video teleconference, is presented. In general, this is accomplished by periodically identifying an attendee that is currently speaking at a rate substantially faster than the video frame rate, and for each frame of the video updating the frame to highlight the attendee currently speaking. More particularly, an audio/visual (A/V) source provides separate video, audio, and current speaker data streams to a client computing device. The client device then uses these data streams to render and display the video and to periodically update the frame being displayed to highlight the current speaker depicted therein.

Abstract: A User Interface (UI) for a real-time panoramic image correction system and method that simplifies the use of the system for the user. The UI includes a control panel that allows a user to enter meeting table size and shape, camera position and orientation, and the amount of normalization desired (e.g. 0 to 100%). A window can also be implemented on a display that displays the corrected panoramic image. In this window, the head (either normalized or non-normalized) of a meeting participant, preferably one that is speaking, is extracted and displayed in a separate window. Additionally, the corrected panoramic image, whose size will vary in conjunction with the amount of warping applied, can be displayed and transmitted with extra pixels around its perimeter in order to allow the corrected or normalized panoramic image to adapt to any of the standard display size and resolutions and to simplify network transmission.

Abstract: A gradient-corrected linear interpolation method and system for the demosaicing of color images. The method and system compute an interpolation using some a current technique (preferably a bilinear interpolation technique to reduce computational complexity), compute a correction term (such as a gradient of a desired color at a given pixel), and linearly combine the interpolation and the correction term to produce a corrected, high-quality interpolation of a missing color value at a pixel. The correction term may be a gradient correction term computed from the current color of the current pixel. This gradient is directly used to affect and correct the estimated color value produced by the prior art interpolation technique. The gradient-corrected linear interpolation method and system may also apply a gradient-correction gain to the gradient correction term. This gradient-correction gain affects the amount of gradient correction that is applied to the interpolation.

Abstract: A system and process for discovery between endpoint component devices and computing devices residing in the same delimited space, such as conference room, in cases where the devices are connected to a common local network, is presented. The present invention allows a device in the space to discover the presence and network address of another device in the space, which then allows the first device to negotiate with the discovered device to facilitate the transfer of data and other communications over the common network. However, this discovery is accomplished without the use of the common network, and is limited to discovering devices residing in the same delimited space also containing the discoverable devices.

Abstract: A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image.