Abstract: A method performed by a display-camera system includes displaying first content and second content that occludes a portion of the first content on a display during a first time period, displaying the second content and third content on the display during a second time period that is non-overlapping with the first time period, the third content to minimize crosstalk from the first content, and capturing fourth content with a camera through the display during the second time period.

Abstract: Video conferencing methods and systems that enable shared content to be displayed in a separate window within a screen or in a separate display are described. In one aspect, a method for establishing a video conference with shared content using a computing device includes capturing images of a first participant through a screen using a camera. The screen is located between the first participant and the camera. The method also includes projecting images of a second participant on the screen to be viewed by the first participant using a projector, and displaying shared content separate from the images of the second participant. The shared content is to be presented in different format than the images of the second participant presented on the screen.

Abstract: An alpha matte is generated from image forming elements of an image. For each of one or more of the image forming elements: a respective representative foreground value is determined from one or more of the image forming element values; the respective representative foreground value and the value of the image forming element are normalized with respect to a threshold level; and a respective value of the alpha matte is generated from an evaluation of the normalized image forming element value in relation to the normalized representative foreground value.

Abstract: An image rendition and capture method includes rendering a first image on a surface using a first set of wavelength ranges of light. While the first image is being rendered, a second image is captured using a second set of wavelength ranges of light but not the first set. The second image is of the surface on which the first image is being rendered.

Abstract: A display-camera system includes a liquid crystal display panel, a camera, a switchable diffuser disposed between the liquid crystal display panel and the camera, a light source, and a control unit to switch the liquid crystal display panel and the switchable diffuser to transparent, to switch the light source to off, and to cause the camera to capture an image through the liquid crystal display panel and the switchable diffuser while the liquid crystal display panel and the switchable diffuser are transparent and the light source is off.

Abstract: A video collaboration session is provided in which data corresponding to a collaboration content is processed. The collaboration content includes a video component of a participant relative to a collaboration medium, as well as a medium content component. During the video collaboration session, one or more display characteristics of the video component and/or medium content component are programmatically adjusted, based on one or more presentation rules that relate to how the video component is to appear relative to at least the portion of the medium content component.

Abstract: Embodiments of the present invention are directed to visual-collaborative systems enabling geographically distributed groups to engage in face-to-face, interactive collaborative video conferences. In one aspect, a visual-collaborative system comprises a transparent display (402) having a first surface (410) and a second surface (412); and a camera system positioned to face the second surface. The display is configured to show images that can be viewed by looking at the first surface. The display is also configured to transmit light scattered off of objects facing the first surface. The light passes through the display and is captured by the camera.

Abstract: Methods and systems that reduce video crosstalk in video streams sent between participants in a video conference are disclosed. In one aspect, a method for reducing video crosstalk in a video stream sent from a local site to a remote site includes projecting a video stream of the remote site onto a screen at the local site. Each image in the video stream is dimmed according to a dimming factor of a dimming sequence. Crosstalk images of the local site are captured through the screen. Each crosstalk image is a blending of the image of the local site captured through the screen with a dimmed image of the remote site projected onto the screen. Images of the local site with reduced crosstalk are computed based on the dimming sequence. A video stream composed of the images of the local site with reduced crosstalk are sent to the remote site.

Abstract: Visual feedback is provided to a local user of a remote collaboration system. While an image is being captured, it is recognized that content is being shared on a screen. A composite image is generated which includes a form of the image being captured and the shared content. The composite image is caused to be displayed on a remote screen. A variably semi-transparent image of at least a portion of the composite image or the image is generated and is rendered on a portion of the screen such that the variably semi-transparent image is overlaid on any of the shared content or another composite image displayed on the screen.

Abstract: A display-camera system includes a liquid crystal panel having a screen side and a back side that is opposed to the screen side. A visible light camera is positioned a first spaced distance from the back side such that a field of view of the camera encompasses all or a fraction of an area of the liquid crystal panel. A visible light source is positioned a second spaced distance from the back side and outside of the field of view of the camera. A diffuser is positioned between the visible light source and the back side.

Abstract: A method for presentation interaction. The method includes, receiving by a computer system an indication of a manual selection of a region proximate to an audience member of an audience wherein the indication is received via an interaction with a displayed image of the audience. The method also includes utilizing a microphone array communicatively coupled with a beam-forming component of the computer system to focus audio pickup from the region proximate to the audience member in response to receiving the indication. The method also includes displaying an enhanced image of the region proximate to the audience member using the computer system in response to receiving the indication.

Abstract: A calibration system including a display screen having a first surface and a second surface and a projector configured to project an image onto the first surface of the display screen and the image is viewable on the second surface of said display screen, wherein the projector includes a projector coordinate system. The calibration system also includes a camera configured to capture an image of an object through the display screen, where the camera comprises a camera coordinate system, and a calibration device configured to calibrate the display screen.

Abstract: A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. A display pipeline of user-supplied image modification processing modules are reduced by first representing the processing modules as multiple, individual matrix operations. All the matrix operations are then combined with, i.e., multiplied to, the transformation matrix to create a modified transformation matrix. The created transformation matrix is then used in place of the original transformation matrix to simultaneously achieve both image transformation and any pre and post image processing defined by the image modification processing modules.

Abstract: Methods, computer-readable media, and systems are provided for combining multiple video streams. One method for combining the multiple video streams includes extracting a sequence of media frames (224-1/224-2) from presenter (222-1) video and from shared digital rich media (222-2) video (340). The media frame (224-1/224-2) content is analyzed (226) to determine a set of space and time varying alpha values (228/342). A compositing operation (230) is performed to produce the combined video frames (232) based on the content analysis (226/344).

Abstract: Embodiments of the present invention are directed to a visual-collaborative system enabling geographically distributed groups to engage in face-to-face, interactive collaborative video conferences. In one aspect, a visual-collaborative system comprises a display screen, a camera system, and a projector. The display screen has a first surface and a second surface, and the camera system is positioned to capture images of objects through the display screen. The projector is positioned to project images onto a projection surface of the display screen, wherein the projected images can be observed by viewing the second surface. The system includes a first filter disposed between the camera and the first surface, where the first filter passes light receives by the camera but substantially blocks the light that is produced by the projector.

Abstract: Embodiments of the present invention are directed to video-conferencing systems that create eye contact and accurate gaze awareness between video-conferencing participants. In one aspect, a method includes capturing images of a first participant through a display using a camera (801). The display is located between the first participant and the camera. A video stream encoding images of a second participant (802,905) is also received. The images of the second participant are shifted in accordance with a shift vector. The shift vector places the images of the second participant's face in approximate alignment with the eyes of the first participant and the lens of the camera (803). The shifted images are projected on the display using a projector (804).

Abstract: Disclosed herein are multimedia-conferencing systems and methods enabling local participants to hear remote participants from the direction the remote participants are rendered on a display. In one aspect, a method includes a computing device receives a remote participant's image and sound information collected at a remote site. The remote participant's image is rendered on a display at a local site. When the local participant is in close proximity to the display, sounds generated by the remote participant are played over stereo loudspeakers so that the local participant perceives the sounds as emanating from the remote participant's location rendered on the display.

Abstract: The present invention provides a method (500) executed on a processor for providing object information about an object in proximity to a display screen. The method includes the step of determining whether an at least first object is located within a proximal distance of the first surface of the display screen based on information provided by a depth camera (step 510). The method also includes the step of determining whether the at least first object has physically contacted a first surface of the display screen based on information provided by a physical contact sensing component (step 520). The information about (1) the proximal distance of the at least first object from the screen and (2) whether the at least first object has physically contacted the display surface of the screen to provide proximal event information and based on the information provided, it is determining whether the user interface should be modified (step 560).

Abstract: Various embodiments of the present invention are directed to video-conferencing systems configured and operated to create eye contact between video conference participants. In one embodiment, video conferencing system includes a display, a video camera positioned to capture a video image of a first video conference participant through the display, and a projector positioned to project a video image of a second video conference participant onto the display screen such that the first participant can view the second participant. The display screen is positioned between the first participant and the video camera. The video camera and the projector can be operated during a video conference to establish eye contact between the first participant and the second participant by creating a line-of-sight that passes through a point of the head of the second participant's image between the video camera and the first participant.

Abstract: Embodiments of the present invention are directed to a visual-collaborative system enabling geographically distributed groups to engage in face-to-face, interactive collaborative video conferences. In one aspect, a visual-collaborative system (400) comprises a display screen, a camera system, and a projector. The display screen (402) has a first surface (410) and a second surface (416), and the camera system is positioned to capture images of objects through the display screen. The projector (404,602,702) is positioned to project images onto the first surface that can be observed by viewing the second surface. The wavelengths of light used to produce the projected images are different from with the wavelengths of light used to capture images.