Abstract: A switchable imaging apparatus having an image display mode and an image capture mode, comprising: a display screen to provide a displayed image when the display screen is in a first display state, wherein the display screen is at least partially transparent when the display screen is switched to a second transparent state; a set of optical beam deflectors, each optical beam deflector being individually switchable between a first non-deflecting state and a second deflecting state wherein imaging light from a corresponding section of the scene is deflected into a camera positioned in a location peripheral to the display screen; and a controller which synchronously switches the display screen between the first display state and the second transparent state, and the individual optical beam deflectors between their first non-deflecting state and their second deflecting state, thereby providing the image display mode and the image capture mode.

Abstract: A switchable imaging apparatus having a transparent viewing mode and an image capture mode, comprising: a transparent plate having a front surface, wherein a scene is viewable through the transparent plate when the imaging apparatus is in the transparent viewing mode; an optical beam deflector positioned within the transparent plate, wherein the optical beam deflector is switchable between a first non-deflecting state and a second deflecting state, such that when the optical beam deflector is in the second deflecting state imaging light from the scene is deflected into a camera positioned in a location peripheral to the transparent plate; and a controller which synchronously switches the optical beam deflector between the first non-deflecting state and the second deflecting state, thereby providing the transparent viewing mode and the image capture mode.

Abstract: A display is disclosed that comprises an array of display pixels, in which light sensing pixels are interspersed with the display pixels substantially across the area of the display. At least one colour display sub-pixel is arranged to be switched off when the corresponding colour light sensor pixel closest to that display sub-pixel is detecting light to generate an image. A portable electronic device is disclosed which comprises the display. The display is then operable to capture an image from the light sensing pixels, so that for example it can then operate as one or more of a digital mirror, scanner, biometric lock or touch panel. When a user looks at the display for a video call, the captured image of the user appears to look directly the other party.

Abstract: A controlled three-dimensional (3D) communication endpoint system and method for simulating an in-person communication between participants in an online meeting or conference and providing easy scaling of a virtual environment when additional participants join. This gives the participants the illusion that the other participants are in the same room and sitting around the same table with the viewer. The controlled communication endpoint includes a plurality of camera pods that capture video of a participant from 360 degrees around the participant. The controlled communication endpoint also includes a display device configuration containing display devices placed at least 180 degrees around the participant and display the virtual environment containing geometric proxies of the other participants. Placing the participants at a round virtual table and increasing the diameter of the virtual table as additional participants are added easily achieves scalability.

Abstract: A method for preventing movement in a telepresence system, includes a plurality of cameras. Each camera has a respective field of vision for viewing one or more users. The fields of vision each have lateral boundaries. The system also includes a plurality of restrictive elements. Each restrictive element is positioned along a respective lateral boundary of a field of vision of the fields of vision of the plurality of cameras such that viewed users each positioned within a field of vision of the plurality of cameras are restricted by the plurality of restrictive elements from moving outside of the field of vision in which each viewed user is positioned.

Abstract: The subject disclosure is directed towards an immersive conference, in which participants in separate locations are brought together into a common virtual environment (scene), such that they appear to each other to be in a common space, with geometry, appearance, and real-time natural interaction (e.g., gestures) preserved. In one aspect, depth data and video data are processed to place remote participants in the common scene from the first person point of view of a local participant. Sound data may be spatially controlled, and parallax computed to provide a realistic experience. The scene may be augmented with various data, videos and other effects/animations.

Abstract: A method and a device for adjusting depth perception, a terminal including a function for adjusting depth perception and a method for operating the terminal are provided. The method for adjusting depth perception includes: obtaining color and depth videos of a user; detecting a user's position based on the obtained depth video of the user; calculating a range of maximum and minimum depths in a 3-dimensional (3D) video according to the detected user's position; and adjusting a left and right stereo video generating interval of the 3D video to be rendered so as to satisfy the calculated range of the maximum and minimum depths. Therefore, during a 3D or multi-view video call, the 3D video having a three-dimensional effect optimized according to the user's position may be provided.

Abstract: An apparatus is provided in one example and includes first and second cameras configured to capture image data associated with an end user involved in a video session. The can further include a display configured to interface with the cameras, and a shaft coupled to a rotor. The cameras are secured to the shaft, and the shaft receives a rotational force such that during rotation of the shaft, the cameras pass over the display in order to capture particular image data associated with the end user's face in such a way as to improve eye gaze alignment.

Abstract: Video teleconferencing systems and methods are provided for providing virtual roundtable meetings. In one embodiment, a video teleconference system is provided for providing virtual round table meetings. The system comprises a curved display surface and a video processor configured to receive a video image of a participant from each of a plurality of remote video teleconferencing systems and display each participant equally spaced about the curved display surface.

Abstract: An apparatus for providing a mobile streaming adaptor includes a processor configured to receive media content from a remote camera, process the received media content by capturing, encoding and encapsulating the media content at a mobile electronic device, connect to a remote streaming server through function of a mobile networked device; and stream the encapsulated media content to the mobile networked device for communication of the encapsulated content to the remote streaming server through an Internet Protocol (IP) network for real-time distribution to a communication device. A corresponding computer program product and method are also provided.

Abstract: A telepresence system enhances the perception of presence of a remote person involved in a video conference. The system preferably has a two-way mirror, which is between the observer and the display device, positioned at an angle to reflect a backdrop surface. The backdrop surface may or may not appear superimposed in a position behind the image of a person from the remote location. The system preferably minimizes image distortion via an optical path for the camera line of sight that is substantially longer than the physical distance between the user and the camera. The system may be asymmetrical, in that one camera is on axis with the user's line of sight while the other camera is off axis with the user's line of sight.

Abstract: A method is provided in one example embodiment and includes receiving data indicative of a personal position of an end user. A media stream is selected from a plurality of media streams to be transmitted to the end user based on the personal position. The selected media stream includes image data of an object captured by a camera and the image data is used to construct a three-dimensional rendering of the object. In more specific embodiments, the media stream selection is executed by a server configured to be coupled to a network. The camera can be part of a plurality of cameras that capture image data associated with the object and that transmit respective media streams over a network. Once a camera begins transmitting image data over the network and to the end user, other cameras from the plurality of cameras stop transmitting their respective media streams over the network.

Abstract: A method for tracking an active subject in a video call service includes establishing a peer-to-peer connection between a videophone input apparatus and a peer over a wireless connection; receiving information of a first resolution display of an A/V output apparatus of the peer; and generating a local video stream in the videophone apparatus based on a video signal provided by a second resolution camera of the videophone apparatus, the second resolution being greater than the first resolution.

Abstract: A feedback-system for managing the position of a frontal camera provided on a portable multimedia device during video communication. The feedback-system comprises a camera image analyzer coupled to the frontal camera and adapted to detect and analyze the pose of a user facing the frontal camera, an optimal video estimator coupled to the camera image analyzer and adapted to calculate a 6-dimentional error-vector of the current position of the frontal camera with respect to an optimal position of the frontal camera, an intuitive feedback manager coupled to the optimal video estimator and adapted to generate a transformation matrix translating the error-vector into an error message for the image displayed on a screen of the portable multimedia device, the intuitive feedback manager being further coupled to the portable multimedia device which is adapted to use the error message for modifying the image displayed on the screen.

Abstract: A mobile terminal having a dual display unit and a method of changing a display screen using the same are disclosed. The mobile terminal includes a main body, a front display unit for providing a multimedia mode, a rear display unit for providing a normal mode, and a screen control module for controlling to turn off the rear display unit and turn on the front display unit, and to display a multimedia execution screen in the front display unit. The method of changing a display screen of the mobile terminal having additional multimedia functions provides an optimum multimedia environment and improves user convenience and effectiveness of the mobile terminal by flexibly supporting a multimedia function to be executed according to a screen state of the rear display unit.

Abstract: In a typical video meeting, each of two persons has a computer or a portable electronic device, controlled by one or more processors executing software instructions. Each device has a screen and a video camera. Typically, B's camera will be positioned above B's screen. Video of B is transmitted across a communication system from B's camera to A's screen. Because B is looking at A's image on the screen, A will perceive B to be focused downward, not making eye contact. The present invention analyzes video frames for the orientations of B's head and focus, and uses image editing software tools to virtually correct the gaze direction of B's eye to be directed toward B's camera. A's gaze direction may be similarly adjusted simultaneously. The approach may also be used with 3 or more participants, e.g., in a video conference.

Abstract: A switchable imaging apparatus having an image display mode and an image capture mode, comprising: a display screen to provide a displayed image when the display screen is in a first display state, wherein the display screen is at least partially transparent when the display screen is switched to a second transparent state; an optical beam deflector switchable between a first non-deflecting state and a second deflecting state, such that when the optical beam deflector is in the second deflecting state imaging light from a scene is deflected into a camera positioned in a location peripheral to the display screen; and a controller which synchronously switches the display screen between the first display state and the second transparent state, and the optical beam deflector between the first non-deflecting state and the second deflecting state, thereby providing the image display mode and the image capture mode.

Abstract: Audio source positioning technique embodiments are presented that are employed in a video teleconference or telepresence session between a local site and one or more remote sites. Each of these sites has one participant, and a virtual scene is constructed and displayed at each site that depicts each of the participants from the other sites in the constructed scene. However, rather than simply playing audio captured at the other site or sites in the viewing participant's site, audio source positioning is used to make it seem to a participant viewing a rendering of the virtual scene that the voice of another participant is emanating from a location on the display device where the remote participant is depicted.

Abstract: A telepresence system enhances the perception of presence of a remote person involved in a video conference. The system preferably has a two-way mirror, which is between the observer and the display device, positioned at an angle to reflect a backdrop surface. The backdrop surface may or may not appear superimposed in a position behind the image of a person from the remote location. The system preferably minimizes image distortion via an optical path for the camera line of sight that is substantially longer than the physical distance between the user and the camera. The system may be asymmetrical, in that one camera is on axis with the user's line of sight while the other camera is off axis with the user's line of sight.

Abstract: Methods, systems, and apparatus are presented for reducing distortion in an image, such as a video image. A video image can be captured by an image capture device, e.g. during a video conferencing session. Distortion correction processing, such as the application of one or more warping techniques, can be applied to the captured image to produce a distortion corrected image, which can be transmitted to one or more participants. The warping techniques can be performed in accordance with one or more warp parameters specifying a transformation of the captured image. Further, the warp parameters can be generated in accordance with an orientation of the image capture device, which can be determined based on sensor data or can be a fixed value. Additionally or alternatively, the warp parameters can be determined in accordance with a reference image or model to which the captured image should be warped.

Abstract: A videoconferencing terminal, a method of videoconferencing and a videoconferencing infrastructure. In one embodiment, the terminal includes: (1) a flat panel display and (2) a camera associated with the flat panel display and configured to receive light from an object through the flat panel display and acquire an image of the object.

Abstract: An exemplary method of facilitating communication includes determining a position of a portable communication device that generates a video output. A sound output control is provided to an audio device that is distinct from the portable communication device for directing a sound output from the audio device based on the determined position of the portable communication device.

Abstract: An avatar image on a device display, such as a cell phone or laptop computer, maintains natural and realistic eye contact with a user (a human being) while the user is communicating with the other human being, whose avatar is displayed on the device. Thus, the user and the avatar have natural eye contact during the communication session (e.g., phone call). Modules within the device ensure that the avatar eyes do not maintain a fixed gaze or stare at the user constantly and that the avatar looks away and changes head and eye angles in a natural manner. An imager in the device captures images of the user and tracks the user's eyes. This data is inputted to an avatar display control module on the device which processes the data, factors in randomness variables, and creates control signals that are sent to the avatar image display component on the device. The control signals instruct how the avatar eyes should be positioned.

Abstract: A system for image manipulation enables an improved video conferencing experience. The system includes a camera; a display screen adjacent to the camera; a processor coupled to the camera and the display screen; and a memory coupled to the processor. Instructions executable by the processor enable receiving a source image from the camera and generating a synthetic image based upon the source image. The synthetic image corresponds to a view of a virtual camera located at the display screen.

Abstract: Methods and systems for generating still images and video by capture of images projected by light passing through a display screen are disclosed. According to an aspect, a method includes controlling light emitting components of a display screen to activate in a sequence for displaying a sequence of images. For example, in an organic light emitting diode (OLED) display screen, the method may include controlling a subset of the display screen OLEDs to activate in sequence to display a sequence of images. The displayed sequence of images may appear to a viewer of the display screen to be a still image or a video. The method may control light emitting components different subsets of the LEDs to be activated in the sequence, such that different areas of the display screen display images in each part of the sequence.

Abstract: A method and apparatus for enabling an improved experience by better matching of the auditory space to the visual space in video viewing applications such as those that may be used in video teleconferencing systems using window-based displays. In particular, in accordance with certain illustrative embodiments of the present invention, one or more desired sound source locations are determined based on a location of a window in a video teleconference display device (which may, for example, comprise the image of a teleconference participant within the given window), and a plurality of audio signals which accurately locate the sound sources at the desired sound source locations (based on the location of the given window in the display) are advantageously generated.

Abstract: Embodiments are configured to provide video conferencing functionality including using region of interest (ROI) features to provide a video signal, but the embodiments are not so limited. In an embodiment, components of a video conferencing system can operate to provide a video signal using pixel data associated with a ROI. In one embodiment, a video conference device can include a detector that can be used to detect human flesh tone regions in a video scene as part of providing a video stream to one or more conference participants.

Abstract: Embodiments of a display device with a vision system are disclosed. In one example, a display device comprises a plurality of pixels for displaying light in a first polarization state, a plurality of photodetectors, where each photodetector in the plurality of photodetectors includes a polarization filter configured to transmit light in a second polarization state to the photodetector and reject light in other polarization states, a plurality of lenslets, where each lenslet in the plurality of lenslets focuses light in the second polarization state onto at least one photodetector in the plurality of photodetectors, a material surrounding the plurality of lenslets, where, for each lenslet in the plurality of lenslets, indices of refraction of the lenslet and the material are substantially equal for light in the first polarization state, and where indices of refraction of the lenslet and the material are different for light in the second polarization state.

Abstract: A mobile communication terminal displays images of a video conference to enable a feeling of natural conversation ambience to the participants. The terminal captures an image of the terminal user and receives images of other video conference participants. The terminal displays one of the received images closest to the camera, and the captured image farthest from the camera to encourage the user to focus his line of sight to the camera. Also, a sight location indicator is displayed as a further aid to directing the line of sight. Looking at the camera provides a natural conversation ambience to the participants.

Abstract: Techniques are provided for receiving multimedia from a plurality of endpoints participating in a conference session, including multimedia from an endpoint that was muted during the conference session. A muting state is detected at a particular endpoint during the conference session and the multimedia from the particular endpoint is recorded even though it is not forwarded and rendered to the other endpoints during the conference session. Information associated with the multimedia data for the conference session is stored to indicate the time period during which the muting state was detected at the particular endpoint. Techniques are also provided for granting access at a later time to the stored multimedia data for conference session, including access controls to the muted multimedia.

Abstract: A signal processing apparatus processing a video signal and an audio signal in synchronization with the video signal includes generating means for generating information indicating a probability of a certain subject appearing in the image on the basis of the video signal that is input; determining means for determining whether the certain subject appears in the image on the basis of the information generated by the generating means; and directional characteristic varying means for, if the determining means determines that the certain subject appears in the image, varying a directional characteristic of the audio signal so as to increase the level of the audio signal collected from the direction of the subject and/or to decrease the levels of the audio signals collected from directions other than the direction of the subject.

Abstract: A system and method is disclosed for adapting a continuous presence videoconferencing layout according to interactions between conferees. Using regions of interest found in video images, the arrangement of images of conferees may be dynamically arranged as displayed by endpoints. Arrangements may be responsive to various metrics, including the position of conferees in a room and dominant conferees in the videoconference. Video images may be manipulated as part of the arrangement, including cropping and mirroring the video image. As interactions between conferees change, the layout may be automatically rearranged responsive to the changed interactions.

Abstract: A camera speakerphone having a microphone array may be used for videoconferencing. Example microphone array designs described herein may be used to perform Sound Source Localization (SSL) and improve audio quality of captured audio. In one example, an omni-directional camera speakerphone includes a base having a speaker and at least one microphone. A neck is coupled to the base which is coupled to a head. The head includes an omni-directional camera and at least one microphone.

Abstract: The disclosure provides apparatuses for videoconferencing and a method of operation thereof. In one embodiment, an apparatus includes: (1) a display substrate occupying less than an entirety of a viewing area, (2) an actuator configured to move the display substrate over the viewing area and (3) a camera having a field of view at least partially overlapping the viewing area and configured to capture a camera image through the viewing area.

Abstract: A communication system is described herein which provides an indicator that helps hub participants of a meeting (or other environmental setting) determine a direction of attention of a satellite participant (who is not physically present at the meeting). The indicator can be implemented as a mechanical pointer, a solid-state display mechanism, a rotating display mechanism, a display mechanism which presents visual information that reflects directionality, and so on. The communication system can assess the directionality of the satellite participant based on any combination of control inputs from explicit input mechanism(s) and/or implicit input mechanism(s). The communication system can also choose between explicit and/or implicit control of the indicator based on at least one selection criterion.

Abstract: An information processing apparatus is connected with at least one external apparatus via a network. An input image of a first user related to the information processing apparatus is accepted while displaying a plurality of target images on a display. The plurality of target images includes an image of a second user related to the external apparatus. A gaze of the first user is detected from the input image. A target image looked by the first user is recognized from the plurality of target images, based on the gaze. A first head model as a head model of the first user, and a first texture to be projected onto the first head model, are generated. A first ID to identify a subject of the target image, the first head model and the first texture, are transmitted to the external apparatus.

Abstract: A remote presenting system, includes: a plurality of displays, configured to display a remote image; an audio output apparatus, configured to output remote audio information; a multimedia communication terminal, configured to process and control audio/video information obtained by a local end and audio/video information sent by a remote end; a plurality of video cameras, configured to shoot a local video image and send the shot video image to the multimedia communication terminal to be processed; an audio collection apparatus, configured to collect local audio information, and send the collected audio information to the multimedia communication terminal; and a plurality of user locations, corresponding to the plurality of video cameras respectively, and respectively being in an approximately perpendicular relationship with optic axes of camera lenses of the plurality of video cameras.

Abstract: Techniques for implementing an integrative interactive space are described. In implementations, video cameras that are positioned to capture video at different locations are synchronized such that aspects of the different locations can be used to generate an integrated interactive space. The integrated interactive space can enable users at the different locations to interact, such as via video interaction, audio interaction, and so on. In at least some embodiments, techniques can be implemented to adjust an image of a participant during a video session such that the participant appears to maintain eye contact with other video session participants at other locations. Techniques can also be implemented to provide a virtual shared space that can enable users to interact with the space, and can also enable users to interact with one another and/or objects that are displayed in the virtual shared space.

Abstract: A device for a conference system and method for operation thereof is provided. The device is configured to receive a first audio signal and a first identifier associated with a first participant. The device is further configured to receive a second audio signal and a second identifier associated with a second participant. The device includes a filter configured to filter the received first audio signal and the received second audio signal and to output a filtered signal to a number of electroacoustic transducers. The device includes a control unit connected to the filter. The control unit is configured to control one or more first filter coefficients based on the first identifier and to control one or more second filter coefficients based on the second identifier. Preferably the device comprises a headtracker function for changing the first and second filter coefficients depending on tracking of head's position.

Abstract: A video conference system provides “in the room” telepresence to near end participants. The video conference system includes a frameless or bezelless display device placed in front of a front wall for displaying edge-to-edge 3D images of far end participants. Color of the near end front wall is configured to be the same as the color of the far end rear wall. As a result, images displayed on the display device can merge or blend into the near end front wall, giving the near end participants the perception that the far end participants are actually in the near end conference room. Brightness of the faces/bodies of the near end participants can also be adjusted to match the brightness of the face/bodies of the images of the far end participants as they appear on the display device—therefore enhancing the in the room perception of the far end participants.

Abstract: A display apparatus including a remote controller signal receiver which receives a remote controller signal, a remote controller operation display light emitting diode (LED) which indicates an operation control according to the remote controller signal, a human interface module which performs a human interface function, a human interface operation display light emitting diode (LED) which indicates an operation control according to the human interface function, and a controller which controls the remote controller operation display LED and the human interface operation display LED by use of signals being transmitted from the remote controller signal receiver and the human interface module, thereby providing user convenience.

Abstract: A method is provided in one example embodiment and includes receiving data indicative of a personal position of an end user and receiving image data associated with an object. The image data can be captured by a first camera at a first angle and a second camera at a second angle. The method also includes synthesizing the image data in order to deliver a three-dimensional rendering of the object at a selected angle, which is based on the data indicative of the personal position of the end user. In more specific embodiments, the synthesizing is executed by a server configured to be coupled to a network. Video analytics can be used to determine the personal position of the end user. In other embodiments, the method includes determining an approximate time interval for the synthesizing of the image data and then delaying audio data based on the time interval.

Abstract: A video conferencing system contains one or more display adjusting components, whereby an object to be displayed can be adjusted to appropriately fit various sized display screens. A display adjusting component is contained within the sending client, which adjusts the image of the object to be appropriately displayed to one or more receiving clients. The receiving clients also contain a display adjusting component, which can further adjust the image of the object to be displayed, as necessary. The multimedia conferencing server of the video conferencing system also contains a display adjusting component, which negotiates parameters of the sending and receiving clients. Any of the display adjusting components can function alone, or in any combination together. A method, and computer readable media which contain computer readable instructions to perform a method, of adjusting an image for video conference display are also described.

Abstract: Exemplary methods and systems relate to telepresence at mobile devices. Aspects comprise dynamic configuration of video provided from a server that intermediates between a mobile device and a telepresence system during a telepresence session. The server receives high definition video from the telepresence system and transcodes into a format that can indicated by the mobile device. The mobile device can dynamically update the format in response to real-time battery life and network interface status. A progressive reduction in bandwidth and power consumptive activities can be implemented. The device can implement face detection and face centering, front/back mobile device camera switching, and automatic contrast control and other video quality controls in an outgoing video stream.

Abstract: A method of determining whether a video frame meets the design composition requirements associated with a video conference, said method comprising steps performed by a processor of: providing design composition requirements for the video frame, wherein the design composition requirements are available at runtime; analyzing captured video content from a video conference, to determine whether a participant of interest is present in a video frame of the video content; and analyzing the video frame to determine if it meets the design composition requirements for the video conference.

Abstract: A compact and lightweight display device having an image pickup function and a two-way communication system which can shoot an image of a user as an object and display an image at the same time without degrading image quality by disposing a semi-transmitting mirror or the like which blocks an image on the display screen (display plane). The display device having the image pickup function includes a display panel capable of transmitting visible light at least and arranging display elements which can be controlled by voltage or current, and an image pickup device disposed around the display panel. The image pickup device is input with data of an image of a user or the like by a reflector, or equipped with a fiberscope bundling optical fibers.

Abstract: A method for capturing an image, comprising: providing a switchable imaging apparatus including a display screen having a first display state and a second transparent state, an optical beam deflector switchable between a first non-deflecting state and a second deflecting state, a camera positioned in a location peripheral to the display screen, and a controller; setting the switchable imaging apparatus to the image capture mode by using the controller to set the display screen to the second transparent state and the optical beam deflector to the second deflecting state; using the camera to capture an image of the scene; setting the switchable imaging apparatus to the image display mode by using the controller to set the display screen to the first display state and the optical beam deflector to the first non-deflecting state; and displaying an image on the display screen.

Abstract: Embodiments of the present disclosure generally include a method and apparatus for minimizing acoustic echo in video conference. In one embodiment, a computer implemented method for minimizing acoustic echo in video conferencing comprises determining position information wherein the position information is derivable from a video stream and processing the position information using a computer to identify at least one direction wherein the one direction minimizes acoustic echo.

Abstract: Eye gaze reduction may be provided. First, a location of a near-end camera relative to a near-end screen may be determined. Next, based upon the determined location of the near-end camera, a location may be determined for a video window on the near-end screen. The determined location for the video window may be configured to reduce an eye gaze error in a near-end image transmitted to a far-end device from the near-end camera. Then video data from a far-end camera corresponding to the far-end device may be received and rendered in the video window at the determined location for the video window on the near-end screen.

Abstract: A combined video display and image capture system and method are disclosed. In one embodiment the system alternates between the capture period of the camera (306) and the image display (302) period to isolate the camera (306) from the display (302). Various methods are disclosed to achieve the alternation in the capture and the display periods of the system. Distortions in the captured image can be corrected using an image correction subsystem.