Abstract: Embodiments of the present invention are directed to video-conferencing systems that create eye contact and accurate gaze awareness between video-conferencing participants. In one aspect, a method includes capturing images of a first participant through a display using a camera (801). The display is located between the first participant and the camera. A video stream encoding images of a second participant (802,905) is also received. The images of the second participant are shifted in accordance with a shift vector. The shift vector places the images of the second participant's face in approximate alignment with the eyes of the first participant and the lens of the camera (803). The shifted images are projected on the display using a projector (804).

Abstract: An apparatus, a method of videoconferencing and a videoconferencing system are disclosed herein. In one embodiment, the apparatus includes: (1) a monitor configured to switch between a display mode and a reflecting mode and (2) a camera located in front of the monitor, the camera positioned to face the monitor and synchronized with the monitor to capture a local image reflected therefrom during the reflecting mode.

Abstract: This image processing system comprises: a device (PRJ, SI1) for projecting a first light beam (FL1) to form a first image (I1) on a screen (ECR) on which a second light beam (FL2) coming from an observation area (ZO) forms a second image (I2) and a device (CAM, SI1) for acquiring a third image (I3) formed on the screen (ECR) and corresponding to the superimposition of the second image (I2) and at least a portion (I1?) of the first image (I1). This system further comprises control means (CTR) for: obtaining a first signal (S1) representing the portion (I1?) of the first image (I1), obtaining a second signal (S2) representing the third image (I3), and calculating a third signal (S3) by subtracting at least part of the first signal (S1) from the second signal (S2) to form an image (I2?) representing the observation area (ZO).

Abstract: Gaze tracking or other interest indications are used during a video conference to determine one or more audio sources that are of interest to one or more participants to the video conference, such as by determining a conversation from among multiple conversations that a subset of participants are participating in or listening to, for enhancing the audio experience of one or more of the participants.

Abstract: A videoconferencing conferee may be provided with feedback on his or her location relative a local video camera by altering how remote videoconference video is displayed on a local videoconference display viewed by the conferee. The conferee's location may be tracked and the displayed remote video may be altered in accordance to the changing location of the conferee. The remote video may appear to move in directions mirroring movement of the conferee. This effect may be achieved by modeling the remote video as offset and behind a virtual portal corresponding to the display. The remote video may be displayed according to a view of the remote video through the virtual portal. As the conferee's position changes, the view through the portal changes, and the remote video changes accordingly.

Abstract: A method of correcting gaze offset in an image of at least one individual having eyes is disclosed. The method comprises: processing the image to extract location of at least one eye over the image, processing the image to replace imagery data associated with each location of each eye with replacement data thereby providing a corrected image, and transmitting the corrected image to a display device. The replacement data are preferably previously-recorded imagery data which respectively correspond to the same eye but a different gaze.

Abstract: Methods and apparatus to direct attention in a video content display are disclosed. An example method to direct attention in a video content display, includes determining a location in a display interface to which attention is to be directed based on video content to be displayed, and modulating with a stimulus, at a frequency such that the stimulus is detectable by human peripheral vision and is less detectable by human foveal vision, a portion of the video content displayed in the location with a stimulus to direct attention to the location.

Abstract: The present invention is a video conferencing system that includes: a first display area for displaying content shared between at least a first participant at a first location and at least a second participant at a second location in a video conference; and a second display area for displaying the video captured of the at least first participant, wherein the video captured of the at least first participant is spatially consistent with the video captured of the at least second participant.

Abstract: The present disclosure discloses a method for identifying individuals in a multimedia stream originating from a video conferencing terminal or a Multipoint Control Unit, including executing a face detection process on the multimedia stream; defining subsets including facial images of one or more individuals, where the subsets are ranked according to a probability that their respective one or more individuals will appear in a video stream; comparing a detected face to the subsets in consecutive order starting with a most probable subset, until a match is found; and storing an identity of the detected face as searchable metadata in a content database in response to the detected face matching a facial image in one of the subsets.

Abstract: A combined video display and camera system is disclosed. According to an embodiment of the present invention, the system comprises a video display with gaps in between the pixels. Light goes through these gaps and enters a camera, which captures an image. The system is arranged such that the display and the gaps are optically out of focus with respect to the camera.

Abstract: Various embodiments of the present invention are directed to video-conferencing systems configured and operated to create eye contact between video conference participants. In one embodiment, video conferencing system includes a display, a video camera positioned to capture a video image of a first video conference participant through the display, and a projector positioned to project a video image of a second video conference participant onto the display screen such that the first participant can view the second participant. The display screen is positioned between the first participant and the video camera. The video camera and the projector can be operated during a video conference to establish eye contact between the first participant and the second participant by creating a line-of-sight that passes through a point of the head of the second participant's image between the video camera and the first participant.

Abstract: A compact and lightweight display device having an image pickup function and a two-way communication system which can shoot an image of a user as an object and display an image at the same time without degrading image quality by disposing a semi-transmitting mirror or the like which blocks an image on the display screen (display plane). The display device having the image pickup function includes a display panel capable of transmitting visible light at least and arranging display elements which can be controlled by voltage or current, and an image pickup device disposed around the display panel. The image pickup device is input with data of an image of a user or the like by a reflector, or equipped with a fiberscope bundling optical fibers.

Abstract: An information processing apparatus is provided which includes a display unit that displays predetermined information, an imaging unit that is installed on a right side or left side of a central portion of an upper frame of an outer frame enclosing the display unit to obtain a pickup image of a user, and a control unit that detects a face area of the user from the pickup image obtained by the imaging unit to cut out the face area containing the detected face area.

Abstract: Embodiments of the present invention are directed to a visual-collaborative system enabling geographically distributed groups to engage in face-to-face, interactive collaborative video conferences. In one aspect, a visual-collaborative system (400) comprises a display screen, a camera system, and a projector. The display screen (402) has a first surface (410) and a second surface (416), and the camera system is positioned to capture images of objects through the display screen. The projector (404,602,702) is positioned to project images onto the first surface that can be observed by viewing the second surface. The wavelengths of light used to produce the projected images are different from with the wavelengths of light used to capture images.

Abstract: A dynamically adjustable framed view of occupants in a room is captured through an automatic framing system. The system employs a camera system, including a pan/tilt/zoom (PTZ) camera and one or more depth cameras, to automatically locate occupants in a room and adjust the PTZ camera's pan, tilt, and zoom settings to focus in on the occupants and center them in the main video frame. The depth cameras may distinguish between occupants and inanimate objects and adaptively determine the location of the occupants in the room. The PTZ camera may be calibrated with the depth cameras in order to use the location information determined by the depth cameras to automatically center the occupants in the main video frame for a framed view. Additionally, the system may track position changes in the room and may dynamically adjust and update the framed view when changes occur.

Abstract: One embodiment of the present invention sets forth a method for intuitively controlling a far-end camera via physical movements. The method includes the steps of receiving an image captured by a first camera and including a digital representation of at least a portion of a user of the first camera, analyzing the digital representation to identify a position of the user relative to the first camera, computing a value associated with a first property of a second camera based on the position of the user, and transmitting the value to the second camera, wherein, in response to receiving the value, a perspective of the second camera is modified based on the value.

Abstract: There is provided a interactive IPTV broadcasting service system of user participation, the system including: a broadcast controller reserving time of IPTV broadcast channels to perform an IPTV broadcast according to the reserved time, notifying user participation to accept the user participation during the broadcasting service, and controlling so that video of the user making a request for participation in broadcasting is included in video of the broadcast in progress, and then broadcast, a plurality of clients each notifying the broadcast controller of the request of the corresponding user when the participation in broadcasting is requested according to a selection of the IPTV broadcasting user and generating video and audio traffic of the corresponding user, and a media server relaying the users' participation in broadcasting between the broadcast controller and the clients, and receiving and mixing video and audio traffic of a broadcaster and the video and audio traffic of each of the users making the req

Abstract: A video conference system includes a first video conference environment, and a second video conference environment linked to the first video conference environment. Each video conference environment has a conference view direction and a reference view direction, the reference view directions being symmetrically oriented with respect to the conference view directions.

Abstract: A method for rendering a video conference including identifying a location of a focus region and a size of the focus region by tracking a head position of a participant viewing the video conference and rendering the video conference to increase an amount of display resources for one or more participants included in the focus region and decrease the amount of display resources for one or more of the participants not included in the focus region.

Abstract: An image pickup apparatus is provided with an imaging optical system (imaging lens), an image sensor for picking up a subject image formed by the imaging optical system, and a view division optical system (first mirror) which divides a view picked up by the image sensor into an environment imaging side view and an eyeball imaging side view.

Abstract: An enhanced interface for voice and video communications, in which a gesture of a user is recognized from a sequence of camera images, and a user interface is provided include a control and a representation of the user. The process also includes causing the representation to interact with the control based on the recognized gesture, and controlling a telecommunication session based on the interaction.

Abstract: The present invention is to provide a storage cabinet that houses a terminal having a reader unit for reading information recorded on a recording medium. With this storage cabinet, a recording medium can be readily connected to the reader unit from any angle. The storage cabinet houses a thin client terminal having a reader unit for reading authentication information from a recording medium. This storage cabinet includes a shelf board that is supported in a horizontal direction and has an opening into which the thin client terminal can be inserted, with the reader unit facing upward, and holding members that hold the thin client terminal inserted into the board member, with the reader unit being located higher than the shelf board.

Abstract: Techniques for automatically selecting a video camera feed based on room events in a video teleconference are described. An embodiment may receive video information from multiple cameras in a conference room. An event of interest may be detected from the video information. Events of interest may be detected, for example, by detecting faces, detecting an eye gaze or head direction, and detecting motion. When an event of interest is detected, the video camera having the optimal view of the event may be selected, and the feed from the selected video camera may be transmitted to remote participants. Other embodiments are described and claimed.

Abstract: Systems and methods for processing video are provided. Video compression schemes are provided to reduce the number of bits required to store and transmit digital media in video conferencing or videoblogging applications. A photorealistic avatar representation of a video conference participant is created. The avatar representation can be based on portions of a video stream that depict the conference participant. A face detector is used to identify, track and classify the face. Object models including density, structure, deformation, appearance and illumination models are created based on the detected face. An object based video compression algorithm, which uses machine learning face detection techniques, creates the photorealistic avatar representation from parameters derived from the density, structure, deformation, appearance and illumination models.

Abstract: An apparatus is provided in one example and includes first and second cameras configured to capture image data associated with an end user involved in a video session. The can further include a display configured to interface with the cameras, and a shaft coupled to a rotor. The cameras are secured to the shaft, and the shaft receives a rotational force such that during rotation of the shaft, the cameras pass over the display in order to capture particular image data associated with the end user's face in such a way as to improve eye gaze alignment.

Abstract: An apparatus is provided in one example and includes an eye gaze module configured to interact with a processor and a memory element such that the apparatus is configured for: receiving first video data from a first camera; receiving second video data from a second camera; determining which of the first and second video data captured by the cameras is to be selected for transmission to a counterparty engaged in a video session; determining a tilt characteristic associated with at least one of the cameras; and modifying image data based on the tilt characteristic in order to orient objects for rendering on a display associated with the video session.

Abstract: Methods and systems for communicating each participant's focus of attention in a video conference are described. In one aspect, a method for communicating where each participant's attention is focused in a video conference includes receiving each remote participant's video and audio streams and focus of attention data, based on the remote participant's head location. The at least one remote participant's video streams are presented in separate viewing areas of the local participant's display. The viewing areas presenting the remote participants are modified to indicate to the local participant each remote participant's focus of attention, based on the focus of attention data.

Abstract: Systems and methods are disclosed for controlling cropping areas of video images to match the allocated area associated with the image in a video conferencing layout. The disclosed methods can protect regions of interest from being cropped. A region of interest within a video image is identified to adjust the cropping in such a way that the region of interest is preserved within the cropped image. The region of interest may be identified based on motion detection or flesh tone detection, for example.

Abstract: A desktop videoconferencing endpoint for enhancing direct eye-contact between participants can include a transparent display device and a camera placed behind the display device to capture images of a near end participant located in front of the display device. The display device can alternate between display states and non-display states. The camera can be operated to capture images of the near end participant only when the display device is in the non-display state. The camera can be placed behind the display device at a location where an image of eyes of the far end participant is displayed. Images captured by the camera when displayed at to the far end participants can give the perceived impression that the near end participant is making direct eye-contact with the far end participant.

Abstract: A communication device is operable to construct one or more image sequences that correspond to voice information, where the image sequences simulate video streaming via the communication device. The image sequences are synchronized with the voice information during active video based connection via the communication device. The image sequences are generated and/or retrieved within the communication device, and/or retrieved from an external source. At least some of the images may be generated via a secondary device that is communicatively coupled with the communication device. The generated images are stored within the secondary device and/or are stored in a dedicated video support server. The secondary device is operable to communicate the images directly during communication with the communication device and/or to communication information that enable retrieving and/or constructing the image sequences. Alternatively, the communication device is operable to generate the image sequences independently.

Abstract: A video conferencing display device a display panel, at least one imaging device and processing structure. The at least one imaging device has a field of view aimed at an inner surface of the display panel and captures images through the display panel such that when a user is positioned adjacent an outer surface of the display panel, the user appears in the captured images. The processing structure communicates with the at least one imaging device and processes the captured images to create a direct eye image for transmission to a remote device over a network.

Abstract: An image processing system and an image processing method are provided. The image processing system includes: a display device, an image detecting device, and a driving unit. The display device comprises: a frame, a display screen supported by the frame, and a sliding track positioned on the frame. The image detecting device is movably positioned on the sliding track via the driving unit, and utilized for detecting at least an object. The driving unit is utilized for moving the image detecting device. The image processing system and the image processing method can determine an optimal position for the image detecting device in the image processing system to detect the largest number of audiences. In addition, the image detecting device in the image processing system can detect objects in each zone in front of the display device in the image processing system no matter what size of the display device is.

Abstract: A method for distributing media packets in a multipoint conference includes receiving a plurality of audio signals. Each of the plurality of audio signals includes audio packets, wherein one or more audio packets from each of the plurality of audio signals is coded with an audiometric, the audiometric including an acoustic measurement from a conference site. The method further includes, for each of the plurality of audio signals, extracting an audiometric from one or more audio packets and selecting an active audio signal based on the extracted audiometrics. In addition, the method includes determining a change in the active audio signal and in response to determining a change in the active audio signal, updating a media forwarding table, the media forwarding table including a directory for routing one or more of the plurality of audio signals. The method further includes distributing audio packets to one or more conference sites in accordance with the media forwarding table.

Abstract: A method of controlling movement of a line of sight of a video camera mounted on a mobile videoconferencing terminal includes: a) a step (72) of using at least two microphones spaced apart from each other in three dimensions and attached to the mobile terminal to pick up a sound uttered by a user of the mobile terminal, b) a step (74) of responding to the signals from the microphones to establish a direction in which the mouth of the user is located, and c) a step (76) of controlling movement of the line of sight as a function of the direction established during step b).

Abstract: Intuitive adjustment of framing on a terminal is achieved by a remote party using a mobile terminal during a videotelephone call. The terminal includes a camera, framing means, video encoding means and communication and multiplexing means. The terminal includes motion sensors, formatting means, and communication and multiplexing means. In response to its own movement, the terminal produces framing data from movement information coming from the movement sensors and sends said framing data to the terminal. The framing means extract image portions from images captured by the camera in response to framing information corresponding to the framing data.

Abstract: The invention relates to a device (1) for a videoconference communication between a local user (5) and at least one remote user (6), which reduces the eye deflection and provides a better eye contact between the local user and the remote user. The device includes a screen (4) capable of restoring, for the local user, an image of the remote user, and an image sensor (3) capable of sensing an image of the local user for the remote user. It further comprises a light source (2) arranged, relative to the image sensor, so as to lighten the eyes of the local user watching the screen during a communication with the remote user, so that the image sensor can detect an image of the local user including a reflection of the light source on a portion at least of each eye of the local user, including the pupil. The device further includes communication means (7) capable of transmitting the detected image to the remote user (6).

Abstract: An image rectification method for a video device includes receiving an image that is a facial image of a transmitter from the transmitter, obtaining a first angular deviation with respect to line of sight of the transmitter according to the image, obtaining a second horizontal angular deviation and a second vertical angular deviation with respect to line of sight of a receiver using the video device, and performing an image synthesis procedure on the image according to the first angular deviation, the second horizontal angular deviation and the second vertical angular deviation, for generating an eye-to-eye image sent to the receiver.

Abstract: Microphone arrays, which are formed by arranging a plurality of microphones, are provided on a front side and a rear side of a housing, respectively. A virtual focus is set for each of the microphone arrays in a direction opposite to a direction in which sound is picked-up sound signals picked up by the plurality of microphones are delayed such that distances to the virtual focus are the same, and the delayed sound signals are synthesized. Therefore, sound in a sound-pickup area of a predetermined angle on each of the front side and the rear side can be picked up at a high level, and even though there is a noise source in areas other than the sound-pickup area, noise from the noise source is not picked up.

Abstract: As discussed herein, there is presented a visual communication system, a method of conducting two-way visual communication and an apparatus. In one embodiment, the apparatus includes: (1) a lens substrate having a first array of micro lenses on one side thereof, (2) an optical output substrate having a second array of display pixels and (3) an optical input substrate having a third array of image sensors laterally inter-dispersed with respect to display pixels of the first array and positioned to receive light from the micro lenses of the first array.

Abstract: Methods, devices, and non-transitory computer-readable storage media are disclosed for allowing video conferencing participants to maintain eye contact with each other. A display is disposed between a first video capture device and a second video capture device. The video capture devices capture images of a subject video conferencing participant. Images from the first capture device are associated with images from the second video capture device for transmission over a network to a video conferencing agent of a peer video conferencing participant. Images of the peer video conferencing participant are received over the network and displayed on the display that is disposed between the video capture devices.

Abstract: The present invention relates to a method for an image processing system (100), the method comprising the steps of acquiring (S1) a first image (I1) of a first person, locating (S2) a first segment (202, 204) in the first image (I1) comprising at least an eye of the first person, acquiring (S3) a second image (I2) of a second person, locating (S4) a second segment (206, 208) in the second image (I2) comprising at least an eye of the second person, the second segment corresponding in relative position and size to the first segment (202, 204), comparing the second segment (206, 208) with the first segment (202, 204), and replacing the second segment (206, 208) in the second image (I2) with the first segment (202, 204) if the comparison gives a difference that is smaller than a pre-defined threshold. The present invention allows for replacements of segments of the face with pre-recorded corresponding segments having characteristics for improving eye-to-eye contact in e.g.

Abstract: A telepresence system enhances the perception of presence of a remote person involved in a video conference. The system preferably has a two-way mirror, which is between the observer and the display device, positioned at an angle to reflect a backdrop surface. The backdrop surface, which is further away from the two-way mirror than the image plane of the image display device, appears superimposed in a position behind the image of a person from the remote location. The system preferably minimizes image distortion via an optical path for the camera line of sight that is substantially longer than the physical distance between the user and the camera. The system may be asymmetrical, in that one camera is on axis with the user's line of sight while the other camera is off axis with the user's line of sight.

Abstract: A method and a device for adjusting depth perception, a terminal including a function for adjusting depth perception and a method for operating the terminal are provided. The method for adjusting depth perception includes: obtaining color and depth videos of a user; detecting a user's position based on the obtained depth video of the user; calculating a range of maximum and minimum depths in a 3-dimensional (3D) video according to the detected user's position; and adjusting a left and right stereo video generating interval of the 3D video to be rendered so as to satisfy the calculated range of the maximum and minimum depths. Therefore, during a 3D or multi-view video call, the 3D video having a three-dimensional effect optimized according to the user's position may be provided.

Abstract: A method and apparatus for displaying images for use during a video teleconference provides improved eye contact between the participants. A video camera mounted on a display (e.g., a monitor or laptop) is co-located with a first participant in the video teleconference. An image of a second participant in the video teleconference is received, and a location of one or more facial features (e.g., the eyes) contained in the image of the second participant is determined. Then, the image of the second participant is displayed on the screen such that the eyes of the second participant are displayed in close proximity to (e.g., directly below) the video camera. In this manner, improved eye contact between the participants is advantageously provided. Alternatively, metadata representing the location of such facial features (e.g., the eyes) contained in the image of the second participant is received along with the image of the second participant.

Abstract: Provided are a video communication apparatus having an eye-to-eye communication function that enables video communication users to communicate with each other in an eye-to-eye state, and a method thereof. The apparatus includes a display unit configured to display a video of a video communication partner, the display unit including a plurality of cameras activated according to a selection control signal; a video processor configured to encode a captured video from the activated camera, and to decode a video from the video communication partner and identify a position of the video communication partner's eyes from the video; a camera selector configured to activate a camera installed in a position corresponding to the position among the plurality of cameras; and a transceiver configured to transmit the encoded video from the video processor to the video communication partner and provide the video from the video communication partner to the video processor.

Abstract: The present invention enables eye contact between conferees during a teleconference using a terminal equipped with a beamsplitter for reflecting an image of a conferee. In one embodiment the image of the conferee appears to be in a backdrop. The display is positioned behind the viewing side of the beam-splitter so that the conferee views the display through the beamsplitter. The invention can be configured to create the appearance that a life-size teleconference image of a remote conferee appears in the same room as the local conferee apparently sitting on the other side of the desk or table—creating the experience of telepresence with eye contact. Additional embodiments include adaptable features of the present invention which enable it to be configured into many specific types of eye contact display products. The invention further teaches the design of a telepresence network, linking numerous terminals sharing a commonality in configuration.

Abstract: Eye gaze reduction may be provided. First, a location of a near-end camera relative to a near-end screen may be determined. Next, based upon the determined location of the near-end camera, a location may be determined for a video window on the near-end screen. The determined location for the video window may be configured to reduce an eye gaze error in a near-end image transmitted to a far-end device from the near-end camera. Then video data from a far-end camera corresponding to the far-end device may be received and rendered in the video window at the determined location for the video window on the near-end screen.

Abstract: Provided is a sound source localization device which can detect a source location of an extraction sound, including at least two microphones; an analysis unit (103) which (i) analyze frequencies of the mixed sound including the noise and received by each microphone, and (ii) generates frequency signals; and an extraction unit (105) which, for each source location candidate, (a) adjusts time axes of the frequency signals corresponding to the microphones, so that there is no time difference between when the mixed sound reaches one microphone from the source location candidate and when the mixed sound reaches another microphone from the source location candidate, and (b) determines frequency signals having a difference distance equal to or smaller than a threshold value, from among the frequency signals corresponding to the microphones with the time axis having been adjusted, the difference distance representing a degree of a difference in the frequency signals between the microphones, and (c) extracts the sourc

Abstract: The present invention relates to the communications field and discloses a video communication method, apparatus, and system, which are invented to solve the problem that the prior art does not achieve consistent eye-to-eye video communication in a horizontal direction. The technical solutions of the present invention includes: obtaining video images of a participant from more than two different horizontal shooting angles, where a range of viewing angles of the participant is between the more than two different horizontal shooting angles; and sending the video images of the participant to a video communication remote end. The embodiments of the present invention may be applied in the video communication field.

Abstract: A method and device for adapting a display image on a hand-held portable wireless display and digital capture device. The device includes a camera for capturing a digital video and/or still image of a user, means for adjusting the captured digital image in response to poor image capture angle of said image capture device so as to create a modified captured digital image; and means for transmitting said modified captured digital image over a wireless communication network to a second hand-held portable wireless display and digital capture device.