Abstract: One embodiment of the present invention sets forth a technique for modifying an audio parameter based on a gesture. The technique includes acquiring sensor data associated with a hand of a user and analyzing the sensor data to determine at least one hand position. The technique further includes determining, based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user. The technique further includes, based on the interaction, modifying a spatial audio parameter associated with the audio event to generate a modified audio stream and causing the modified audio stream to be reproduced for output to the user.

Abstract: Techniques for video capture including determining a position of a subject in relation to multiple cameras; selecting a foreground camera from the cameras based on at least the determined position; obtaining an RGB image captured by the foreground camera; segmenting the RGB image to identify a foreground portion corresponding to the subject, with a total height of the foreground portion being a first percentage of a total height of the RGB image; generating a foreground image from the foreground portion; producing a composite image, including compositing the foreground image and a background image to produce a portion of the composite image, with a total height of the foreground image in the composite image being a second percentage of a total height of the composite image and the second percentage being substantially less than the first percentage; and causing the composite image to be displayed on a remote system.

Abstract: A communication terminal includes: a receiver to receive a plurality of items of content data respectively from a plurality of counterpart communication terminals through a session established between the communication terminal and the counterpart communication terminals via a communication network; and circuitry to: determine an available band of the communication network; select, from among the plurality of items of content data, one or more items of content data receivable by the communication terminal in accordance with the available band of the communication network and bands being used to receive the plurality of items of content data; and control a display to display information indicating the available band of the communication network in association with the selected one or more items of content data receivable by the communication terminal.

Abstract: A video conference invite is accessed and names and/or account addresses in the invite are used to obtain information of people listed on the invite from a database. The information can include template photographs of the people and locations of the people. During a video conference that is subject of the invite, when it is determined that a video feed of the video conference indicates that plural participants are together in a single room, images of faces in the video feed are efficiently matched against only template photographs of people in the database indicated by the database as being associated with the room.

Abstract: An electronic device for displaying video signals on a display device has a processing device and a storage device. The processing device generates a user interface including video areas for showing the video signals on the display device. The processing device determines a first area size for the video areas based on an interface size of the user interface, a row quantity and an aspect ratio, to arrange the video areas. The processing device adjusts the first area size to generate a second area size and a third area size for the video areas according to the interface size, when the number of the video areas in each row is not equal to each other. The processing device shows the video signals in the video areas based on the second area size and the third area size on the user interface of the display device.

Abstract: Some embodiments include a mobile device with a light sensor overlaid under a display (e.g., a touchscreen). The mobile device can identify a command to capture an image. The mobile device can adjust at least a target portion of an opaqueness adjustable region of the display directly over the light sensor. The opaqueness adjustable region is capable of transforming from substantially opaque to substantially transparent. The mobile device can capture the image utilizing at least the light sensor while the target portion of the opaqueness adjustable region is substantially transparent.

Abstract: Embodiments provide a system that includes a first interactive device and control logic configured to perform an operation. The operation includes receiving historical data describing historical interactions between a user and one or more interactive devices. Additionally, the operation includes configuring the first interactive device with one or more interactive events. Each interactive event includes a respective (i) stimulus event and (ii) an action to perform responsive to an occurrence of the stimulus event, and at least one of the one or more interactive events is based on the received historical data. Responsive to detecting an occurrence of a first one of the one or more stimulus events, the operation includes causing the first interactive device to perform the corresponding action. The operation also includes updating the first interactive device with a second one or more interactive events.

Abstract: The invention is directed to recording, transmitting, and displaying a three-dimensional image of a face of a user in a video stream. Reflected light from a curved or geometrically shaped screen is employed to provide multiple perspective views of the user's face that are transformed into the image, which is communicated to remotely located other users. A head mounted projection display system is employed to capture the reflective light. The system includes a frame, that when worn by a user, wraps around and grips the user's head. Also, at least two separate image capture modules are included on the frame and generally positioned relatively adjacent to the left and right eyes of a user when the system is worn. Each module includes one or more sensor components, such as cameras, that are arranged to detect at least reflected non-visible light from a screen positioned in front of the user.

Abstract: An apparatus for a premises based system is provided. A processor may be configured to generate a layout (such as a floor plan layout) of at least a portion of a premises to be monitored by the premises based system and populate the layout with at least one premises device. The processor may be further configured to cause layout data associated with the populated layout to be stored.

Abstract: Techniques related to electronic meeting intelligence are disclosed. An apparatus receives audio/video data including first meeting content data for an electronic meeting that includes multiple participants. The apparatus extracts the first meeting content data from the audio/video data. The apparatus generates meeting content metadata based on analyzing the first meeting content data. The apparatus includes the meeting content metadata in a report of the electronic meeting. If the apparatus determines that the audio/video data includes a cue for the apparatus to intervene in the electronic meeting, the apparatus generates intervention data including second meeting content data that is different from the first meeting content data. During the electronic meeting, the apparatus sends the intervention data to one or more nodes associated with at least one participant of the multiple participants.

Abstract: A display apparatus includes a communication interface configured to communicate with another display apparatus, a display configured to display contents being shared with the other display apparatus and a video call user interface (UI) for a video call with a user of the other display apparatus, and a processor, in response to at least one of a gesture and a voice of the user included in video call data received from the other display apparatus satisfying a predetermined condition, configured to control the display to change a size of the video call UI displayed on the display.

Abstract: A system for transmitting a temperature of a patient to an electronic medical record associated with the patient includes a thermometer with a digital display that is configured to display a temperature value associated with the temperature signal and at least one error-checking value. The system also includes a handheld imaging device including a camera to capture an image of the digital display of the thermometer, a processor to extract the text in the image using optical character recognition, and perform an error-check on the temperature value using the at least one error-checking value in the image, and to transmit the patient's identification number and temperature to an electronic medical record system.

Abstract: A mobile terminal including a camera; a wireless communication processor configured to provide wireless communication; a display; and a controller configured to display a first preview image on the display corresponding to image data input through the camera, detect an external device located within a preset range of the mobile terminal via the wireless communication processor, display an icon on the display corresponding to the detected external device by overlapping the first preview image, execute a communication connection with the external device, in response to a touch input applied to the icon, while the communication with the detected external device is not connected, and release the communication connection with the external device, in response to the touch input applied to the icon, while the communication with the detected external device is connected.

Abstract: Embodiments disclosed herein provide methods, systems, and computer readable storage media for facilitating controlling a meeting between remote Augmented Reality (AR) and Virtual Reality (VR) participants. In a particular embodiment, a method provides, during a conference session wherein a plurality of head mounted displays (HMDs) are each worn by one of a plurality of participants, compiling first orientation information and first view information from a first HMD of the plurality of HMDs. The orientation information describes current orientation of the first HMD. Based on the first orientation information and the first view information, the method provides determining a first change to how video is presented the first HMD. Also, the method provides directing the first HMD to implement the first change.

Abstract: Disclosed are various embodiments for facilitating a cooperative shopping session. A mobile computing device establishes a session with a remote computing device. Product data is displayed by the mobile computing device in association with the session. The product data is shared with the remote computing device in association with the session. The mobile computing device receives an indication of a user interaction with the product data at the remote computing device. The mobile computing device displays the user interaction with the product data in conjunction with the product data and in association with the session.

Abstract: A visual data processing method applied to a visual data processing system. The visual data processing method comprises: (a) detecting a gazing point position of a user on a display; and (b) performing at least one process operation to visual data according to at least one distance between at least one display location for the visual data on the display and the gazing point position.

Abstract: A method relating to a video conference connecting a first terminal to a plurality of second terminals via a switching server is disclosed. The switching server receives a plurality of uplink video streams from the first terminal via a single transport path, and the switching server sends a downlink video stream based on the uplink video streams to each of the second terminals. The method involves the steps of collecting information relating to the use of each of the second terminals and determining an order between the uplink video streams based on the information. The method further involves the steps of generating instructions for the first terminal to adjust the plurality of uplink video streams based on the order, and informing the first terminal of the instructions. A switching server and a first terminal involved in the method are also disclosed.

Abstract: A computer receives one or more media content source locations. The computer determines two or more media content items associated with the one or more received media content source locations. The computer negotiates digital rights associated with the two or more media content items. The computer pre-fetches the two or more media content items from the one or more media content source locations. The computer determines at least one digital characteristic of a first media content item of the two or more media content items does not match at least one digital characteristic of a second media content item of the two or more media content items. The computer resamples the first media content item of the two or more media content items. The computer publishes a composition of the two or more media content items to appear as one linked asset with uniform digital characteristics.

Abstract: A photography system includes a remote server to store themed photograph overlays, and at least one themed photograph overlay image located at a designated area and corresponding to one of the themed photograph overlays on the remote server. A portable electronic device (PED) includes a processor to execute a creative artworks picture application, a transceiver to communicate with the remote server based on execution of the creative artworks picture application, and a camera to scan the themed photograph overlay image located at the designated area. The transceiver receives the themed photograph overlay from the remote server based on the camera scanning the themed photograph overlay image. The camera takes a photograph at the designated area, and the photograph with the at least one themed photograph overlay is displayed.

Abstract: According to an implementation of the present specification there is provided an apparatus for creating a hybrid image. The apparatus comprises: a first light source configured to emit a first light in a first direction; a reflector disposed to intercept the first light and configured to at least partially reflect the first light in an output direction to produce a reflected first light. The apparatus also comprises a second light source configured to emit a second light, the reflector configured to at least partially transmit the second light in the output direction to produce a transmitted second light. The apparatus also comprises an input terminal configured to receive an input used to control one or more of the first light source and the second light source. The hybrid image comprises a combination of the reflected first light and the transmitted second light.

Abstract: Teleconferencing is performed between two telecommunication devices having a display device and a stereoscopic pair of cameras positioned outside opposed sides of the display device at the same level partway along those sides. The separation between the centers of the cameras is in a range having a lower limit of 60 mm and an upper limit of 110 mm to improve the perceived roundness in a displayed stereoscopic image of a head. In captured stereo images that are video images, a head is segmented and the segmented backgrounds are replaced by replacement images that have a lower degree of perceived stereoscopic depth to compensate for non-linear depth perception in the displayed stereo images. Images are shifted vertically to position an eye-line of a detected face at the level of the stereoscopic pair of cameras of the telecommunication device where the images are displayed, improving the naturalness of the displayed image.

Abstract: Sound collection directionality is formed toward a location corresponding to a position designated in a video of a predetermined region which is imaged by a camera apparatus with a microphone array apparatus as a reference, and audio data is collected with high accuracy. In a directionality control system (10), a signal processing unit (33) derives a sound collection direction (?MAh,?MAv) which is directed from an installation position of a microphone array apparatus (2) toward a sound position corresponding to a position designated in video data on a screen of the display device (36) in response to a user's designation of any position in the video data displayed on the screen. The signal processing unit (33) forms sound collection directionality of audio data in the derived sound collection direction (?MAh,?MAv).

Abstract: A communication system includes, a first projection unit configured to project an image on a first projection surface, an imaging unit configured to capture an image of an object positioned in front of the first projection surface, a determination unit configured to determine a processing parameter for image processing to be performed on the object image captured by the imaging unit, based on a distance between the first projection surface and the object, a processing unit configured to perform the image processing on the object image based on the processing parameter determined by the determination unit, and a second projection unit configured to project the object image having undergone the image processing on a second projection surface.

Abstract: A method for estimating the image depth map of a scene, includes the following steps: providing (E1) an image, the focus of which depends on the depth and wavelength of the considered object points of the scene, using a longitudinal chromatic optical system; determining (E2) a set of spectral images from the image provided by the longitudinal chromatic optical system; deconvoluting (E3) the spectral images to provide estimated spectral images with field depth extension; and analyzing (E4) a cost criterion depending on the estimated spectral images with field depth extension to provide an estimated depth map.

Abstract: This disclosure is about a method and apparatus for estimating heading misalignment between a device and a person, where the device/apparatus comprises an optical sensor, the optical sensor capable of capturing an image of the person. At least one physical feature of the person is extracted from the image. A misalignment angle is estimated using the at least one physical feature of the person extracted from the image.

Abstract: The invention is directed to recording, transmitting, and displaying a three-dimensional image of a face of a user in a video stream. Reflected light from a curved or geometrically shaped screen is employed to provide multiple perspective views of the user's face that are transformed into the image, which is communicated to remotely located other users. A head mounted projection display system is employed to capture the reflective light. The system includes a frame, that when worn by a user, wraps around and grips the user's head. Also, at least two separate image capture modules are included on the frame and generally positioned relatively adjacent to the left and right eyes of a user when the system is worn. Each module includes one or more sensor components, such as cameras, that are arranged to detect at least reflected non-visible light from a screen positioned in front of the user.

Abstract: A streaming device includes a signal source to supply a first streaming signal and a second streaming signal, a server coupled to the signal source to process the first streaming signal and the second streaming signal; and at least one client. The client is used to decode the first streaming signal and the second streaming signal into a first window and a second window. The server can read an adjustment to the first window and the second window and output different signals to the client according to the adjustment.

Abstract: In a telepresence system, a local station receives images of participants at remote stations processed to isolate the remote participant in the image from image background. The local station merges the images of the participants at the remote stations to generate an output image in which a first remote participant appears to partially overlay another participant. The output image undergoes display at the local station.

Abstract: A candidate human head is found in depth video using a head detector. A head region of light intensity video is spatially resolved with a three-dimensional location of the candidate human head in the depth video. Facial recognition is performed on the head region of the light intensity video using a face recognizer.

Abstract: An imaging device includes an imager that images a multi-view image in which plural sub-images from plural viewpoints are aligned, a display that displays images; and a Central Processing Unit (CPU). The CPU is configured to: generate a main reconstruction image for viewing display after photographing by a main image generation process from the sub-images of the multi-view image, and store the main reconstruction image; obtain image displacement degrees for the sub-images respectively, wherein each of the image displacement degrees indicates a displacement between a position of a predetermined part in a sub-image and a position of a part corresponding to a photographic object captured in the predetermined part in another sub-image; determine a clipping size of partial images clipped from a predetermined range of the sub-images included in the multi-view image; and cause the display to display the main reconstruction image in the viewing display after the photographing.

Abstract: In a communication event between a first user and one or more second users via a communication network. A plurality of video streams is received via the network at a computer connected to the network. Each of the streams carries a respective moving image of at least one respective user. The computer causes the respective moving image of a first of the video streams to be displayed at a user device of the first user for a first time interval. The computer detects, in the respective moving image of a second of the video streams that is not displayed at the user device in the first time interval, a change in the visual content thereof. In response to detecting said change in the visual content, the computer causes at least the second video stream to be displayed at the user device for a second time interval.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pausing interactive sessions. One of the methods includes initiating a live interactive session between a first user and a second user over a data communication network; during the interactive session, determining that the quality of the interactive session has become unacceptable to the first user; pausing the interactive session; while the session is paused, recording a segment of video captured by a user device of the second user; and providing the segment of video for presentation to a user device of the first user with acceptable quality.

Abstract: A method and an audio conference device for carrying out an audio conference are disclosed, whereby classification information associated with a respective audio date flow is recorded for supplied audio data flows. According to a result of an evaluation of the classification information, the audio data flows are associated with at least three groups which are homogeneous with regard to the results. The individual audio data flows are processed uniformly in each group in terms of the signals thereof, and said audio data flows processed in this way are superimposed in order to form audio conference data flows to be transmitted to the communication terminals.

Abstract: A virtual conferencing system is described which tracks events during a virtual conference, provides a user interface for reviewing the events, and allows a moderator and/or other participant to provide feedback related to the events.

Abstract: A video conference display method includes: an MCU obtaining a stereoscopic video source of a conference site where a first terminal device in a video conference is located; and the MCU sending the stereoscopic video source to one or more other terminal devices, except the first terminal device, in the video conference, wherein the stereoscopic video source is used by one or more other terminal devices for non-screen displaying of the conference site where the first terminal device is located in one or more conference sites where the one or more other terminal devices are located. The scheme solves the problem of poor user experience of video conferencing, improves the sense of being present at the video conference, has no other differences from an on-site conference except that the entities cannot be touched, improves the user experience, and is an important step towards widely popularizing the video system.

Abstract: Techniques related to electronic meeting intelligence are disclosed. An apparatus receives audio/video data including first meeting content data for an electronic meeting that includes multiple participants. The apparatus extracts the first meeting content data from the audio/video data. The apparatus generates meeting content metadata based on analyzing the first meeting content data. The apparatus includes the meeting content metadata in a report of the electronic meeting. If the apparatus determines that the audio/video data includes a cue for the apparatus to intervene in the electronic meeting, the apparatus generates intervention data including second meeting content data that is different from the first meeting content data. During the electronic meeting, the apparatus sends the intervention data to one or more nodes associated with at least one participant of the multiple participants.

Abstract: A tele-immersive environment is described that provides interaction among participants of a tele-immersive session. The environment includes two or more set-ups, each associated with a participant. Each set-up, in turn, includes mirror functionality for presenting a three-dimensional virtual space for viewing by a local participant. The virtual space shows at least some of the participants as if the participants were physically present at a same location and looking into a mirror. The mirror functionality can be implemented as a combination of a semi-transparent mirror and a display device, or just a display device acting alone. According to another feature, the environment may present a virtual object in a manner that allows any of the participants of the tele-immersive session to interact with the virtual object.

Abstract: A method, computer program product and video communication device are provided for transmitting video to a remote user. The video communication device includes a communication interface for providing a communication session with a device of the remote user, a camera capturing images, and a control unit configured to obtain a three-dimensional model of the location, control the camera to capture video images of the location, determine a current orientation of the video communication device, and transfer the three-dimensional model and orientation to the device of the remote user together with a video stream from the camera comprising the captured video images.

Abstract: Enterprise communication display systems enable life-like images for videoconferencing and entertainment productions. Life-like images appear in a 3D environment where imaged people are visible through the use of specially configured see-through displays. Imaged people can also be viewed amongst a reflected foreground. Methods for enterprise wide deployments for corporate, healthcare, education, and government communications, including hotel properties and a property management system are shown. The invention further advances the communication and display art by creating novel direct projection see-through screen devices that use extreme short throw projectors to reduce cost and bulk of common throw projectors. Further, numerous unique devices and systems are disclosed of transparent OLED videoconferencing and displays. Further, unique embodiments of aiming a camera through a transparent OLED for eye contact videoconferencing are disclosed.

Abstract: Systems and methods provide location of an object via video conferencing. The systems and methods may be useful for applications that require remote assistance from an individual to help another individual locate an object or a feature within an image displayed on screen. The user of a local device may view the remote image for context of the environment. In some embodiments, the local user may help direct the remote user by directions to zoom in or out of the displayed image and may provide a frame to guide the remote user. A position in the remote image shown in the remote device is activated and displayed by the local user as an icon to help pinpoint the object location for the remote user.

Abstract: An arrangement for a collaborative videoconferencing environment is disclosed. A display having a substantially “L-shaped” configuration allows for display of collaborative materials and video of remote participants simultaneously, which provides for a more natural interaction for a meeting participant interacting with the collaborative materials. Additionally, a camera is arranged to focus on the meeting participants shoulder while the meeting participant is interacting with the collaborative materials. Such location of the camera provides a more natural view of the collaborator to remote users.

Abstract: A videoconferencing device that determines a spatial arrangement of the video streams output at a first endpoint based on a number of display devices being utilized at the first endpoint and a number of cameras being utilized at each of the one or more additional endpoints.

Abstract: An audiovisual conferencing system and method include a plurality of video monitors, video cameras and audio transducers positioned within a home club. Each of the components is connected to a computer controller and broadband interne router so as to be in selective communication with one of a plurality of similar remote systems positioned within another club. Accordingly, patrons of the home club can visually and audibly communicate with patrons of a remote club via the interne.

Abstract: A control method, control apparatus, and control device are disclosed. The control method includes: acquiring audio data including voice information of a target voice source; determining location range information of the target voice source according to the audio data; and controlling rotation of a camera device which currently cannot capture the target voice source according to the location range information, so that the camera device can capture the target voice source. The embodiments of the present invention support capture of a target voice source outside an original screen range by the camera device.

Abstract: A computer program product for creation and maintenance of video-based training documentation. Universal identifiers are created and associated with user interface elements for delimiting videos and audios. Test scripts are created based on matching the universal identifiers to task instructions. Videos are created based on test scripts where the universal identifiers are marked on the videos. Audios are created based on the universal identifiers and the task instructions, where the universal identifiers are marked on the audios. The audios and the videos are combined based on synchronizing the universal identifiers.

Abstract: A video tracking system includes a user interface configured to facilitate tracking of a target between video cameras. The user interface includes user controls configured to assist a user in selecting video cameras as the target moves between fields of view of the video cameras. These user controls are automatically associated with specific cameras based on a camera topology relative to a point of view of a camera whose video data is currently being viewed. The video tracking system further includes systems and methods of synchronizing video data generated using the video cameras and of automatically generating a stitched video sequence based on the user selection of video cameras. The target may be tracked in real-time or in previously recorded video and may be track forward or backwards in time.

Abstract: Systems, methods, and devices are provided for automatically configuring a display layout for a slide presentation to allow a presenter to seamlessly perform effective, professional slide presentation even in unfamiliar locales. A method for doing so may involve receiving connected display information that describes the electronic displays currently connected to the electronic device. When the connected display information indicates that multiple electronic displays are currently connected, the processor of the electronic device may automatically choose, without explicit user assignment, a main presentation display and one or more presenter displays. The main presentation display may display a slide presentation from among the multiple electronic displays, while the presenter displays may display information other than only the slide presentation to aid the presenter. The main presentation display and the presenter displays may be chosen based at least in part on the connected display information.

Abstract: A method comprising causing display of at least one frame of video information, receiving information indicative of a scrub input associated with the video information, such that the scrub input comprises a movement portion and a termination portion, causing display of a progression of frames of the video information in correspondence with the movement portion of the scrub input determining share video information that comprises at least part of the video information based, at least in part, on a speed of the movement portion of the scrub input, and sending the share video information to a separate apparatus is disclosed.

Abstract: Providing a video session from an agent of a contact center includes initiating by a contact center server an interactive video session to a customer computer, the interactive video session comprising a first video stream transmitted to the customer computer and the first video stream having an image size. The interactive video session also includes inserting an agent video portion within the first video stream, the agent video portion occupying a first part of the image size; providing an agent computer with a script related to a subject of the interactive video session; and inserting an automation within the first video stream; the automation occupying a second part of the image size. Input is received from the customer computer interacting with the automation; and based on the input, the script provided to the agent computer is modified.

Abstract: Disclosed is a video processing method. The method comprises: splicing, according to pre-determined video sorting information, two or more original video images, to obtain a composite video image; encoding the composite video image; and sending out the encoded composite video image. Correspondingly, also disclosed are a video processing apparatus and system, which can ensure strict synchronization between multiple channels of videos in a telepresence meeting; moreover, the problem of how to determine a video image output position is solved, so that the telepresence meeting renders a vivid communication effect.