Abstract: Scene changes should be done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers, and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.

Abstract: A method for determining camera framing in a teleconferencing system comprises a process loop which includes acquiring an audio-visual frame from a captured a video data frame; detecting objects and extracting image features of the objects within the video data frame, ingesting the audio-visual frame into a context-based audio-visual map in an intelligent manner, and selecting targets from within the map for inclusion in an audio-video stream for transmission to a remote endpoint.

Abstract: The frame or image of a video stream of a videoconference is divided into a series of segments for analysis. There is a primary grid, which covers the entire frame, and an alternate grid, which is shifted from the primary grid. Each segment is small enough to allow a neural network to efficiently operate on the segment without requiring downsampling. By operating on full resolution images, a participant can be identified at a greater distance from the camera. The entire frame is analyzed at a lower frequency, such as once per five seconds, but each segment containing a participant in the conference is scanned at a higher frequency, such as once per second, to maintain responsiveness to participant movement but also allow the full resolution operation.

Abstract: A method of view selection in a teleconferencing environment includes receiving a frame of image data from an optical sensor such as a camera, detecting one or more conference participants within the frame of image data, and identifying an interest region for each of the conference participants. Identifying the interest region comprises estimating head poses of participants to determine where a majority of the participants are looking and determining if there is an object in that area. If a suitable object is in the area at which the participants are looking, such as a whiteboard or another person, the image data corresponding to the object will be displayed on a display device or sent to a remote teleconference endpoint.

Abstract: Scene changes that are done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.

Abstract: Systems and methods for collaboratively controlling the display of information across multiple displays is disclosed. A plurality of electronic devices linked to a plurality of co-located display devices are accessed. At least one of the plurality of electronic devices is a master electronic device. Different users can select and transfer content elements from the set displayed on the master display device to the remainder of display devices, such that the selected and transferred content elements advance in order across the remainder of display devices. Users can select individual content elements from a device under their control for display by one or more display devices without the need to transfer an entire document or file from which the content element is taken. Once a content element is so displayed, other currently displayed content elements are advanced in a logical manner, or removed from display.

Abstract: The frame or image of a video stream of a videoconference is divided into a series of segments for analysis. There is a primary grid, which covers the entire frame, and an alternate grid, which is shifted from the primary grid. Each segment is small enough to allow a neural network to efficiently operate on the segment without requiring downsampling. By operating on full resolution images, a participant can be identified at a greater distance from the camera. The entire frame is analyzed at a lower frequency, such as once per five seconds, but each segment containing a participant in the conference is scanned at a higher frequency, such as once per second, to maintain responsiveness to participant movement but also allow the full resolution operation.

Abstract: Scene changes that are done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.

Abstract: A method of view selection in a teleconferencing environment includes receiving a frame of image data from an optical sensor such as a camera, detecting one or more conference participants within the frame of image data, and identifying an interest region for each of the conference participants. Identifying the interest region comprises estimating head poses of participants to determine where a majority of the participants are looking and determining if there is an object in that area. If a suitable object is in the area at which the participants are looking, such as a whiteboard or another person, the image data corresponding to the object will be displayed on a display device or sent to a remote teleconference endpoint.

Abstract: A method for determining camera framing in a teleconferencing system comprises a process loop which includes acquiring an audio-visual frame from a captured a video data frame; detecting objects and extracting image features of the objects within the video data frame, ingesting the audio-visual frame into a context-based audio-visual map in an intelligent manner, and selecting targets from within the map for inclusion in an audio-video stream for transmission to a remote endpoint.

Abstract: Utilization of a state machine to determine participant framing. The states include empty room, group framing, any talker, conversation mode and unambiguous talker. In empty room state, the conference room is framed. In group framing state, any participants in the room are framed. In any talker state, the talking participant is framed. In conversation mode state, all talking participants are framed. In unambiguous talker state, the single talking participant is framed. Various framing conditions define transitions between the states. Conditions include, presence of participants, which and number of participants that are talking for how long, system mute and far site talking. The conversation states and conditions and framing decisions provide a fully automated framing mechanism to provide pleasant framing of the individuals in the near site or end for any of the conditions relating to number of talkers, participants and the like.

Abstract: A method of view selection in a teleconferencing environment includes receiving a frame of image data from an optical sensor such as a camera, detecting one or more conference participants within the frame of image data, and identifying an interest region for each of the conference participants. Identifying the interest region comprises estimating head poses of participants to determine where a majority of the participants are looking and determining if there is an object in that area. If a suitable object is in the area at which the participants are looking, such as a whiteboard or another person, the image data corresponding to the object will be displayed on a display device or sent to a remote teleconference endpoint.

Abstract: Scene changes that are done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 8o frames.

Abstract: A method for determining camera framing in a teleconferencing system comprises a process loop which includes acquiring an audio-visual frame from a captured a video data frame; detecting objects and extracting image features of the objects within the video data frame, ingesting the audio-visual frame into a context-based audio-visual map in an intelligent manner, and selecting targets from within the map for inclusion in an audio-video stream for transmission to a remote endpoint.

Abstract: Systems and methods for collaboratively controlling the display of information across multiple displays is disclosed. A plurality of electronic devices linked to a plurality of co-located display devices are accessed. At least one of the plurality of electronic devices is a master electronic device. Different users can select and transfer content elements from the set displayed on the master display device to the remainder of display devices, such that the selected and transferred content elements advance in order across the remainder of display devices. Users can select individual content elements from a device under their control for display by one or more display devices without the need to transfer an entire document or file from which the content element is taken. Once a content element is so displayed, other currently displayed content elements are advanced in a logical manner, or removed from display.

Abstract: Systems and methods for collaboratively controlling the display of information across multiple displays is disclosed. A plurality of electronic devices linked to a plurality of co-located display devices are accessed. At least one of the plurality of electronic devices is a master electronic device. Different users can select and transfer content elements from the set displayed on the master display device to the remainder of display devices, such that the selected and transferred content elements advance in order across the remainder of display devices. Users can select individual content elements from a device under their control for display by one or more display devices without the need to transfer an entire document or file from which the content element is taken. Once a content element is so displayed, other currently displayed content elements are advanced in a logical manner, or removed from display.

Abstract: Scene changes that are done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.

Abstract: A digital storyboard system that uses multiple displays and related methods are disclosed. The systems and methods may be used to present graphical content such as slides of a slide shows or boards of a storyboard sequence simultaneously on multiple screens at each of a plurality of locations. One or more users of the system may, through their interface device, update or edit the content on any of the screens, resulting in real-time updates to those designated screens at all locations and on any interface devices on which those screens appear. Portable devices may be used to interface with the storyboard system to choose content, place content on display areas, edit and annotate content. Concurrent editing and/or annotating of content by multiple users is supported. The systems and methods may also partition screens at a plurality of locations into display areas to display different content, such that all content is visible at all locations, regardless of the number of available screens.

Abstract: An automatic process for producing professional, directed, production crew quality, video for videoconferencing is described. Rule based logic is integrated into an automatic process for producing director quality video for videoconferencing. An automatic process can include a method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video. The method can include determining a region of interest in a panoramic view video using motion detection and presence sensors, and preparing the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon the location of persons in the panoramic view video. The method includes determining placement of panoramic view video on a composite display to prevent the panoramic view video overlaying display of an active talker on the active talker video stream.

Abstract: An automatic process for producing professional, directed, production crew quality, video for videoconferencing is described. Rule based logic is integrated into an automatic process for producing director quality video for videoconferencing. The automatic process uses sensor data to process video streams for video conferencing. A method and system for automatically processing sensor data on room activity into general room analytics for further processing by application of rules based logic to produce production quality video for videoconferencing is described. Sensory devices and equipment, for example motion, infrared, audio, sound source localization (SSL) and video are used to detect room activity or room stimulus. The room activity is analyzed (for example, to determine whether individuals are in the subject room, speaker identification and movement within the room) and processed to produce room analytics.