Abstract: Distance-based framing includes obtaining at least a video stream during an online conference session. The video stream, an audio stream received with the video stream, or both the video stream and the audio stream are analyzed and a framing that either focuses on a speaker in the video stream or provides an overview of participants in the video stream, the framing being is composed based on the analyzing. A potential error in the framing is detected based on further analysis of at least one of the video stream, the audio stream, or distance sensor data received with the video stream. If the distance sensor data contradicts the potential error, the framing is maintained, but if the distance sensor data confirms the potential error, a new framing is generated.

Abstract: Distance-based framing includes obtaining at least a video stream during an online conference session. The video stream, an audio stream received with the video stream, or both the video stream and the audio stream are analyzed and a framing that either focuses on a speaker in the video stream or provides an overview of participants in the video stream, the framing being is composed based on the analyzing. A potential error in the framing is detected based on further analysis of at least one of the video stream, the audio stream, or distance sensor data received with the video stream. The potential error may be contradicted or confirmed based on an amount of motion when the framing focuses on the speaker. If the distance sensor data contradicts the potential error, the framing is maintained, but if the distance sensor data confirms the potential error, a new framing is generated.

Abstract: A method, computer system, and computer program product are provided for virtual background replacement during a video communication session. A frame comprising a user image and a captured background is obtained from a video capture device as part of a video stream. The frame is processed to replace the captured background with a virtual background. A change to an exposure characteristic of the video capture device is determined. In response to determining the change to the exposure characteristic, the virtual background is modified to match a virtual background brightness with a user image brightness to produce a modified virtual background. The frame is modified by combining the user image with the modified virtual background.

Abstract: A method, computer system, and computer program product are provided for virtual background replacement during a video communication session. A frame comprising a user image and a captured background is obtained from a video capture device as part of a video stream. The frame is processed to replace the captured background with a virtual background. A change to an exposure characteristic of the video capture device is determined. In response to determining the change to the exposure characteristic, the virtual background is modified to match a virtual background brightness with a user image brightness to produce a modified virtual background. The frame is modified by combining the user image with the modified virtual background.

Abstract: Distance-based framing includes obtaining at least a video stream during an online conference session. The video stream, an audio stream received with the video stream, or both the video stream and the audio stream are analyzed and a framing that either focuses on a speaker in the video stream or provides an overview of participants in the video stream, the framing being is composed based on the analyzing. A potential error in the framing is detected based on further analysis of at least one of the video stream, the audio stream, or distance sensor data received with the video stream. If the distance sensor data contradicts the potential error, the framing is maintained, but if the distance sensor data confirms the potential error, a new framing is generated.

Abstract: The present disclosure provides methods and systems related to automatic adjustment of screen brightness for optimized presentation to both physically present and remote audience during the multimedia collaboration session. In one aspect, a method includes detecting presence of a screen in the field of view of a camera in a meeting room; determining if exposure of the camera or brightness of the screen is to be adjusted, to yield a determination; and controlling at least one of the exposure of the camera or the brightness of the screen based on the determination such that viewing of meeting room and the screen are legible for one or more audience and the screen is legible for one or more audience present in the meeting room.

Abstract: The present disclosure provides methods and systems related to automatic adjustment of screen brightness for optimized presentation to both physically present and remote audience during the multimedia collaboration session. In one aspect, a method includes detecting presence of a screen in the field of view of a camera in a meeting room; determining if exposure of the camera or brightness of the screen is to be adjusted, to yield a determination; and controlling at least one of the exposure of the camera or the brightness of the screen based on the determination such that viewing of meeting room and the screen are legible for one or more audience and the screen is legible for one or more audience present in the meeting room.

Abstract: Systems, methods, and computer-readable media for automatically setting exposure levels in a session based on an active participant. In some embodiments, a method can include detecting faces of one or more participants in one or more images in a captured video feed at a location of the participants illuminated at one or more illumination levels at the location. The one or more detected faces can be associated with brightness levels of the one or more participants based on the one or more illumination levels at the location. Audio input can be received for the one or more participants at the location and a first participant can be identified as an active participant using the audio input. Further, an exposure level of the captured video feed can be set based on the first participant acting as the active participant according to a brightness level in the one or more images associated with a face detection of the first participant in the one or more images.

Abstract: Crop synchronized auto focus and exposure may be provided. First, a command corresponding to a new crop region of a sensor of a camera may be received. Then new capture settings corresponding to the new crop region may be obtained. Next, a frame may be captured from the sensor of the camera according to the obtained new capture settings. The captured frame may then be cropped according to the new crop region.

Abstract: Systems, methods, and computer-readable media for automatically setting exposure levels in a session based on an active participant. In some embodiments, a method can include detecting faces of one or more participants in one or more images in a captured video feed at a location of the participants illuminated at one or more illumination levels at the location. The one or more detected faces can be associated with brightness levels of the one or more participants based on the one or more illumination levels at the location. Audio input can be received for the one or more participants at the location and a first participant can be identified as an active participant using the audio input. Further, an exposure level of the captured video feed can be set based on the first participant acting as the active participant according to a brightness level in the one or more images associated with a face detection of the first participant in the one or more images.