Abstract: The present invention is a method and a processing device that allows smoothing of all camera parameters that are changeable while the camera is running through a tasklist component that schedules transitions synchronized with the output video frame rate. A device-native thread runs the scheduler which picks smoothing tasks off a list to meet real-time requirements. Different strategies for smoothing based on Bézier curves, splines and linear interpolation are scheduled on the runtime. The camera, which is automatically able to detect people and frame them based on where they are, uses this module to smoothly change the frame when people move in the camera field of view, among other functions.

Abstract: Consistent with disclosed embodiments, systems and methods for analyzing video output streams and generating a primary video stream may be provided. Embodiments may include automatically analyzing a first video output stream and a second video output stream, based on at least one identity indicator, to determine whether a first representation of a meeting participant and a second representation of a meeting participant correspond to a common meeting participant. Disclosed embodiments may involve evaluating the first representation and the second representation of the common meeting participant relative to one or more predetermined criteria. Embodiments may involve selecting, based on the evaluation, either the first video output stream or the second video output stream as a source of a framed representation of the common meeting participant to be output as a primary video stream.

Abstract: Consistent with disclosed embodiments, systems and methods for analyzing video output streams and generating a primary video stream may be provided. Embodiments may include a video conferencing camera configured to generate a video output representative of an environment. The video conferencing camera may comprise a video processing unit configured to determine, for a plurality of subjects represented in the video output, whether each of the plurality of subjects is inside or outside of a meeting region within the environment. The video processing unit may be further configured to determine a frame configuration for a primary video stream, constituting a portion of the video output, to be shown on a display based on one or more characteristics of at least one subject, among the plurality of subjects, determined to be located inside the meeting region.

Abstract: Systems and methods are provided to power video conferencing and remote collaboration with subsymbolic and symbolic artificial intelligence. The autonomous video conferencing systems of this disclosure include one main smart camera and multiple peripheral smart cameras, optionally coupled with one or more smart sensors. Each smart camera is equipped with a vision pipeline supported by machine learning to detect objects and their interactions as well as related changes in gesture and posture, and a virtual director adapted to apply a predetermined rule set consistent with television studio production principles. The main camera is adapted to select and update a focus video stream in real time under the direction of its virtual director and stream the updated focus stream to a user computer. Methods for creating an automated television studio production for a variety of conferencing spaces and special-purpose scenarios with virtual director assistance are provided.

Abstract: The present invention is a method and a processing device that allows smoothing of all camera parameters that are changeable while the camera is running through a tasklist component that schedules transitions synchronized with the output video frame rate. A device-native thread runs the scheduler which picks smoothing tasks off a list to meet real-time requirements. Different strategies for smoothing based on Bézier curves, splines and linear interpolation are scheduled on the runtime. The camera, which is automatically able to detect people and frame them based on where they are, uses this module to smoothly change the frame when people move in the camera field of view, among other functions.

Abstract: Systems and methods are provided to power video conferencing and remote collaboration with subsymbolic and symbolic artificial intelligence. The autonomous video conferencing systems of this disclosure include one main smart camera and multiple peripheral smart cameras, optionally coupled with one or more smart sensors. Each smart camera is equipped with a vision pipeline supported by machine learning to detect objects and their interactions as well as related changes in gesture and posture, and a virtual director adapted to apply a predetermined rule set consistent with television studio production principles. The main camera is adapted to select and update a focus video stream in real time under the direction of its virtual director and stream the updated focus stream to a user computer. Methods for creating an automated television studio production for a variety of conferencing spaces and special-purpose scenarios with virtual director assistance are provided.

Abstract: Systems and methods are provided to power video conferencing and remote collaboration with subsymbolic and symbolic artificial intelligence. The autonomous video conferencing systems of this disclosure include one main smart camera and multiple peripheral smart cameras, optionally coupled with one or more smart sensors. Each smart camera is equipped with a vision pipeline supported by machine learning to detect objects and their interactions as well as related changes in gesture and posture, and a virtual director adapted to apply a predetermined rule set consistent with television studio production principles. The main camera is adapted to select and update a focus video stream in real time under the direction of its virtual director and stream the updated focus stream to a user computer. Methods for creating an automated television studio production for a variety of conferencing spaces and special-purpose scenarios with virtual director assistance are provided.

Abstract: Methods and systems are provided for enhanced audio experiences in VR/AR applications. The apparatuses of this disclosure are adapted to record multiple binaural stereo pairs and play back select binaural pairs corresponding to users' head positions. A substantially spherical microarray is utilized in various embodiments for recording multiple binaural stereo pairs. A VR/AR headset is further adapted to track a user's head positions and dynamically play back binaural sound pairs corresponding to the head positions.

Abstract: Systems and methods are provided for capturing time-stamped data from whiteboard video signals and producing high-resolution whiteboard images. Local patches around a multitude of pixels in the whiteboard are used in classifying background white pixels and foreground color pixels for each foreground marker color. Clustering is performed in alternative color spaces globally and locally in defining background white and each foreground marker color. Color normalization is performed for each foreground pixel classified as a foreground marker color and for each image sensor color plane separately utilizing the maximum local background white and the darkest pixel intensities in local patches. Strokes are reconstructed based on spline interpolation of inflection points of cross sections along the length of each stroke for a foreground marker color with a predetermined width.

Abstract: Systems and methods are provided for compensating bias introduced from various image signal processors (ISP) or ISP components while effectively reducing noise. An ISP stage such as spatial noise filtering, high dynamic range (HDR) interpolation, and demosaicking among others, often results in various types of biases and artifacts being introduced in the output frame. The methods and systems of this disclosure employ a convex combination of multiple input frames or blocks of pixels, to effectively reduce bias from a spatial noise filter, a debayer unit, or other ISP components, thereby providing improved spatiotemporal noise reduction solutions.

Abstract: The present invention is a method and a processing device that allows smoothing of all camera parameters that are changeable while the camera is running through a tasklist component that schedules transitions synchronized with the output video frame rate. A device-native thread runs the scheduler which picks smoothing tasks off a list to meet real-time requirements. Different strategies for smoothing based on Bézier curves, splines and linear interpolation are scheduled on the runtime. The camera, which is automatically able to detect people and frame them based on where they are, uses this module to smoothly change the frame when people move in the camera field of view, among other functions.

Abstract: A modular camera apparatus with a discontinuous snap joint is provided for snap-fitting a lens ring to a camera module enclosed in a main case of the camera apparatus, thereby improving the manufacture and assembly efficiency.

Abstract: Methods and systems are provided for enhanced audio experiences in VR/AR applications. The apparatuses of this disclosure are adapted to record multiple binaural stereo pairs and play back select binaural pairs corresponding to users' head positions. A substantially spherical microarray is utilized in various embodiments for recording multiple binaural stereo pairs. A VR/AR headset is further adapted to track a user's head positions and dynamically play back binaural sound pairs corresponding to the head positions.

Abstract: Methods and systems are provided for enhanced audio experiences in VR/AR applications. The apparatuses of this disclosure are adapted to record multiple binaural stereo pairs and play back select binaural pairs corresponding to users' head positions. A substantially spherical microarray is utilized in various embodiments for recording multiple binaural stereo pairs. A VR/AR headset is further adapted to track a user's head positions and dynamically play back binaural sound pairs corresponding to the head positions.

Abstract: Systems and methods are provided for alleviating bandwidth limitations of video transmission and enhancing the quality of videos at a receiver. In particular, an improved video transmission system is provided for generating high-resolution videos. The systems have therein a transmitter and a receiver; the transmitter includes an outer encoder and a core encoder, while the receiver includes a core decoder and an outer decoder. The outer encoder is adapted to receive the video from a source and separately output a salient video and an encoded background, and the outer decoder is adapted to merge the background with the salient video thereby producing an enhanced video. Also provided is a system that simulates pan-tilt-zoom (PTZ) operations without PTZ hardware. Further provided are methods for video transmission whereby a background model is initialized, a background independently encoded, updated incrementally, and the background and the updates transmitted independently from the video.

Abstract: Systems and methods are provided for capturing time-stamped data from whiteboard video signals and producing high-resolution whiteboard images. Local patches around a multitude of pixels in the whiteboard are used in classifying background white pixels and foreground color pixels for each foreground marker color. Clustering is performed in alternative color spaces globally and locally in defining background white and each foreground marker color. Color normalization is performed for each foreground pixel classified as a foreground marker color and for each image sensor color plane separately utilizing the maximum local background white and the darkest pixel intensities in local patches. Strokes are reconstructed based on spline interpolation of inflection points of cross sections along the length of each stroke for a foreground marker color with a predetermined width.