Abstract: A system and method for improving event and user communications and experiences. (e.g., managing meetings and their participants) is disclosed. By treating events such as meetings and their participants (meeting leaders and invited attendees) as a managed system, the present invention improves the quality and outcomes of meetings and the satisfaction of the participants. The present invention also makes joining of this intelligently-managed system particularly simple for new as well as returning participants, by providing a unique approach to the issues at the pre-meeting, meeting, and post-meeting phases in order to generate scores for the particular meeting, each participant (meeting leader and attendees), and a meeting graph linking the performance of each participant (meeting leader and attendees). This score is used to adjust and predict participant (meeting leader and attendees) behavior in subsequent meetings.

Abstract: One example system for displaying immersive scenes includes a processor and at least one memory device. The memory device includes instructions that are executable by the processor to cause the processor to receive a collection of metadata associated with an immersive scene, identify each of a plurality of properties of the immersive scene based on the collection of metadata, receive a dynamic immersive background, receive a plurality of video streams associated with a video conference, and display each of the plurality of video streams in the immersive scene based at least in part of the plurality of properties of the immersive scene and on the dynamic immersive background.

Abstract: Certain aspects of the present disclosure present a method for providing communication in a virtual world. The method generally includes receiving, via one or more microphones, voice data of a user corresponding to an avatar in the virtual world, selecting, from a plurality of devices associated with a plurality of other avatars in the virtual world, at least one device based, at least in part, on an intensity of the voice data of the user, and communicating the voice data to the selected at least one device.

Abstract: A method of visualising a meeting between one or more participants on a display includes, in an electronic processing device, the steps of: determining a plurality of signals, each of the plurality of signals being at least partially indicative of the meeting; generating a plurality of features using the plurality of signals, the features being at least partially indicative of the signals; generating at least one of: at least one phase indicator associated with the plurality of features, the at least one phase indicator being indicative of a temporal segmentation of at least part of the meeting; and at least one event indicator associated with the plurality of features, the at least one event indicator being indicative of an event during the meeting. The method also includes the step of causing a representation indicative of the at least one phase indicator and/or the at least one event indicator to be displayed on the display to thereby provide visualisation of the meeting.

Abstract: Methods and systems are provided for accurately filling holes, regions, and/or portions of high-resolution images using guided upsampling during image inpainting. For instance, an image inpainting system can apply guided upsampling to an inpainted image result to enable generation of a high-resolution inpainting result from a lower-resolution image that has undergone inpainting. To allow for guided upsampling during image inpainting, one or more neural networks can be used. For instance, a low-resolution result neural network (e.g., comprised of an encoder and a decoder) and a high-resolution input neural network (e.g., comprised of an encoder and a decoder). The image inpainting system can use such networks to generate a high-resolution inpainting image result that fills the hole, region, and/or portion of the image.

Abstract: Presented herein is a stage area for “focused” video that is configured to allow for dynamic layout changes during an online video conference or meeting. By providing a user interface environment that allows a user (meeting participant) to customize the stage, each participant can choose their own view, and the meeting host can fully customize a view for every participant in the meeting.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing a room preview within a virtual conferencing system. The program and method provide for virtual conferencing between plural participants within a first room of plural rooms, the plural rooms being included within a virtual space for virtual conferencing; and for each of the plural participants, provide a first audio channel associated with audio output of the first room, provide display of a room preview element within the first room, the room preview element corresponding to a live preview of a second room of the plural rooms, and provide a second audio channel associated with audio output of the second room.

Abstract: A video recording process is commenced by a camera of a device. The video recording process produces a sequence of frames. While the video recording process is in progress, a gesture directed at the device is detected. A new first frame from the sequence of frames is displayed in a camera view user interface (UI) of the device, based on a characteristic of the gesture. A video file is generated using frames captured during the video recording process and the new first frame is set as a starting point of the video file.

Abstract: A method of videoconferencing comprises displaying an image of a remote user on a display and capturing an image of a local user at a user position in front of the display. The at least one camera is located at a camera position behind the display. The method comprises modifying an image to be displayed based on the camera position of the at least one camera with respect to the display and based on the user position of the local user with respect to the display.

Abstract: Embodiments of the present invention disclose techniques for outputting content aware video based on at least one a video application use case. The technique recognizes objects associated with the use case and performs enhancement of the objects based on content-aware rules, and composes at least some of the objects in an output frame based on on content-aware frame composition templates. Embodiments of the present invention also disclose systems for implementing the above techniques.

Abstract: In one aspect, an apparatus may include at least one processor and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to permit a first device to change one or more settings that are related to a video conference and that are associated with a second device's outbound stream of one or more of audio and video as part of the video conference. The instructions may also be executable to receive first input to change the one or more settings, where the first input may be instigated at the first device. Based on permitting the first device to change the one or more settings and based on receipt of the first input to change the one or more settings, the instructions may then be executable to change the one or more settings.

Abstract: A videoconferencing system includes a camera acquiring image data and a microphone array acquiring audio data. Image data is used in conjunction with sound source localization (SSL) data to locate a talker depicted in the image data. SSL processes the audio data and determines SSL pan angle values indicative of an estimated direction of a sound. Columns of pixels in an image are associated with bins. A bin count is incremented for each SSL pan angle value of the audio data that falls within a given bin. A bounding box in the image data is determined that encompasses a face depicted in the image data. A range of pixels is determined for the bounding box, such as extending from a leftmost column to a rightmost column. The bin with the highest bin count that also overlaps a range of pixels for a bounding box is deemed to contain the talker.

Abstract: A screen projection control method, storage medium and communication apparatus are provided. The screen projection control method includes: a screen projection receiving end receiving screen projection request information from a first screen projection sending end; determining, according to the screen projection request information, whether a third screen projection sending end that has triggered an interference-free mode of screen projection exists in at least one second screen projection sending end that is performing screen projection, wherein enabling the interference-free mode comprises stopping accepting a screen projection request; and if the third screen projection sending end that has enabled the screen projection interference-free mode exists, the screen projection receiving end sending response information for refusing the screen projection request to the first screen projection sending end.

Abstract: One variation of a method for monitoring occupancy in a work area includes, at a sensor block: transitioning from an inactive state into an active state when an output of a motion sensor indicates motion in a work area; during a scan cycle in the active state, recording an image through an optical sensor at a time, detecting a set of humans in the image, detecting a second set of human effects in the image, predicting a second set of humans occupying but absent the work area based on the second set of human effects, and estimating a total occupancy in the work area at the time based on the set of humans and the second set of humans; and transmitting the total occupancy to a remote computer system for update of a scheduler for the work area.

Abstract: Management of web conference assets in a content management system. At the conclusion of a web conferencing session, an event is raised at the content management system. Various web conference assets (e.g., recordings) and web conference parameters are analyzed in conjunction with content management system metadata. Based on the analysis, one or more actions to perform on the web conference assets are determined. The content management system metadata may include user profile information of at least one web conference participant. Rules and/or a classification model that considers then-current conditions at the content management system are used singly, or in combination, to determine action characteristics and/or labels such as a retention period or security classifications to apply to the web conference assets. The web conference assets are stored in a hierarchical directory at the content management system. The hierarchy of the directory is derived from aspects of the web conferencing facility.

Abstract: A telephone call is elevated to a virtual meeting while maintaining the telephone call as an audio channel of the virtual meeting for an audio-only caller. During a telephone call, one of the participants of the telephone call requests to switch the telephone call to a virtual meeting. To enable an audio-only caller participating in the telephone call to switch to the virtual meeting, a message is transmitted to the phone device of the audio-only caller. Responsive to an interaction with the message at the phone device, the phone device is connected to the virtual meeting in which the telephone call is maintained as the audio channel at least for the audio-only caller. The specific form and content of the message is based on whether a client application associated with a web service used to implement the virtual meeting is installed on the phone device.

Abstract: A method for controlling effects on a live video stream includes providing a video image from a content creator device and displaying the video image on a first viewer device. A selection of a sticker graphic is received on the first viewer device. A position of a user input operation on the displayed video image is determined. The determined position of the user input operation on the displayed video image is converted to a position of the user input operation on the video image. The selected sticker graphic is applied to the video image at the position of the user input operation on the video image. The applied sticker graphic is displayed along with the video image on at least the first viewer device.

Abstract: Aspects of the present disclosure are directed to a mini-map coordination system that can facilitate interactions between co-located and non-co-located users by providing a min-map through an artificial reality system. The mini-map can be a representation of a virtual space that corresponds to a real-world space in which some users are located and that other users join virtually. Users can join the space by entering the real-world space or by remotely logging into the virtual space. Users who have joined the virtual space can be represented in the mini-map by avatars. Users moving their avatars around the mini-map can trigger interactions, such as automatically initiating a holographic call between the users whose avatars come within a threshold distance of each other. The system can allow remote users to observe social norms such as requiring a user to “knock” before their avatar is allowed to enter a private space.

Abstract: A user requests to join a meeting is detected. The meeting includes a meeting audio stream of one or more participant audio streams that include participant timestamps that correspond to when one or more other users are in the meeting. The user is prompted for an authentication credential based on the detecting the request to join the meeting. A participant profile of the user is determined based the authentication credential. The user is authorized access to the meeting and a first timestamp is saved. A first audio stream of the user is recorded. The user is identified as having left the meeting and a second timestamp is saved. A transcript of the meeting audio stream is generated based on the first audio stream and the one or more participant audio streams. The first timestamp, the second timestamp, and the meeting are associated with the participant profile.

Abstract: A computer-implemented method for modifying audio-based communications produced during a conference call is disclosed. The computer-implemented method can include monitoring a plurality of utterances transmitted via an audio feed of a device connected to the conference call. The computer-implemented method can identify a first unwanted audio component transmitted via the audio feed. The computer-implemented method can actively modify the audio feed by removing the first unwanted audio component from the audio feed.

Abstract: A system may detect a participant of a video conference, such as by facial recognition, voice detection, beaconing from a device, login information, location information, or calendar information. The system may identify the participant as a particular person, a person belonging to a particular group, or a person in a particular geographic region. The system may determine one or more configurations specific to the participant for altering functionality of one or more components available for use during the video conference. The one or more configurations may be determined based on one or more preferences of the participant and a priority associated with the functionality. The system may apply the one or more configurations during the video conference.

Abstract: A method and a device for signaling multiple audio mixing gains in a teleconference using Real-time Transport Control Protocol (RTCP) feedback. The method includes receiving an input audio stream from a 360-degree video stream, the input audio stream including mixing gains, declaring an RTCP feedback rate for receiving the mixing gains, based on an allocated bandwidth, and signaling the mixing gains using the declared RTCP feedback rate. The mixing gains may include audio gains from the input audio stream and audio gains from overlay audio streams. The RTCP feedback rate used for signaling the mixing gains may be constant or event-based feedback rate.

Abstract: Systems and methods for predicting an outcome for a marketing asset. The systems and methods comprise first determining by a computing device, for a marketing asset received by the computing device, at least one asset type of the marketing asset. The marketing asset is parsed, by the computing device, into a plurality of segmented components, based on the determined at least one asset type. For at least one of the plurality of segmented components, at least one discrete marketing message conveyed by the marketing asset is determined, by applying at least one of a predictive model or rules to the at least one segmented component, where the at least one predictive model or rules are stored in a memory associated with the computing device. The method further includes determining, for each of the at least one discrete marketing message, at least one associated score.

Abstract: Provided is a media control device system including a media control device including: a user interface configured to receive user input; and a communication interface configured to establish communication with a separate computing device.

Abstract: The techniques disclosed herein provide controlled user interface transitions for private breakout communication sessions. A system provides a Together Mode user interface that gives participants of a communication session a feeling that they are in the same room. When a person joins a communication session, a system uses a seating policy to determine a location of that user. That user is placed near or next to a select user meeting one or more conditions. If a number of people join the communication session, each person is ranked according to an organizational chart and each person is positioned and ordered relative to the select user according to each person's rank. The system configures the updated user interface arrangement to maintain the position of the select group of the participants.

Abstract: A method enabling digital automation of virtual events comprises providing a virtual environment enabling interactions between users represented by user graphical representations created from media feeds received from corresponding user cameras; responsive to a session request received from at least one client device, setting up a virtual event session between at least two users; obtaining an event flow rule set comprising a plurality of rules, the rule set determining an event flow sequence comprising presentation of media streams of the users in the virtual event session; applying the event flow rule set to the media streams of the users in the virtual event session; and, responsive to the application of the event flow rule set to the media streams, triggering an event flow action in real time in the virtual event session, wherein the triggered event flow action comprises modifying presentation of a media stream in the virtual event session.

Abstract: A system can automatically adjust a virtual background used by a participant in a video conference to match lighting level conditions present in a foreground of a participant video stream captured at a participant device. The matching can be done by adjusting one or more virtual background parameters, including but not limited to, exposure, brightness, contrast, and ISO. In some implementations, the system can dynamically or automatically adjust the lighting levels of the virtual background based on changes that may occur to the lighting level of the foreground during the video conference.

Abstract: One or more lighting fixtures are auto-focused on selected persons in a venue who are performers of a performance occurring at the venue. Each of the performers are associated with a tag of a real-time location system (RTLS). The auto-focusing operates by receiving a signal indicating a scene of a performance that is currently being performed, identifying which RTLS-tagged performer or performers are active during the currently performed scene, identifying the position(s) of the RTLS-tagged performer or performers who are active during the currently performed scene, and auto-focusing the one or more lighting fixtures on the identified position(s) of the RTLS tag.

Abstract: A conference device comprising a first image sensor for provision of first image data, a second image sensor for provision of second image data, a first image processor configured for provision of a first primary videostream and a first secondary videostream based on the first image data, a second image processor configured for provision of a second primary videostream and a second secondary videostream based on the second image data, and an intermediate image processor in communication with the first image processor and the second image processor and configured for provision of a field-of-view videostream and a region-of-interest videostream, wherein the field-of-view videostream is based on the first primary videostream and the second primary videostream, and wherein the region-of-interest videostream is based on one or more of the first secondary videostream and the second secondary videostream.

Abstract: An electronic device and a control method thereof are provided. The electronic device includes a camera, a microphone, a display, a communicator including circuitry, a memory, and a processor configured to capture an image of an external device through the camera and obtain information on the external device, based on a user's voice for requesting for solution information for solving a problem regarding the external device being input through the microphone while obtaining the information on the external device, control the communicator to transmit the input user's voice and the information on the external device to a server, receive a content related to the solution information from a content of a device related to the external device from the server via the communicator, and control the display to provide the content related to the solution information along with the captured image.

Abstract: An avatar display device includes: an obtaining part that obtains captured image data of a person; a second obtaining part that obtains, from the captured image data, depth data or image data of the person; a generating part that composes a 3D model in accordance with the depth data or image data to generate an avatar; and a display part that displays, in an image display area of an information communication device, the avatar that is caused to follow a motion of the person.

Abstract: One or more cameras are auto-focused on selected persons in a venue who are performers of a performance occurring at the venue. Each of the performers are associated with a tag of a real-time location system (RTLS). The auto-focusing operates by receiving a signal indicating a scene of a performance that is currently being performed, identifying which RTLS-tagged performer or performers are active during the currently performed scene, identifying the position(s) of the RTLS-tagged performer or performers who are active during the currently performed scene, and auto-focusing the one or more cameras on the identified position(s) of the RTLS tag.

Abstract: One variation of a method for monitoring occupancy in a work area includes, at a sensor block: transitioning from an inactive state into an active state when an output of a motion sensor indicates motion in a work area; during a scan cycle in the active state, recording an image through an optical sensor at a time, detecting a set of humans in the image, detecting a second set of human effects in the image, predicting a second set of humans occupying but absent the work area based on the second set of human effects, and estimating a total occupancy in the work area at the time based on the set of humans and the second set of humans; and transmitting the total occupancy to a remote computer system for update of a scheduler for the work area.

Abstract: A method including: establishing connections, at a server, to at least two client devices using a call control protocol, the call control protocol negotiating video formats and connection information for sending and receiving media streams; receiving information from a first client at the server, the information comprising meta-data describing different media streams the first client is configured to transmit; transmitting the information received from the first client to the at least one other client; receiving a subscribe message from the at least one other client at the server, subscribing to at least one available media stream from the first client; in response to receiving at least one subscribe message from the at least one other client, transmitting, by the server, a message instructing the first client to start transmitting media streams subscribed to by the at least one other client.

Abstract: One example method for displaying ephemeral content in video conferences includes receiving a video conference stream at a client device, displaying the video conference stream on a display in communication with the client device, displaying a content layer over the video conference stream on the display, receiving a content item from a user input device in communication with the client device, displaying the content item in the content layer at a first time, and when a predetermined period of time has elapsed from the first time, automatically removing the content item from the content layer.

Abstract: A camera is auto-focused on a person in a venue who is wearing, or carrying, or holding, or speaking into a microphone at the venue by detecting when a microphone having a real-time location system (RTLS) affixed thereto is active, identifying the position of RTLS tag, and auto-focusing the camera on the identified position of the RTLS tag.

Abstract: The present technology is generally directed to multi-user screen sharing. In some embodiments, a method for media content screen sharing includes receiving a first media content item selection from a first user and receiving a second media content item selection from a second user. The method can further include generating a multi-content video signal, wherein the multi-content video signal includes the selected first media content item and the selected second media content item. The multi-content video signal can be displayed to both the first user and the second user. The method can include causing a first electronic device of the first user to display a first portion of the multi-content video signal that corresponds to the selected first media content item, and causing a second electronic device of the second user to display a second portion of the multi-content video signal that corresponds to the selected second media content item.

Abstract: A method includes receiving a plurality of video data associated with a plurality of users in an electronic conference. The method further includes processing the plurality of video data to determine whether an action of a user matches an active communicator action. In response to determining that the action of the user matches the active communicator action, the method further includes determining that the user intends to actively communicate audio or video data in the electronic conference. Moreover, the method includes identifying the user as an active communicator within the electronic conference.

Abstract: The present disclosure describes systems and methods operating a set remotely, and more specifically, for enabling the control of a remotely adjustable audio-visual recording device as well as the communication between the remotely adjustable audio-visual recording device and various specialty devices of a cloud control center configured to remotely control features of the remotely adjustable audio-visual recording device. In operation, a talent component may receive a user input indicative of turning on the r remotely adjustable audio-visual recording device. Based on receiving the user input, the talent component may automatically connect, via a network, to a cloud control center. Based on connecting to the talent component, the cloud control center may remotely control the remotely adjustable audio-visual recording device an enable the remote recording of audio-visual content.

Abstract: An acquisition unit acquires image data by performing screen capture of a screen operated by a user, at a predetermined interval. A detection unit detects the user operation. An estimation unit estimates an amount of delay time from a user operation time point to a time point at which the user operation is detected by the detection unit. The selection unit selects image data of the user operation time point out of the acquired image data.

Abstract: The server system hosts one or more virtual client devices executing one or more virtual applications, each virtual client device corresponding to a remote physical client device. The server system receives, from a first remote physical client device, a signal of a characteristic of media detected by a physical component of the first remote physical client device. The server system, in response to receiving the signal of the characteristic of the media, determines, based on the characteristic of the media, an instruction for adjusting the media detected by the physical component of the first remote physical client device and transmits, to the client device, the instruction for adjusting the media at the first remote physical client device.

Abstract: A camera includes an image processor configured to generate an image or a video data, an intelligent processor configured to perform intelligent analysis and to process on the image or the video data, and a communications interface configured to receive, from an external device, configuration information for the camera, where the configuration information extends a function of the camera.

Abstract: An electronic device, computer program product, and method are provided that automatically focus on meaningful content in an image stream during an instruction-oriented video communication session. The electronic device communicatively connects the electronic device via a network to image stream transmitting (IST) electronic device(s) during a video communication session. A controller of the electronic device identifies a person and a writing surface within an image stream received from the IST electronic device. In response to determining that the person is attending to the writing surface, the controller presents on display device(s) a first portion of the image stream that focuses on the writing surface. In response to determining that the person is not attending to the writing surface, the controller presents on the display device(s) a second portion of the image stream that does not focus on the writing surface.

Abstract: A virtual space management unit 60 generates a virtual space information and manages the virtual space information. An icon position acquisition unit 61 acquires icon position information of each of the users U. A transmission-side voice acquisition unit 62 acquires a transmission-side voice information. A distance calculation unit 63 calculates a distance between each of the icons based on a position within the virtual space of the icons corresponding to each of the users U. A correction factor determination unit 64 determines a correction factor of an output information based on the distance between the icons calculated by the distance calculation unit 63. A reception-side voice transmission control unit 65 transmits the acquired transmission-side voice information and the determined correction factor to each of the second user terminals 3.

Abstract: A method, system, device for improving a user's visual presentation on screen during a communication session including a video portion. The method includes an image capturing device (e.g., a camera) that acquires an image of a local participant during a video communication session, a processing unit that determines a position of the local participant on the screen/within the camera frame, and a control unit that alerts the local participant if an adjustment is necessary to obtain an optimal position, lighting, etc., wherein the optimal position comprises the user's head and shoulders being displayed predominantly on the screen.

Abstract: Techniques are disclosed for allowing remote participation in collaborative video review based on joint state data, for a video collaboration session, maintained by a video collaboration service. A user at a participant client device may provide one or more annotations, such as a drawing annotation, for the video data via a client application. The client application transmits computer-readable instructions for re-creating the drawing annotation to the service, which distributes the drawing instructions to the other participant client devices. Using the drawing instructions, the client applications at the client devices are configured to re-create the drawing annotation on the associated video frame displayed at the client devices. The joint state data communicated to client devices for a given session may include co-presence data that efficiently increases communication among the participants in a session.

Abstract: A conferencing system for conferencing between multiple local conferees within a first conference space and at least a first remote conferee located remotely from the first conference space includes an emissive surface located within the first conference space for generating at least first and second video representations of the remote conferee and at least a first processor for driving the emissive surface to simultaneously present at least the first and second video representations on the emissive surface. The first video representation shows the remote conferee from a first perspective and the second video representation shows the remote conferee from a second, different perspective. The first video representation is observable from within a first viewing zone and not within a second viewing zone within the conference space, and the second video representation is observable from within the second viewing zone and not within the first viewing zone.

Abstract: A computer-implemented visitation system includes tablet computer devices accessible to respective ones of authorized incarcerated inmates inside a correctional facility, and a visitation services computer system. The tablet devices and visitation services system are configured to: accept login credentials to uniquely identify one pre-registered authorized incarcerated inmates; establish an interconnection between a visitor computer device and the tablet computer devices to commence video visitation sessions without requiring endpoint control to schedule or initiate the visitation session by administrative personnel of the correctional facility; and apply a video visitation session charge.

Abstract: An electronic device includes a traffic redirect module that creates a traffic sink interface that enables data to be sent to it, without generating an error if an underlying physical link does not exist. To send data over a physical link, a processor of the electronic device creates a network interface to connect to another electronic device using a transport connection over the physical link. If the physical link disconnects, then the processor removes the network interface, and the traffic redirect module redirects data to be sent to the other electronic device to use the traffic sink interface, without indicating that the physical link has disconnected. When the physical link reconnects, or a new physical link to the other electronic device is established, the processor creates a new network interface to connect to the other electronic device using the transport connection over the reconnected or new physical link.

Abstract: A video conferencing system is provided, which includes at least one camera device, a microphone array device, a sound output device, and a processor. The processor is configured to: receive multiple image signals converted by an image shot by the at least one camera device, and receive multiple voice signals converted from multiple voices captured from the microphone array device; and select at least one sound source signal corresponding to multiple personnel positions from the multiple sound signals according to the image signal and the multiple voice signals, so as to transmit at least one sound source signal corresponding to the multiple personnel positions to the sound output device, where the sound output device converts at least one sound source signal into sound for play. In addition, a video conferencing method is also disclosed herein.