Abstract: An example device includes a memory device, and a processor coupled to the memory device. The memory is configured to store audio spatial metadata associated with a soundfield and video data. The processor is configured to identify one or more foreground audio objects of the soundfield using the audio spatial metadata stored to the memory device, and to select, based on the identified one or more foreground audio objects, one or more viewports associated with the video data. Display hardware coupled to the processor and the memory device is configured to output a portion of the video data being associated with the one or more viewports selected by the processor.

Abstract: An image captured at a first moment in time is received. A user is identified by comparing at least one facial feature extracted from the image with user information stored in a database. It is determined whether the user observed a visual display by determining whether the visual display was within the visual field of the user. Upon determining that the user observed the visual display, the image is processed with a sentiment analysis module to determine a sentiment of the user. Further, it is determined, based on a record stored in a transaction database, that the user purchased the first product at a second moment in time, and an engagement index is generated for the visual display based on processing the determined sentiment of the user and a period of elapsed time between the second moment in time and the first moment in time.

Abstract: Devices, systems and methods are provided to support a party call with auto-joining function in a communication system for a distributed transport system that employs VoIP technology. A VoIP unit or end point acts as a conference bridge between an operator extension and other end points. A first end point makes a SIP call to the operator and multicasts a mix of its send audio and the received operator audio. Other end points first check for multicast traffic being received before making a SIP call to the operator and, if so, play out the received audio over its speaker and multicast its send audio. The end point initiating the call mixes this subsequent stream into a stream to the operator, effectively acting as the conference bridge to the operator. The other end points are responsible for mixing received multicast streams for their local speaker.

Abstract: Panoramic video transcoding methods, devices, and apparatuses are provided. The method involves a central processing unit (CPU) and a graphics processing unit (GPU) and includes decoding a panoramic video; mapping, at least partly using the GPU, the decoded video data to N visual angles, to obtain N channels of video data, in which N is more than 1; encoding the N channels of video data respectively to obtain N channels of video streams; and slicing and packing the N channels of video streams respectively.

Abstract: An image captured at a first moment in time is received. A user is identified by comparing at least one facial feature extracted from the image with user information stored in a database. It is determined whether the user observed a visual display by determining whether the visual display was within the visual field of the user. Upon determining that the user observed the visual display, the image is processed with a sentiment analysis module to determine a sentiment of the user. Further, it is determined, based on a record stored in a transaction database, that the user purchased the first product at a second moment in time, and an engagement index is generated for the visual display based on processing the determined sentiment of the user and a period of elapsed time between the second moment in time and the first moment in time.

Abstract: A method is disclosed for videoconferencing in a three-dimensional virtual environment. In the method, a position and direction, a specification of an emote, and a video stream are received. The position and direction specify a location and orientation in the virtual environment and are input by a first user. The specification of the emote is also input by the first user. The video stream is captured from a camera on a device of the first user that is positioned to capture photographic images of the first user. The video stream is mapped onto a three-dimensional model of an avatar. From a perspective of a virtual camera of a second user, the virtual environment is rendering for display to the second user. The rendered environment includes the mapped three-dimensional model of the avatar located at the position and oriented at the direction and the emote attached to the video stream-mapped avatar.

Abstract: Provided is an application stored in a computer-readable storage medium to perform a method of providing a video call service, the method including, in a first terminal, establishing a video call session between the first terminal and a second terminal; modulating and displaying an area of an image of a second user, except for an exposure area, the image of the second user being displayed in the first terminal; detecting a predetermined event during the video call session; and controlling a size of the exposure area based on the predetermined event.

Abstract: A communication apparatus comprises: one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the communication apparatus to function as: a communication unit configured to communicate with an external device; and a control unit configured to control first communication in which the communication apparatus operates as a client and second communication in which the communication apparatus operates as a server, in communication using the communication unit, wherein, when executing a connection operation of each communication in order to control the first communication and the second communication in parallel, the control unit matches a termination timing of the connection operation of the first communication and a termination timing of the connection operation of the second communication.

Abstract: A method for archiving a collaboration session regarding visual content is disclosed. A collaboration session is established from a collaboration server with participant nodes. The visual content is transmitted to the participant nodes. A first multimedia data stream, an annotation data object associated with an annotation to the visual content in timed correlation to a first time reference within the first multimedia data stream, and view parameters are received. A first session record entry associated with the multimedia data stream, the annotation data object, and the view parameters is stored into a session record. The session record includes a plurality of session record entries including the first session record entry. The session record is retrievable by other participant nodes for playing back of the collaboration session in sequence with the session record entries. The first session record entry is transmitted to other participant nodes.

Abstract: Technologies for streaming multi-user broadcasts include a broadcast management server configured to receive multimedia data captured of a user. The broadcast management server streams a multimedia broadcast including the multimedia data captured of the user to other users. Additionally, the broadcast management server is configured to receive a request to participate in the streamed multimedia broadcast from another user. Multimedia data captured of the other user is received in response to a determination that the request to participate in the streamed multimedia broadcast is accepted. The broadcast management server merges the multimedia data captured of the first and second users to generate a merged multimedia broadcast, which is streamed to other users. The broadcast management server also generates a broadcast feed for users. The broadcast feed includes streaming multimedia broadcasts and streaming merged multimedia broadcasts corresponding to other users. Other embodiments are described and claimed.

Abstract: An endpoint deployed in a room may analyze a video output of a video camera disposed within the room for an image of a microphone disposed within the room. Based on the analyzing, the endpoint may then detect the image of the microphone within the video output of the video camera. The endpoint may then determine if the microphone is receiving speech from an active speaking participant, who may be one of the one or more participants that are disposed within the room. In the event the microphone is receiving speech from the active speaking participant, the endpoint may then display on a video display the video output of the video camera that has been altered to show a framing of the active speaking participant.

Abstract: The invention provides a video conferencing system and a video conferencing method. The video conferencing system includes a sound sensor, an omnidirectional camera, and a processor. The sound sensor senses a first sound source and a second sound source, to provide a first positioning coordinate corresponding to the first sound source and a second positioning coordinate corresponding to the second sound source. The omnidirectional camera captures an omnidirectional conference image. The processor acquires a first facial image and a second facial image from the omnidirectional conference image according to the first positioning coordinate and the second positioning coordinate. The processor determines an image stitching order according to positions of the first facial image and the second facial image respectively in the omnidirectional conference image to generate a close-up conference image.

Abstract: Content determination, in an online collaboration environment, moved from each client to a server, where the server reviews signal characteristics to determine the content in the data stream, may be provided. First, an online collaboration server receives a data stream associated with an online collaboration session. A traffic analyzer at the frontend of the server analyzes the data stream to determine a signal characteristic. Based on the signal characteristic, the traffic analyzer generates a classification of a type of content in the data stream. This classification is sent to an online collaboration application at the client. The client can then adjust the encoding of the data based on the type of content in the data stream.

Abstract: Various embodiments disclose a method and apparatus for image correction. The apparatus includes at least one camera, a memory, and a processor. The processor is configured to obtain at least one image corresponding external objects using the at least one camera, identify depth information on the external objects using the at least one image, identify a first region, corresponding to a first external object having a first depth level related to the depth information, and a second region, corresponding to a second external object having a second depth level different from the first depth level. The processor is further configured to generate a first noise pattern by detecting noise included in the first region, perform bokeh processing on at least part of the second region, and generate a corrected image in which the first noise pattern has been at least incorporated into at least part of the bokeh-processed second region.

Abstract: A speaker estimation method that estimate the speaker from audio and image includes: inputting audio; extracting a feature quantity representing a voice characteristic from the input audio; inputting an image; detecting person regions of respective persons from the input image; estimating feature quantities representing voice characteristics from the respective detected person regions; Performing a change such that an image taken from another position and with another angle is input when any person is not detected; calculating a similarity between the feature quantity representing the voice characteristic extracted from the audio and the feature quantity representing the voice characteristic estimated from the person region in the image; and estimating a speaker from the calculated similarity.

Abstract: One embodiment provides a method, including: receiving, at an information handling device, an incoming communication; accessing, using a processor, context data associated with a user, wherein the context data corresponds to at least one active application; determining, using the context data, a work status of the user; and providing, responsive to the incoming communication, a status message associated with the determined work status. Other aspects are described and claimed.

Abstract: An audio signal processing method includes selecting a channel group of at least two channels according to a predetermined reference, from among audio signals of at least three channels; and controlling a gain of the audio signal of each channel of the selected channel group, according to a volume level of the audio signal of each channel of the channel group.

Abstract: A system includes an image capture device and one or more processors. The image capture device is configured to detect a plurality of images regarding a subject. The one or more processors are configured to receive the plurality of images, identify the subject using the plurality of images, detect a movement of the subject using the plurality of images, compare the movement to a predetermined movement pattern, generate a movement metric based on the comparison, and store, in a database, an association between a subject profile corresponding to the identified subject, the plurality of images, and the movement metric.

Abstract: To provide an information processing device, an information processing method, and a recording medium capable of appropriately presenting necessary information while maintaining scenery. An information processing device including: a communication unit configured to receive sensor data detected by a sensor for grasping a surrounding situation; and a control unit configured to perform control to generate a control signal for displaying an image including appropriate information on a display unit installed around the sensor, in accordance with at least one of an attribute of a user, a situation of the user, or an environment detected from the sensor data, generate a control signal for displaying a blending image that blends into surroundings of the display unit on the display unit in a case where information presentation is determined to be unnecessary, and transmit the control signal to the display unit via the communication unit.

Abstract: Disclosed herein are system, method, and computer program product embodiments for providing a local scene recreation of an augmented reality meeting space to a mobile device, laptop computer, or other computing device. By decoupling the augmented reality meeting space from virtual reality headsets, the user-base expands to include users that could otherwise not participate in the collaborative augmented reality meeting spaces. Users participating on mobile devices and laptops may choose between multiple modes of interaction including an auto-switch view and manual views as well as interacting with the augmented reality meeting space by installing an augmented reality toolkit. Users may deploy and interact with various forms of avatars representing other users in the augmented reality meeting space.

Abstract: A conference management system (“system”) facilitates data compliance in recording conversations between users. A host user can send an electronic invitation for a meeting to participants. Upon accessing the invitation, the participants can be presented with two options to join the conference—a first option using which a participant can join the meeting by providing consent to recording the meeting and a second option using which the participant can join the meeting by opting-out of recording of the meeting. When a participant opts-out of the recording of the meeting, the conference management system ensures that the recording is performed in compliance with a data compliance policy applicable to the participant who opted out of recording.

Abstract: Among other things, a first video is captured of at least the eyes of a first person who is looking along a video capture axis. A second video of at least the eyes of a second person is presented, along a display axis. The video capture axis and the display axis are aligned along a common axis so that the first person can view the second video of at least the eyes of the second person along the common axis when the first video of the eyes of the first person is being captured along the common axis. Instructions are executed to maintain an eye contact video interaction session between the first person and the second person using the captured video and the presented video.

Abstract: A Voice over Internet Protocol (VoIP) system is configured for direct communications between remote computing devices in a peer-to-peer configuration. Voice data from the communication is marked such that the voice data from the different endpoints can be combined into a unified audio stream. An authentication may be accomplished automatically prior to text or audio communication between a customer and a service agent. In some embodiments, authentication is accomplished automatically by authentication of the remote access device or accomplished by asking the customer questions. A single authentication of the remote access device may be used to authenticate a service request transferred between service agents. The authentication of the remote device may include, for example, use of a personal identification number, a fingerprint, a photograph, and/or a hardware identifier.

Abstract: An image display device includes: an image display unit which includes a display panel switchable between an image display mode in which an image is displayed and a transmissive mode in which the display panel is in a transmissive state where an object behind the image display unit is visible in a front view of the display panel; a controller which controls an operation of the display panel; and a lower shelf board which is a holding member. The lower shelf board is disposed projecting rearward from a rear surface of the image display unit and holds the controller in a housed state.

Abstract: A videoconferencing system includes a server adapted to store information associated with multiple videoconferencing rooms, each including a videoconferencing codec and a system controller, and the system controller is in communication with the server via one or more wired and/or wireless communication networks. The system includes a mobile computing device configured to exchange data with the server to determine whether at least one of the videoconferencing rooms is within a defined proximity of the mobile computing device, and in response to determining that at least one of the videoconferencing rooms is within the defined proximity of the mobile computing device, transmit one or more commands to the system controller located in the determined at least one videoconferencing room. The system controller is configured to control the videoconferencing codec located in the determined at least one videoconferencing room according to the one or more commands to establish or control a videoconference.

Abstract: Systems, methods, and computer-readable storage devices are for identifying a user profile for speech recognition. The user profile is selected from one of several user profiles which are all associated with a speaker, and can be selected based on the identity of the speaker, the location of the speaker, the device the speaker is using, or other relevant parameters. Such parameters can be hierarchical, having multiple layers, and can also be dependent or independent from one another. Using the parameters identified, the user profile is selected and used to recognize speech.

Abstract: Method and device for processing a video sequence containing a succession of images of one or more participant speakers, captured by a wide-angle camera. The method includes: capturing sound using a microphone having a plurality of sensors for capturing a sound field; processing the audio data captured by the microphone in order to determine at least one direction of origin of sound coming from a participant, relative to an optical axis of the wide-angle camera; generating a signal including data concerning the direction of origin of the sound relative to the optical axis of the camera, for the purpose of utilizing the signal when rendering the captured images by zooming into an area around the participant emitting the sound for which the direction of origin corresponds to the data of the signal.

Abstract: Embodiments include methods, systems and computer program products for scheduling a meeting based upon n state of being of a meeting participant. Aspects include receiving a request to schedule the meeting with the meeting participant, the request including a desired state of being of the meeting participant and a desired time period of the meeting. Aspects also include obtaining a calendar of the meeting participant for the time period and determining an expected state of being of the meeting participant during the desired time period based at least in part upon meeting information for one or more scheduled meetings on the calendar during the desired time period. Aspects further include identifying a meeting time during the desired time period, wherein the expected state of being for of the meeting participant at the meeting time is the same as the desired state of being.

Abstract: An augmented mirror comprising: a partially silvered mirrored surface; a screen underneath the mirrored surface; a camera; and a computer module for receiving data from the camera and for providing graphical images to the screen, wherein the field of view over which visual information is processed is reduced to visual information from within a visual corridor, the visual corridor corresponding to a subset of the field of view of the camera.

Abstract: Embodiments herein relate to methods, apparatuses, and computer program products for position stream session negotiation. An example method includes: transmitting, to a positioning system, a message for initiating a positional data stream associated with at least one audio source, the message comprising one or more requirements for positional characteristics of the positional data stream; receive a response from the positioning system comprising an indication of one or more of the positional characteristics that are supported by the positioning system for the at least one audio source; and initiating the position data stream with the positioning system based on the received response.

Abstract: The present disclosure is directed toward systems and methods for optimizing video conferences. For instance, systems and methods described herein optimize both the transmission and display of one or more video conference data streams. Systems and methods described herein optimize the transmission and display of one or more video conference data streams by identifying a context associated with the one or more video conference data streams and optimizing the one or more video conference data streams based on the identified context.

Abstract: A control method for an electronic device, an electronic device and a computer-readable storage medium are provided. An electronic device includes a transparent display screen and an infrared sensor. The transparent display screen includes a display area. The infrared sensor is stacked below the display area. The infrared sensor is configured to emit infrared light and receive infrared light reflected by an object, to detect a distance between the object and the electronic device. The control method includes operations as follows. It is determined whether the electronic device is in an outgoing call state. Control is performed to reduce the brightness of the transparent display screen in a case that the electronic device is in the outgoing call state. Control is performed to turn on the infrared sensor to detect a distance between the object and the electronic device.

Abstract: A network separation device that can separate an internal network and an external network with little changes in the networks in a video surveillance system providing monitoring picture data through the internal network and the external network. The network separation device receives monitoring picture data from a monitoring camera that acquires a monitoring picture, transmits outbound picture data unidirectionally to an external network client through an external network in response to a request of the external network client, and transmits inbound picture data to an internal network client through an internal network in response to another request from of the internal network client.

Abstract: The systems and techniques disclosed here feature a device including an audio analyzer connected to microphone(s) monitoring a conversation between one or more individuals. The audio analyzer can identify auditory expressions from audio captured by the microphone, where the auditory expressions can include linguistic expressions and nonlinguistic expressions. The audio analyzer can analyze the linguistic expressions to identify a topic and a time period when the topic was discussed. A video analyzer can be connected to camera(s) monitoring the conversation. The video analyzer can identify non-auditory expressions by the individuals from video captured by the camera. A sentiment analyzer can analyze auditory expressions during the time period when the topic was discussed and non-auditory expressions during the time period when the topic was discussed to determine sentiments to the topic. A processor can analyze the determined sentiments to the topic to determine a group sentiment to the topic.

Abstract: An example apparatus for generating panoramic video includes a number of modular wedges. Each of the modular wedges also includes two high resolution imaging sensors. Each of the modular wedges further includes two discrete lenses coupled to one side of the modular wedge. Each of the modular wedges also further includes two transceivers coupled to the imaging sensors to output video data.

Abstract: A radio access network intelligent controller (RIC) platform can enable various highly secure, reliable, fast communications for first responders during emergency situations. The RIC can utilize radio access network (RAN) resources, for example, beam management procedures to facilitate the use of virtual zones. The virtual zones can be generated dynamically by leveraging collaborating mobile devices from various zones. The virtual zones can be distributed entities that span across real-physical zones but are managed as a single logical entity under a common set of policies. The creation and management of virtual zones can be performed by a group of corresponding RICs as a distributed system.

Abstract: A system for disparity estimation includes one or more feature extractor modules configured to extract one or more feature maps from one or more input images; and one or more semantic information modules connected at one or more outputs of the one or more feature extractor modules, wherein the one or more semantic information modules are configured to generate one or more foreground semantic information to be provided to the one or more feature extractor modules for disparity estimation at a next training epoch.

Abstract: In one general aspect, a method can include receiving, at a server computing device, a launch request to launch and stream media content pertaining to a game session, the launch request being provided by a mobile device, selecting, using the launch request, a media host configured to stream the media content, verifying a user associated with the mobile device and launching the game session for streaming to the user on a device other than the mobile device. In addition, the method can include during the game session and while streaming the media content, receiving a plurality of real time control requests from the mobile device, and executing the control request by compositing, in real time, the at least one change and the media content and to produce a composite display and transmitting, to the device other than the mobile device, the encoded composite display for streaming in real time.

Abstract: The present disclosure provides a method and a device for adaptively controlling a multimedia blackboard, a medium, and an electronic apparatus. In the present disclosure, a three-dimensional model of a target space is established, and a distribution area of the students in a classroom may be obtained by an adaptive algorithm based on the three-dimensional model and an angle of the multimedia blackboard may be automatically controlled to ensure that the students can watch the multimedia blackboard better and reduce the fatigue feeling about the class, which helps in improving an efficiency of having the class.

Abstract: A method for detecting and flagging problems in videoconferencing is provided. The method includes measuring, by a processing device of a videoconferencing device, a first set of acoustic data associated with a conference room during a video conference attended by a plurality of users. The first set of acoustic data indicates one or more acoustic parameters, including the reverberation time, the signal-to-noise ratio, or the absolute noise level of the conference room. The method further includes determining whether the acoustic parameters suggest that a feedback is to be provided to one or more of the users regarding an action to be performed to improve the acoustic parameters during the video conference. Moreover, the method includes responsive to determining that the feedback is to be provided to at least one user, providing the feedback to the at least one user during the video conference.

Abstract: Disclosed in some examples are devices, systems, methods, and machine-readable mediums which provide for a network-based communication service that allows users in a network-based communication session to subscribe to video streams of the communication session that are of interest by subscribing to content features of those video streams rather than the video streams themselves. Content features may be any object in the video stream that is recognized by applying an image processing algorithm to one or more video frames. Example content features may include recognized users and/or other recognized objects.

Abstract: Systems and methods for multi-attendee video conferencing are described. A system can receive a request to stream video associated with a first attendee for a high-resolution display region and video associated with a second attendee for a low-resolution display region at a client device. The system can generate a first video stream for the first attendee at a first resolution for the high-resolution display region. The system can determine a second resolution for a second video stream for the second attendee that is larger than a requested resolution for the low-resolution display region. The system can determine a video quality for the second video stream at the second resolution based on maximizing use of a bandwidth. The system can generate the second video stream for the client device.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for selecting representative recent cover images from collections of digital portraits by determining selection scores based on average face vectors. For example, the disclosed systems can generate an average face feature vector to represent a common appearance or facial expression of a user in the collection of digital portraits. The disclosed systems can further determine representativeness scores that indicate measures of closeness of digital portraits to the average face feature vectors. In addition, the digital portrait selection system can determine various other factors, such as recency scores, face area scores, and face expandability scores. Based on these factors, the digital portrait selection system can determine an overall selection score and select a digital portrait as a cover image.

Abstract: An information processing apparatus includes processing circuitry; and a memory storing computer-executable instructions that cause the processing circuitry to create data for displaying a web page in a web browser on a display device of at least one communication terminal among a plurality of communication terminals; and transmit the created data to the at least one communication terminal. The web page includes a first area for displaying a shared screen to be shared among the plurality of communication terminals; and a second area including at least an image of the shared screen displayed in response to an acquisition request, which is accepted at the at least one communication terminal, to acquire the image of the shared screen, and an editable area.

Abstract: A head-mounted device may have a display that displays computer-generated content for a user. The head-mounted device may have an optical system that directs the computer-generated image towards eye boxes for viewing by a user. The optical system may be a see-through optical system that allows the user to view a real-world object through the optical system while receiving the computer-generated image or the optical system may include a non-removable lens and a removable vision correction lens through which an opaque display is viewable. The optical system may include a removable lens. The removable lens may serve as a custom vision correction lens to correct for a user's vision defects. The optical system may have a projection bias lens that places computer-generated content at one or more desired virtual image distances and a corresponding compensation bias lens.

Abstract: Methods and systems for augmenting communications using input data from mobile devices are described herein. A computing device may establish a connection with a mobile device having one or more input devices. The computing device may display a barcode that, when scanned by a mobile device, causes the mobile device to access a web page. The web page may be configured to cause the mobile device to transmit, e.g., via a web browser executing on the mobile device and to the computing device, input data from the input devices. The input data may be used by the computing device to replicate a physical input device connected to the computing device. The computing device may transmit the input data to a different computing device.

Abstract: A telemedicine system including a cart that allows for two-way audio/video conferencing between patients or local care providers and remote care providers or family members. The cart employs a modular design that allows its capabilities to be expanded to meet the needs of particular telemedicine applications. In addition, the cart provides thermal imaging and a user interface that allows local care provers to access various capabilities of the device while the device is not in session with a remote party.

Abstract: An electronic device display may have a color filter layer and a thin film transistor layer. A layer of liquid crystal material may be interposed between the color filter layer and the thin film transistor layer. A layer of polarizer may be laminated onto the surface of the color filter layer. Laser trimming may ensure that the edges of the polarizer are even with the edges of the color filter layer. The thin film transistor layer may have an array of thin film transistors that control pixels of the liquid crystal material in the display. Driver circuitry may be used to control the array. The driver circuitry may be encapsulated in a planarized encapsulant on the thin film transistor layer or may be mounted to the underside of the color filter layer. Conductive structures may connect driver circuitry on the color filter layer to the thin film transistor layer.

Abstract: A mixed-media ACD device is configured to monitor one or more encounter participants of a patient encounter and includes a machine vision system configured to obtain machine vision encounter information concerning the patient encounter. An audio recording system is configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices.

Abstract: A media playback apparatus and a method for synchronously reproducing video and audio on a web browser are provided. In the media playback apparatus, audio is buffered to be outputted at a time point at which video is outputted, thereby synchronizing the outputs of video and audio. The media playback apparatus may output the video in synchronization with the audio even when video and audio are decoded by different decoders. Therefore, it is possible to implement a decoder separately from a decoder embedded in a web browser in a non-plug-in environment, thereby reducing the dependency on the codec format of the media.