Abstract: A system and method for managing a conference call using a selective transmission unit (STU) to manage multiple client devices participating in the conference call. In one example, the STU uses video transmission parameters and video reception parameters from each of the client devices to control which video streams are sent by the client devices to the STU. The STU then sends particular received video streams to each of the client devices based on the video reception parameters of the respective client device.

Abstract: This application provides a data processing method and apparatus, a non-transitory computer-readable storage medium, and an electronic apparatus. The method includes the following steps: A server obtains stream control signaling transmitted by an interface machine, the interface machine being configured to obtain, from the server, audio and video data to be transmitted to a client. The server obtains, in response to the stream control signaling, a first transmission rate from the server to the interface machine. The server transmits audio data to the interface machine if the first rate is less than a first predetermined threshold, and discards video data in the same GOP as the audio data.

Abstract: The present disclosure relates to determining communication inclusivity amongst speakers during a user communication. Communication inclusivity is a targeted analysis that collectively evaluates speaking opportunities (provided and taken by users) during a user communication and thought completion during speech associated with the user communication. To derive communication inclusivity, a user communication is modeled as a probabilistic interaction between speakers, where a sequence of speaking states of the user communication is identified and analyzed. Non-limiting examples of speaking states comprise: active user speech; periods of silence; overlapping speakers; icon indication; questions in corresponding chat windows; combination states; other contextual signals; and any combination thereof. With these observed sequences of speaking states, a probability distribution is modeled over transitions between states to predict inclusivity of a user communication.

Abstract: Techniques are disclosed relating to a delayed presentation of authentication challenge for users, such as in the context of a chat session. In various embodiments, a server system receives an indication of a request for service initiated by a user in a chat session within an application executed by a client device. The request for service involves an authentication of the user that is dependent on the authentication being successfully completed within a particular time period after the authentication is initiated. The server system delays the initiation of authentication for the request for service until a readiness condition is satisfied. The readiness condition includes the server system being available to process the request for service, as well as subsequently detecting engagement with the user relating to the request for service. In response to the readiness condition being satisfied, the server system initiates the authentication of the user.

Abstract: Systems and methods are presented herein for modifying messages transmitted between a first computing device and a second computing device based on the determination of a context of messages transmitted between the first and second computing devices. A first message, prepared to be transmitted to a second computing device, is prepared at a first computing device. The message contains a reference and a context of the message is determined. Based on the reference and the context, a modification of the message is determined. In response to determining the modification, the message is modified and transmitted from the first computing device to the second computing device. The modification is performed relative to the reference and the context.

Abstract: Embodiments included herein generally relate to measuring a latency of a playback device. For example, a method includes: determining a first latency of a playback device; determining a second latency of the playback device; comparing the second latency to the first latency to determine whether an event occurred at the playback device; and in response to detecting a latency change between the second latency and the first latency indicating the occurrence of the event, adjusting a timing of a data stream provided to the playback device based on the latency change.

Abstract: Disclosed is a vehicular electronic device including a processor configured to receive information on a user gaze direction, to determine whether a user looks forward based on the information, to perform control to make a call using voice only upon determining that the user looks forward, and to perform control to make a call using voice and an image upon determining that the user does not look forward.

Abstract: Systems and methods are presented herein that facilitate temporally synchronizing, in real time, a separately sourced high quality audio segment of a live event with a video segment that is generated by a recording device associated with a member of the audience. An A-V Synchronization Application may synchronize a video segment of a live event that is generated from a personal electronic device of an audience member with a high quality audio segment that is separately sourced and generated by professional sound recording equipment at the live event. The result of the temporal synchronization is a high fidelity digital audio visual recording of the live event. In various, the audience member may stream, in real-time, the high fidelity digital audio visual recording to an additional electronic device at a different geo-location. In some examples, narrative audio segments may be also included as part of the high fidelity digital audio visual recording.

Abstract: A system and method are provided for automatically concatenating two or more audiovisual clips containing video input from multiple cameras, and producing a combined audiovisual file containing video that switches between the two video inputs. In some examples, two video inputs and an audio input are recorded synchronously and are synchronized. The audio input can be sampled to locate low-noise audio events. The audiovisual file contains video that switches between two or more camera angles at the low-noise audio events. In one aspect, pauses are automatically removed from the audiovisual files. In another aspect, the system detects switch-initiating events, and switches between camera angles in response to detecting a switch-initiating event.

Abstract: [Problem] An information processing device, an information processing method, and a recording medium that enable change in display of real space without being noticed by a communicatee are to be proposed. [Solution] An information processing device, including: a determining unit that determines a gazing state or a non-gazing state of a first user present in first real space, for a display object displayed by a display device of the first user, the display object being associated with second real space different from the first real space; and a display control unit that changes appearance of the display object when the gazing state has been changed to the non-gazing state.

Abstract: Examples disclosed herein provide an image capture device. As an example, the image capture device includes an image sensor, a shutter, and a touch-enabled layer disposed above the image sensor. A controller of the image capture device is to register a user touch interaction with the touch-enabled layer and, based on a gesture detected from the user touch interaction, cycle between engaging the shutter to cover the image sensor and disengaging the shutter to expose the image sensor.

Abstract: An electronic apparatus for social distancing alert notification based on location is provided. The electronic apparatus includes a first sensor mountable on a first living entity. The electronic apparatus stores information related to a plurality of detection ranges of the first sensor with respect to a plurality of specific geographic locations. The electronic apparatus acquires location information associated with the first living entity. The electronic apparatus compares the acquired location information with the plurality of specific geographic locations. The electronic apparatus sets the detection range of the first sensor from the plurality of detection ranges based on the comparison. The electronic apparatus detects a second living entity at the geo-location of the first living entity based on the detection range. The electronic apparatus controls output of a notification to the first living entity based on the detected second living entity is within the detection range of the first sensor.

Abstract: A source and a sink device are provided. The sink device includes: an interface configured to receive, from a source device, a content, and image quality-related data regarding a next scene to be output after a scene output from the sink device from among a plurality of scenes forming the content; a storage configured to store the image quality-related data received from the source device; and a processor configured to perform an image quality improvement process with respect to the next scene to be output using the stored image quality-related data.

Abstract: A processing system having at least one processor may establish a communication session between a first communication system of a first user and a second communication system of a second user, the communication session including first visual content, the first visual content including a first visual representation of the first user, and detecting a first action of the first visual representation in the first visual content in accordance with a first action detection model. The processing system may modify, in response to the detecting the first action, the first visual content in accordance with a first configuration setting of the first user for the communication session, which may include modifying the first action of the first visual representation of the first user in the first visual content. In addition, the processing system may transmit the first visual content that is modified to the second communication system of the second user.

Abstract: Techniques are described for detecting desynchronization between an audio stream and a video stream.

Abstract: Techniques are described for applying virtual makeup products. Virtual makeup products, in this context, may include a predefined effect and a configuration for the effect, wherein the predefined effect includes one or more layered visual filters. In an embodiment, a system in accordance with the present disclosure may acquire a base image of a face, acquire a defined region of the face over which to apply a selected virtual makeup product, and generate a makeup image including one or more layered and masked filters based on the selected virtual makeup product and the defined region of the face. After generating the makeup image, a composite image including the makeup image overlaid on the base image can be displayed so as to simulate the application of a real-world makeup product.

Abstract: A processing system having at least one processor may establish a communication session between a first communication system of a first user and a second communication system of a second user, the communication session including first video content of a first physical environment of the first user and second video content of a second physical environment of the second user, determine a first visualization action for a first physical object in the first physical environment in accordance with a first configuration setting of the first user for the communication session, obtain the first video content from a first camera of the first communication system, detect the first physical object in the first video content, and perform the first visualization action to modify the first video content. The processing system may then transmit first visualization information including the first video content that is modified to the second communication system.

Abstract: An electronic device comprises an input device comprising input circuitry, a display device, a communication circuit, and at least one processor configured to control the electronic device to: receive a text through the input device, transmit first information about the text to a server, control the communication circuit to receive second information associated with an image identified based on an emotional state of a first user, the emotional state of the first user being identified as a result of analysis of the text by a learning model trained using a database for a plurality of texts and a plurality of types of emotion and degrees of emotion and an emotional state of a second user conversing with the first user, and display the image based on the second information associated with the image.

Abstract: Provided is an intermediate unit including a first connect unit, a second connect unit, and an information bridge unit. The first connect unit is for connecting a camera unit having a first resolution in one of a spatial direction and a temporal direction. The second connect unit is for connecting a camera control unit for a camera unit having a second resolution lower than the first resolution in one of the spatial direction and the temporal direction. The information bridge unit is interposed between the first connect unit and the second connect unit and configured to bridge information exchanged between the camera unit and the camera control unit.

Abstract: Automated methods and systems are provided for performing acoustic echo cancellation of streaming audio for a plurality of participants who are each receiving the streaming audio from a host, and who are simultaneously engaged in remote audio communications with each other. The streaming audio is captured in memory as an audio signal copy for subsequent use in performing the acoustic echo cancellation. In this manner, participants may engage in remote audio communications with each other without receiving acoustic echoes of the streaming audio received by other participant computers, while still being able to individually hear the streaming audio outputted from their respective speakers.

Abstract: A method for configuring a path for intercepting user data, a method for intercepting user data, an apparatus, a system, a control plane entity and a user plane entity are provided. The method for configuring the path for intercepting user data comprises: acquiring a target to be intercepted and an intercepting interface address; configuring data path configuration information on a user plane entity GW-U according to the target to be intercepted and the intercepting interface address; sending the data path configuration information to the user plane entity GW-U so that the GW-U establishes a path for data transmission; initiating an establishment of an intercepting connection of an intercepting interface to an intercepting entity based on the intercepting interface address so as to transmit the data of the target to be intercepted.

Abstract: An interactive sign language response (ISLR) system and method are described herein. The method includes receiving, by the interactive sign language response system, a video call from a videophone used by a video calling party, the video call including a video signal between the videophone and the interactive sign language response system; sending, by the interactive sign language response system and by way of the video call, a video prompt to be displayed on the videophone of the video calling party; and detecting, by the interactive sign language response system and by way of the video call, a response from the video calling party to the video prompt. In at least one embodiment, the interactive sign language recognition system performs automatic sign language recognition to determine one or more gestures in the video signal.

Abstract: An image processing apparatus for controlling at least one, of a plurality of image capture apparatuses, the plurality of image capture apparatuses arranged to capture a plurality of images for generating a virtual viewpoint image, the image processing apparatus comprising: a determination unit configured to determine a region of interest in at least one image captured by the at least one image capture apparatus; and a control unit configured to control, if based on the determined region of interest it is determined to adjust an image quality of another image to be captured by the at least one image capture apparatus, the at least one image capture apparatus so that the image quality of the other image to be captured thereby is adjusted.

Abstract: In response to a detected presence of an intended target appliance within a logical topography of controllable appliances identity information associated with the intended target appliance is used to automatically add to a graphical user interface of a controlling device an icon representative of the intended target appliance and to create at a Universal Control Engine a listing of communication methods for use in controlling corresponding functional operations of the intended target appliance. When the icon is later activated, the controlling device is placed into an operating state appropriate for controlling functional operations of the intended target appliance while the Universal Control Engine uses at least one of the communication methods to transmit at least one command to place the intended target appliance into a predetermined operating state.

Abstract: Provided is an information processing apparatus that includes an acquisition unit and a generation control unit. The acquisition unit acquires input information including at least one of an image or audio of a first user. The generation control unit controls, on the basis of request information including a request to output information including at least one of an image or audio and the acquired input information, generation of output information related to the first user to be output by a terminal of a second user who is a communication partner of the first user.

Abstract: One variation of a method for video conferencing includes, at a first device associated with a first user: capturing a first video feed; representing constellations of facial landmarks, detected in the first video feed, in a first feed of facial landmark containers; and transmitting the first feed of facial landmark containers to a second device. The method further includes, at the second device associated with a second user: accessing a first face model representing facial characteristics of the first user; accessing a synthetic face generator; transforming the first feed of facial landmark containers and the first face model into a first feed of synthetic face images according to the synthetic face generator; and rendering the first feed of synthetic face images.

Abstract: Provided are a computer program product, system, and method for using at least one machine learning module to select a priority queue from which to process an Input/Output (I/O) request. Input I/O statistics are provided on processing of I/O requests at the queues to at least one machine learning module. Output is received from the at least one machine learning module for each of the queues. The output for each queue indicates a likelihood that selection of an I/O request from the queue will maintain desired response time ratios between the queues. The received output for each of the queues is used to select a queue of the queues. An I/O request from the selected queue is processed.

Abstract: A processing system having at least one processor may establish a communication session between a first communication system of a first user and a second communication system of a second user, the communication session including first visual content, the first visual content including a first visual representation of the first user, and detecting a first action of the first visual representation in the first visual content in accordance with a first action detection model. The processing system may modify, in response to the detecting the first action, the first visual content in accordance with a first configuration setting of the first user for the communication session, which may include modifying the first action of the first visual representation of the first user in the first visual content. In addition, the processing system may transmit the first visual content that is modified to the second communication system of the second user.

Abstract: A processing system having at least one processor may establish a communication session between a first communication system of a first user and a second communication system of a second user, the communication session including first video content of a first physical environment of the first user and second video content of a second physical environment of the second user, determine a first visualization action for a first physical object in the first physical environment in accordance with a first configuration setting of the first user for the communication session, obtain the first video content from a first camera of the first communication system, detect the first physical object in the first video content, and perform the first visualization action to modify the first video content. The processing system may then transmit first visualization information including the first video content that is modified to the second communication system.

Abstract: A terminal for connecting to a conference via a network according to an embodiment of the present invention includes an image acquisition unit configured to acquire each participant image received from a plurality of other terminals connected to the conference, a network monitoring unit configured to monitor performance of the network, an image analyzer configured to analyze the each participant image to acquire one or more of image information, speech information, and quality information of the each participant image when the performance of the network changes, and a quality controller configured to change the quality of at least some of the participant images according to the analysis result of the each participant image.

Abstract: A system and method are provided for automatically concatenating two or more audiovisual clips containing video input from multiple cameras, and producing a combined audiovisual file containing video that switches between the two video inputs. In some examples, two video inputs and an audio input are recorded synchronously and are synchronized. The audio input can be sampled to locate low-noise audio events. The audiovisual file contains video that switches between two or more camera angles at the low-noise audio events. In one aspect, pauses are automatically removed from the audiovisual files. In another aspect, the system detects switch-initiating events, and switches between camera angles in response to detecting a switch-initiating event.

Abstract: A system, method, and computer program are provided for transmitting face models based on face data points. In use, a first image is received and at least one face associated with the first image is identified. Next, a face model is created of the at least one face by determining a structure of the at least one face, wherein the face model includes one or more face data points. The face model is transmitted. Additionally, a real-time stream is enabled of the at least one face, and a real-time face model is determined of the real-time stream using the face model. The real-time face model is then transmitted.

Abstract: A video display hub is mounted in a common household area such as a kitchen or family room. During times that have been designated as being available for communications, devices in first and second households exchange and display blurred video, allowing users in each household to see vague shapes and movements of the other household. Upon noticing activity, a user in the first household may initiate a video conversation, causing the video from the first household to be unblurred and causing unobscured voice to be transmitted to the second household. A user in the second household may respond by allowing the video conversation to be fully enabled, allowing the video from the second household to be unblurred and unobscured voice to be transmitted back to the first household.

Abstract: A method and a device for generating a blurred image, and a mobile terminal are provided. The method includes the followings. According to preview image data acquired via two rear cameras of a dual-camera device, first depth-of-field information for a foreground region and second depth-of-field information for a background region in a current preview image are determined. In addition, a basic value of a blurring degree is acquired according to the first depth-of-field information and the second depth-of-field information. Furthermore, Gaussian blur process is performed on the background region according to the basic value of the blurring degree to generate the blurred image.

Abstract: There is provided an information processing device including a reception unit that receives data from a communication destination, a generation unit that generates spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations, and a display control unit that performs control so as to display the generated spatial image information on a display unit.

Abstract: A wearable apparatus is provided for capturing and processing images from an environment of a user. In one implementation, a system for facilitating collaboration between individuals includes a transceiver and at least one processing device. The at least one processing device is programmed to obtain and analyze one or more images captured by an image sensor included in a wearable apparatus. The at least one processing device is further programmed to detect, by the analysis, a visual trigger in an environment of a wearer of the wearable apparatus. The visual trigger may be associated with a collaborative action to be taken. The at least one processing device may be further programmed to use the transceiver to transmit an indicator relating to the visual trigger associated with the collaborative action to be taken.

Abstract: A first imaging unit and a second imaging unit are installed on a first site. An image captured by the first imaging unit and an image captured by the second imaging unit can be alternately displayed on a screen installed on a second site. When a first image, generated based on the image captured by the first imaging unit, is to be displayed on the screen, a display control system displays the first image on the screen irrespective of a position of a predetermined subject included in the first image. When a target image to be displayed on the screen is a second image generated based on the image captured by the second imaging unit, the display control system displays the second image in such a way as to locate an image of a predetermined subject included in the second image at a predetermined position of the screen.

Abstract: A method of video encoding is provided. The method includes downscaling a block of a frame of a video to generate a downscaled block. The method includes downscaling a reference block of a reference frame of the video to generate a downscaled reference block. The method includes processing the downscaled block to calculate first compression efficacy data indicative of a first efficacy of encoding the block using intra-frame prediction. The method includes processing the downscaled block and the downscaled reference block to calculate second compression efficacy data indicative of a second efficacy of encoding the block using inter-frame prediction. The method includes based on at least one of the first compression efficacy data or the second compression efficacy data, determining that the block is to be encoded using inter-frame prediction. Other methods of video encoding and a video encoder system are also provided.

Abstract: A device implementing a system for multiway audio-video conferencing includes a processor configured to receive, from a first device, indication of a first channel and a second channel for communicating content for an audio-video conference session. The first channel and the second channel correspond to different types of communication interfaces. The processor is further configured to receive, from the first device, a first request to subscribe to a first content stream for the audio-video conference session via the first channel, and to subscribe to a second content stream for the audio-video conference session via the second channel, and in response to receiving the first request, forward, to the first device, the first content stream via the first channel.

Abstract: Example stain and trash detection systems and methods are described. In one implementation, a method receives a clean image of a vehicle interior and a second image of the vehicle interior after a passenger has occupied the vehicle. The method quantizes the clean image and the second image to reduce noise and identifies differences between the clean image and the second image. Additionally, the method identifies at least one contour in the identified differences and classifies an area defined by the contour as one of a stain, dirt, trash, or another item.

Abstract: A processing system having at least one processor may establish a communication session between a first communication system of a first user and a second communication system of a second user, the communication session including first video content of a first physical environment of the first user and second video content of a second physical environment of the second user, determine a first visualization action for a first physical object in the first physical environment in accordance with a first configuration setting of the first user for the communication session, obtain the first video content from a first camera of the first communication system, detect the first physical object in the first video content, and perform the first visualization action to modify the first video content. The processing system may then transmit first visualization information including the first video content that is modified to the second communication system.

Abstract: Features relating to communicating delay information and minimizing aggregate processing delays corresponding to content streams, e.g., audio and video streams, in a multi-media communication session while still achieving stream synchronization, are described. Some embodiments are well suited for systems where video and audio streams are transcoded by different entities. In some embodiments downstream entities, e.g., transcoder and/or receiving end device, are informed about the delay introduced to at least one stream by one or more upstream devices, e.g., a transcoder. The downstream entity synchronizes the received content streams by adding artificial latency as needed to the relevant one of the streams based on the received delay information thereby avoiding unnecessary introduction of artificial delays at every transcoding node in the path.

Abstract: An encoder circuit includes a reduction circuit, a statistical processing circuit, a first motion search circuit, and a second motion search circuit. The reduction circuit generates reduced images of multiple patterns with respect to each of macroblocks. Each of frame images included in video is divided into the macroblocks. The statistical processing circuit performs statistical processing on motion vectors detected with respect to each of the macroblocks. The first motion search circuit selects one of the reduced images generated with respect to the frame image of a reference frame, based on the result of the statistical processing, and searches a first search range in the selected one of the reduced images so as to detect a first motion vector. The second motion search circuit searches a second search range set in the reference frame based on the first motion vector so as to detect a second motion vector.

Abstract: An imaging device that includes an imaging unit included K imaging elements, a display unit included K display areas, an image signal generation unit that generates partial image signals based on imaging signals output from the imaging unit, and outputs image signals to the display unit, and a timing control unit that outputs a timing when the image processing generation unit outputs the image signal based on display output line information and image processing line information, and the image processing generation unit outputs an image signal indicating an image to be displayed in a display target line in a case where the display output line information and the image processing line information indicate the display target line.

Abstract: An information processing apparatus includes: a first specifying unit that specifies a size of a display region of a video delivered by streaming, the video having a bit rate that is changeable during a playback; a second specifying unit that specifies a data amount of data temporarily stored for a period of the video to be next played back; and a third specifying unit that specifies a bandwidth in reception of the data. The information processing apparatus further includes a determining unit that determines a bit rate of the video that is played back based on the size, the data amount, and the bandwidth that are specified.

Abstract: To provide an information processing apparatus, an information processing method, and a program capable of producing the distance to a communication partner by using a three-dimensional expression to connect spaces, and realizing more comfortable communication. An information processing apparatus including: a reception unit configured to receive data from a communication destination; a generation unit configured to generate space image information in which an image corresponding to a space of the communication destination is disposed at a predetermined position in a three-dimensional space; and a display control unit configured to perform control such that the generated space image information is displayed on a display unit in a communication source.

Abstract: In one embodiment, a method includes receiving a request to establish an audiovisual streaming session between a first device and a second device; determining a level of network connectivity for a network associated with the first device or the second device; receiving data from the first device. The data may the data represent facial expressions of a user in a video captured by the first device. The data may be generated by the first device using the video based on: detections of a face and facial features of the user in the video and application of one or more subtractive filters using the detected face and facial features. The subtractive filters may be selected based on the level of network connectivity. The method may also include sending the data to the second device with instructions to process the data and display a representation of the user's facial expressions.

Abstract: Techniques are described for allocation hardware and/or bandwidth resources of a viewer device between a live streaming media content playback of a video player and a concurrently provided live chat. For example, the bandwidth used by the live chat can be adjusted based on the playback of the video player.

Abstract: The present invention pertains to a method for configuring an infrared audio transmission system comprising a signal generator and a plurality of radiators connected to said signal generator, the method comprising at least one of said plurality of radiators: receiving (1050) a delay compensation configuration message; and storing (1060) an amount of delay to be introduced into subsequently radiated signals in accordance with the received delay compensation configuration message. The invention also pertains to a configuration node (100) for configuring radiators in such a system, configured to: transmit (1010) at least one test signal to the radiators; detect (1020) events triggered by the test signal; determine (1030) respective transmission delays between the node and the radiators on the basis of these reflections; and transmit (1040) a delay compensation configuration message over said network, the delays being included in the delay compensation configuration message.

Abstract: A method for managing audio during a conference includes receiving, at a first buffer of a mobile device, a first audio stream from a first device associated with a first participant of the conference. The method also includes receiving, at a second buffer of the mobile device, a second audio stream from a second device associated with a second participant of the conference. The method further includes generating a control signal at a delay controller of the mobile device. The control signal is provided to the first buffer and to the second buffer to synchronize first buffered audio that is output from the first buffer with second buffered audio that is output from the second buffer.