Abstract: A measurement method for measuring video latency induced by a piece of video playback equipment that is connected to a piece of decoder equipment having a photosensitive sensor incorporated therein, the method including the steps of: causing a screen of the video playback equipment to generate emitted light test signals; using the photosensitive sensor to acquire captured light signals including received light test signals resulting from the emitted light test signals being reflected on at least one surface of surroundings of the video playback equipment; acquiring measurement signals produced by the photosensitive sensor from the captured light signals, and analyzing the measurement signals in order to obtain a video latency measurement.

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for managing extended reality video conferences. In one implementation, the computer-readable medium may include instructions to cause a processor to: receive a request to initiate a video conference between a plurality of participants; receive image data captured by at least one image sensor associated with a wearable extended reality appliance, the image data reflecting a layout of a physical environment in which the wearable extended reality appliance is located; analyze the image data to identify at least one interference region in the physical environment; receive visual representations of the plurality of participants; and cause the wearable extended reality appliance to display the visual representations of the plurality of participants at multiple distinct locations other than in the at least one interference region.

Abstract: A recording of a conference is selectively configured to include only certain conference content. A server receives, from a requesting user device, a request to generate a recording of a conference. The server outputs, to the requesting user device based on the request, a graphical user interface listing content of the conference to include within the recording of the conference. The content comprises at least one of: audio content from one or more participant user devices connected to the conference, camera-generated video content from the one or more participant user devices, or screensharing video content from the one or more participant user devices. The server receives, via the graphical user interface, a selection of a subset of the content to include in the recording of the conference. The server generates the recording of the conference according to the selection of the subset of the content.

Abstract: Methods, apparatus and systems for geometric matching of virtual reality (VR) or augmented reality (AR) output contemporaneously with video output formatted for display on a 2D screen include a determination of value sets that when used in image processing cause an off-screen angular field of view of the at least one of the AR output object or the VR output object to have a fixed relationship to at least one of the angular field of view of the onscreen object or of the 2D screen. The AR/VR output object is outputted to an AR/VR display device and the user experience is improved by the geometric matching between objects observed on the AR/VR display device and corresponding objects appearing on the 2D screen.

Abstract: A system, method and device operable to produce a video are disclosed herein. The system, method and device, in an embodiment, involve a recording session resulting in a video track. During the recording session, inputs are received at different points in time and a set of data markers are stored based on each one of the inputs. Each set has a first data marker and a second data marker, and the first data marker is chronologically located before the point in time of the input related to the set. Before or after the recording session, an additional input is received that is associated with an output. The output includes a visual output, an audio output or a combination thereof. A video is produced that has one or more desired portions of the video track. The video excludes at least one undesired portion of the video track, and the video includes the output or is otherwise playable to provide the output.

Abstract: An electronic device, method and computer program product provide multiple simultaneous camera previews of different imaging modes of the same image. The electronic device includes at least one image capturing device that generates a photographic image stream. The electronic device includes an image processing module that simultaneously produces more than one camera previews of the photographic image stream in different imaging modes. The electronic device includes a display driver. A controller of the electronic device is communicatively coupled to the at least one image capturing device, the image processing module, the display driver, and a first display device. The controller receives the more than one camera previews from the image processing module. The controller simultaneously presents, via the display driver, the more than one camera previews on the first display device.

Abstract: Techniques are disclosed for the creation of multi-codec encoding profiles (or encoding ladders), which define quality and bitrate for each of the streams made available to clients for streaming a video. In particular, optimization techniques may take into account a quality rate function of each of the codecs when determining the encoding ladder. Additional considerations may include a network bandwidth distribution and/or a distribution of client types.

Abstract: A dual sensory input speech detection method includes receiving, at a first time, a first video image input of a conference participant of the video conference and a first audio input of the conference participant; communicating the first video image input to the video conference; identifying the first video image input as a first facial image of the conference participant; determining, based on the first facial image, the first video image input indicates the conference participant is in a speaking state; identifying the first audio input as a first speech sound; determining, while in the speaking state, the first speech sound originates from the conference participant; and communicating the first audio input to an audio output for the video conference.

Abstract: The present application relates to the technical field of communication, and provides a method and a device for controlling camera shooting, a smart device and a computer storage medium, including: collecting voice data of a sound source object; extracting a voice feature based on the voice data of the sound source object; determining a current voice scene according to the extracted voice feature and a voice feature corresponding to the preset voice scene; and acquiring a shooting mode corresponding to the current voice scene, and controlling movement of the camera according to the shooting mode corresponding to the current voice scene. With the method above, frequently shaking can be avoided, and shooting efficiency and user experience can be improved.

Abstract: Disclosed here are methods, systems, and devices for measuring visual quality degradation of digital content caused by an encoding process. There is received first data for a digital content item, which is not encoded by the encoding process, and second data for the digital content item, which is encoded by the encoding process. For a given artefact type, the first data and the second data are processed to obtain a first quality metric measuring visual quality degradation in the digital content item attributable to the given artefact type caused by the encoding process. A stored mapping corresponding to the given artefact type is applied to the first quality metric to obtain a second quality metric which measures visual quality degradation in the digital content item attributable to the given artefact type caused by the encoding process and approximates subjective assessment of the digital content item by a human visual system.

Abstract: One or more computing devices, systems, and/or methods for hosting virtual chat rooms of a chat room are provided. For example, users (e.g., 3,000 users) may access video interfaces, hosting a video, and chat room interfaces associated with a chat room for the video (e.g., users may access a news website providing a live stream of a current event along with a chat room for discussing the live stream). Signals of the users (e.g., a user location, age, account profile information, prior chat room message behavior, etc.) are evaluated to identify user properties (e.g., the user is an active participant within chat rooms). The chat room may be sharded into a set of virtual chat rooms into which users are assigned based upon the user properties (e.g., 300 virtual chat rooms of 100 users each). In this way, users may have more meaningful interactions within the smaller virtual chat rooms.

Abstract: A technique includes, on an electronic device that includes a plurality of display panels that are mounted to allow physically positioning of the display panels to create a plurality of potential display configurations for the electronic device, sensing the display configuration associated with current positions of the display panels. A camera is mounted on a given display panel of the plurality of display panels, and the technique includes selecting a camera mode for the electronic device based at least in part on the sensed display configuration.

Abstract: A communication system may include, in an example, a first computing device communicatively coupled, via a network, to at least a second computing device maintained at a geographically distinct location than the first computing device; the first computing device including: an array of audio output devices and a processor to receive transmitted speech data and metadata describing an estimated direction of arrival (DOA) of speech from a plurality of speakers at an array of microphones at the second computing device and render audio at the array of audio output devices associated with the first computing device by eliminating spatial collision during rendering; said spatial collision arising due to the low angular separation of the estimated DOA of a plurality of speakers.

Abstract: A computer-implemented method for modifying video-based communications produced during a conference call, is disclosed. The computer-implemented method can include monitoring a plurality of images transmitted via a video feed of a device connected to the conference call. The computer-implemented method can include identifying a first unwanted image component transmitted via the video feed. The computer-implemented method can include actively modifying the video feed by removing the first unwanted image component from the video feed.

Abstract: An example method of operation may include initializing a microphone array in a defined space to receive one or more sound instances based on a preliminary beamform tracking configuration, detecting the one or more sound instances within the defined space via the microphone array, modifying the preliminary beamform tracking configuration, based on a location of the one or more sound instances, to create a modified beamform tracking configuration, and saving the modified beamform tracking configuration in a memory of a microphone array controller.

Abstract: The present application relates to the field of security and protection, and provides a pan-tilt control method, device and system. The method comprises: detecting whether there is a signal source within a monitored region of a pan-tilt camera, the pan-tilt camera comprising a pan-tilt and a camera attached to the pan-tilt; judging, when there is a signal source within the monitored region, whether signals emitted from the signal source are position adjusting signals for indicating a position adjustment on the pan-tilt; and adjusting a position of the pan-tilt according to a position of the signal source when the signals emitted from the signal source are position adjusting signals. In the present application, the trigger delay of the control operation on the pan-tilt camera is reduced.

Abstract: A video stream of a video call between a communication endpoint of customer and a communication endpoint of a contact center agent is received. The video stream of the video call is processed in real-time to generate a real-time emotion transcript. The real-time emotion transcript tracks a plurality of separate emotions based on non-verbal expressions (e.g. facial expressions) that occur in the video stream of the video call. For example, different emotions of both the customer and the contact center agent may tracked in the real-time emotion transcript. The real-time emotion transcript is compared to an emotion transcript of at least one previous video call to determine if the video call should be handled differently in the contact center. In response to determining that video call should be handled differently in the contact center, an action determined to change how the video call is managed in the contact center.

Abstract: A system and method for creating, managing, and displaying an interactive display for 3D digital collectibles comprising a virtual, three dimensional, n-sided structure including a digital media file or set of digital media files representing an event rendered on a representation of a first surface thereof, and data relating to the event rendered on at least a second surface thereof, where the digital media file may be a video clip of the event that can be played automatically via a media player associated with the display. The interactive display may provide a graphical user interface that displays a set of user tools to interact with the 3D digital collectibles and a user interface control module that receives user input via the user tools and generates instructions to control the display of one or more 3D digital collectible display elements.

Abstract: Spatial audio upmixing enables mixing spatial sound on a more granular per-channel level than is possible using conventional upmixing. A spatial bed is a multi-channel audio content that represents a complete sound field description, e.g., a virtual sphere of sound, for example surrounding a simulated reality listener in a simulated reality environment. A new spatial bed is generated by combining sections of at least two of such spatial beds. Other embodiments are also described and claimed.

Abstract: An electronic device is provided. The electronic device includes image sensors configured to include a plurality of pairs of image sensors, each pair of image sensors facing in substantially the same direction and generating image data and each of which has a different field of view, a processor configured to be operatively connected to the image sensors, and a memory configured to be operatively connected to the processor. The memory stores instructions, when executed, causing the processor to receive at least one set of image data from the pairs of image sensors, recognize at least one object from the image data, determine depth information of the at least one object, and stitch the at least one set of image data using the at least one object and the depth information.

Abstract: A video signal generating apparatus is disclosed which includes: a camera configured to generate a video signal; an operating device configured to operate at least either the camera or an apparatus configured to receive the video signal; a text data generating device configured to generate text data including a meaningful term in response to the operation performed on the operating device; and a text data inserting device configured to insert the text data generated by the text data generating device into the video signal in a corresponding manner.

Abstract: A lighting method for illuminating an environment by means of a plurality of light sources is comprised of the following steps: acquiring a video signal, in which an image of each frame is divided into a plurality of boxes; subdividing the video signal into a plurality of video signal boxes, each associated with an image portion of each frame displayed on a respective box; processing frequency of the frame video signals, for obtaining spectra of respective luminance and chrominance signals associated with each video signal box; extracting a dominant frequency band of the luminance signal spectrum associated with each box video signal; extracting a dominant frequency band of the chrominance signal spectrum associated with each box video signal; summing the processed spectra of luminance and chrominance signals; and obtaining a time driving signal of each of the light sources.

Abstract: A method and apparatus for synchronizing the playback of a media title to a group of client device platforms is disclosed. A synchronizer may make adjustments to the playback modes of one or more client device platforms within a group watching the same media title in order to ensure synchronized playback. When a client device platform is behind the group its playback mode may be changed to a fast playback mode. When a client device platform is ahead of the group its playback mode may be changed to a slow playback mode. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: Examples relate to a system to apply stimuli to a human body. The system comprises a three dimensional display, a stimulation element, a specific piece of clothing, a portable background and a controller. The controller comprises a processor, data storage and an instruction set. The instruction set is to cooperate with the processor, data storage, three dimensional display and stimulation element to display a recorded three dimensional representation of an actor in movement and to transmit to the stimulation element stimuli synchronized with the movement. The actor is wearing a piece of clothing having the same aspect as the specific piece of clothing, the actor being located in front of a background having the same aspect as the portable background, the recording being from the actor point of view.

Abstract: A video conference system may include two or more video conference endpoints, each having a display configured to display content. The video conference system may detect a plurality of participants within a field of view of a camera of the system. The video conference system may determine an attention score for each endpoint based on the participants. The video conference system may determine whether the content of the first endpoint and/or the content of the second endpoint are active content based on whether the attention scores exceed a predetermined threshold value. The video conference system may send to secondary video conference systems an indication of the active content to enable the secondary video conference systems to display the active content.

Abstract: A system and method for creating a virtual world conferencing experience wherein a first set of real world emissive surfaces and content thereon is replicated on virtual world emissive surfaces where the virtual world emissive surfaces are juxtaposed in a virtual world instance at locations and in orientations that replicate the juxtapositions in the real world arrangement and where the virtual world instance is presented on a second set of real world emissive surfaces at a virtual world workstation where the second set of emissive surfaces are arranged differently than the first set of real world surfaces.

Abstract: Systems and methods for transcoding media content are disclosed. In some embodiments, the method includes obtaining a transcoded media content that is transcoded from an uploaded media content. The method includes determining a plurality of degradation metric values corresponding to the transcoded media content based on the uploaded media content and the transcoded media content, each degradation metric value corresponding to a different degradation metric type. The method includes mapping each degradation metric value to a respective calibrated score to obtain a plurality of calibrated scores. The method includes determining an aggregated quality score of the transcoded media content based on the plurality of calibrated scores and an exponential weighting function. The exponential weighting function exponentiates each of the calibrated scores by a respective weighting exponent and aggregates the exponentiated calibrated scores.

Abstract: Embodiments of the present disclosure are directed to a speech interaction method executed at an electronic device, a speech interaction apparatus, and a computer readable storage medium. The method includes receiving an image sequence of a user from an image capturing apparatus coupled to the electronic device. The method also includes detecting a change in a head feature of the user from the image sequence. After that, the method includes determining whether the change in the head feature matches a predetermined change pattern. The method further includes causing the electronic device to enter an active state in response to determining that the change in the head feature matches the predetermined change pattern, the electronic device in the active state being capable of responding to a speech command of the user.

Abstract: Collaboration devices are disclosed. An example table-top collaboration device, including a housing; a sensor to obtain audio data, image data, or video data; a display including a first portion and a second portion, the first portion viewable from a first side of the device and the second portion viewable from a second side of the device; and a processor to facilitate a collaboration session between participants, the processor to use the audio data, the image data, or the video data during the collaboration session.

Abstract: System and method for improving video encoding and/or video decoding. In embodiments, a video encoding pipeline includes a main encoding pipeline that compresses source image data corresponding with an image frame by processing the source image data based at least in part on encoding parameters to generate encoded image data. Additionally the video encoding pipeline includes a machine learning block communicatively coupled to the main encoding pipeline, in which the machine learning block analyzes content of the image frame by processing the source image data based at least in part on machine learning parameters implemented in the machine learning block when the machine learning block is enabled by the encoding parameters; and the video encoding pipeline adaptively adjusts the encoding parameters based at least in part on the content expected to be present in the image frame to facilitate improving encoding efficiency.

Abstract: In accordance with embodiments of the present disclosure, systems and methods for facilitating electronic commerce over a network include communicating with a plurality of users via a plurality of user devices over the network, receiving a login request from a first user via a first user device over the network, accessing an account related to the user based on information passed with the login request, receiving a snaplist file related to a multiple image listing provided by the first user via the first user device, processing the snaplist file by extracting the multiple image listing from the snaplist file, and displaying the multiple image listing to one or more other users via one or more other user devices.

Abstract: A method and apparatus for call handling control comprises receiving, from a first device, call handling information directed towards a second device, wherein a call is currently established between the first device and the second device and transmitting the call handling information to the second device, wherein the call handling information comprises feature activation instructions for the second device.

Abstract: An audio device including a housing having a side facing outwardly of the housing, the housing further having a first mounting position disposed on the side. The side has a first portion and a second portion, the first portion opposite the second portion relative to the first mounting position. The audio device also includes a first omnidirectional microphone disposed on the first portion. The audio device also includes a second microphone disposed on the first mounting position. The second microphone may be a second-order microphone. The second-order microphone has a first-order microphone disposed within a first platform mounted a distance from the first mounting position. The audio device also includes a first speaker disposed on the second portion. The first speaker is further disposed such that an audio output of the first speaker falls within a null of the second microphone.

Abstract: An electronic device includes: an operation unit; a detection unit that detects a position or an orientation; a communication unit that communicates with an external device including an image capture unit; and a storing unit that stores image data, wherein the communication unit receives image data generated by the image capture unit from the external device after transmitting information instructing the image capture unit included in the external device to capture an image in response to an operation of the operation unit, and the storing unit stores the image data received and information on the position detected by the detection unit or information on the orientation detected by the detection unit.

Abstract: Systems and methods described herein are provided for managing user positions in a shared virtual geometry, capturing 360° views of a local user environment in a spatially faithful system, and computing a perspective view of a first user from the eye-point of a second user. Users may move around the shared virtual geometry, and perspective views of users may be updated. Some embodiments use a co-centric geometry for group conferencing with other users. Some embodiments may use a grid-based geometry for exploration with other users. Some embodiments may reduce transferred bitrates to enable systems and methods to be implemented in data-limited environments. Some embodiments support users moving and navigating a shared virtual geometry.

Abstract: For muting an audio device participating in a conference call, methods, apparatus, and systems are disclosed. One apparatus includes a processor and a memory that stores code executable by the processor. The processor identifies a plurality of physical locations participating in a conference call and identifies a plurality of devices participating in the conference call, wherein each device is located in one of the plurality of physical locations. The processor designates a primary device for each physical location, the primary device being a highest priority device at that physical location and mutes an audio device of each of the plurality of devices that is not designated a primary device.

Abstract: A method and device for face tracking and a smart terminal. The method includes: collecting a frame of an image in a video stream and conducting face detection and identification, to identify a target face; determining a position of a window to be tracked that contains the target face according to the identified target face, and extracting an edge feature point in the window to be tracked of the reference frame; determining an initial position of a window to be tracked on the current frame in the video stream, and extracting an edge feature point in the window to be tracked of the current frame; calculating a relative displacement between the edge feature point of the reference frame and the edge feature point of the current frame; and adjusting the initial position of the window to be tracked of the current frame by using the relative displacement.

Abstract: Disclosed is a method and system for providing a camera effect. An effect providing method of an electronic device configured as a computer includes determining an emotion for a camera image of the electronic device as a criterion for selecting an effect to be applied to the camera image of the electronic device; and immediately applying, to the camera image, an effect that is randomly selected from among effects representing the determined emotion.

Abstract: A building method and a building system for panorama point cloud data are provided. The building method for panorama point cloud data includes the following steps. At least one reference geometric object located at an overlap region of two adjacent three-dimensional capturing devices is captured by the two adjacent three-dimensional capturing devices to obtain two reference point cloud sets. A reference feature plane is obtained from each of the reference point cloud sets. A coordinate transformation matrix is obtained according to the reference feature planes. A plurality of real-time point cloud sets are obtained by the three-dimensional capturing devices. The coordinate transformation of the real-time point cloud sets are performed according to the coordinate transformation matrix, and the real-time point cloud sets are combined to obtain the panorama point cloud data.

Abstract: An example method of operation may include initializing a microphone array in a defined space to receive one or more sound instances based on a preliminary beamform tracking configuration, detecting the one or more sound instances within the defined space via the microphone array, modifying the preliminary beamform tracking configuration, based on a location of the one or more sound instances, to create a modified beamform tracking configuration, and saving the modified beamform tracking configuration in a memory of a microphone array controller.

Abstract: A DEFLATE Conversion Call general-purpose processor instruction. An instruction is obtained by a general-purpose processor of the computing environment. The instruction is a single architected instruction of an instruction set architecture that complies to an industry standard for compression. The instruction is executed, and the executing includes transforming, based on a function to be performed by the instruction being a compression function or a decompression function, state of input data between an uncompressed form of the input data and a compressed form of the input data to provide a transformed state of data. The transformed state of the data is provided as output to be used in performing a task.

Abstract: A near-touch interface is provided that utilizes stereo cameras and a series of targeted structured light tessellations, emanating from the screen as a light source and incident on objects in the field-of-view. After radial distortion from a series of wide-angle lenses is mitigated, a surface-based spatio-temporal stereo algorithm is utilized to estimate initial depth values. Once these values are calculated, a subsequent refinement step may be applied in which light source tessellations are used to flash a structure onto targeted components of the scene, where initial near-interaction disparity values have been calculated. The combination of a spherical stereo algorithm, and smoothing with structured light source tessellations, provides for a very reliable and fast near-field depth engine, and resolves issues that are associated with depth estimates for embedded solutions of this approach.

Abstract: A server is configured to provide a service that manages access to communication sessions supported by at least one communication service and to which user devices connect. The service assigns to users registered with the service respective communication identifiers that the users, and unregistered users of the service, use to access the communication sessions via user devices. The service maps each communication identifier to a list of communication sessions, if any, in which the respective user is currently participating and/or is scheduled to participate. The service receives from a user device a join request from a requester. The join request indicates a particular communication identifier of a particular user registered with the service and a requester identifier. The service connects the user device to a communication session, if any, based on the particular communication identifier and the requester identifier.

Abstract: A method and system for optimizing conference session activities within a conference space, the system comprising at least a first sensor for sensing session characteristics and a processor receiving the sensed session characteristics and identifying a conference paradigm based on the sensed session characteristics, identifying an action sequence to perform as a function of the conference paradigm and performing the action sequence, wherein the action sequence results in automatic presentation of at least some information to at least a subset of conferees within the conference space.

Abstract: Various aspects include approaches for intelligent acoustic beam steering. In some implementations, a method of controlling a microphone array in a speaker system is disclosed. In other implementations, a speaker system is disclosed. In particular aspects, a computer-implemented method of controlling a microphone array includes: generating an acoustic map including an acoustic description of a physical environment proximate the speaker system; and focusing the microphone array in a direction based upon the acoustic map prior to receiving a voice command input at the microphone array.

Abstract: Various aspects disclosed herein are directed to Online Education techniques and award incentives for facilitating collaborative, social online education. One aspect disclosed herein is directed to different methods, systems, and computer program products for facilitating mobile video presentations using digital compositing techniques.

Abstract: Fast moving objects may be monitored by a video unit under a variety of lighting conditions. In a bootstrap phase, a model database is established for each of a plurality of sampling points, each model being a combination of color of the video image, respective optimum exposure, and respective lighting condition. Then in an image capture phase the video unit compares captured color and optimum exposure of the sampling point, with the models of color and respective optimum exposure in the model database, to find a best match lighting condition model in the model database. The video unit then adjusts an exposure setting to the most frequently occurring value for exposure among the other sampling points, if lighting conditions for the other sampling points are within a threshold range of the lighting condition of the best match model in the model database.

Abstract: A system that automatically configures the behavior of the display devices of a video conference endpoint. The controller may detect, at a microphone array having a predetermined physical relationship with respect to a camera, audio emitted from one or more loudspeakers, each loudspeaker having a predetermined physical relationship with respect to at least one of one or more display devices in a conference room. The controller may then generate data representing a spatial relationship between the one or more display devices and the camera based on the detected audio. Finally, the controller may assign video sources received by the endpoint to each of the one or more display devices based on the data representing the spatial relationship and the content of each received video source, and may also assign outputs from multiple video cameras to an outgoing video stream based on the on the data representing the spatial relationship.

Abstract: Various embodiments related to a hand-held mobile computing device are disclosed. One disclosed embodiment comprises a hand-held mobile computing device having a touch-sensitive display forming a surface of the hand-held mobile computing device configured to receive touch input. The hand-held mobile computing device further comprises a processor and memory comprising code executable by the processor to display a scrollable list of items in a first content viewing mode having a first set of content for each of the items in the scrollable list, to detect a dynamic multi-touch gesture over the scrollable list of items, and to change the scrollable list of items to a second content viewing mode responsive to detection of the dynamic multi-touch gesture, wherein the second content viewing mode comprises a second set of content for each item in the scrollable list of items.

Abstract: A method for processing video is disclosed. The method comprises associating a plurality of audio zones with the video; associating a region of interest (ROI) for each of a plurality of client devices to which the video is currently being streamed; for each client device generating custom video comprising a modified video channel associated with the video being streamed to that client, wherein the modified audio channel comprises an enhanced audio for at least one audio zone indicated by the region of interest (ROI) for said client device.