Abstract: The present disclosure relates to a multimedia device and a method for controlling the same. More specifically, the present disclosure may be applied to all of a 5G communication technology field, a robot technology field, an autonomous driving technology field, and an AI (Artificial Intelligence) technology field. An extended reality device including a camera, a display, a sensor for sensing a user action, and a controller that activates a power saving mode when a predetermined user action is detected using the sensor while a predetermined application is executed in a non-power saving mode is provided.

Abstract: A system includes acquisition of meeting data associated with a meeting, determination of a plurality of meeting participants based on the acquired meeting data, acquisition of e-mail data associated with each of the plurality of meeting participants, generation of a meeting language model based on the acquired e-mail data and the meeting data, and transcription of audio associated with the meeting based on the meeting language model.

Abstract: Methods and systems for triggering presentation of virtual content based on sensor information. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergences. The system may monitor information detected via the sensors, and based on the monitored information, trigger access to virtual content identified in the sensor information. Virtual content can be obtained, and presented as augmented reality content via the display system. The system may monitor information detected via the sensors to identify a QR code, or a presence of a wireless beacon. The QR code or wireless beacon can trigger the display system to obtain virtual content for presentation.

Abstract: A method, system and/or computer usable program product for managing user access to restricted data including authenticating a set of users requesting attendance to a teleconference; obtaining content access rights associated with each of the authenticated users; converting and reviewing content of the teleconference in real-time to identify restricted data in the teleconference content; determining whether each of the authenticated users has content access rights to identified restricted data; upon determining at least one authenticated user does not have content access rights to the identified restricted data, redacting the identified restricted data in real-time from the teleconference content to generate a redacted teleconference content; and providing the teleconference content in real-time to each authenticated user with content access rights to the identified restricted data, and providing the redacted teleconference content in real-time to each authenticated user without content access rights to the i

Abstract: A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting the background in the received real time video conference stream from the user; and matching the first background and a second background associated with the second user.

Abstract: A method, a system, and a non-transitory computer-readable record medium for providing a communication using a video call bot are disclosed. A video call method implemented by a computer apparatus, may include: in response to a request for inviting a chat bot to a video call in which a plurality of users comprising a user of the computer apparatus participate, displaying the chat bot on a display screen for the video call; transmitting, to a server, a command line that is associated with the chat bot and is extracted from an a voice input that is input to the computer apparatus during the video call; and in response to the command line, outputting a response to the command line through the chat bot that participates in the video call.

Abstract: According to an example embodiment, a technique for zooming one or more images of a video stream into corresponding one or more images of a video signal for rendering together with a spatial audio signal that conveys a spatial audio image representing a range of sound directions that spatially correspond to a respective range of positions in images of the video signal is provided, the technique comprising: receiving the video stream, a plurality of audio signals and audiovisual metadata that defines a spatial relationship between images of the video stream and said plurality of audio signals that serve as basis for said spatial audio signal; determining presence of at least a first sound source and a second sound source depicted in an image of the video stream, wherein respective sounds originating from the first and second sound sources are to be represented in said spatial audio signal by a single directional sound component; determining a first zoom factor threshold for zooming said image of the video stre

Abstract: Techniques for authenticating digital media asset, and particularly to verifying the authenticity of digital image or video files which may have been redacted or otherwise altered in some way. The approach, which we call perceptual video fingerprinting, compares media assets based on what humans perceive, rather than exactly which bits match, by using neural network algorithms.

Abstract: In some embodiments, the systems and methods built in accordance with the present disclosure may analyze audience engagement with a presentation displayed during a meeting and provide feedback to a presenter during and/or after the presentation. In some embodiments, the provided feedback may include determining metrics indicative of participant engagement levels. Participant engagement levels may then be used to adjust meetings in real-time and/or after the meeting has ended. In some embodiments, the system may include a hybrid configuration where a subset of the presenters, participants and moderators are physically present in the same environment. In some embodiments, the system may include a fully virtual configuration where all of the presenters, participants and moderators are physically remote from each other.

Abstract: A voice processing device includes a voice receiver that receives a voice, an imager, an image acquirer that acquires a captured image captured by the imager, an utterer identifier that identifies an utterer based on the voice received by the voice receiver and the captured image acquired by the image acquirer, a voice determiner that determines whether the voice is a specific word based on the voice received by the voice receiver and an image of the utterer identified by the utterer identifier, the image being included in the captured image, and a voice transmitter that switches a transmission destination of the voice received by the voice receiver based on a determination result by the voice determiner.

Abstract: A telepresence communication system for group meeting rooms and personal home and office systems provides improved human factor experience through substantially life size images with eye level camera placement. The system provides switched presence interfaces so that conferees can select when to transmit their images during a conference and optionally provides individual microphones for each of conferee. Switched presence between presets of conferees are viewed on multipoint windows overlaying life-size images upon eye contact camera regions and eliminate seeing camera image movement during pan, tilt and zoom operations. An ambient light rejecting filter system enables an eye level camera to be hidden behind a projection screen and provides bright, high contrast images under normal meeting room and office environments.

Abstract: A sensor fusion system for an autonomous vehicle and/or advanced driver assistance systems (ADAS) that combines measurements from multiple independent sensors to generate a better output. The multiple sensors can interact and perform “cross-training” for enhanced sensor performance. The sensor fusion system utilizes data exchange and cross-training between sensors for enhanced sensor performance while constantly improving sensor fusion results. Some exemplary embodiments of the present disclosure provide a system for an autonomous vehicle and/or a vehicle ADAS that combines information from independent sensors in order to accurately distinguish environmental objects and movements. This allows the vehicle to accurately make informed navigation decisions based on the environmental surroundings.

Abstract: Systems and methods are provided for automatically arranging the display of a plurality of videos on a display of a computing device. One example method includes receiving, at the computing device, a plurality of video streams. An order in which to display the video streams is determined, based on the video of the video streams. The plurality of video streams is displayed on a display of the computing device based on the determined order.

Abstract: A system that uses persistent sound source selection to augment audio content. The system comprises one or more microphones coupled to a frame of a headset. The one or more microphones capture sound emitted by sound sources in a local area. The system further comprises an audio controller integrated into the headset. The audio controller receives sound signals corresponding to sounds emitted by sound sources in the local area. The audio controller further updates a ranking of the sound sources based on eye tracking information of the user. The audio controller further selectively applies one or more filters to the one or more of the sound signals according to the ranking to generate augmented audio data. The audio controller further provides the augmented audio data to a speaker assembly for presentation to the user.

Abstract: The embodiments of the present disclosure disclose a method for outputting audio data of applications in a display device. The method includes: while first audio data of one or more first applications is playing by the display device through an audio output interface of the display device, receiving a first input instruction for playing second audio data of a second application; controlling output volume of the first audio data to be muted, and output volume of the second audio data to be maintained in response to the first input instruction; and outputting superimposed data of the muted first audio data and the second audio data with maintained output volume through the audio output interface.

Abstract: An electronic meeting tool and method for communicating arbitrary media content from users at a meeting comprises a node configuration means adapted to operate a display node of a communications network, the display node being coupled to a first display. The node configuration means is adapted to receive user selected arbitrary media content and to control display of the user selected arbitrary media content on the first display. A peripheral device adapted to communicate the user selected arbitrary media content via the communications network is a connection unit comprising a connector adapted to couple to a port of a processing device having a second display, a memory and an operating system, and a transmitter. A program is adapted to obtain user selected arbitrary media content, said program leaving a zero footprint on termination. The user may trigger transfer of said user selected arbitrary media content to said transmitter.

Abstract: A surveillance apparatus includes a communication unit configured to transmit a command to an external device, a detection unit configured to detect a change in a surrounding environment in a case where the change is caused by an operation of the external device or a peripheral device controlled by the external device operating in response to the command and a control unit configured to change, in a case where there is a function to be affected by the change detected by the detection unit, a setting of the function to a setting with which the function is not affected.

Abstract: One or more users log in to a video conference with a shared, online electronic whiteboard and draw upon a shared whiteboard. Each user has a video and audio stream that are sent to a recording server. Data describing each drawing action upon the shared whiteboard is sent to a database server and each action is then distributed to all users to update their whiteboards. Screenshots of the drawing actions are created by emulating a browser and inputting data describing each action from the database. Alternatively, screenshots are taken by each user computer (after each action or periodically) and sent to the recording server. Audiovisual manipulation software is used to create a whiteboard video from the screenshots are then combined with the audio and video streams to create a resulting video of the entire session. A video clip is created simply by sending begin and end timestamps during the session.

Abstract: A camera includes an image processor configured to generate an image or a video data, an intelligent processor configured to perform intelligent analysis and to process on the image or the video data, and a communications interface configured to receive, from an external device, configuration information for the camera, where the configuration information extends a function of the camera.

Abstract: The present teaching relates to method, system, medium, and implementations for managing a virtual studio. A plurality of single data streams from a plurality content contributors are received. When a request is received, via public network connections, for creating a composite data stream associated with a virtual room in the virtual studio, signaling information is generated for constructing the composite data stream by stitching together some of the plurality of single data streams selected to be incorporated in the composite data stream in accordance with a layout. When an access request is received from an end user to access the composite data stream, the composite data stream is delivered to the end user in response to the access request.

Abstract: A video display system generally includes a computerized media processing unit configured to receive a plurality of content from a plurality of content sources and configured to combine the plurality of content from the plurality of content sources to generate and output a video signal receivable by at least one display device. The video signal includes an interactive multilayer stream, with a plurality of video layers all displayable on the at least one display device simultaneously with independently variable size and position under the control of a user. The content of one of the video layers may be determined based on the content of a different video layer.

Abstract: A method for audio processing includes receiving, in a computer, a recording of a teleconference among multiple participants over a network including an audio stream containing speech uttered by the participants and conference metadata for controlling a display on video screens viewed by the participants during the teleconference. The audio stream is processed by the computer to identify speech segments, in which one or more of the participants were speaking, interspersed with intervals of silence in the audio stream. The conference metadata are parsed so as to extract speaker identifications, which are indicative of the participants who spoke during successive periods of the teleconference. The teleconference is diarized by labeling the identified speech segments from the audio stream with the speaker identifications extracted from corresponding periods of the teleconference.

Abstract: Examples of an audio-video (AV) apparatus are described herein. In an example, the AV apparatus includes a base member. The AV apparatus further includes an AV unit including an image sensor and an audio sensor. The AV unit being actuated to move, with respect to the base member, either in a first direction and activate the audio sensor or in a second direction and activate the image sensor and the audio sensor.

Abstract: An image acquisition apparatus includes a display layer including hole regions through which external light is received and pixel regions arranged between the hole regions, an image sensor disposed under the display layer and configured to generate a raw image by sensing the external light received through the hole regions, and a processor configured to perform image processing on the raw image based on blur information based on an arrangement of the hole regions.

Abstract: A communication server facilitates a video call between client devices of a plurality of participants. During the video call, the communication server identifies an in-call activity to recommend to the plurality of participants in the video call based on user information. The in-call activity is selected to be relevant to each of the plurality of participants and jointly recommended to the plurality of participants of the video call. To identify the recommended in-call activity, the communication server may determine common interests among the plurality of participants and select an in-call activity that is associated with the common interests. After the recommended in-call activity is selected, an indication of the recommended in-call activity is provided to the client devices to enable the client devices to display a user interface including the in-call activity to the participants during the video call.

Abstract: A computer-implemented video visitation system of a correctional facility includes an administrator computer device in communication with a visitation services computer system and a database. The administrator computer device is configured, via an administrator interface displayed on the administrative computer device, to enable or disable privileges for selected inmates in the inmate population allowing inmates access to the visitation services computer system, and set visitation session preferences including maximum visitation session length and visitation session cost that applies to the visitation services.

Abstract: The present disclosure relates to management of presentation content including technical instances where presentation content interacts with live feeds. The scope of the present disclosure covers technical examples that pertain to creation/design of presentation content as well technical examples where presentation content is presented in real-time (or near real-time). Design solutions are provided enabling users to easily interject a representation of a live camera feed into presentation content. For example, an editable GUI object is presented enabling users to incorporate a representation of a live camera feed into slide-based presentation content. The present disclosure further provides processing that fosters dynamic management of presentation content including interactions with live camera feeds during a presentation. Furthermore, an improved GUI presents GUI elements and notifications to aid management of representations of live camera feeds relative to presentation content.

Abstract: A method of controlling image display includes: receiving an image capture instruction from a client device, wherein the image capture instruction includes a photographing direction, and the photographing direction is determined by the client device according to a relative position relationship between a position of the client device and a user-specified display position; controlling an image capture device to perform image capture according to the photographing direction, to obtain a depth image comprising a target object image; extracting the target object image from the depth image; and sending the target object image to the client device such that the client device displays the target object image at the display position.

Abstract: A secured party audio and audio/video communication system and method providing administration, management and control that includes a portable secured communication device in possession solely of a secured party positioned in a secured environment, the portable secured communication device being exclusive to the secured party and communicatively connectable only to a secured connection management system, in a secured connection management system hosting a secured communication device interface, hosting a remote communication device interface, storing in the database information related to the secured party, the portable secured communication system, and the external party, at least one of which includes a predetermined connection parameter, creating the selective communication between the portable secured communication device and only the remote communication device response to the stored database information and controlling a duration of the communication as a function of the predetermined connection parame

Abstract: Systems and methods for verifying identifies of parties to a video conference call are disclosed. An example method includes storing a plurality of first facial encodings each associated with one or more images of a registered agent, receiving, during the video conference call, a second facial encoding associated with one or more images of a person participating in the video conference call, determining that a specified registered agent is scheduled as a party to the video conference call, comparing the second facial encoding to a selected first facial encoding associated with the specified registered agent, and determining, based at least in part on the comparing, whether or not the person is the specified registered agent.

Abstract: Systems and methods for using auditorily-induced vection (AIV) to enhance a person's attitude awareness are provided herein. In at least one embodiment, an auditory object is projected based on the orientation of the person or a vehicle and the projected auditory is provided to the person. By projecting the auditory object, the attitude of the person or the vehicle can be conveyed to the person to enhance the person's attitude awareness.

Abstract: A method may include enabling a camera to capture an image of a user operating an information handling system. An orientation of the user's head relative to a microphone may be determined based on the image. The method may further include retrieving a lookup table identifying attenuation of particular frequencies of human speech as a function of head angle. The method concludes by adjusting a gain of a signal received from the microphone to compensate for the attenuation, the adjusting based on the lookup table and based on the user's head orientation.

Abstract: Disclosed are a methods and/or systems for hybrid video coding. A hybrid video coding method may include generating scaled-down video frames by scaling down frames of an original video, generating a stream of a first layer by encoding the scaled-down video frames using a first encoder of a software codec, and generating a stream of a second layer using the frames of the original video and a second encoder of a hardware codec.

Abstract: In part, the invention relates to an image data collection system. The system can include an interferometer having a reference arm that includes a first optical fiber of length of L1 and a sample arm that includes a second optical fiber of length of L2 and a first rotary coupler configured to interface with an optical tomography imaging probe, wherein the rotary coupler is in optical communication with the sample arm. In one embodiment, L2 is greater than about 5 meters. The first optical fiber and the second optical fiber can both be disposed in a common protective sheath. In one embodiment, the system further includes an optical element configured to adjust the optical path length of the reference arm, wherein the optical element is in optical communication with the reference arm and wherein the optical element is transmissive or reflective.

Abstract: For multiuser information exchange management, a processor receives information permissions for a plurality of participants in an electronic forum. The information permissions include an audio permission, a video permission, a file share permission, a drawing permission, and/or a presentation permission for each participant. The processor provides forum information to each participant based on the information permissions. The audio permission is required to receive audio from the electronic forum. The video permission is required to receive video from the electronic forum. The file share permission is required to receive a file from the electronic forum. The drawing permission is required to receive a drawing from the electronic forum. The presentation permission is required to receive a presentation from the electronic forum.

Abstract: Method of generating image capture modifiers based on media content items starts with a server system receiving a request to access first media content item included in a storage from a first client device in communication with the server system over a network. The server system causes the first media content item and a modifier generator icon to be displayed on a user interface of the first client device. The server system receives a selection of the modifier generator icon on the user interface of the first client device and generates a first image capture modifier based on the first media content item. The server system causes to be displayed on the user interface of the first client device a field of view of an image capture device and image modifier icons including a first image modifier icon associated with the first image capture modifier. Other embodiments are disclosed herein.

Abstract: A method of detecting voice activity includes performing a video analysis on a frame of video signal to determine a position of a user in the frame and to identify one or more beams of a corresponding audio signal associated with a region including the position of the user. The identified one or more beams of audio signal are analyzed to determine whether voice is present in the frame. When a user is not identified during the video analysis of the frame of video signal, audio analysis is not performed on the corresponding frame of audio signal.

Abstract: Managing a video conference includes connecting participants of the videoconference to at least one video conferencing server that sends and receives video streams between the participants, detecting non-verbal cues of the participants, using the non-verbal cues to track reactions of the participants to segments of a presentation provided by a speaker and to interactions among participants, determining a health index of the video conference based on the reactions of the participants, and providing to at least a subset of the participants recommendations based on the health index for modifying the video conference. The non-verbal cues may include facial expressions, body language, gestures, postures, and/or eye contact. The interactions among participants may include discussions, agreement, disagreement, interruption, and/or eye-rolling. The recommendations may include asking a participant to provide an opinion on a subject matter being discussed in the video conference. The participant may be an expert.

Abstract: Systems and methods are disclosed for establishing a video connection between a client device and a support terminal while enabling the support terminal to concurrently push display element triggers to the client device through a separate connection. In particular, a display element trigger can cause the client device to display, within a dual pane display of the client device, a display element within one pane and a video chat in another pane. The display element can include a check deposit element that enables a user of the client device to capture one or more images of a check and then transmit the image(s) for deposit by the support terminal during a video chat. The support terminal can analyze the image(s) of the check to identify check deposit data and then deposit the check accordingly while a support representative communicates with the user of the client device via the video chat.

Abstract: A method for facilitating space experiences for at least a first space user and for at least first and second different spaces, the method comprising the steps of storing first and second space experience specifications for the first and second different spaces, respectively, wherein the first and second space experience specifications indicate space affordance settings for the first and second spaces, respectively, sensing a trigger event associated with at least one of the first and second different spaces, where the sensed trigger event is associated with the first space, using the first space experience specification to control the first space affordances and where the sensed trigger event is associated with the second space, using the second space experience specification to control the second space affordances.

Abstract: Disclosed are a display device and an operation method thereof. The display device includes a primary display screen, a secondary display and an optical function processor. The primary display screen has a display surface and includes a transparent region; the secondary display is located at a side of the primary display screen opposite to the display surface of the primary display screen, and is configured to project image light to the transparent region of the primary display screen for displaying in the transparent region; the optical function processor is located at the side of the primary display screen opposite to the display surface of the primary display screen, and is configured to perform the corresponding operation.

Abstract: An information processing apparatus for use by a plurality of users is provided. The information processing apparatus includes a memory; and a processor coupled to the memory and configured to authenticate logins of the plurality of users, register, on a list of participants, the plurality of users whose logins have been authenticated, perform recognition of each of the plurality of users registered on the list of participants, and restrict access to a resource owned by a given user while keeping the given user registered on the list of participants, in response to determining that the given user satisfies a predetermined condition based on a result of the recognition.

Abstract: An image processing method, for collaborating between a first augmented reality (AR) workspace and a second AR workspace, includes: calibrating the first AR workspace by creating a camera-to-shared space transformation between a camera coordinate space and a shared coordinate space, and a shared space-to-projector transformation between the shared coordinate space and a projector coordinate space; obtaining a remote composite image of a foreground content in the second AR workspace; generating a projector image by applying the shared space-to-projector transformation to the remote composite image; projecting the projector image into the first AR workspace; obtaining an input image of the first AR workspace that includes the projector image and a foreground content of the first AR workspace; generating an output image by applying the camera-to-shared space transformation to the input image; and obtaining a remote mask based on the remote composite image.

Abstract: Provided herein are augmented reality visual aid systems, software, and methods which enhance vision, to simulate natural vision, by utilizing hybrid see through occlusion enabled hardware, and software through image manipulation, reprocessing, blending, for presentation and display to the eyes thus enabling a range of tasks previously lost or impacted.

Abstract: A processor may record a first location at an event with at least one person. The processor may monitor a plurality of actions of that at least one person at the first location. The processor may interpret at least one action of the at least one person that indicates a change of interest to a second location at the event. Based on the at least one action, the processor may determine the second location at the event. The processor may record the second location at the event.

Abstract: In one aspect, a device may include at least one processor and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to facilitate, at a first device, a video conference. The instructions may also be executable to determine, at the first device and based on input from at least one sensor, a first video feed for the video conference to provide. The instructions may then be executable to, based on the determination, provide the first video feed as part of the video conference.

Abstract: Real-time modification of video images of humans allows for the video to be modified so that an expression of a subject human may be changed. Customer service agents may have more successful interactions with customers if they display an appropriate facial expression, such as to provide a particular emotional state. By determining an appropriate facial expression, and any deviation from a customer service agent's current expression, a modification to the video image of the customer service agent may be determined and applied. As a result, agents may not have a facial expression that is best suited to successfully resolve a purpose of the interaction, to have the customer be presented with the best-suited facial expression.

Abstract: Provided herein are system, apparatus, device, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for streaming a video chat from a mobile device on a display device. In a given embodiment, a first mobile device and second video device can communicate audio and video data to one another, via a video chat. The incoming audio and video data for the first mobile device can be streamed to and output by an external display device. The streaming request is generated in response to the first mobile device coupling with a rotating base, controlled by the first mobile device.

Abstract: Methods and systems for assisting a user at an event and venue are described. A user is guided or navigated to different points of interest at a venue. The points of interest include seat locations or surrounding services and facilities, such as restaurants, shops, and restrooms. Advertisements and promotions associated with surrounding services may be displayed to the user. The user may be notified of the presence of friends and family at the same venue, and be provided with real-time information about the event.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for enhanced video conference management. In some implementations, a media stream is received from each of multiple endpoint devices over a communication network. A video conference session among the endpoint devices is managed such that at least one or more of the media streams are transmitted over the communication network for display by the endpoint devices. A plurality of audio and/or video characteristics from the media stream from a particular endpoint device of the multiple endpoint devices are measured. Based on the audio and/or video characteristics, a collaboration factor score is determined for the particular endpoint device for each of a plurality of collaboration factors. The video conference of the endpoint devices by performing a video conference management action selected based on the collaboration factor scores.