Abstract: One variation of a method for enabling autopilot functionality during a video call includes, during an operating period: receiving a sequence of frames from a camera in a first device; detecting a face, of a first user, in the sequence of frames; generating a sequence of facial landmark containers representing facial actions of the face of the first user; transmitting the sequence of facial landmark containers to a second device for combination with a look model to generate a first synthetic image feed depicting facial actions of the first user; and detecting a trigger event. The method also includes, during an autopilot operating period, entering autopilot mode; retrieving a prerecorded autopilot sequence of facial landmark containers from a memory; and transmitting the prerecorded autopilot sequence of facial landmark containers to the second device for combination with the look model to generate a second synthetic image feed depicting predefined facial actions.

Abstract: Disclosed herein are systems and methods for virtually integrated care delivery. In one implementation, a provider controller is disposed in a virtual care command center and has a provider care delivery interface. Patient controllers and provider user devices are in communication with the provider controller over a network and are each associated with a patient room and have a patient care delivery interface. The provider controller obtains real-time video from the patient controllers for presentation using the provider care delivery interface. The real-time video is captured using the patient care delivery interfaces and provides real-time surveillance of the patient rooms in the virtual care command center. A communication manager device is deployed in the network and configured to route communications among the controllers and user devices and routes a round coordination communication from the provider controller to a subset of the provider user devices associated with providers for a patient.

Abstract: Embodiments of the present invention are directed to a method and system for providing a visual indication that a video relay service (VRS) call originates from an inmate at a corrections facility, in which the method includes initiating a video relay service (VRS) call from a corrections facility between a called party and an inmate incarcerated at the corrections facility; and displaying a visual indication on a VRS client used by the called party, the visual indication including at least one of a visual indication that the VRS call is originating from a corrections facility, a visual indication that the VRS call is from an inmate incarcerated at a corrections facility, and a visual indication that the VRS call is being recorded.

Abstract: Systems and methods for providing a universal platform for at-home health testing and diagnostics are provided herein. In particular, a health testing and diagnostic platform is provided to connect medical providers with patients and to generate a unique, private testing environment. In some embodiments, the testing environment may facilitate administration of a medical test to a patient with the guidance of a proctor. In some embodiments, the patient may be provided with step-by-step instructions for test administration by the proctor within a testing environment. The platform may display unique, dynamic testing interfaces to the patient and proctor to ensure proper testing protocols and accurate test result verification.

Abstract: The present disclosure provides a communication method, and an electronic device. The method includes: obtaining, by an electronic device, a plurality of 2D images and/or a plurality of depth maps for a current scene, the plurality of 2D images and/or the plurality of depth maps being aligned in time; and transmitting, by the electronic device, the plurality of 2D images and/or the plurality of depth maps to the server by means of wireless communication.

Abstract: A computer-implemented method of transcribing an audio stream can include transcribing the audio stream using a first transcribing instance having a first predetermined transcription size that is smaller than the total length of the audio stream. The first transcribing instance can provide a plurality of consecutive first transcribed text data snippets of the audio stream and the size of the first transcribed text data snippets can respectively corresponding to the first predetermined transcription size. The audio stream can also be transcribed using at least a second transcribing instance having a second predetermined transcription size that is smaller than the length of the audio stream. The second transcribing instance can provide a plurality of consecutive second transcribed text data snippets each corresponding to the second predetermined transcription size.

Abstract: A hearing system comprises a hearing device, e.g. a hearing aid, configured to be worn by a particular user at or in an ear, or to be fully or partially implanted in the head at an ear of the user. The hearing device comprises at least one microphone for converting a sound in the environment of the hearing device to an electric input signal. The hearing system, e.g. the hearing device, comprises a processor comprising an own voice analyzer configured to characterize the voice of a person presently wearing the hearing device based at least partly on said electric input signal, and to provide characteristics of said person's voice, and an own voice acoustic channel analyzer for estimating characteristics of an acoustic channel from the mouth of the person presently wearing the hearing device to the at least one microphone based at least partly on said electric input signal, and to provide characteristics of said acoustic channel of said person.

Abstract: A device for communication includes one or more processors configured to receive, during an online meeting, a speech audio stream representing speech of a first user. The one or more processors are also configured to receive a text stream representing the speech of the first user. The one or more processors are further configured to selectively generate an output based on the text stream in response to an interruption in the speech audio stream.

Abstract: Location determination and telephone number distribution for emergency calls is enabled by a telephony system which maintains multiple pools of telephone numbers. Each pool corresponds to a different region such that the pools of telephone numbers are defined at the region-level rather than at the site-level. The telephony system determines the location of a calling device initiating an emergency call regardless of whether the calling device is at a known site. Based on the determined location of the calling device, one of the pools of telephone numbers which corresponds to that location is selected. The telephony system thereafter distributes a telephone number for the calling device to use for the emergency call from that selected pool of telephone numbers to facilitate an emergency call between the calling device and a local public safety answering point.

Abstract: The disclosure relates to an artificial intelligence (AI) system using a machine learning algorithm such as deep learning, and an application thereof. In particular, an electronic apparatus, a document displaying method thereof, and a non-transitory computer readable recording medium are provided. An electronic apparatus according to an embodiment of the disclosure includes a display unit displaying a document, a microphone receiving a user voice, and a processor configured to acquire at least one topic from contents included in a plurality of pages constituting the document, recognize a voice input through the microphone, match the recognized voice with one of the acquired at least one topic, and control the display unit to display a page including the matched topic.

Abstract: A multi-display capture system receives user selections of two or more display areas, such as screens or application windows, generated by a computing device. The multi-display capture system simultaneously captures a video stream of each of the selected display areas. In another display area, the multi-display capture system outputs a combined display that includes each of the captured video streams. The user may select a video stream to enlarge, and the multi-display capture system enlarges the video streams while continuing to display the other video streams. The combined display may be shared with one or more other users.

Abstract: A videophone system includes a processor which selectively sets a television (TV) broadcast program viewing function mode and videophone function mode in response to manual operation of a remote control, a decoder which performs, in the TV program view mode, a TV program-use decode function for decoding a broadcast program signal received from a TV tuner to thereby display it on a display screen while producing audio sounds by loudspeakers and which performs, in the videophone function mode a videophone-use decode function for decoding a videophone signal received from a distant party to thereby display on the screen an image of the distant party using the screen and speakers, and an encoder which performs a videophone-use encode function for encoding a video signal from a camera and a voice signal from a microphone to generate a videophone signal, which is sent to the distant party via a network.

Abstract: A device with a microphone acquires audio data of a user's speech. A neural network accepts audio data as input and provides sentiment data as output. The neural network is trained using training data based on input from raters who provide votes as to which sentiment descriptors they think are associated with a sample of speech. A vote by a rater assessing the sample for a particular semantic descriptor is distributed to a plurality of semantically similar semantic descriptors. Semantic descriptor similarity data indicates relative similarity between possible semantic descriptors in the semantic space. The distributed partial votes may be aggregated to produce training data comprising samples of speech and weights of corresponding semantic descriptors. The training data is then used to train the neural network. For example, the neural network may be trained with the training data using per-instance cosine similarity loss or correlational loss.

Abstract: Described herein is a system for improving sentiment detection and/or recognition using multiple inputs. For example, an autonomously motile device is configured to generate audio data and/or image data and perform sentiment detection processing. The device may process the audio data and the image data using a multimodal temporal attention model to generate sentiment data that estimates a sentiment score and/or a sentiment category. In some examples, the device may also process language data (e.g., lexical information) using the multimodal temporal attention model. The device can adjust its operations based on the sentiment data. For example, the device may improve an interaction with the user by estimating the user's current emotional state, or can change a position of the device and/or sensor(s) of the device relative to the user to improve an accuracy of the sentiment data.

Abstract: A computer-implemented method and system of providing a video chat experience in a network are described. The method may include: receiving live video stream signals, including audio signals, from a plurality of participants of a live video chat session; combining the live video stream signals into a shared canvas; providing the shared canvas to the plurality of participants, wherein the shared canvas is substantially synchronized among the plurality of participants; and providing options for the specific chat participant to manipulate the shared canvas.

Abstract: The present technology is effective to receive a list of topics for discussion, initiate a conversation with a passenger of an autonomous vehicle, receive sensor data from sensors of the autonomous vehicle; determine, based upon sensor data received from the autonomous vehicle and the first topic, contextual information to present in the conversation with the passenger; and present the contextual information in the conversation to the passenger. The list of topics may be determined by a user. The conversation may include at least a first topic. The first topic may be included in the list of topics for discussion.

Abstract: Disclosed are an information processing method and information processing apparatus which execute an installed artificial intelligence (AI) algorithm and/or machine learning algorithm to process a spoken utterance of a user in a 5G communication environment. The information processing method according to an embodiment of the present disclosure may include receiving a spoken utterance of a user and extracting, from the spoken utterance, a demonstrative pronoun referring to a target indicated by the user, determining an image capture region to be scanned by a camera according to the type of the demonstrative pronoun, recognizing the target indicated by the user from a result of scanning the image capture region, and feeding back a result of processing the spoken utterance to the user on the basis of a result of recognizing the target indicated by the user.

Abstract: Computing systems and methods are described in which video calls or other online communications are established or enhanced among two or more live participants. In some variants one or more preferences are gleaned from a first participant's behavior so as to streamline a call establishment with one or more qualified recipients. Alternatively or additionally, enriched auditory message data may be received privately from a sender without leaving a shared space.

Abstract: Electronic conferences are a common method of conducting a meeting when the participants are not at the same location. When a conference drops a portion of the audio, such carrying speech from a speaker, participants may be excluded from the full content of the conference. By having a device associated with a speaking participant convey both audio and generated text from the speech provided by the speaking participant, a server may be able to determine that speech is missing from the audio portion and automatically insert text content. As a result, poor audio quality may be mitigated with text and omitting unwanted text when the audio quality is sufficient.

Abstract: Systems and methods for providing a universal platform for at-home health testing and diagnostics are provided herein. In particular, a health testing and diagnostic platform is provided to connect medical providers with patients and to generate a unique, private testing environment. In some embodiments, the testing environment may facilitate administration of a medical test to a patient with the guidance of a proctor. In some embodiments, the patient may be provided with step-by-step instructions for test administration by the proctor within a testing environment. The platform may display unique, dynamic testing interfaces to the patient and proctor to ensure proper testing protocols and accurate test result verification.