Abstract: A method (1000) for operating cameras (202) in a cascaded network (100), comprising: capturing a first view (1200) with a first lens (326) having a first focal point (328) and a first centroid (352), the first view (1200) depicting a subject (1106); capturing a second view (1202) with a second lens (326) having a second focal point (328) and a second centroid (352); detecting a first location of the subject (1106), relative the first lens (326), wherein detecting the first location of the subject (1106), relative the first lens (326), is based on audio captured by a plurality of microphones (204); estimating a second location of the subject (1106), relative the second lens (326), based on the first location of the subject (1106) relative the first lens (326); selecting a portion (1206) of the second view (1202) as depicting the subject (1106) based on the estimate of the second location of the subject (1106) relative the second lens (326).

Abstract: Systems and methods for providing a universal platform for at-home health testing and diagnostics are provided herein. In particular, a health testing and diagnostic platform is provided to connect medical providers with patients and to generate a unique, private testing environment. In some embodiments, the testing environment may facilitate administration of a medical test to a patient with the guidance of a proctor. In some embodiments, the patient may be provided with step-by-step instructions for test administration by the proctor within a testing environment. The platform may display unique, dynamic testing interfaces to the patient and proctor to ensure proper testing protocols and accurate test result verification.

Abstract: Embodiments allow for an auto-mixer to gate microphones on and off based on speech detection, without losing or discarding the speech received during the speech recognition period. An example method includes receiving and storing an input audio signal. The method also includes determining, based on a first segment of the input audio signal, that the input audio signal comprises speech, and determining a delay between the input audio signal and a corresponding output audio signal provided to a speaker. The method also includes reducing the delay, wherein reducing the delay comprises removing one or more segments of the stored input audio signal to create a time-compressed audio signal and providing the time-compressed audio signal as the corresponding output audio signal. The method also includes determining that the delay is less than a threshold duration, and responsively providing the input audio signal as the corresponding output audio signal.

Abstract: The present invention relates to a method and a system for capping incoming transactions in inbound stateful conversations established between a client and a plurality of conversation servers of a service integrator. For each client, a group of conversation servers is allocated to handle the inbound stateful conversations initiated. Each conversation server in the group broadcasts a local traffic value periodically to the other conversation servers in the group. Each conversation server in the group calculates a transaction capping limit based on a client global transaction capping limit and the broadcasted local traffic values from the other conversation servers in the group. Each conversation server limits the rate of incoming transactions received by the client when exceeding the local transaction capping limit.

Abstract: Methods, systems, and devices for audio detection are described. A security and automation system may include a control system that includes a hub device and one or more user interfaces. The control system is configured to receive, at a microphone included in the control system, an audio signal from a zone within the premises. In some examples, the control system may be configured to communicate with nodes of the security and automation system using one or more wireless access technologies and one or more wired access technologies. The control system may determine, at a first processor of the control system, that a set of characteristics of the audio signal satisfies a threshold. The control system may transmit a notification of an event in the zone of the premises based on determining that the set of characteristics of the audio signal satisfies the threshold.

Abstract: Systems and methods for facilitating virtual collaboration between users within virtual environments are disclosed. A plurality of users access a collaborative virtual environment system using interface devices to establish a virtual collaboration session in which users communicate via a bidirectional real-time communication channel and interact within a virtual environment. Annotations or other user interactions within the virtual environment are automatically propagated to each user in the virtual collaboration session in order to facilitate collaboration. Data from such virtual collaboration sessions may be captured for later use.

Abstract: In various examples, as a user is speaking or presenting content during an online video conference, the data stream may be processed to generate a textual representation (e.g., transcript) of the audio and/or information relating to the video. The textual representation and/or video related information may then be processed to determine a context or one or more topic(s) of discussion. Based on the determined context/topic(s), a corresponding neural network(s) may be selected. Once a neural network has been selected, comments may be retrieved from a chat feature of the application and applied to the neural network. The neural network may then output data to indicate the relevance of the comments to the determined discussion topic. Based on the relevance of the comment, the comment may be allowed, prioritized, deleted, de-emphasized, or otherwise filtered in the chat feature.

Abstract: Implementations described here provide a chatbot system that is configurable to meet the needs of the user. In one implementation, a chatbot system is configured to utilize and vary decision trees, decision tree complexity, and decision tree selection adaptive to the needs of the end user. Further, implements may utilize decision trees that are configured as static or dynamic using independent leaves and skillsets to allow for variations in the level of sophistication needed for a chatbot conversation. In other implementations, a chatbot system may be configured to assess the chatbot scenario and requirements in order to adapt processing requirements in order to increase or decrease processing threads to vary processing efficiency relative to the needs of the user. In some scenarios, the chatbot system described herein is introspective thereby using feedback and data to be adaptive to chatbot session errors and self-healing.

Abstract: A conference gallery view intelligence system determines regions of interest for display within views of conferencing software based on input streams received from devices within a conference room during a conference. Conference participants are detected in the conference room based on an input video stream received from a video capture device. A direction of audio from the conference participants is determined based on an input audio stream received from a multi-directional audio capture device. A conversational context within the conference room is then determined based on the direction of the audio and locations of the one or more conference participants in the conference room. A region of interest to output within conferencing software is determined based on the conversational context, and the region of interest is output for display within a view of the conferencing software.

Abstract: An agent control device configured to execute a plurality of agents and including a processor, the processor being configured to store an interruptibility list that stipulates interruptibility of execution for each function of one given agent being executed or for an execution status of the one given agent; request execution of each of the agents at a prescribed trigger, or request execution of another given agent at a specific trigger, reference the interruptibility list in order to set permissibility information relating to executability of the other given agent in conjunction with execution of the one given agent; and perform management such that, in a case in which there is a request at the specific trigger for execution of the other given agent while the one given agent is executing, the other given agent is executed based on the request.

Abstract: An illustrative frequency-domain encoder system transforms time-domain data representative of a content instance into frequency-domain data representative of the content instance. The frequency-domain data includes a plurality of complex coefficients each representing different frequency components of a plurality of frequency components incorporated by the content instance. The frequency-domain encoder system generates a frequency-domain data container that includes the complex coefficients of the frequency-domain data and metadata descriptive of the frequency-domain data. Additionally, within the frequency-domain data container, the frequency-domain encoder system integrates the complex coefficients of the frequency-domain data with timing data representative of a time-dependent feature of the content instance. Corresponding systems and methods are also disclosed.

Abstract: Systems, devices, and methods of the present invention relate to detecting a request for explanation in text. In an example, a method creates a discourse tree from a subset of text. The discourse tree includes nodes, each nonterminal node representing a rhetorical relationship between two of the fragments and each terminal node of the nodes of the discourse tree is associated with one of the fragments. The method forms a communicative discourse tree from the discourse tree by matching each fragment that has a verb to a verb signature. The method further identifies that the subset of text comprises a request for an explanation by applying a classification model trained to detect a request for an explanation to the communicative discourse tree.

Abstract: Disclosed is a method for processing a voice signal applicable to a terminal. The method can include: receiving a first voice signal; sending the first voice signal to a server in response to determining that the first voice signal includes a preset wake-up word; and receiving a second voice signal in response to receiving an acknowledgement result from the server, and responding to an interaction instruction corresponding to the second voice signal in a live streaming room.

Abstract: An information processing apparatus includes: a processor configured to specify, in a conference in which plural participants participate via a communication line, a first business card image obtained by reading a business card of a first participant of the conference based on an image obtained by photographing the first participant, and display the first business card image in a display manner different from a display manner for a second business card image of a second participant of the conference, the second participant being different from the first participant.

Abstract: A method for determining camera framing in a teleconferencing system comprises a process loop which includes acquiring an audio-visual frame from a captured a video data frame; detecting objects and extracting image features of the objects within the video data frame, ingesting the audio-visual frame into a context-based audio-visual map in an intelligent manner, and selecting targets from within the map for inclusion in an audio-video stream for transmission to a remote endpoint.

Abstract: A method for publishing a synthetic video feed during a video call including, during an operating period: tracking a computational load of a first device; and receiving a sequence of frames in a video feed from a camera facing a first user. The method also includes, responsive to the computational load of the first device falling below a first computational load threshold: detecting the first user's face in the sequence of frames; generating facial landmark containers representing facial actions of the first user; inserting the facial landmark containers and a look model, into a synthetic face generator to generate a first synthetic video feed; and publishing the first synthetic video feed for access by a second device. The method further includes, responsive to the computational load of the first device exceeding the first computational load threshold, offloading generation of a second synthetic video feed to the second device.

Abstract: The present disclosure relates to a response analysis system that employs a small-data training dataset to train a neural network that accurately performs domain-agnostic opinion mining. For example, in one or more embodiments, the response analysis system trains a response classification neural network using part of speech information (e.g., syntactic information) to learn and apply response classification labels for opinion text responses. In particular, the response analysis system employs part of speech information patterns without regard to word patterns to determine whether words in a text response correspond to an opinion, the target of the opinion, or neither. In addition, the trained response classification neural network has a significantly reduced learned parameter space, which decreases processing, memory requirements, and overall complexity.

Abstract: A method of obtaining and automatically providing secure authentication information includes registering a client device over a data line, storing information and a changeable value for authentication in subsequent telephone-only transactions. In the subsequent transactions, a telephone call placed from the client device to an interactive voice response server is intercepted and modified to include dialing of a delay and at least a passcode, the passcode being based on the unique information and the changeable value, where the changeable value is updated for every call session. The interactive voice response server forwards the passcode and a client device identifier to an authentication function, which compares the received passcode to plural passcodes generated based on information and iterations of a value stored in correspondence with the client device identifier. Authentication is confirmed when a generated passcode matches the passcode from the client device.

Abstract: Interactions with objects depicted within video streams displayed during a video conference are detected to cause information associated with the interacted objects to be presented. During a video conference, multiple video layers of a video stream obtained from a first participant device connected to the video conference are identified. An interaction with an object within one of those multiple video layers is detected during the video conference, in which the interaction is from a second participant device connected to the video conference. Based on the interaction, information associated with the object is presented during the video conference within a graphical user interface associated with the video conference. The video stream may, for example, initially include a background layer, a foreground layer, and an overlay layer. Interactive video layers corresponding to each of those initial layers may be introduced to receive interactions with objects depicted therein.

Abstract: An information processing device includes a processor configured to query a user about an operation item to be executed by equipment in a case where biological information about the user satisfying a specific condition is acquired, but a single operation item of the equipment to associate with the acquired biological information is not specified, and associate an operation item designated by the user in response to the query with the acquired biological information.