Abstract: Aspects of the disclosure are directed to monitoring, alerting, and/or root causing network problems based on current network behavior and network events at any instant in time using a network behavior model. The network behavior model can learn and be updated with network states and events to correlate network problems and determine root causes of the network problems for alerting and/or automatic correction.

Abstract: Systems and methods for video conference content auto-retrieval and focus based on learned relevance is provided. In accordance with the systems and methods, audio streams and video streams from client devices participating in a video conference are received. Based on the audio streams, a subject being discussed during the video conference at a point in time is determined. A video stream that is most relevant to the subject being discussed during the video conference at the point in time is determined from the video streams. The determined video stream is provided to the client devices for presentation on the client devices while the subject is being discussed during the video conference.

Abstract: Implementations relate to managing multimedia content that is obtained by large language model(s) (LLM(s)) and/or generated by other generative model(s). Processor(s) of a system can: receive natural language (NL) based input that requests multimedia content, generate a response that is responsive to the NL based input, and cause the response to be rendered. In some implementations, and in generating the response, the processor(s) can process, using a LLM, LLM input to generate LLM output, and determine, based on the LLM output, at least multimedia content to be included in the response. Further, the processor(s) can evaluate the multimedia content to determine whether it should be included in the response. In response to determining that the multimedia content should not be included in the response, the processor(s) can cause the response, including alternative multimedia content or other textual content, to be rendered.

Abstract: Routing packetized actions in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate an action data structure. The system can transmit the action data structure to a third party provider device. The system can receive an indication from the third party provider device that a communication session was established with the device.

Abstract: Implementations described herein relate to a computer-implemented method that includes capturing image data using one or more cameras, wherein the image data includes a primary image and associated depth values. The method further includes encoding the image data in an image format. The encoded image data includes the primary image encoded in the image format and image metadata that includes a device element that includes a profile element indicative of an image type and a first camera element, wherein the first camera element includes an image element and a depth map based on the depth values. The method further includes, after the encoding, storing the image data in a file container based on the image format. The method further includes causing the primary image to be displayed.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining watch time loss regions in media content items. In one aspect, features for a video are input into a trained model that is trained to output watch time loss regions. The trained model is trained using labels corresponding to known watch time loss regions in training videos and features of training videos that correspond to the known watch time loss regions. A watch time loss region defines a time window of a video during which a likelihood of a user stopping playback of the video is more than a threshold likelihood. In response to inputting the feature for the first video into the trained model, data regarding watch time loss regions for the video is obtained from the model and provided to an entity involved in providing the video to a user.

Abstract: The present disclosure is generally related to inserting supplemental audio content into primary audio content via digital assistant applications. A data processing system can maintain an audio recording of a content publisher and a content spot marker to specify a content spot that defines a time at which to insert supplemental audio content. The data processing system can receive an input audio signal from a client device. The data processing system can parse the input audio signal to determine that the input audio signal corresponds to a request and can identify the audio recording of the content publisher. The data processing system can identify, responsive to the determination, a content selection parameter. The data processing system can select an audio content item using the content selection parameter. The data processing system can generate and transmit an action data structure including the audio recording inserted with audio content item.

Abstract: Automatically communicating information related to a user computing device from a central computing system to a transaction computing system prior to initiation of a transaction between the user computing device and the transaction computing system comprises a digital wallet application and a central computing system. A digital wallet application receives a beacon signal from a transaction computing system indicating the specific identification of the terminal with which the user intends to conduct a transaction. The user computing device communicates the terminal identification to the central computing system. The central computing system communicates customer data, such as loyalty information and offers, to the transaction computing system associated with the terminal. The transaction computing system communicates the customer data to the terminal. When the user taps the user computing device to initiate the transaction, the terminal provides any benefits associated with the customer data.

Abstract: A computer-implemented method for optimizing the placement of previously selected breaks in a media item is provided herein. Embodiments of the method include steps of identifying a break in a media item, the break being associated with a first break point at a first time during playback of the media item. The method may also include steps of dynamically adjusting the placement of the breaks within the media item based on the performance of the media item.

Abstract: A method includes receiving image data representing an environment of a robotic device from a camera on the robotic device. The method further includes applying a trained dense network to the image data to generate a set of feature values, where the trained dense network has been trained to accomplish a first robot vision task. The method additionally includes applying a trained task-specific head to the set of feature values to generate a task-specific output to accomplish a second robot vision task, where the trained task-specific head has been trained to accomplish the second robot vision task based on previously generated feature values from the trained dense network, where the second robot vision task is different from the first robot vision task. The method also includes controlling the robotic device to operate in the environment based on the task-specific output generated to accomplish the second robot vision task.

Abstract: The present disclosure provides for a wearable device having a wireless power receiving system that may inductively receive or transmit power. The wireless power receiving system includes a receiver coil having a profile that follows a contour of a bottom cover of the wearable device. A transmitter coil from a wireless charging device has a complementary profile that mates with the profile defined by the receiver coil. In one example, the wireless power receiving system includes a shielding, and a receiver coil attached to the shielding. The receiver coil further includes an inner wall and an outer wall connected by a top surface of a coil body. The inner wall defines a center opening in the receiver coil, wherein the receiver coil is conical in shape.

Abstract: The disclosure relates to power modules that include elevated inductors with capacitors disposed under the inductors. In one aspect, a power module includes a first circuit board having a first surface and a second surface opposite the first surface. One or more inductors are mounted on the first surface. Each of the one or more inductors includes a top surface and a bottom surface opposite the top surface and that faces the first surface of the first circuit board. Each inductor is elevated above the first surface of the first circuit board such that at least a portion of the bottom surface of the inductor does not contact the first surface of the first circuit board. The first circuit board includes capacitors arranged in an area below the portion of the bottom surface of the inductor that does not contact the first surface of the first circuit board.

Abstract: The various embodiments described herein include methods, devices, and systems for relaying messages in a communications system. In one aspect, a method is performed at a server having one or more processors and memory storing instructions for execution by the one or more processors. The method includes: (1) obtaining a plurality of incoming messages; (2) identifying one or more messages from among the plurality of incoming messages, the one or more messages obtained from a first user; (3) receiving a feedback message from a second user about at least one of: the first user and a first message of the one or more messages; and (4) sending the feedback message from the second user to a plurality of users, where the plurality of users track at least one of: the first user and the first message.

Abstract: Methods, systems, and apparatus, including an apparatus for verifying the integrity of requests. In some aspects, a method includes receiving, from an application, a request including an attestation token of the application. The attestation token includes a set of data that includes at least a public key of the application and a token creation time that indicates a time at which the attestation token was created. The attestation also includes a signature of the set of data. The signature is generated using a private key that corresponds to the public key. The integrity of the request is verified using the attestation token. The verification includes determining that the integrity of the request is valid based on a determination that the token creation time is within a threshold duration of the time at which the request was received and a determination that the set of data has not been.

Abstract: The present disclosure provides systems and methods that perform machine-learned natural language processing. A computing system can include a machine-learned natural language processing model that includes an encoder model trained to receive a natural language text body and output a knowledge graph and a programmer model trained to receive a natural language question and output a program. The computing system can include a computer-readable medium storing instructions that, when executed, cause the processor to perform operations. The operations can include obtaining the natural language text body, inputting the natural language text body into the encoder model, receiving, as an output of the encoder model, the knowledge graph, obtaining the natural language question, inputting the natural language question into the programmer model, receiving the program as an output of the programmer model, and executing the program on the knowledge graph to produce an answer to the natural language question.

Abstract: A computer-implemented method for automatically uploading media content from a mobile device to an online service provider can include receiving, in the mobile device, identifying information corresponding to a user account associated with at least one of a plurality of online service providers; capturing media content with a media input component included in the mobile device; and after the media content is captured, automatically uploading to the at least one online service provider the captured media content and the identifying information, without receiving user input contemporaneous with the automatic uploading that specifies that the captured media content is to be uploaded. The mobile device can further include a wireless communication component configured to wirelessly send data to and wirelessly receive data from the plurality of online service providers, which can be external to the mobile device.

Abstract: In accordance with some embodiments, a method for generating sentimental information associated with media content is provided, the method comprising: receiving user input data corresponding to a user; identifying a portion of the media content item based on the user input data; determining a sentiment based on the user input data, wherein the sentiment is one of a positive sentiment which indicates that the media content item was liked by the user or a negative sentiment which indicates that the media content item was disliked by the user; determining an amount of the sentiment based on the user input data; associating the amount of the sentiment with the portion of the media content item; and generating, for the media content item, sentimental information that indicates the amount of the sentiment associated with at least one portion of the media content item.

Abstract: A method for providing personalized content sharing is disclosed.

Abstract: The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.

Abstract: A uniform enclave interface is provided for creating and operating enclaves across multiple different types of backends and system configurations. For instance, an enclave manager may be created in an untrusted environment of a host computing device. The enclave manager may include instructions for creating one or more enclaves. An enclave may be generated in memory of the host computing device using the enclave manager. One or more enclave clients of the enclave may be generated by the enclave manager such that the enclave clients configured to provide one or more entry points into the enclave. One or more trusted application instances may be created in the enclave.

Abstract: Systems and methods that enable hardware memory error tolerant software systems. For instance, the system may comprise a host device that instantiates a kernel agent in response to one or more requests to access hardware memory, determines, by the kernel agent based on the received information, whether the request to access memory will cause access to a corrupt memory location, and skip an operation associated with the corrupt memory location in response to determining that the request will access a corrupt memory location. The systems may also include a system that detects software vulnerabilities to hardware memory errors.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating data defining a graph. In one aspect, a method comprises: sequentially generating a respective edge set for each node in the graph, wherein for each of a plurality of nodes after a first node, generating the edge set for the node comprises: receiving a context embedding for the node that summarizes a respective edge set for each node that precedes the node; generating, based on the context embedding for the node: (i) a respective edge set for the node, and (ii) a respective embedding of the edge set for the node; generating a context embedding for a next node in the ordering of the nodes using the embedding of the edge set for the node; and adding the set of edges defined by the edge set for the node to the graph.

Abstract: Implementations described herein are directed to enabling collaborative ranking of interpretations of spoken utterances based on data that is available to an automated assistant and third-party agent(s), respectively. The automated assistant can determine first-party interpretation(s) of a spoken utterance provided by a user, and can cause the third-party agent(s) to determine third-party interpretation(s) of the spoken utterance provided by the user. In some implementations, the automated assistant can select a given interpretation, from the first-party interpretation(s) and the third-party interpretation(s), of the spoken utterance, and can cause a given third-party agent to satisfy the spoken utterance based on the given interpretation.

Abstract: Implementations set forth herein relate to an automated assistant that can perform operations to revert various applications to prior states that the applications may have arrived at via certain user inputs. The user can provide a spoken utterance such as, “undo,” in order to cause the automated assistant to identify a particular application that the user may want to affect with the “undo” command. When the particular application is identified, the automated assistant can identify one or more operations recently performed using the particular application. In some implementations, the automated assistant can provide the user with a variety of undo options in response to an “undo” command. For instance, the automated assistant can prompt the user to select one of a first cluster of operations and/or a second cluster of operations to be undone, and each cluster can refer to different operations.

Abstract: Methods, systems, devices, and computer-readable storage media for managing a multi-tenant cloud computing platform. Rather than maintain cluster control planes separately for each tenant, a cloud provider control plane implemented on one or more nodes can manage the creation, allocation, execution, and destruction of cluster control planes in an on-demand way. Computing resources can be used more efficiently at least because resources are not under-utilized. Adding additional tenants can be done with zero or small marginal cost per-tenant, because cluster control planes for servicing requests by the tenant are executed in response to a request, but destroyed when a tenant for the plane is idle. Multiple instances of an API server implementing a platform API for communicating between devices of the platform and clusters of computing resources can be generated and modified on a per-tenant basis.

Abstract: Methods, systems, and apparatus for parallel optimization of continuously running quantum error correction by closed-loop feedback. In one aspect, a method includes continuously and effectively optimizing qubit performance in-situ whilst an error correction operation on the quantum system is running. The method directly monitors the output from error detection and provides this information as feedback to calibrate the quantum gates associated with the quantum system. In some implementations, the physical qubits are spatially partitioned into one or more independent hardware patterns, where the errors attributable to each hardware pattern are non-overlapping. The one or more different sets of hardware patterns are then temporarily interleaved such that all physical qubits and operations are optimized. The method allows for the optimization of each section of a hardware pattern to be performed individually and in parallel, and can result is O(1) scaling.

Abstract: A three dimensional neural network accelerator that includes a first neural network accelerator tile that includes a first transmission coil, and a second neural network accelerator tile that includes a second transmission coil, wherein the first neural network accelerator tile is adjacent to and aligned vertically with the second neural network accelerator tile, and wherein the first transmission coil is configured to wirelessly communicate with the second transmission coil via inductive coupling.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for scalable matrix factorization. A method includes obtaining a Structured Query Language (SQL) query to create a matrix factorization model based on a set of training data, generating SQL sub-queries that don't include non-scalable functions, obtaining the set of training data, and generating a matrix factorization model based on the set of training data and the SQL sub-queries that don't include non-scalable functions.

Abstract: An example method includes programming, during non-emission periods of frames of a plurality of frames based on image data of the frames, pixels of the plurality of pixels of a display of a computing device; causing, during emission periods of the frames, pixels of the plurality of pixels to emit light, wherein an amount of light emitted by the pixels during an emission period of a particular frame is based on the programming for the particular frame; and synchronizing operation of one or more sensors and operation of the plurality of pixels by at least causing the one or more sensors to alternatingly emit, through the display, electromagnetic radiation during emission periods and non-emission periods.

Abstract: A comprehensive cybersecurity platform includes a cybersecurity intelligence hub, a cybersecurity sensor and one or more endpoints communicatively coupled to the cybersecurity sensor, where the platform allows for efficient scaling, analysis, and detection of malware and/or malicious activity. An endpoint includes a local data store and an agent that monitors for one or more types of events being performed on the endpoint, and performs deduplication within the local data store to identify “distinct” events. The agent provides the collected metadata of distinct events to the cybersecurity sensor which also performs deduplication within a local data store. The cybersecurity sensor sends all distinct events and/or file objects to a cybersecurity intelligence hub for analysis. The cybersecurity intelligence hub is coupled to a data management and analytics engine (DMAE) that analyzes the event and/or object using multiple services to render a verdict (e.g., benign or malicious) and issues an alert.

Abstract: PWM-frame rate misalignment is mitigated through implementation of a discrete variable refresh rate (VRR) scheme. A target frame rate is limited to a frame rate selected from only those frame rates that facilitate alignment of each frame period to a specified edge of a PWM cycle of a brightness control signal of a display panel. This alignment results in each frame period at the selected frame rate starting at a same point in a corresponding PWM cycle and ending at a same point in a corresponding PWM cycle to help ensure a constant effective duty cycle across each successive frame period, which in turn mitigates perception of flicker that otherwise would arise. Further, the discrete VRR scheme can employ a compensation mode for compensating for the delay in rendering or otherwise obtaining a frame for display so as to maintain a consistent duty cycle in the brightness control signal.

Abstract: A computing system and method that can be used for safe and privacy preserving video representations of participants in a videoconference. In particular, the present disclosure provides a general pipeline for generating reconstructions of videoconference participants based on semantic statuses and/or activity statuses of the participants. The systems and methods of the present disclosure allow for videoconferences that convey necessary or meaningful information of participants through presentation of generalized representations of participants while filtering unnecessary or unwanted information from the representations by leveraging machine-learning models.

Abstract: A method for combining hotwords in a single utterance receives, at a first assistant-enabled device (AED), audio data corresponding to an utterance directed toward the first AED and a second AED among two or more AEDs where the audio data includes a query specifying an operation to perform. The method also detects, using a hotword detector, a first hotword assigned to the first AED that is different than a second hotword assigned to the second AED In response to detecting the first hotword, the method initiates processing on the audio data to determine that the audio data includes a term preceding the query that at least partially matches the second hotword assigned. Based on the at least partial match, the method executes a collaboration routine to cause the first AED and the second AED to collaborate with one another to fulfill the query.

Abstract: This document describes apparatuses and techniques enabling a scale down capture preview for a panorama capture user interface. This scale down preview enables users to more-easily and more-accurately capture images for a panorama.

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for enhancing online user privacy. Methods can include receiving tag information specifying a given publisher identifier for a publisher and a given client identifier assigned to a user of the client device by the publisher. A given service identifier assigned to the user by the service apparatus is obtained. A mapping between the given service identifier to the given client identifier is created. A list of client identifiers assigned to a set of users by the publisher is received. A list of matched service identifiers corresponding to the list of client identifiers are stored. Multiple content requests are received from multiple different client devices accessing services provided by the service apparatus. Responses to the content requests are based on whether the client devices provide service identifiers that are included in the list of matched service identifiers.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for storing semi-structured data. One of the methods includes maintaining a plurality of schemas; receiving a first semi-structured data item; determining that the first semi-structured data item does not match any of the schemas in the plurality of schemas; and in response to determining that the first semi-structured data item does not match any of the schemas in the plurality of schemas: generating a new schema, encoding the first semi-structured data item in the first data format to generate the first new encoded data item in accordance with the new schema, storing the first new encoded data item in the data item repository, and associating the first new encoded data item with the new schema.

Abstract: This document describes techniques and devices for efficient handling of a resource control state change and multi-node connectivity. Instead of performing multiple radio resource control (RRC) procedures to change a resource control state of a user equipment (UE) and establish, modify, or release a connection with multi-node connectivity, the techniques described herein combine the multiple RRC procedures into a single RRC procedure that supports both a resource control state change and multi-node connectivity. In particular, a master node sends a resource control state and multi-node connectivity message that includes both state change information and multi-node connectivity information. With this single message, timing and power resources of the UE can be conserved and failures resulting from asynchronous communication of the state change information and the multi-node connectivity information can be avoided.

Abstract: Techniques are described herein for detecting and/or enrolling (or commissioning) new “hot commands” that are useable to cause an automated assistant to perform responsive action(s) without having to be first explicitly invoked. In various implementations, an automated assistant may be transitioned from a limited listening state into a full speech recognition state in response to a trigger event. While in the full speech recognition state, the automated assistant may receive and perform speech recognition processing on a spoken command from a user to generate a textual command. The textual command may be determined to satisfy a frequency threshold in a corpus of textual commands Consequently, data indicative of the textual command may be enrolled as a hot command. Subsequent utterance of another textual command that is semantically consistent with the textual command may trigger performance of a responsive action by the automated assistant, without requiring explicit invocation.

Abstract: Methods, systems, and apparatus, including computer-readable media, are described for performing neural network computations using a system configured to implement a neural network on a hardware circuit. The system includes a host that receives a batch of inputs to a neural network layer. Each of the inputs is stored in a memory location identified by an address. The system identifies one or more duplicate addresses in a listing of addresses for one or more inputs. For each duplicate address: the system generates a unique identifier that identifies the duplicate address in the listing of addresses. The system (i) obtains first inputs from memory locations identified by addresses corresponding to the unique identifiers and (ii) generates an output of the layer from the obtained first inputs.

Abstract: The present disclosure is directed to processing imagery using one or more machine learning (ML) models. In particular, data describing imagery comprising a plurality of different and distinct frames can be received; and based at least in part on one or more ML models and the data describing the imagery, and for each frame of the plurality of different and distinct frames, one or more scores can be determined for the frame. Each score of the score(s) can indicate a determined measure of suitability of the frame with respect to one or more of various different and distinct uses for which the ML model(s) are configured to determine suitability of imagery.

Abstract: Methods, apparatus, systems, and computer-readable media are provided for introducing a user to functions of various applications through interactions with an assistant agent. The assistant agent can correspond to an assistant application that can provide a user interface with multiple selectable elements, each of which can correspond to a separate application. When a user selects one of the selectable elements, a function of an application can be demonstrated to the user, in order that the user might become more familiar with functions of the application. In some implementations, a portion of the selectable element can be selected to cause information about the application to be presented to the user. This allows the user to have the option to try out or learn about an application before investing computational resources through downloading and installing the entire application.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a compressed recurrent neural network (RNN). One of the systems includes a compressed RNN, the compressed RNN comprising a plurality of recurrent layers, wherein each of the recurrent layers has a respective recurrent weight matrix and a respective inter-layer weight matrix, and wherein at least one of recurrent layers is compressed such that a respective recurrent weight matrix of the compressed layer is defined by a first compressed weight matrix and a projection matrix and a respective inter-layer weight matrix of the compressed layer is defined by a second compressed weight matrix and the projection matrix.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detecting utterances of a key phrase in an audio signal. One of the methods includes receiving, by a key phrase spotting system, an audio signal encoding one or more utterances; while continuing to receive the audio signal, generating, by the key phrase spotting system, an attention output using an attention mechanism that is configured to compute the attention output based on a series of encodings generated by an encoder comprising one or more neural network layers; generating, by the key phrase spotting system and using attention output, output that indicates whether the audio signal likely encodes the key phrase; and providing, by the key phrase spotting system, the output that indicates whether the audio signal likely encodes the key phrase.

Abstract: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.

Abstract: Implementations set forth herein relate to an automated assistant that uses circumstantial condition data, generated based on circumstantial conditions of an input, to determine whether the input should affect an action been initialized by a particular user. The automated assistant can allow each user to manipulate their respective ongoing action without necessitating interruptions for soliciting explicit user authentication. For example, when an individual in a group of persons interacts with the automated assistant to initialize or affect a particular ongoing action, the automated assistant can generate data that correlates that individual to the particular ongoing action. The data can be generated using a variety of different input modalities, which can be dynamically selected based on changing circumstances of the individual. Therefore, different sets of input modalities can be processed each time a user provides an input for modifying an ongoing action and/or initializing another action.

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.