Abstract: Features described herein pertain to extending the functionality of an application executing on an electronic device. A device trait specification associated with a smart device can be used to generate an application extension template for defining a layout of a graphical user interface page of the application and binding at least one device trait of the set of device traits to the application. An application extension can be generated based on the application extension template being populated with layout defining values and binding values. The application extension can be provided to the application. The application extension can cause the graphical user interface page of the application to be displayed on a display of the electronic device with the defined layout and elements bound to the layout and configured to cause the smart device to be controlled based on the device traits.

Abstract: A method includes receiving a sequence of acoustic frames and generating, by an audio encoder, at each of a plurality of output steps, an acoustic higher-order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. For each acoustic frame in the sequence of acoustic frames paired with a corresponding video frame, the method includes generating, by an audiovisual encoder, an audiovisual higher-order feature representation for the corresponding acoustic higher-order feature frame and the corresponding video frame; and generating, by a joint network, at an output step, a probability distribution over possible speech recognition hypotheses based on the audiovisual higher-order feature representation.

Abstract: A method includes receiving a code insight request requesting a code insight for target source code. The code insight request includes the target source code and a tool type indicator specifying that the software development tool includes one of a code labeling type of software development tool or a code transformation type of software development tool. The method also includes obtaining a machine learning model based on the tool type indicator and generating the code insight using the machine learning model. The code insight includes one of a predicted label for the target source code when the tool type indicator specifies that the software development tool includes the code labeling type of software development tool, or a predicted code transformation for the target source code when the tool type indicator specifies that the software development tool includes the code transformation type of software building tool.

Abstract: Systems, methods, and media for presenting media content are provided. In some implementations, a system for presenting media content is provided, the system comprising: a hardware processor that is programmed to: establish a connection with a media playback device; respond to a discovery request from a computing device presenting a media content item; establish a persistent communication channel with the computing device over a network in response to a request from the computing device to establish the persistent communication channel; receive identifying information of the media content item being presented by the computing device and identifying information of a source of the media content item being presented by the computing device; request the media content item from the identified source of the media content item as a stream of media content; and cause the media content item to be presented using the media playback device.

Abstract: A computing device may perform various aspects of the techniques described in this disclosure, and comprises a processor, a network interface, and a memory. The processor may receive, from a vehicle head unit, and via a wireless inter-device communication process, connection information identifying a wireless network provided by the vehicle head unit. The network interface may automatically establish, based on the connection information, a wireless network connection to the wireless network provided by the vehicle head unit. The processor may project, via the wireless network connection, a vehicle operating system to the vehicle head unit for display by the vehicle head unit. The memory may store the connection information.

Abstract: Some implementations process, using warm word model(s), a stream of audio data to determine a portion of the audio data that corresponds to particular word(s) and/or phrase(s) (e.g., a warm word) associated with an assistant command, process, using an automatic speech recognition (ASR) model, a preamble portion of the audio data (e.g., that precedes the warm word) and/or a postamble portion of the audio data (e.g., that follows the warm word) to generate ASR output, and determine, based on processing the ASR output, whether a user intended the assistant command to be performed. Additional or alternative implementations can process the stream of audio data using a speaker identification (SID) model to determine whether the audio data is sufficient to identify the user that provided a spoken utterance captured in the stream of audio data, and determine if that user is authorized to cause performance of the assistant command.

Abstract: A method of sharing smart home devices between applications may include receiving a request from a first application operating on a control device to share a smart home device that registered with the first application; generating an interface on the control device that displays one or more applications with which the smart home device can be shared; receiving a selection of a second application with which to share the smart home device; and sending information to the second smart home device to register the smart home device.

Abstract: A battery pack includes a battery, an outer enclosure housing the battery to form a battery pack, and an expandable portion extending from the outer enclosure and allowing the battery pack to expand along an X-axis of the battery pack. The expandable portion includes an inner portion, an outer portion, and a gap portion between the inner portion and the outer portion. The inner portion and the outer portion have a sealing layer to seal off an interior space and the gap portion is devoid of the sealing layer. The sealing layer allows for fluid communication between the gap portion and the interior space when a pressure exerted on the sealing layer exceeds a pressure threshold. The expandable portion includes folds allowing the expandable portion to fold toward the battery pack in an initial folded configuration and expand away from the battery pack in an at least partially unfolded configuration.

Abstract: Images of a plurality of users are captured concurrently with the plurality of users evincing a plurality of expressions. The images are captured using one or more eye tracking sensors implemented in one or more head mounted devices (HMDs) worn by the plurality of first users. A machine learnt algorithm is trained to infer labels indicative of expressions of the users in the images. A live image of a user is captured using an eye tracking sensor implemented in an HMD worn by the user. A label of an expression evinced by the user in the live image is inferred using the machine learnt algorithm that has been trained to predict labels indicative of expressions. The images of the users and the live image can be personalized by combining the images with personalization images of the users evincing a subset of the expressions.

Abstract: A method including, at a camera, detecting motion in a field of view of the camera using a motion sensor, initiating processing of video data corresponding to the field of view in which the motion was detected, ceasing the processing after a first time duration, and determining a cool-off period for the motion sensor, the cool-off period having a second time duration based on the first time duration during which the camera does not detect motion using the motion sensor.

Abstract: Delay reporting information descriptive of an existing delay of the participant computing device is received from each participant computing device of a participant cohort. The existing delay includes a period of time between transmission of audio data from the teleconference computing system and receipt of the audio data by the participant computing device. The participant cohort includes multiple participant computing devices that are co-located within a same area and are connected to a teleconference hosted by the teleconference computing system. A target delay is determined for the participant cohort. The target delay includes a period of time greater than the existing delay of participant computing devices. The target delay is configured to cause synchronized audio playback when implemented by the devices. Target delay information indicative of the target delay is provided to the participant cohort.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining summary content for resources in a domain. In one aspect, a method includes accessing a first resource belonging to a particular domain, selecting an anchor in the first resource linking to a second resource belonging to the particular domain, identifying particular text content in the first resource that is subordinate to the anchor that the second resource includes the particular text content that is subordinate to the anchor, based on determining that the second resource includes the particular text content that is subordinate to the anchor, generating a domain template for the particular domain, the domain template specifying a location of the particular text content in the second resource, and determining, for each respective resource belonging to the particular domain having a structure matching the domain template, respective text content for the respective resource.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for scheduling operations represented as a computational graph on a distributed computing network. A method includes: receiving data representing operations to be executed in order to perform a job on a plurality of hardware accelerators of a plurality of different accelerator types; generating, for the job and from at least the data representing the operations, features that represent a predicted performance for the job on hardware accelerators of the plurality of different accelerator types; generating, from the features, a respective predicted performance metric for the job for each of the plurality of different accelerator types according to a performance objective function; and providing, to a scheduling system, one or more recommendations for scheduling the job on one or more recommended types of hardware accelerators.

Abstract: Methods and systems for performing a surface code error detection cycle. In one aspect, a method includes initializing and applying Hadamard gates to multiple measurement qubits; performing entangling operations on a first set of paired qubits, wherein each pair comprises a measurement qubit coupled to a neighboring data qubit in a first direction; performing entangling operations on a second set of paired qubits, wherein each pair comprises a measurement qubit coupled to a neighboring data qubit in a second or third direction, the second and third direction being perpendicular to the first direction, the second direction being opposite to the third direction; performing entangling operations on a third set of paired qubits, wherein each pair comprises a measurement qubit coupled to a neighboring data qubit in a fourth direction, the fourth direction being opposite to the first direction; applying Hadamard gates to the measurement qubits; and measuring the measurement qubits.

Abstract: A media application segments a library of media associated with a user account into episodes, wherein each episode is associated with a corresponding time period. The media application generates, using an event machine-learning model, an event signal that indicates a likelihood that an event occurred in each episode, wherein the event machine-learning model is a classifier that receives the media as input. The media application generates an event significance score for each episode. The media application determines one or more events from the episodes based on the event signal and a corresponding event significance score exceeding a threshold event significance value. The media application provides a user interface that includes corresponding media from the one or more events.

Abstract: Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.

Abstract: In general, techniques are described by which to perform memory efficient patching for computing devices. A server computing device comprising a memory and a processor may be configured to perform the techniques. The memory may store first assets that form an unpatched application and second assets that form a patched application. The processor may virtualize the first assets to obtain a single first virtual asset and obtain a single second virtual asset that represents the second assets. The processor may obtain, based on differences between the single first virtual asset and the single second virtual asset, a patch identifying how to update the single first virtual asset to obtain the single second virtual asset. The processor may next segment the patch into a plurality of segments and output to a user computing device a single segment from the plurality of segments for individual application by the user computing device.

Abstract: Systems and method for routing data packets in ring network. A data packet being transmitted to a destination node may be received by a first structure at a first node. The first node may determine a number of hops the data packet will traverse as it is transmitted from the first node to the destination node and compare the determined number of hops to a threshold hop value to determine whether the number of hops is equal to or less than the threshold hop value. If the number of hops is greater than the threshold, the data packet may be transmitted to a dimension queuing structure for a first virtual channel within a second node, otherwise, the data packet may be transmitted to a dimension queuing structure for a second virtual channel or a turn queuing structure within the second node.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network system to perform multiple machine learning tasks.

Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.