Abstract: Techniques and devices for a hierarchical framework of contexts for the smart home are described for managing modes in a smart home system by an electronic device. The electronic device receives a first input of a model for a second operational mode of a smart home system and receives a second input of the model for the second operational mode of the smart home system. Based on the first input and the second input, the electronic device determines an effective time interval for the second operational mode that is effective to cause the smart home system to transition from a first operational mode to the second operational mode during the effective time interval.

Abstract: The technology involves providing haptic feedback to a user of a computing device. For instance, user input associated with a program of the computing device is received by a user interface module of the computing device. One or more processors of the computing device determine a kind of interaction corresponding to the user input. The one or more processors identify whether the kind of interaction is associated with one or more haptic feedback effects of a curated suite of haptic effects. Upon identifying that the kind of interaction is associated with one or more haptic feedback effect, the one or more processors select a particular haptic feedback effect from the curated suite of haptic effects. And the one or more processors are able to cause a haptic feedback module of the computing device to provide the particular haptic feedback effect for sensation by the user.

Abstract: This document describes techniques and apparatuses for memory patching with associative and directly mapped patch data. In some aspects, a processor requests boot code stored at an address of a first region of an address map of a boot ROM. A boot ROM controller can determine, based on the address, that an associative record in a programmable memory includes address information matching the address. The controller returns patch data of the associative record. This patch data includes another address to a second region of the address map. The processor requests other data of the other address, which is directly mapped to other records of the programmable memory that do not include address information related to the address map. Based on an offset between the start address of the second region and the other address from which data is requested, the other data can be fetched from the directly mapped record.

Abstract: A method includes receiving, as input, reference audio data representing a reference audio signal captured by an audio input device. The method also includes receiving, as input, from a beamformer, spatially-filtered audio data representing an output of the beamformer, the beamformer configured to spatially filter, based on additional audio data captured by one or more additional audio input devices, the reference audio data to attenuate one or more interfering signals in the spatially-filtered audio data. The method processes, using a trained guided speech-enhancement network, the reference audio data and the spatially-filtered audio data to generate, as output, enhanced audio data, the guided speech-enhancement network processing the reference audio data and the spatially-filtered audio data to further attenuate, in the enhanced audio data, the one or more interfering signals attenuated by the beamformer.

Abstract: A system enables universal remote media control across multiple platforms, devices, and users. A protocol allows a cast controller to have access to media operations and a state(s) associated with media content. The system receives commands from a cast controller, provides the commands to a media player, loads new media content into the media player, based on the commands, and receives state notifications from the media player. Another cast controller can receive the state notifications from the media player and control the media player based on the media operations and state(s) associated with media content.

Abstract: Restoring a clustered database having a plurality of nodes each having database from a failed storage device by receiving a request to restore a backup image of a failed shared storage device associated with the clustered database to a time; performing a preflight check including at least one checklist process; terminating the restore when any checklist process fails; when each checklist process succeeds completing the restore by creating at least one flashcopy associated with the backup image, mapping to each of the plurality of nodes an associated portion of the at least one flashcopy, mounting the at least one flashcopy to the node as a diskgroup, and switching the clustered database to run from the diskgroup.

Abstract: A method includes obtaining a set of unlabeled test data samples and, for each respective initial training step, determining a first average output for each unlabeled test data sample using a deep ensemble. For each round of a plurality of rounds, the method includes selecting a subset of unlabeled test data samples based on the determined first average outputs, labeling each respective unlabeled in the subset of unlabeled test data samples, fine-tuning the deep ensemble model using the subset of labeled test data samples, and determining a second average output for each unlabeled test data sample using the fine-tuned deep ensemble model. The method also includes generating, using the set of unlabeled test data samples and the determined second average outputs, a pseudo-labeled set of training data samples. The method also includes training the deep ensemble model using the pseudo-labeled set of training data samples.

Abstract: This document describes a thermal-control system (110) that may be integrated into a mesh network device (102) and associated mesh network devices. The thermal-control system (110), which may include a heat sink (112), multiple heat spreaders (114, 118), and a heat shield (116), is such that heat (106) originating from IC devices populating a printed circuit board (104) of the mesh network device (102) may be transferred to a housing component (108) of the mesh network device (102) for external dissipation to maintain a desired thermal profile of the mesh network device (102).

Abstract: Methods, systems, and apparatus for receiving a natural language query of a user, and environmental data, identifying a media item based on the environmental data, determining an entity type based on the natural language query, selecting an entity associated with the media item that matches the entity type, selecting, from a media consumption database that identifies media items that have been indicated as consumed by the user, one or more media items that have been indicated as consumed by the user and that are associated with the selected entity, and providing a response to the query based on selecting the one or more media items that have been indicated as consumed by the user and that are associated with the selected entity.

Abstract: Various arrangements of an electronic device case are presented herein. The case can include a housing shaped to allow an electronic device to be removably installed within the housing. The case can include magnets, the magnets being arranged to magnetically couple with magnets of a dock. The case can include a kickstand assembly attached with the housing. A kickstand body of the kickstand assembly can be extended for propping up the electronic device case when the electronic device case is not docked with the dock. The kickstand body can be collapsed for when the electronic device case is magnetically docked with the dock.

Abstract: Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.

Abstract: A method includes training a first machine learning model with a first dataset, to produce a first trained machine learning model to infer cybersecurity-oriented file properties and/or detect cybersecurity threats within a first domain. The first dataset includes labeled files associated with the first domain. The first trained machine learning model includes multiple layers, some of which are trainable. A second trained machine learning model is generated, via a transfer learning process, using (1) at least one trainable layer from the multiple trainable layers of the first trained machine learning model, and (2) a second dataset different from the first dataset. The second dataset includes labeled files associated with a second domain. The first domain has a different syntax, different semantics, and/or a different structure than that of the second domain. The second trained machine learning model (e.g.

Abstract: Provided are methods, systems, devices, apparatuses, and tangible non-transitory computer readable media for navigation and geocoding. The disclosed technology can perform operations including accessing location data and semantic tags. The location data can include information associated with locations including the location of a carrier and the location of a passenger. The semantic tags can include information associated with features of the locations. The location data and the semantic tags that satisfy meeting criteria can be identified. The meeting criteria can be associated with a suitability of a location for the carrier and the passenger. A meeting location for the carrier and the passenger can be determined based on the location data and the semantic tags that satisfy the meeting criteria. Furthermore, indications associated with the meeting location can be generated based on the features of the meeting location.

Abstract: A user can submit a visual query that includes one or more images. Various processing techniques such as optical character recognition (OCR) techniques can be used to recognize text (e.g. in the image, surrounding image(s), etc.) and/or various object detection techniques (e.g., machine-learned object detection models, etc.) may be used to detect objects (e.g., products, landmarks, animals, humans, etc.) within or related to the visual query. Content related to the detected text or object(s) can be identified and potentially provided to a user as search results or a proactive content feed. As such, aspects of the present disclosure enable the visual search system to more intelligently process a visual query to provide improved search results and content feeds, including those search results which are more personalized and/or consider contextual signals to account for implicit characteristics of the visual query and/or user's search intent.

Abstract: Implementations described herein relate to methods, systems, and computer-readable media to provide an assistive user interface. In some implementations, a computer-implemented method to provide an assistive user interface includes identifying a user journey that includes a plurality of operations to perform a computer-mediated task by analyzing data comprising user interaction data. The method further includes analyzing one or more of application programming interface (API) definitions of a plurality of software applications or user interface (UI) elements of the plurality of software applications to identify a plurality of executable units. The method further includes generating an execution block that defines a sequence of two or more of the plurality of executable units based on the user journey and the plurality of executable units. Execution of the execution block completes the computer-mediated task. The method further includes providing an assistive user interface that includes the execution block.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining one or more neural network architectures of a neural network for performing a video processing neural network task. In one aspect, a method comprises: at each of a plurality of iterations: selecting a parent neural network architecture from a set of neural network architectures; training a neural network having the parent neural network architecture to perform the video processing neural network task, comprising determining trained values of connection weight parameters of the parent neural network architecture; generating a new neural network architecture based at least in part on the trained values of the connection weight parameters of the parent neural network architecture; and adding the new neural network architecture to the set of neural network architectures.

Abstract: A computer-implemented method can include receiving, by a computing system including one or more computing devices, data describing a media content item that includes a plurality of image frames for sequential display. The method can include inputting, by the computing system, the data describing the media content item into a machine-learned temporal analysis model that is configured to receive the data describing the media content item, and in response to receiving the data describing the media content item, output temporal analysis data that describes temporal information associated with sequentially viewing the plurality of image frames of the media content item. The method can include receiving, by the computing system and as an output of the machine-learned temporal analysis model, the temporal analysis data.

Abstract: Methods, and systems, including computer programs encoded on computer storage media for generating machine learning models. A method includes receiving, through a GUI, user selection of a mode button displayed in the GUI, wherein the mode button, when selected, causes the GUI to display a first set of user-selectable buttons that correspond to respective machine learning routines, and when not selected, causes the GUI to display a second set of user-selectable buttons that correspond to respective machine learning sub-routines; in response to receiving user selection of the mode button, displaying the first set of user-selectable buttons; receiving user selection of one or more of the first set of user-selectable buttons; displaying a graphical representation of a machine learning model defined by machine learning routines corresponding to the user selected one or more of the first set of user-selectable buttons and generating a file representing the machine learning model.

Abstract: The various implementations described herein include methods and systems for determining device leadership among voice interface devices. In one aspect, a method is performed at a first electronic device of a plurality of electronic devices, each having microphones, a speaker, processors, and memory storing programs for execution by the processors. The first device detects a voice input. It determines a device state and a relevance of the voice input. It identifies a subset of electronic devices from the plurality to which the voice input is relevant. In accordance with a determination that the subset includes the first device, the first device determines a first score of a criterion associated with the voice input and receives second scores of the criterion from other devices in the subset. In accordance with a determination that the first score is higher than the second scores, the first device responds to the detected input.

Abstract: System and methods are provided for generating panoramic imagery. An example method may be performed by one or more processors and includes obtaining first panoramic imagery depicting a geographic area. The method also includes obtaining an image depicting one or more physical objects absent from the first panoramic imagery. Further, the method includes transforming the first panoramic imagery into second panoramic imagery depicting the one or more physical objects and including at least a portion of the first panoramic imagery.

Abstract: A method includes providing for display at a user device associated with a user a graphical user interface (GUI) of an electronic document editor application of an electronic document system. The GUI includes a document view to display at least a portion of an electronic document that is editable by the user of a first users and a search region to receive one or more search terms. The method includes receiving an indication of a user activation of the search region. Responsive to receiving the indication of the user activation of the search region, the method determines a subset of document operations, among multiple document operations, based on one or more criteria. The method provides, to the user device, an indication of the subset of document operations for display at the GUI as commands for user selection.

Abstract: A method may include (i) obtaining first data records structured in accordance with a first schema, (ii) determining, for the first schema, one or more first schema property values for each schema property in a set of pre-defined schema properties, (iii) determining, for a second schema, one of more second schema property values for each schema property in the set of pre-defined schema properties, (iv) providing, to a schema matching engine, first and second schema property values, where the schema matching engine contains schema mapping techniques and rules, where each rule suggests a schema mapping technique based on schema properties from the set of pre-defined schema properties, (v) applying the rules to select a schema mapping technique, (vi) transforming the first data records in accordance with the selected schema mapping technique, and (vii) providing the transformed first data records in a data structure in accordance with the second schema.

Abstract: This disclosure describes systems and techniques for synchronizing cameras and tagging images for face authentication. For face authentication by a facial recognition model, a dual infrared camera may generate an image stream by alternating between capturing a “flood image” and a “dot image” and tagging each image with metadata that indicates whether the image is a flood or a dot image. Accurately tagging images can be difficult due to dropped frames and errors in metadata tags. The disclosed systems and techniques provide for the improved synchronization of cameras and tagging of images to promote accurate facial recognition.

Abstract: A system includes a light source to generate a source light, a spatial modulator to receive the source light. A display element to receive the source light from the spatial modulator and to direct the source light towards an eye, and a controller. The controller is to receive initial image data for an image to be displayed, the image comprising a plurality of pixels having a plurality of brightness levels, determine an image power based on the brightness levels, and determine an excess power status based on a comparison of the image power to a specified power threshold. Responsive to the excess power status indicating the image power is to exceed the specified power threshold, the controller is to reduce the brightness levels to generate updated image data, and control the light source and the spatial modulator to project the image using the updated image data.

Abstract: Implementations relate to determining whether and/or how to implement a user request to prevent a particular search result from being provided in response to a search query. Some of those implementations grant or deny the request based on processing of the particular search result, the search query, and/or account information for a user submitting the user request. For example, some implementations process such information utilizing a classifier in determining whether to automatically deny the request, automatically approve the request, or to provide the request for manual review. Some additional or alternative implementations at least selectively automatically expand (or suggest for automatic expansion) an approval of a request to search result(s) and/or to one or more search queries that are not specified in the request.

Abstract: A method and workstation for generating a transcript of a conversation between a patient and a healthcare practitioner is disclosed. A workstation is provided with a tool for rendering of an audio recording of the conversation and generating a display of a transcript of the audio recording using a speech-to-text engine, thereby enabling inspection of the accuracy of conversion of speech to text. A tool is provided for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling. There is a highlighting in the transcript of words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts. Additionally, there is provided a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording.

Abstract: Methods, systems, and media for presenting recommended media content items based on complementary media content item pairs are presented.

Abstract: A method for load balancing application requests across a multi-cluster container orchestration system includes receiving a load-balancing configuration for a multi-cluster service managing access to a set of destination clusters hosting a software application deployed by a user. The multi-cluster service uses the load-balancing configuration to load balance application level traffic across the set of destination clusters. Each destination cluster includes at least one container executing the software application and a respective geographical region. The method also includes receiving an application level request directed toward the software application hosted across the destination clusters. The application level request is received from a client and includes a host name and a geographical location associated with the client. The method also includes routing the request to one of the clusters based on the geographical location of the request and the respective geographical locations of the clusters.

Abstract: Transform kernel candidates including a vertical transform type associated with a vertical motion and a horizontal transform type associated with a horizontal motion can be encoded or decoded. During a decoding operation, a probability model for decoding encoded bitstream video data associated with a transform kernel candidate for an encoded transform block is identified based on one or both of a first transform kernel candidate selected for an above neighbor transform block of the encoded transform block or a second transform kernel candidate selected for a left neighbor transform block of the encoded transform block. The encoded bitstream video data associated with the transform kernel candidate is decoded using the probability model.

Abstract: Systems and methods of parallel uniform resource identifier resource extraction are provided. A tracking uniform resource identifier (URI) generation component can generate a first uniform resource locator (URL) that, responsive to actuation by a client computing device, causes the client computing device to send a content item identifier of a content item and a device identifier of the client computing device, via a computer network, to a records server at a first network location identified by the first URL. A resource URI generation component can generate a second URL that, responsive to actuation by the client computing device, causes the client computing device to retrieve, via the computer network, a first resource from a second network location identified by the second URL for display by the client computing device. A content item packaging component can generate the content item.

Abstract: A method includes receiving, from a client device associated with a first user, a first request for content of one or more second users of a content platform. The content includes multiple content items and metadata associated with each of the content items. The method further includes providing, to the client device, a modified version of the metadata associated with each of the content items for presentation to the first user via the client device. The method further includes receiving, from the client device, a second request to access an unmodified version of the metadata. The method further includes providing the unmodified version of the metadata for presentation with the content items to the first user via the client device.

Abstract: Implementations set forth relate to suggesting an alternate interface modality when an automated assistant and/or a user is expected to not understand a particular interaction between the user and the automated assistant. In some instances, the automated assistant can pre-emptively determine that a forthcoming and/or ongoing interaction between a user and an automated assistant may experience interference. Based on this determination, the automated assistant can provide an indication that the interaction may not be successful and/or that the user should interact with the automated assistant through a different modality. For example, the automated assistant can render a keyboard interface at a portable computing device when the automated assistant determines that an audio interface of the portable computing device is experiencing interference.

Abstract: A memory device includes at least one memory cell array block and a control logic. The memory cell array block includes multiple layers of memory cells and word line layers provided corresponding to individual layers of memory cells. The memory cell array block is divided into at least two memory cell array subblocks, each subblock comprising a number of layers of memory cells and word line layers provided corresponding to individual layers of memory cells. The control logic is coupled to the memory cell array block, and configured to: erase, read or program the memory cell array block using a block mode or a subblock mode, and when the memory cell array block is erased, read, or programmed under the subblock mode, determine, at least based on a state of one of the two memory cell array subblocks, an operation strategy of the other memory cell array subblock.

Abstract: Determining a language for speech recognition of a spoken utterance received via an automated assistant interface for interacting with an automated assistant. Implementations can enable multilingual interaction with the automated assistant, without necessitating a user explicitly designate a language to be utilized for each interaction. Implementations determine a user profile that corresponds to audio data that captures a spoken utterance, and utilize language(s), and optionally corresponding probabilities, assigned to the user profile in determining a language for speech recognition of the spoken utterance. Some implementations select only a subset of languages, assigned to the user profile, to utilize in speech recognition of a given spoken utterance of the user.

Abstract: According to one aspect, a computer-implemented method for detecting an earthquake includes detecting vibrations in a trackpad of a computing device using an inductive element and force sensing circuitry of the trackpad and, processing, by a microcontroller of the computing device, the vibrations for detection of an earthquake vibration signal. In response to detecting the earthquake vibration signal, communicating, by the computing device, the earthquake vibration signal to a remote server and receiving, at the computing device, an earthquake alert from the remote server.

Abstract: A method for generating frame values using a key frame network includes receiving a text utterance having at least one phoneme, and for each respective phoneme of the at least one phoneme, predicting, using a predictive model, a fixed quantity of key frames. Each respective key frame of the fixed quantity of key frames includes a representation of a component of the respective phoneme. The method also includes generating, using the fixed quantity of key frames, a plurality of frame values. Here, each respective frame value of the plurality of frame values is representative of a fixed-duration of audio.

Abstract: A system includes a server to generate a real-time stream of audio packets and a client device to decode and playback the audio content of the stream. The client device includes a network interface configured to receive a stream of audio packets via a network and a buffer configured to temporarily buffer a subset of audio packets of the stream. The client device further includes an audio decoder having an input to receive audio packets from the buffer and an output to provide corresponding segments of a decoded audio data stream. The client device also includes a stream monitoring module configured to provide an audio packet of the subset in the buffer which was previously decoded by the decoder to the input of the decoder again for a repeated decoding in place of a decoding of an audio packet that is lost or late.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for adjusting physical location usage for a plurality of particular locations. Methods can include obtaining a three-dimensional (3D) representation of the given geographic area, wherein the 3D representation depicts a view of the given geographic area from a specified viewing perspective. For the given geographic area, traffic data is obtained indicating different traffic volumes during different time periods and one or more traffic characteristics. The 3D representation is segmented into a plurality of particular locations. For each particular location among the plurality of particular locations and based on the traffic data, a viewability score is determined that indicates an aggregate amount of time that the particular location is viewable by traffic passing the different locations. Physical location usage is then adjusted based on the viewability scores for the plurality of particular locations.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for index-side synonym expansion. One method includes obtaining a token sequence for a resource and indexing a token in the token sequence. The indexing includes applying one or more stemming rules to the particular token to generate a stemmed form of the token, obtaining a variant of the stemmed form of the token, and storing data associating the resource with both the token and the variant as index terms for the resource in a search engine index.

Abstract: Implementations include actions of obtaining a set of entities based on one or more terms of a query, obtaining one or more entities associated with each live event of a plurality of live events, identifying a live event that is responsive to the query based on comparing at least one entity in the set of entities to one or more entities associated with each live event of a plurality of live events, determining that an event search result corresponding to the live event is to be displayed in search results, and in response: providing the event search result for display, the event search result including information associated with the live event, the information including an indicator of an occurrence of the live event.

Abstract: A method for training hotword detection includes receiving a training input audio sequence including a sequence of input frames that define a hotword that initiates a wake-up process on a device. The method also includes feeding the training input audio sequence into an encoder and a decoder of a memorized neural network. Each of the encoder and the decoder of the memorized neural network include sequentially-stacked single value decomposition filter (SVDF) layers. The method further includes generating a logit at each of the encoder and the decoder based on the training input audio sequence. For each of the encoder and the decoder, the method includes smoothing each respective logit generated from the training input audio sequence, determining a max pooling loss from a probability distribution based on each respective logit, and optimizing the encoder and the decoder based on all max pooling losses associated with the training input audio sequence.

Abstract: A method includes receiving, at a first processor of a user device, streaming multi-channel audio captured by an array of microphones, each channel including respective audio features. For each channel, the method also includes processing, by the first processor, using a first stage hotword detector, the respective audio features to determine whether a hotword is detected. When the first stage hotword detector detects the hotword, the method also includes the first processor providing chomped raw audio data to a second processor that processes, using a first noise cleaning algorithm, the chomped raw audio data to generate a clean monophonic audio chomp. The method also includes processing, by the second processor using a second stage hotword detector, the clean monophonic audio chomp to detect the hotword.

Abstract: This application is directed to a doorbell camera for illuminating and capturing scenes. The doorbell camera includes at least a subset of processors for operating a camera module, an image sensor having a field of view of a scene and configured to capture video of a portion of the scene, one or more infrared (IR) illuminators for providing illumination, a waterproof button assembly, and a microphone and a speaker for enabling a real-time conversation between a visitor located at the doorbell camera and a user of a remote client device. The waterproof button assembly is configured to receive a user press on a button top, block water from entering the electronic device, and display a visual pattern uniformly at a peripheral region of the button assembly using LEDs and light guide component that are disposed under the button top.

Abstract: Techniques and apparatuses are described that implement control signaling for monostatic radar sensing. In particular, a base station uses control signaling to configure a user equipment for monostatic radar sensing and control when monostatic radar sensing is performed by the user equipment. With control signaling, the base station can enable monostatic radar sensing to occur using similar frequency resources used for wireless communication, which enables efficient use of a frequency spectrum. The base station can also use control signaling to reduce interference observed by other user equipment as the user equipment performs monostatic radar sensing. By performing monostatic radar sensing, the user equipment compiles explicit information about objects within an operating environment and shares this information with the base station. The base station uses this information to improve wireless communication performance.

Abstract: A method includes receiving a plurality of unlabeled audio samples corresponding to spoken utterances not paired with corresponding transcriptions. At a target branch of a contrastive Siamese network, the method also includes generating a sequence of encoder outputs for the plurality of unlabeled audio samples and modifying time characteristics of the encoder outputs to generate a sequence of target branch outputs. At an augmentation branch of a contrastive Siamese network, the method also includes performing augmentation on the unlabeled audio samples, generating a sequence of augmented encoder outputs for the augmented unlabeled audio samples, and generating predictions of the sequence of target branch outputs generated at the target branch. The method also includes determining an unsupervised loss term based on target branch outputs and predictions of the sequence of target branch outputs. The method also includes updating parameters of the audio encoder based on the unsupervised loss term.

Abstract: A method includes adding, by a first computing device, a first audio watermark to first speech data corresponding to playback of a first utterance including a hotword used to invoke an attention of a second computing device. The method includes outputting, by the first computing device, the playback of the first utterance corresponding to the watermarked first speech data. The second computing device is configured to receive the watermarked first speech data and determine to cease processing of the watermarked first speech data.

Abstract: A data processing device incorporates a plurality of chiplets having working elements such as processing and memory elements. At least one of the working elements is operative to generate messages directed to working elements of the same chiplet or another one of the chiplets. Each message includes a global address. An evaluation circuit determines whether the global address of a message is within a range of global addresses assigned to the chiplet. If so, the message passes to a translation circuit which translates the message to a local address for routing to a working element of the chiplet. If not, the message is dispatched to one or more other chiplets.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining and recommending the types of digital components that content providers can generate and provide for distribution to client devices. In one aspect, a method can determine whether a content provider has not previously provided a first digital component of a first media type. A first set of user interaction data can be obtained and input into a machine learning model. The model can can output result data for expected affirmative user actions related to the first digital component of the first media type. Based on the result data, a recommendation specifying whether the content provider should provide the first digital component of the first media type can be generated and provided to the content provider.