Abstract: Systems and methods for audio listening devices, comprise a speaker coupled to a first housing, a sound port having a first end and a second end, wherein the first end is coupled to the first housing, and the second end is configured to be inserted in an ear canal of a person such that sound waves emitted from the speaker propagates via a secondary path to the ear canal through the sound port, active noise cancellation (ANC) components configured to generate anti-noise signals through the micro-speakers to cancel external noise, and a first microphone disposed within the sound port at the second end of the sound port such that the first microphone is configured to detect the anti-noise signal that propagates through the sound port via the secondary path and the external noise that propagates via a primary path.

Abstract: Implementations relate to proactively aggregating client device data to append to client assistant data that is communicated to a server device in response to a user request to a client automated assistant. When a user request that is associated with, for example, a peripheral client device, is received at a client device, the client device can communicate, to a server device, data that embodies the user request (e.g., audio data and/or local speech recognition data), along with peripheral device data that was received before the client device received the user request. In this way, the client automated assistant can bypass expressly soliciting peripheral device data each time a user request is received at another client device. Instead, a peripheral device can proactively communicate device data to a client device so that the device data can be appended to request data communicated to the server device from a particular client device.

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.

Abstract: A method is implemented at an Internet-connected remote control device for reviewing content channels on an Internet-connected display device that is associated with the remote control device via a user account maintained at a server. In response to receiving a user actuation of a user button, the remote control identifies a first Internet content channel that is currently being displayed on the display device, and obtains a preferred channel list including a sequence of Internet content channels that is associated with the user account and includes the first Internet content channel. The remote control then identifies a second Internet content channel that follows the first Internet content channel in the preferred channel list, and transmits to the server a first channel change message including information of the second Internet content channel to cause the Internet-connected display device to display media content provided by the second content channel.

Abstract: Methods, systems, and media for synchronizing video streams are provided. In some embodiments, the method comprises: identifying a target video stream and a reference video stream, wherein the target video stream and the reference video stream are two different broadcasts of a program; generating, for the target video stream, a sequence of fingerprints; determining a time shift at which the sequence of fingerprints appears within the reference video stream; determining whether the target video stream is synchronized with the reference video stream by determining whether the time shift exceeds a predetermined threshold; and, in response to determining that the target video stream is not synchronized with the reference video stream, causing an electronic programming guide that includes an indication of the target video stream to be modified based on the time shift.

Abstract: A display configuration to facilitate imaging through the display is disclosed. The imaging can be achieved by positioning a camera behind a through-transmissive area of a display. The through-transmissive area is configured to reduce the interaction between the light propagating through the display and circuit elements of the display. The configuration of the through-transmissive area can be characterized by reduced pixel density, rearranged circuit elements, and a light blocking layer to prevent light from diffracting from gaps formed by circuit elements.

Abstract: The technology relates to an integrated circuit (IC) package. The IC package may include a substrate. An IC die may be mounted to the substrate. One or more photonic modules may be attached to the substrate and one or more serializer/deserializer (SerDes) interfaces may connect the IC die to the one or more photonic modules. The IC die may be an application specific integrated circuit (ASIC) die and the one or more photonic modules may include a photonic integrated circuit (PIC) and fiber array. The one or more photonic modules may be mounted to one or more additional substrates which may be attached to the substrate via one or more sockets.

Abstract: Operations of a method include obtaining a segment of image data that represents a portion of a frame of video image data to be encoded. The operations include determining, based on the segment and a target bitrate, a quantization parameter (QP) value for the segment. The operations include determining a minimum QP value and a maximum QP value that establishes a range of QP values an integrated bit rate control algorithm may use to encode the segment. The operations include encoding the segment with a first QP value that is greater than the minimum QP value and less than the maximum QP value. The operations include adjusting, by the bit rate control algorithm, the first QP value to a second QP value that is greater than the minimum QP value and less than the maximum QP value. The operations include transmitting the encoded segment to a remote device.

Abstract: This document describes a thermal-control system that is integrated into a media-streaming device. The thermal-control system includes a combination of heat spreaders and materials with high thermal-conductivity. The thermal-control system may spread, transfer, and dissipate energy from a thermal-loading condition effectuated upon the media-streaming device to concurrently maintain temperatures of multiple thermal zones on or within the media-streaming device at or below multiple respective prescribed temperature thresholds.

Abstract: An electronic device comprises an image sensor, one or more processors, and memory storing instructions for receiving an event recording profile based on configuration data of the electronic device, the configuration data including a location type or a power type; receiving a plurality of images of a scene captured by the image sensor; detecting a trigger event based on one or more of the plurality of images of the scene; in response to detecting the trigger event, identifying an object of interest in one or more of the plurality of images of the scene; creating an event clip from the stored images that include the object of interest, wherein creating the event clip includes configuring a clip length based on the event recording profile; and providing the event clip for display.

Abstract: A method for rejecting biased data using a machine learning model includes receiving a cluster training data set including a known unbiased population of data and training a clustering model to segment the received cluster training data set into clusters based on data characteristics of the known unbiased population of data. Each cluster of the cluster training data set includes a cluster weight. The method also includes receiving a training data set for a machine learning model and generating training data set weights corresponding to the training data set for the machine learning model based on the clustering model. The method also includes adjusting each training data set weight of the training data set weights to match a respective cluster weight and providing the adjusted training data set to the machine learning model as an unbiased training data set.

Abstract: Features described herein pertain to systems and methods for wirelessly providing an audio stream. When audio that is to be output to an audio output device is associated with an application a set of parameters for modifying an established Connected Isochronous Stream (CIS) of a wireless link between an audio source and the audio output device can be determined and the CIS of the wireless link can be modified based on the set of parameters. The audio that is associated with the application can be output to the audio output device using the modified CIS of the wireless link.

Abstract: A method includes receiving an input audio signal corresponding to utterances spoken by multiple speakers. The method also includes encoding the input audio signal into a sequence of T temporal embeddings. During each of a plurality of iterations each corresponding to a respective speaker of the multiple speakers, the method includes selecting a respective speaker embedding for the respective speaker by determining a probability that the corresponding temporal embedding includes a presence of voice activity by a single new speaker for which a speaker embedding was not previously selected during a previous iteration and selecting the respective speaker embedding for the respective speaker as the temporal embedding. The method also includes, at each time step, predicting a respective voice activity indicator for each respective speaker of the multiple speakers based on the respective speaker embeddings selected during the plurality of iterations and the temporal embedding.

Abstract: Methods, systems, and media for presenting notifications indicating recommended content are provided. A notification of recommended content can be provided. An indication that a user device has initiated a casting session with a display device can be received. A request for recommended content to be presented on the display device can be received. A media content item can be identified based on at least one media content item that has been previously selected by a user account associated with the user device. A notification can be generated that includes an indication of the identified media content item and a selectable input that, when selected, causes the identified media content item to begin being presented on the display device.

Abstract: A method for processing data exactly once using transactional stream writes includes receiving, from a client, a batch of data blocks for storage on memory hardware in communication with the data processing hardware. The batch of data blocks is associated with a corresponding sequence number and represents a number of rows of a table stored on the memory hardware. The method also includes partitioning the batch of data blocks into a plurality of sub-batches of data blocks. For each sub-batch of data blocks, the method further includes assigning the sub-batch of data blocks to a buffered stream; writing, using the assigned buffered stream, the sub-batch of data blocks to the memory hardware; updating a storage log with an intent to commit the sub-batch of data blocks using the assigned buffered stream; and committing the sub-batch of data blocks to the memory hardware.

Abstract: A method of interpreting tabular data includes receiving, at a deep tabular data learning network (TabNet) executing on data processing hardware, a set of features. For each of multiple sequential processing steps, the method also includes: selecting, using a sparse mask of the TabNet, a subset of relevant features of the set of features; processing using a feature transformer of the TabNet, the subset of relevant features to generate a decision step output and information for a next processing step in the multiple sequential processing steps; and providing the information to the next processing step. The method also includes determining a final decision output by aggregating the decision step outputs generated for the multiple sequential processing steps.

Abstract: A method includes obtaining a base encoder from a pre-trained model, and receiving training data comprising a sequence of acoustic frames characterizing an utterance paired with a ground-truth transcription of the utterance. At each of a plurality of output steps, the method includes: generating, by the base encoder, a first encoded representation for a corresponding acoustic frame; generating, by an exporter network configured to receive a continuous sequence of first encoded representations generated by the base encoder, a second encoded representation for a corresponding acoustic frame; generating, by an exporter decoder, a probability distribution over possible logits; and determining an exporter decoder loss based on the probability distribution over possible logits generated by the exporter decoder at the corresponding output step and the ground-truth transcription.

Abstract: A computer-implemented method causes data processing hardware to perform operations for training a firewall utilization model. The operations include receiving firewall utilization data for firewall connection requests during a utilization period. The firewall utilization data includes hit counts for each sub-rule associated with at least one firewall rule. The operations also include generating training data based on the firewall utilization data. The training data includes unused sub-rules corresponding to sub-rules having no hits during the utilization period and hit sub-rules corresponding to sub-rules having more than zero hits during the utilization period. The operations also include training a firewall utilization model on the training data. The operations further include, for each sub-rule associated with the at least one firewall rule, determining a corresponding sub-rule utilization probability indicating a likelihood the sub-rule will be used for a future connection request.

Abstract: The various implementations described herein include a video camera assembly that includes: (1) a housing; (2) an image sensor positioned within the housing and having a field of view corresponding to a scene in the smart home environment; and (3) a concave-shaped front face positioned in front of the image sensor such that light from the scene passes through the front face prior to entering the image sensor; where the front face includes: (a) an inner section corresponding to the image sensor; and (b) an outer section between the housing and the inner section, the outer section having a concave shape that extends from an outer periphery of the outer section to an inner periphery of the outer section; and where the concave shape extends around an entirety of the outer periphery.

Abstract: This disclosure describes systems and techniques directed to using a supplementary uplink (SUL) to mitigate a desensitization condition. The described systems and techniques include a user equipment having a desensitization manager application that directs the user equipment to determine a presence of a desensitization condition. The desensitization manager application further directs the user equipment to transmit, to a base station, a first message that requests the base station to allocate, to the user equipment, a portion of resources used for a supplementary uplink between the user equipment and the base station. After receiving a second a message from the base station that identifies the allocated portion of the resources, the desensitization manager application directs the user equipment perform uplink transmissions using the allocated portion of the resources.

Abstract: Methods, apparatus, and computer readable media related to determining that no resources responsive to a query of a user at a first time satisfy one or more criteria (e.g., one or more quality criteria) and, in response to such a determination: providing for presentation to the user at a later time, content that is based on a given resource that is responsive to the query at the later time and that satisfies the criteria. The given resource that is responsive to the query at the later time may be a resource that is in addition to any resources responsive to the query at the first time or may be a refined version of a resource that was responsive to the query at the first time.

Abstract: Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to extract, validate, maintain, generalize, extend and/or distribute individual actions and “traces” of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website.

Abstract: The technology relates to factors regarding the external environment around a vehicle that are used to trigger enhanced driving directions for use by the driver. The factors can include issues such as adverse weather conditions, low light conditions and temporary obstacles or other obstructions that may prevent or reduce the ability of the driver to see street signs or other landmarks that are part of an initial set of driving directions. Upon determination of one or more relevant factors, the system is able to modify or otherwise enhances directions in real time. This allows the driver to be able to quickly and easily identify other visible landmarks and use such information to navigate to a desired destination. This approach employs one or more on-board cameras configured to detect objects and conditions in the environment adjacent to or otherwise nearby the vehicle, such as within line of sight of the vehicle's front end.

Abstract: This application is directed to presenting a unified user interface on a network-connected television device. The unified user interface displays media content recommendations selected and organized based on knowledge of a user (e.g., search queries, search results, watch history, purchase history, physical activities). The unified user interface also includes a focus area for displaying a series of media content items (e.g., an advertisement) sequentially according to a temporal order for the purposes of promoting a media content item, product, event or service. In some implementations, playback of a media content item presented on the unified user interface relies on a collaborative implementation of a corresponding media player application and a media content casting application, particularly when the play involves a restricted mode. The content casting application is enabled to play the media content item at the restrict mode when the media player application does not operate in the restricted mode.

Abstract: Systems and methods of combining digital video are described. A system can receive digital video comprising frames. The system can analyze the frames to identify a subset of consecutive frames that have a static portion defined by a spatial region with matching pixels across two or more frames. The system can tag the digital video with an indication of the subset and a trigger that causes transmission, at a temporal offset during playback prior to the subset, of a request for content used to overwrite the static portion. The system can receive the request from the client device, the request transmitted by the client device based on the temporal offset during playback prior to the subset. The system can select and transmit a content item responsive to the request to cause the client device to render the content item at the static portion of the subset.

Abstract: Systems and methods for identifying related videos based on elements tagged in the videos are presented. In an aspect, a system includes an identification component configured to identify tagged elements in a video, a matching component configured to identify other videos that include one or more of the tagged elements, and a recommendation component configured to recommend the other videos for viewing based on a current or past request to play the video.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for the selection, provision and display of one or more digital components during display of content. Methods can include identifying a plurality of digital components that can be presented on the client device. A maximum number of digital components that can be presented in a slot of a content and the time duration of the slot is determined. For each digital component a score is generated based on the duration, position requirement and the number of times the digital component is available for provision within the slot is generated. A first set of digital component is selected based on the scores and provided to the client device.

Abstract: Implementations disclose comprehensibility-based identification of educational content of multiple content types. A method includes determining respective comprehensibility ranking signals for content items corresponding to a user request, the comprehensibility ranking signals based on learning attribute scores generated for the content items from at least one machine learning model, determining a learning level of a user corresponding to the user request, ranking the content items based on a mapping between the learning level and the respective comprehensibility ranking signals of the content items, and providing a recommendation for the content items according to the ranking of the content items.

Abstract: An electronic document associated with users of a collaborative document platform is identified. The electronic document is associated with an approval data structure including entries that correspond to approval requests. A portion of an approval data structure is included within the content of the electronic document for presentation to a first user. A first user updates a first entry of the portion of the approval data structure included within the content of the electronic is detected. The update to the first entry corresponds to a first approval request for a second user to approve a portion of the electronic document. A first notification is transmitted to a second client device associated with the second user. The first notification indicates the first approval request. The approval data structure is updated to include data of the first entry.

Abstract: Systems and methods of predicting documentation associated with an encounter between attendees are provided. For instance, attendee data indicative of one or more previous visit notes associated with a first attendee can be obtained. The attendee data can be inputted into a machine-learned note prediction model that includes a neural network. The neural network can generate one or more context vectors descriptive of the attendee data. Data indicative of a predicted visit note can be received as output of the machine-learned note prediction model based at least in part on the context vectors. The predicted visit note can include a set of predicted information expected to be included in a subsequently generated visit note associated with the first attendee.

Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.

Abstract: A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

Abstract: In one example, a method includes receiving, by a computing system, context information associated with a computing device; inferring, by the computing system and based on the context information, an action of a user of the computing device, the action associated with at least one entity; determining, by the computing system and based on stored attribute information associated with the at least one entity, and based on a stored set of rules associated with the inferred action, that the inferred action is not advisable; and responsive to determining that the inferred action is not advisable, outputting, by the computing system and for display on the computing device, notification data indicating that the inferred action is not advisable.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining a plurality of model representations of predictive models, each model representation associated with a respective user and expresses a respective predictive model, and selecting a model implementation for each of the model representations based on one or more system usage properties associated with the user associated with the corresponding model representation.

Abstract: Methods, systems, and apparatus for propagating reduced-precision on computation graphs are described. In one aspect, a method includes receiving data specifying a directed graph that includes operators for a program. The operators include first operators that each represent a numerical operation performed on numerical values having a first level of precision and second operators that each represent a numerical operation performed on numerical values having a second level of precision. One or more downstream operators are identified for a first operator. A determination is made whether each downstream operator represents a numerical operation that is performed on input values having the second level of precision. Whenever each downstream operator represents a numerical operation that is performed on input values having the second level of precision, a precision of numerical values output by the operation represented by the first operator is adjusted to the second level of precision.

Abstract: An IC chip can provide silicon root of trust (RoT) functionality. In described implementations, the IC chip includes a processor, an alert handler, and multiple peripheral devices, which generate alert indications. The alert handler processes the alert indications, which have security implications. The alert handler includes multiple alert receiver modules to communicate with the multiple peripheral devices. The alert handler also includes a controller, multiple accumulation units, multiple escalation timers, and multiple escalation sender modules. These components can be organized into a hierarchy of increasing escalation severity. In operation, the controller classifies an alert and flexibly implements an adaptable alert handler path that is established through the escalation components responsive to the classification and based on a source of the alert. A path can conclude with an escalation sender module commanding an escalation handler to implement a security countermeasure.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, that facilitate generating stable real-time textual translations in a target language of an input audio data stream that is recorded in a source language. An audio stream that is recorded in a first language is obtained. A partial transcription of the audio can be generated at each time interval in a plurality of successive time intervals. Each partial transcription can be translated into a second language that is different from the first language. Each translated partial transcription can be input to a model that determines whether a portion of an input translated partial transcription is stable. Based on the input translated partial transcription, the model identifies a portion of the translated partial transcription that is predicted to be stable. This stable portion of the translated partial transcription is provided for display on a user device.

Abstract: Systems and methods of the present disclosure are directed to a method for machine-learned code segment prediction for optimizing software development. The method includes obtaining an incomplete segment of code. The method includes processing the incomplete segment of code with a machine-learned code prediction model to obtain a sampled set of segment completion predictions that include code that completes the incomplete segment of code. The method includes determining an aggregated segment completion prediction from the sampled set of segment completion predictions. The method includes replacing a portion of the aggregated segment completion prediction with an input field, wherein the portion of the aggregated segment completion prediction is associated with a degree of certainty less than a threshold degree of certainty.

Abstract: Methods, apparatus, and computer readable media are described for tailoring instructions for configuring a smart device based on feedback received from the smart device and/or based on feedback received from a device that is separate from the smart device. Some implementations additionally or alternatively relate to utilization of data corresponding to previous installations of similar smart devices to tailor provided instructions in order to mitigate the reoccurrence of past issues during configuration of smart devices. Some implementations additionally or alternatively relate to proactively suggesting and/or providing, to a user, guidance related to a smart device in response to determining the smart device is to be configured by the user and/or in response to determining a complete configuration of the smart device has not occurred.

Abstract: Aspects of the disclosure are directed to methods, systems, and apparatuses using an instruction prefetch pipeline architecture that provides good performance without the complexity of a full cache coherent solution deployed in conventional CPUs. The architecture can include components which can be used to construct an instruction prefetch pipeline, including instruction memory (TiMem), instruction buffer (iBuf), a prefetch unit, and an instruction router.

Abstract: A computer-implemented method for generating results for a client-requested query involves receiving a query produced by a client communication device, generating a result for the query in response to reception of the query, determining one or more predictive follow-up requests before receiving an actual follow-up request from the client device, and initiating retrieval of information associated with the one or more predictive follow-up requests, and transmitting at least part of the result to the client device, and then transmitting to the client device at least part of the information associated with the one or more predictive follow-up requests.

Abstract: An autostereoscopic display system includes a transmissive display panel including a backlight having an array of backlight pixels, a selectively-selectively-transmissive display pixel matrix having a first side facing the backlight and an opposing second side, the selectively-transmissive display pixel matrix comprising an array of display pixels, a first lenticular array disposed between the backlight and the first side of the selectively-transmissive display pixel matrix, and a second lenticular array disposed facing the second side of the selectively-transmissive display pixel matrix. The backlight is configured to separately activate different subsets of the backlight pixels such that light emitted from an activated subset of backlight pixels and transmitted through the first lenticular array, the selectively-transmissive display pixel matrix, and the second lenticular array is emitted by the display panel as display light in a corresponding separate direction relative to the display panel.

Abstract: Optical systems may include MEMS mirrors having elliptical mirror plates. A laser scanning system may include a MEMS mirror that scans an incident light beam along a single scanning axis. The MEMS mirror may include an elliptical mirror plate having a semi-major axis that is aligned parallel or perpendicular to the rotational axis of the elliptical mirror plate. The incident light beam may have an elliptical cross-section, such that the incident light beam completely or substantially overlaps the reflecting surface of the elliptical mirror plate. After being reflected by the elliptical mirror plate, the light beam may be circularized via one or more shaping lenses disposed in the optical path of the reflected light beam, prior to projection of the light beam.

Abstract: This document describes techniques and apparatuses for performing listen-before-talk procedures on bandwidth parts. These techniques include a user equipment (UE) initiating a first listen-before-talk (LBT) procedure on an active bandwidth part used in a radio resource control (RRC) connection between a UE and a base station. During the first LBT procedure, the UE receives a configuration message from the base station instructing the UE to change the active bandwidth part from the first bandwidth part to a second bandwidth part. Responsively, the UE changes the active bandwidth part and initiates a second LBT procedure on the second bandwidth part.

Abstract: Methods, systems, devices, and tangible non-transitory computer readable media for route planning are provided. The disclosed technology can include accessing travel data that includes information associated with a starting location and a destination. Routes from the starting location to the destination can be determined and each of the routes can be associated regions. Travel costs associated with travelling from the starting location to the destination via each of the routes can be determined. Convenience costs associated with an availability of facilities within the regions associated with each of routes can also be determined. A travel route can be selected from the routes. The travel route can be selected based in part on the travel costs, the convenience costs, and travel criteria. The travel criteria can be associated with travel preferences. Furthermore, route data that can include information associated indications based in part on the travel route can be generated.

Abstract: This document describes a light-sealing gasket with crossbar force distribution. The gasket can be used in an electronic device with a sensor package that is capable of transmitting and receiving signals and is positioned behind a display of the device. The gasket provides a shield between the receive signals and the transmit signals, prevents signal crosstalk, and protects the delicate panel layer of the display. Use of this gasket in an electronic device allows manufacturers to add more features to the device and enrich the user experience.