Abstract: Aspects of the disclosure relate to providing a secure collaboration between one or more PCIe accelerators and an enclave. An example system may include a PCIe accelerator apparatus. The PCIs accelerator apparatus may include the one or more PCIe accelerators and a microcontroller configured to provide a cryptographic identity to the PCIe accelerator apparatus. The PCIe accelerator apparatus may be configured to use the cryptographic identity to establish communication between the PCIe accelerator apparatus the enclave.

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.

Abstract: A quantum neural network architecture. In one aspect, a quantum neural network trained to perform a machine learning task includes: an input quantum neural network layer comprising (i) multiple qubits prepared in an initial quantum state encoding a machine learning task data input, and (ii) a target qubit; a sequence of intermediate quantum neural network layers, each intermediate quantum neural network layer comprising multiple quantum logic gates that operate on the multiple qubits and target qubit; and an output quantum neural network layer comprising a measurement quantum gate that operates on the target qubit and provides as output data representing a solution to the machine learning task.

Abstract: Systems and methods for generating social annotations for content that are capable of being seen by a broad audience are provided herein. A system can include a user identification component configured to identify a user that has potential for generating a valuable endorsement of a content item based at least in part on a sharing setting associated with a user. The system further includes an audience component configured to determine an audience associated with the user based at least in part on the sharing setting, a user selection component configured to select the user as a candidate user for generating the endorsement of the content item in response to a determination that a size of the audience exceeds a threshold, and a targeted content component configured to, in response to selection of the user, provide the content item to the user with a capability to endorse the content item.

Abstract: The technology relates to allowing a user to enter text into text boxes using a stylus. For instance, first user input identifying a text box displayed on a display of the computing device may be received. Based on the received first user input, a handwriting field may be generated on the display without visual impact on the display. A second user input within the handwriting field may be received. The second user input may be converted into typed text, and the typed text may be displayed in the text box.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for indicating location status. A computing device can receive a query from a user device, a current time, and a location for the user device. The computing device identifies results responsive to the query, including one or more business results that are each associated with a business location and operating hours. The computing device can select a subset of the business results as open results based on the operating hours of the business results, the current time, and travel times from the device location to the respective business locations. Data can be provided for a search engine results page that designates the subset of the business results as open results.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for rollback resistant security are disclosed. In one aspect, a method, during a boot process of a computing device, includes the actions of obtaining a secret key derived from device-specific information for the computing device. The method further includes verifying that a signature for a software module is valid. The method further includes obtaining information indicating a current version of the software module. The method further includes using the secret key to generate a first encryption key corresponding to the current version of the software module and a second encryption key corresponding to a prior version of the software module. The method further includes preventing future access to the secret key until the computing device is rebooted. The method further includes providing the software module access to the first encryption key and the second encryption key.

Abstract: Systems and methods of the present disclosure enable for a delayed, two-factor authentication to occur in networked devices. The system and methods can enable the immediate delivery of digital components, which results in fewer abandoned requests, and saves network resources. The system and methods can enable the authorization of data transmissions in networked computer devices that include limited user interfaces, such as voice-based interfaces.

Abstract: One or more servers can implement a method including generating an information resource comprising a content package including first content, metadata of a content extension, and a script for displaying the first content, and transmitting the information resource to a client device to cause the client device to: display the first content within an inline frame; identify an interaction with a user interface feature; transmit, responsive to identifying the interaction, a content extension request based on the metadata of the content extension; receive, responsive to the content extension request, a second content item; responsive to identifying the interaction, expand the inline frame from the first size to a second size; and display, in the expanded inline frame, the second content item, the second content item different from the first content item.

Abstract: Aspects of the present disclosure enable humanly-specified relationships to contribute to a mapping that enables compression of the output structure of a machine-learned model. An exponential model such as a maximum entropy model can leverage a machine-learned embedding and the mapping to produce a classification output. In such fashion, the feature discovery capabilities of machine-learned models (e.g., deep networks) can be synergistically combined with relationships developed based on human understanding of the structural nature of the problem to be solved, thereby enabling compression of model output structures without significant loss of accuracy. These compressed models provide improved applicability to “on device” or other resource-constrained scenarios.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a machine learning model using teacher annealing.

Abstract: A neural network system is configured to receive an input image and to generate a classification output for the input image. The neural network system includes: a separable convolution subnetwork comprising a plurality of separable convolutional neural network layers arranged in a stack one after the other, in which each separable convolutional neural network layer is configured to: separately apply both a depthwise convolution and a pointwise convolution during processing of an input to the separable convolutional neural network layer to generate a layer output.

Abstract: Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions, and determining second costs associated with the warping mesh that include costs of edge-related transformations for preserving straightness of edges of the image. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.

Abstract: Mapping-aware coding tools for 360 degree videos adapt conventional video coding tools for 360 degree video data using parameters related to a spherical projection of the 360 degree video data. The mapping-aware coding tools perform motion vector mapping techniques, adaptive motion search pattern techniques, adaptive interpolation filter selection techniques, and adaptive block partitioning techniques. Motion vector mapping includes calculating a motion vector for a pixel of a current block by mapping the location of the pixel within a two-dimensional plane (e.g., video frame) onto a sphere and mapping a predicted location of the pixel on the sphere determined based on rotation parameters back onto the plane. Adaptive motion searching, adaptive interpolation filter selection, and adaptive block partitioning operate according to density distortion based on locations along the sphere.

Abstract: Implementations set forth herein relate to an automated assistant that can be customized by a user to provide custom assistant responses to certain assistant queries, which may originate from other users. The user can establish certain custom assistant responses by providing an assistant response request to the automated assistant and/or responding to a request from the automated assistant to establish a particular custom assistant response. In some instances, a user can elect to establish a custom assistant response when the user determines or acknowledges that certain common queries are being submitted to the automated assistant—but the automated assistant is unable to resolve the common query. Establishing such custom assistant responses can therefore condense interactions between other users and the automated assistant.

Abstract: An example method includes programming, based on image data of a frame of a plurality of frames and during a non-emission period of the frame, pixels of a plurality of pixels of a display of a computing device; causing pixels of the plurality of pixels to emit light during an emission period of the frame, wherein an amount of light emitted by the pixels during the emission period is based on the programming; and synchronizing operation of one or more sensors and operation of the plurality of pixels by at least causing the one or more sensors to emit, during a particular portion of the emission period of the frame, electromagnetic radiation through the display.

Abstract: A method for accessing customer data includes receiving an access request requesting access to customer data stored on a storage abstraction. The access request includes a justification that specifies a purpose/reason for requesting access to the customer data. The method also includes validating the justification, and after validating the justification, transmitting the justification to an external key management service associated with a customer of the customer data. The external key management service is configured to grant or deny access to the customer data based on the justification. The method also includes receiving an approved access token from the external key management service when the external key management service grants access to the customer data and accessing the customer data stored on the storage abstraction using the approved access token received from the external key management service.

Abstract: Computing systems and methods are provided for detecting skin conditions of humans. A computing device can authenticate a user via a fingerprint scan of a first skin region of the user using a three-dimensional (3D) sonic sensor. The device can generate a three-dimensional (3D) volumetric sonic measurement of a second skin region of the user based at least in part on one or more sonic pulses of the three-dimensional sonic sensor. The device can input data indicative of the 3D volumetric sonic measurement into one or more machine-learning models, generate one or more skin cancer condition identifications associated with the second skin region of the user based on one or more outputs of the one or more machine-learned models, and provide one or more outputs including the one or more skin cancer condition identifications associated with the second skin region of the user.

Abstract: Interconnections for connecting flex circuit boards in classical and/or quantum computing systems can include a first flex circuit board having a removed portion that exposes one or more signal lines and a second flex circuit board having a removed portion that exposes one or more other signal lines. The flex circuit boards can be aligned at the removed portions to form a signal trace gap near the exposed signal lines. Exposed signal lines of the first flex circuit board can be coupled with exposed signal lines of the second flex circuit board. A ground support layer can be coupled to the first flex circuit board and the second flex circuit board along the same side. An isolation plate at least partially covering the signal trace gap can be coupled to the first flex circuit board and/or the second flex circuit board on a side opposite of the ground support layer.

Abstract: This document describes techniques and apparatuses directed at detecting and preventing light-based injection attacks. In aspects, a computing device includes executable instructions of an input manager, an audio sensor having subtracting circuitry, and a light sensor. One or more processors executing instructions of the input manager is configured to receive and analyze signals generated by the audio sensor, the light sensor, and the subtracting circuit. Upon analysis, the input manager can detect and prevent light-based injection attacks.

Abstract: Secure communication in mobile digital pages is provided. The system receives an electronic document and validates the electronic document for storage in a cache server. The system receives a request for the electronic document and provides it to a viewer component on a client computing device. The viewer component loads the electronic document in an iframe. The viewer component executes a runtime component to receive, via a secure communication channel, a tag from the electronic document. The system receives the tag and selects a data value for transmission to the viewer component. The viewer components provides the data value to cause the runtime component to execute an action with the data value.

Abstract: Interface and mode selection for digital action execution is provided. For example, a system loads a script library embedded in an electronic resource. The system determines a historic level of engagement between a client computing device and one or more digital assistants. The system selects, based on a first property of the client computing device and the historic level of engagement, a type of digital interface. The system generates, based on the type of digital interface, a digital interface with the call-to-action. The system determines, responsive to an instruction to execute the call-to-action, a mode of execution. The system selects a digital assistant and a second client device to execute the call-to-action. The system transmits the call-to-action to the second client device for execution.

Abstract: The various implementations described herein include a video camera assembly that includes: (1) a housing; (2) an image sensor positioned within the housing and having a field of view corresponding to a scene in the smart home environment; and (3) a concave-shaped front face positioned in front of the image sensor such that light from the scene passes through the front face prior to entering the image sensor; where the front face includes: (a) an inner section corresponding to the image sensor; and (b) an outer section between the housing and the inner section, the outer section having a concave shape that extends from an outer periphery of the outer section to an inner periphery of the outer section; and where the concave shape extends around an entirety of the outer periphery.

Abstract: A device for restoring a degraded frame resulting from reconstruction of a source frame includes a processor that is configured to receive a compressed bitstream. The compressed bitstream includes a first projection parameter ? a second projection parameter ?, first restoration parameters comprising a first radius value, and second restoration parameters comprising a second radius value. The processor is further configured to restore at least a portion of the degraded frame using a projection operation that uses the first projection parameter ?, the second projection parameter ?, and at least two guide tiles.

Abstract: A firewall intelligence system, includes a data storage storing a set of firewall rules for a network; a recommendation engine that receives, from a log service, traffic logs detailing traffic for the network and firewall logs detailing the usage of firewall rules in response to the traffic for the network, accesses, from the data storage, the set of firewall rules for the network; processes the set of firewall rules to evaluate the firewall rules against a set of quantitative evaluation rules to determine one or more firewall rule recommendations, wherein each firewall rule recommendation is a recommendation to change at least one of the firewall rules in the set of firewall rules; and a front end API that provides data describing the one or more firewall rule recommendations to a user device.

Abstract: Image editing on a wearable device includes a system which obtains sensor data via the wearable device. The sensor data includes a representation of hand movement, head movement or voice command associated with a user. The system executes an application for editing an image based on the obtained sensor data. The system provides for display a list of image adjustment types associated with the application. The system selects an image adjustment type based on one or more of the hand movement, the head movement or the voice command. The system provides for display a prompt having options to adjust a property of the selected image adjustment type. The system selects one of the options included in the prompt. The system modifies an image based on the selected option. The system then provides the modified image for storage in a data structure of a memory unit in the wearable device.

Abstract: A computer-implemented method that includes monitoring execution of program code by first and second processor components. A computing system detects that a trigger condition is satisfied by: i) identifying an operand in a portion of the program code; or ii) determining that a current time of a clock of the computing system indicates a predefined time value. The operand and the predefined time value are used to initiate trace events. When the trigger condition is satisfied the system initiates trace events that generate trace data identifying respective hardware events occurring across the computing system. The system uses the trace data to generate a correlated set of trace data. The correlated trace data indicates a time ordered sequence of the respective hardware events. The system uses the correlated set of trace data to analyze performance of the executing program code.

Abstract: Techniques are disclosed that enable processing of audio data to generate one or more refined versions of audio data, where each of the refined versions of audio data isolate one or more utterances of a single respective human speaker. Various implementations generate a refined version of audio data that isolates utterance(s) of a single human speaker by processing a spectrogram representation of the audio data (generated by processing the audio data with a frequency transformation) using a mask generated by processing the spectrogram of the audio data and a speaker embedding for the single human speaker using a trained voice filter model. Output generated over the trained voice filter model is processed using an inverse of the frequency transformation to generate the refined audio data.

Abstract: Embodiments provided herein relate to enforcing a device restriction policy. A device restriction policy may be stored that maps one or more portions of a household with particular household occupants of a plurality of household occupants. A request may be received to activate the device restriction policy on a household occupant. The device restriction policy may be activated against the household occupant based on the received request. One or more electronic devices may be disabled that are located in a portion of the household linked with the household occupant based on the received request and the device restriction policy.

Abstract: A method for auralizing a multi-microphone device. Path information for one or more sound paths using dimensions and room reflection coefficients of a simulated room for one of a plurality of microphones included in a multi-microphone device is determined. An array-related transfer functions (ARTFs) for the one of the plurality of microphones is retrieved. The auralized impulse response for the one of the plurality of microphones is generated based at least on the retrieved ARTFs and the determined path information.

Abstract: Methods and systems for a content server to select sets of video streams having different encoding parameters for transmitting the sets of video streams to a media device are disclosed herein. In some embodiments, a method for transmitting video streams for a media program from a server to a media device includes: selecting, by the server, first encoding parameters including a first bitrate for a first set of video streams for the media program based on a first estimated bandwidth capacity for a network linking the server and the media device, transmitting the first set of video streams from the server to the media device, determining, by the server, second encoding parameters including a second bitrate for a second set of video streams for the media program, and transmitting the second set of video streams from the server to the media device.

Abstract: A method includes receiving a series of writes that each requests respective data to be stored at a database. For each respective write, the method includes storing the respective data in a first buffer associated with a first data streaming application and a second buffer associated with a second data streaming application. The method includes transmitting the respective data to the database. The method includes receiving, from the database, confirmation that the respective data of the respective write has been committed to the database. The confirmation includes an order indicator indicating an order the respective data of the respective write was committed to the database relative to other writes in the series of writes. In response to receiving the confirmation, the method includes sending the respective data from the first buffer to the first data streaming application and from the second buffer to the second data streaming application.

Abstract: A method of providing a workspace graphical user interface (GUI) for a user of a cloud-based content management platform includes providing the workspace GUI for the user via the cloud-based content management platform. The workspace GUI presents visual representations of documents stored on the user's cloud storage of the cloud-based content management platform and visual representations of workspaces created by the user. Each workspace includes a set of documents previously added to a respective workspace by the user and stored on the user's cloud storage. The method further includes receiving, via the workspace GUI, a user input with respect to a corresponding document stored on the user's cloud storage. The user input indicates a request to add the corresponding document to a particular workspace.

Abstract: An example computer-implemented method includes receiving, from one or more vision components in an environment, vision data that captures features of the environment, including object features of an object that is located in the environment, and prior to a robot manipulating the object: (i) determining based on the vision data, at least one first adjustment to a programmed trajectory of movement of the robot operating in the environment to perform a task of transporting the object, and (ii) determining based on the object features of the object, at least one second adjustment to the programmed trajectory of movement of the robot operating in the environment to perform the task, and causing the robot to perform the task, in accordance with the at least one first adjustment and the at least one second adjustment to the programmed trajectory of movement of the robot.

Abstract: A computer-implemented method for providing landmark-assisted navigation guidance by selectively utilizing database information includes receiving navigation requests from one or more mobile computing devices, each of the requests being associated with a respective starting point, destination, and travel mode. For each navigation request, a corresponding route to be depicted in a corresponding digital map is determined. For each navigation request associated with a first travel mode, corresponding points of interest (POIs) are determined from among a plurality of POIs stored in a database. The corresponding POIs are determined based at least on whether the corresponding POIs are associated with any landmark category. For each navigation request associated with a second travel mode, corresponding POIs are determined irrespective of whether the corresponding POIs are associated with any landmark categories.

Abstract: Systems, devices, and methods for eyebox expansion in wearable heads-up displays (“WHUDs”) are described. The WHUDs described herein each include a projector and an optical waveguide positioned in an optical path between the projector and an eye of the user. For any given light signal from the projector, the optical waveguide receives the light signal at an input coupler and outputs multiple instances or copies of the light signal from multiple discrete, spatially-separated output couplers. The multiple instances or copies of the light signal may be converged by the optical waveguide directly to respective exit pupils at the user's eye or may be routed by the optical waveguide to a holographic combiner in the user's field of view from which the light signals may be converged to respective exit pupils at the user's eye. The optical waveguide employs exit pupil replication to expand the eyebox of the WHUD.

Abstract: A system comprises data processing hardware and memory hardware. The memory hardware is in communication with the data processing hardware, and stores instructions that, when executed on the data processing hardware, cause the data processing hardware to perform a plurality of operations. In some examples, one of the operations may include receiving instance management configuration data for a single-tenant software-as-a-service (SaaS) application. Another operation may include further include receiving an image of the single-tenant SaaS application. Yet another operation can include generating, by the control plane manager, a control plane based on the instance management configuration data. The control plane is configured to create multiple instances of the single-tenant SaaS application based on the received image, and to manage the instances of the single-tenant SaaS application based on the received instance management configuration data.

Abstract: Implementations described herein relate to providing device messages in image compilations based on user content. A computer-implemented method includes determining that a playback mode is entered on a device to display one or more image compilations, each image compilation including images for successive display. Message criteria are obtained for device messages, each device message indicating a device function associated with images of the image compilations or of a user image library. A device message is selected based on associated message criteria. An image is identified in the user image library, the image being in the image compilations, depicts a type of image feature in the image compilations, and/or has characteristic(s) modifiable by the device function. The device message is displayed during image compilation playback and includes the identified image and a message control option. In response to user selection of the message control option, the device function is initiated.

Abstract: Various arrangements for establishing a link between two electronic devices are presented herein. A pairing mode may be activated to establish the link. A first electronic wireless device can determine that a distance to a second wireless electronic device meets a distance threshold criterion. In response to the pairing mode being activated and the distance to the second wireless electronic device meeting the distance threshold criterion, a graphic element, such as a glow effect, can be presented indicative of direction and distance to the second wireless electronic device.

Abstract: Features described herein generally relate to enhancing functionality of electronic devices. Particularly, a notification is received from a wearable device that includes a position of the wearable device within an area, a determination is made that the wearable device is located within a predetermined distance from a controllable device, a graphical user interface page that includes buttons is sent to the wearable device, an indication that a button of the buttons has been activated is received from the wearable device, and a command signal that includes an instruction is sent to the controllable device. In this way, functionality of electronic devices can be extended with wearable devices.

Abstract: This document describes techniques and apparatuses directed at providing a tubular band with seamless lug integration for wearable devices. In aspects, the tubular band includes an extensible strap formed of interwoven fibers. The strap includes opposing outward-facing edges at opposing longitudinal ends. Each edge defines an opening within which a base section of a coupling device can reside. The coupling device further includes an attachment section, opposite the base section, which extends from the base section outwardly through the opening to engage a coupling connector of the wearable device. When the attachment section is connected to the coupling connector, the attachment section positions an end portion of the strap adjacent the opening to engage a surface of the wearable device. In this way, the strap can be coupled to a wearable device by positioning end portions of the strap against one or more surfaces of the wearable device, forming a seamless connection between the band and the wearable device.

Abstract: Sensor data having values received from several sensors of a mobile device and response data associated with the sensor data may be used in the determination or training of a predictive model. Received sensor data may be input into the predictive model, and the output of the predictive model may be used in the selection and serving of content items to the mobile device. Data to effect presentation of the selected content item may be outputted to the mobile device to effect presentation. In some instances, the predictive model may be updated using the received plurality of values. The updated predictive model may be used in the selection of a subsequent content item for the mobile device. In other implementations, historical sensor data may be used with the set of received sensor data as input for the predictive model.

Abstract: A motion field estimate determined using motion vector information of two or more reference frames of a current/encoded frame is used to derive a motion vector for inter-prediction of the current/encoded frame. Motion trajectory information, including concatenated motion vectors and locations of the current/encoded frame at which those concatenated motion vectors point, is determined by concatenating motion vectors of the reference frames. A motion field estimate is determined using the motion trajectory information and, in some cases, by interpolating unavailable motion vectors using neighbors. The motion field estimate is used to determine a co-located reference frame for the current/encoded frame, and an inter-prediction process is performed for the current/encoded frame using a motion vector derived using the co-located reference frame.

Abstract: Features of various implementations are used to enable identifying and presenting, in real time, Internet-accessible and/or Internet-based functionality, content and/or services associated with a particular television program concurrently playing on a television or display, as a part of an interactive television suite of technologies. In some implementations, the process of identifying Internet-accessible and/or Internet-based functionality, content and/or services associated with a particular television program is enabled to reduce communication between a primary set-top box and a supplemental set-top box and/or television integrated device, thereby reducing the need for one or more provider specific APIs.

Abstract: Methods, systems, and media for presenting media content in response to a channel change request are provided. In some implementations, methods for presenting media content in response to a channel change request are provided, the methods comprising: causing media content provided on a first channel to be presented in a first display area on a first screen; receiving, at a hardware processor, a request to switch to a second channel; in response to receiving the request to switch to the second channel, causing thumbnail content corresponding to the second channel to be presented in the first display area; determining whether media content provided on the second channel is ready for presentation; and in response to determining that the media content provided on the second channel is ready for presentation, causing the media content provided on the second channel to be presented in the first display area.

Abstract: A method in a user device that supports a plurality of message authentication code (MAC) lengths for integrity protection of wireless communications includes receiving, from a base station, a first message including an information element (1002), determining, based on the information element, that a first MAC length of the plurality of MAC lengths is to be used for integrity protection (1004) and, thereafter, generating a second message including a MAC having the first MAC length (1006). The method also includes transmitting the second message to the base station (1008).

Abstract: Systems and methods are provided that train a machine-learned language encoding model through the use of a contrastive learning task. In particular, the present disclosure describes a contrastive learning task where the encoder learns to distinguish input tokens from plausible alternatives. In some implementations, on each training example the proposed method masks out some subset (e.g., 15%) of the original input tokens, replaces the masked tokens with samples from a “generator” (e.g., which may be a small masked language model), and then trains the encoder to predict whether each token comes from the original data or is a replacement produced by the generator.