Abstract: Systems and methods are described for replacing image data from a virtual machine with local image data, such as for a video application. In some aspects, a method for replacing image data in a video application may include obtaining first image data from a camera connected to the user device and transmitting the first image data to a virtual machine that executes the video application. The user device may receive a video application image from the virtual machine that includes an indication that identifies the first image data. The user device may identify the first image data in the video application image based on the indication and replace it with second image data obtained from the camera device to produce a modified video application image. The client device may render the modified video application image in a virtual computing environment displayed on the user device.

Abstract: An IoT service of a provider network may be used to optimize downlink scheduling for edge devices that use a radio communication protocol (e.g., LoRaWAN). A processing instance receives DL packets from a client application that are to be sent to an edge device. The processing instance adds metadata entries (device ID, message ID) to a metadata queue and stores the DL packets into a data store. A scheduling instance obtains a metadata entry and the associated DL packet, formats the DL packet based on edge device information, and publishes the packet to a gateway topic. A separate connection instance receives the formatted DL packet and sends it to a gateway of the client network.

Abstract: A physical space contains stationary objects that do not move over time (e.g., a couch) and may have non-stationary objects that do move over time (e.g., people and pets). An autonomous mobile device (AMD) determines and uses an occupancy map of stationary objects to find a route from one point to another in a physical space. Non-stationary objects are detected and prevented from being incorrectly added to the occupancy map. Point cloud data is processed to determine first candidate objects. Image data is processed to determine second candidate objects. These candidate objects are associated with each other and their characteristics assessed to determine if the candidate objects are stationary or non-stationary. The occupancy map is updated with stationary obstacles. During navigation, the occupancy map may be used for route planning while the non-stationary objects are used for local avoidance.

Abstract: Techniques for communications in a multi-zone space are described. In an example, a system stores data indicating devices in zones of a space and data indicating zones that are associated with a communications session. A display in a zone presents graphical user interface indicating the zones associated with the communications session. Incoming audio data can be mixed with audio data detected from another participating zone and a speaker in the zone can output this audio data. Audio data detected from the participating zone can also be mixed and sent to a remote device that is an endpoint of the communications session.

Abstract: This disclosure describes, in part, techniques for modifying network applications. For instance, remote system(s) may store an application on a first virtual storage device and store a modification for the application on a second virtual storage device. The remote system(s) may then install the application on a virtual server using the first virtual storage device. Additionally, the remote system(s) may receive a request to access the application along with an indication to enable the modification for the application. Based on the request, the remote system(s) may modify the application on the virtual server using the second virtual storage device. The remote system(s) may then launch the application, as modified, on the virtual server. Once the application is launched, the system(s) may provide the application to a user device using the virtual server.

Abstract: Techniques are described for providing an access control list (ACL) assisted process for filtering the analysis and display of dependency relationships among software application components (e.g., packages, files, classes, etc.), e.g., as part of modernization processes aimed at decomposing monolithic applications, identifying anti-patterns, or otherwise analyzing such applications. A software modernization service of a cloud provider network provides discovery agents and other tools that are capable of creating an inventory of users' software applications and collecting application artifacts (e.g., source code or bytecode files) associated with the software applications in users' computing environments. Various techniques are described for using ACLs containing entries enabling or disabling the analysis or display of various application components to customize various modernization processes and results displays.

Abstract: A method and system including a monitoring device to detect, during a session, a set of radar signals associated with first respiratory-related movements of a first person and second respiratory-related movements of a second person located within a detection zone comprising at least a portion of a bed. The method and system dynamically generate an out-of-bed zone adjacent to a side of the bed. The out-of-bed zone is monitored to detect motion within the zone to determine when the first person exits and enters the bed. The method and system identify a portion of the set of radar signals collected during a time period when the first person is determined to be out of the bed. The identified portion of the set of radar signals is removed from the set of radar signals collected during the sleep session.

Abstract: Time and value ordering may be applied for items stored in data backups. A change log that persists changes to a data set may be updated with changes and used to update an in-memory table for the data set, which describes changes to items up to a current time. An event may be detected to seal the in-memory table from subsequent updates and a persistent data object that orders the items in the in-memory according to both keys of the respective items and the respective time values of the items, as stored in the change log, may be generated and stored as part of a backup for the data set.

Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.

Abstract: A system for encoding video for film grain synthesis is disclosed. A video encoding system includes a film grain description estimator configured to receive an input video comprising film grain and analyze the input video to generate a film grain description for the input video. The video encoding system includes a video encoder configured to receive the input video and, responsive to a determination that the input video comprises film grain, configure one or more encoder settings based on presence of the film grain to achieve a compression target for the input video. The video encoder is further configured to encode the input video comprising film grain using the encoder settings configured based on the presence of film grain to produce encoded video. The video encoding system is configured to send the encoded video and the film grain description to a video destination.

Abstract: A domain registry (DR) service executing within a service provider network protects data, such as account data, that is associated with different accounts for testing and/or performing other operations/actions by registering an account with one or more domains. The DR service may register an account in one or more domains based on a request by a user. The operations performed that uses/changes data associated with accounts may be restricted based on the domains for which an account is registered. For example, an account that is registered in a “testing” domain may have different workflows/operations performed using the account data associated with the account registered in the testing domain as compared to an account that is not part of the testing domain.

Abstract: Modular components may be used to build a robotic manipulator. A subset of the modular components can be selected to build the robotic manipulator based on a schematic. The subset of modular components can be assembled in different combinations to build the robotic manipulator. Using one of the combinations of the subset of modular components, the robotic manipulator can be built.

Abstract: Techniques are disclosed for detecting an uncovered portion of a body of a person in a frame of video content. In an example, a first machine learning model of a computing system may output a first score for the frame based on a map that identifies a region of the frame associated with an uncovered body part type. Depending on a value of the first score, a second machine learning model that includes a neural network architecture may further analyze the frame to output a second score. The first score and second score may be merged to produce a third score for the frame. A plurality of scores may be determined, respectively, for frames of the video content, and a maximum score may be selected. The video content may be selected for presentation on a display for further evaluation based on the maximum score.

Abstract: Systems and methods for image-based item identification are disclosed. Image data corresponding to one or more images depicting an item may be sent to one or more remote systems for image-based item identification. The identification indications and/or identification confidence scores received from the remote systems may be aggregated and weighted based at least in part on one or more factors related to the remote systems, the results, domains, image capture timing, image capture angles, and/or events to more accurately identify an item depicted in the images.

Abstract: Systems and methods are described for streaming data between a user device and a remote computing environment via a “switchboard” service that enables interaction without the user device or the remote computing environment establishing additional connections. A first routing device receives a connection from a user device that requests routing a data stream to or from a remote computing environment. The first routing device processes the request by generating a token, which is passed to the remote computing environment along with the request. The remote computing environment passes the token to a second routing device, which decodes the routing token to identify the first routing device. The second routing device then passes the request token to the first routing device, which responds by establishing a route for streaming data between the connection made with the user device and the remote computing environment via the routing devices.

Abstract: Devices and techniques are generally described for detection of network anomalies. In various examples, first data describing network communication between a plurality of source entities and a plurality of destination entities may be received. In some examples, respective feature data representing network communication between a respective source entity and one or more of the plurality of destination entities may be generated. In some examples, an unsupervised machine learning model may be used to determine a first number of clusters of the feature data. In various cases, a first source entity that is an outlier with respect to the first number of clusters may be determined based at least in part on the first number of clusters. The first source entity may be classified as an anomalous entity.

Abstract: Modular storage systems include load sensors disposed beneath or in association with platforms. The load sensors are pulse-sampled for signals corresponding to loads at time intervals, rather than continuously, in order to conserve electrical power. An item associated with a transaction is identified based on a change in the loads, as determined from the pulse-sampled signals. The platforms are aligned at horizontal or non-horizontal angles, and photovoltaic power sources with banks of photovoltaic cells are mounted to front edges of the platforms. When a user reaches over one of the photovoltaic cells to access an item on a platform, a level of power or voltage generated by the photovoltaic cell is diminished. The item closest to the photovoltaic cell having the diminished power or voltage, or a customer that accessed the item, may be identified accordingly.

Abstract: A system may use multiple speech interface devices to interact with a user by speech. All or a portion of the speech interface devices may detect a user utterance and may initiate speech processing to determine a meaning or intent of the utterance. Within the speech processing, arbitration is employed to select one of the multiple speech interface devices to respond to the user utterance. Arbitration may be based in part on metadata that directly or indirectly indicates the proximity of the user to the devices, and the device that is deemed to be nearest the user may be selected to respond to the user utterance.

Abstract: Disclosed are systems and methods that determine specification portions of Dafny code and transform those specifications into one or more annotations, expressions, comments, and/or assertions that are included in a destination code written in a destination language as part of a compilation of the Dafny code into the destination code. The annotations, expressions, comments, and/or assertions in the destination code may be utilized by a verification component, such as a Checker Framework, to detect errors that are introduced into the destination code by the compiler as part of the compilation or to verify the absence of errors in the destination code.

Abstract: Systems and processes are described for a message service with distributed key caching for server-side encryption. Message requests are received by message handlers of the message service that cache data encryption keys used to encrypt and decrypt messages that are stored to message containers in back end storage. A metadata service obtains the data encryption keys from a key management service, caches the keys locally, and sends the keys to the message handlers upon request, where the keys are cached, again. The key management service may generate the data encryption keys based on a master key (e.g., a client's master key). The message handlers may send both message data encrypted using the data encryption key and an encrypted copy of the data encryption key to be stored together in the data store.

Abstract: Disclosed are various embodiments for efficiently identifying whether any expected user interface elements (e.g., informational components, containers, navigational components, input controls, labels, etc.) are missing from a rendered user interface. A user interface is generated and rendered by a client device according to user interface content data received from a content provider. User interface feature identifiers associated with user interface features included in the rendered user interface are identified and applied to one or more probabilistic data structure algorithms to generate a rendered feature probabilistic data structure digest representing the rendered user interface features. The rendered feature probabilistic data structure digest is compared with an expected feature digest to determine whether any expected user interface features are missing from the rendered user interface.

Abstract: Commercial interactions with non-discretized items such as liquids in carafes or other dispensers are detected and associated with actors using images captured by one or more digital cameras including the carafes or dispensers within their fields of view. The images are processed to detect body parts of actors and other aspects therein, and to not only determine that a commercial interaction has occurred but also identify an actor that performed the commercial interaction. Based on information or data determined from such images, movements of body parts associated with raising, lowering or rotating one or more carafes or other dispensers may be detected, and a commercial interaction involving such carafes or dispensers may be detected and associated with a specific actor accordingly.

Abstract: A multi-assistant speech-processing system that centrally determines multiple execution plans to respond to a user input. A central component determines whether a particular input should be processed using a requested assistant or a different assistant or should be terminated. Assistant handoff may be determined based on system policies as well as user input-specific data. A ranked list of execution options may be supplemented by augmented data corresponding to messages to a user. The system may attempt to execute plans in the ranked order until a plan succeeds.

Abstract: A satellite provides communication between user terminals (UTs) and ground stations that connect to other networks, such as the Internet. Because the satellite is within range of many UTs at any given time, many UTs are in contention to use an uplink to send upstream data to the satellite. This saturates a random-access channel (RACH) on the uplink. When a UT has data to uplink, it sends a short buffer data status (SBDS) message using the RACH. The minimal size of the SBDS facilitates use of a non-orthogonal multiple access uplink. Based on the SBDS, the satellite allocates a grant to the UT to use the uplink. Additional messages from the UT involving buffer status may be sent using the granted uplink. Unsolicited grants may be issued to the UT based on analysis of uplink and downlink traffic. If needed, the RACH may still be used to request additional grants.

Abstract: Devices and techniques are generally described for generating response templates for natural language processing. In various examples, a first knowledge graph comprising a plurality of entities may be received. First text data may be received for a first response template, the first text data defining a natural language input configured to invoke the first response template. A response definition may be received for the first response template, the response definition defining a response associated with the first response template. Natural language input data may be received. A determination may be made that the natural language input data corresponds to the natural language input configured to invoke the first response template. The first response template may be configured to generate natural language output data.

Abstract: A pair of virtualized security device initialization data sets are received at a first virtualization server from respective sources prior to a launch of a compute instance at the server. A first virtualized security device is initialized using the data sets, and used to generate cryptographic artifacts used by the compute instance. A data item which was included in one of the data sets is modified after the cryptographic artifacts are generated. Additional cryptographic artifacts are generated by a second virtualized security device at a second virtualization server to which the compute instance has been migrated. The second virtualized security device is initialized using at least the modified data item.

Abstract: A constellation of many satellites provide communication between devices such as user terminals (UTs) and ground stations that are connected to other networks, such as the Internet. A constellation management system (CMS) facilitates management and operation of the satellites in the constellation and facilitates information exchange with other authorized systems to provide for situationally aware operation. The CMS may ingest data such as satellite telemetry, space weather data, object ephemeris data about other orbital objects, and so forth. The CMS uses the ingested data to automatically operate satellites to perform routine activities such as station keeping maneuvers, maintenance activities, interference mitigation, and so forth. Confirmation from a human operator may be obtained before performing some activities. Activities may be planned and coordinated to minimize resource consumption for the individual satellite as well as the constellation.

Abstract: Techniques for managing connections in a mesh network that includes multiple provisioners are described. In an example, a computer system receives, from a first device set up as a first provisioner in the mesh network, a first identifier of a third device of the mesh network. The computer system also receives, from a second device set up as a second provisioner in the mesh network, the first identifier of the third device. The computer system generates an association between the third device and the first device based at least in part on a determination that the third device is to be reached exclusively via the first device. The computer system also generates a message about an action to be performed by the third device and sends, based at least in part on the association, the message to the first device.

Abstract: Disclosed are systems, methods, and apparatus of an automated and self-service kiosk that allows customers to select inventory items available from the kiosk and walk or move away with selected inventory item(s) without having to process payment, identify the inventory item(s), or provide any other form of checkout. After a customer has picked one or more items and departed the kiosk, the picked items are determined and the customer charged for the items. For example, one or more of detected weight changes measured at the kiosk and/or images generated at the kiosk may be used to identify items picked by the customer from the kiosk.

Abstract: A semiconductor package can include a unitary substrate defining a first region and a second region. A first interposer can be mounted on the unitary substrate in the first region, and a first die can be mounted on the first interposer. A second interposer can be mounted in the second region on the unitary substrate, and a second die can be mounted on the second interposer.

Abstract: Techniques for improving the power consumption of a device without impacting or with minimal impact to operations of the device are described. In an example, the device includes a processor. The device receives, while the processor is operating in a first power mode, first input data corresponding to first audio detected by a microphone. Based at least in part on the first input data, the device detects a sound event or ambient noise. Based at least in part on a detection of the ambient noise only, the device causes processor to operate in a second power mode in which the processor consumes less power than in the first power mode.

Abstract: When a client requests a data import job, a remote storage service provider provisions a shippable storage device that will be used to transfer client data from the client to the service provider for import. The service provider generates security information for the data import job, provisions the shippable storage device with the security information, and sends the shippable storage device to the client. The service provider also sends client-keys to the client, separate from the shippable storage device (e.g., via a network). The client receives the device, encrypts the client data and keys, transfers the encrypted data and keys onto the device, and ships it back to the service provider. The remote storage service provider authenticates the storage device, decrypts client-generated keys using the client-keys stored at the storage service provider, decrypts the data using the decrypted client-side generated keys, and imports the decrypted data.

Abstract: Determining whether to allow access to a message is disclosed. A message is received from a sender. The message is associated with a first time-to-live (TTL) value. A determination is made that the first time-to-live value has not been exceeded. The determination is made at least in part by obtaining an external master clock time. In response to the determination, access is allowed to the message.

Abstract: Joint noise and echo suppression may be performed for enhancing two-way audio communications. Audio data is captured at a communication device and audio data transmitted to the communication device from another communication device are used as input features to a trained machine learning model that uses the transmitted audio data as a reference signal to eliminate residual echo in the captured audio data when also suppressing noise in the captured audio data.

Abstract: Techniques are generally described for fusing sensor data of different modalities using a transformer. In various examples, first sensor data may be received from a first sensor and second sensor data may be received from a second sensor. A first feature representation of the first sensor data may be generated using a first machine learning model and a second feature representation of the second sensor data may be generated using a second machine learning model. In some examples, a modified first feature representation of the first sensor data may be generated based at least in part on a self-attention mechanism of a transformer encoder. The modified first feature representation may be generated based at least in part on the first feature representation and the second feature representation. A computer vision task may be performed using the modified first feature representation.

Abstract: At a first compute instance run on a virtualization host, a local instance scaling manager is launched. The scaling manager determines, based on metrics collected at the host, that a triggering condition for redistributing one or more types of resources of the first compute instance has been met. The scaling manager causes virtualization management components to allocate a subset of the first compute instance's resources to a second compute instance at the host.

Abstract: Systems, methods, and computer-readable media are disclosed for flexible rail switching components for container shuttles. In one embodiment, an example system for a shuttle may include an elongated spring steel plate, a first rail track component coupled to the elongated spring steel plate, a second rail track component coupled to the elongated spring steel plate and disposed adjacent to the first rail track component, and a third rail track component coupled to the elongated spring steel plate and disposed adjacent to the second rail track component. The elongated spring steel plate may be configured to be actuated from a first position to a second position. A distance between the first rail track component and the second rail track component when the elongated spring steel plate is in the second position may be less than when the elongated spring steel plate is in the first position.

Abstract: A speech recognition platform configured to receive an audio signal that includes speech from a user and perform automatic speech recognition (ASR) on the audio signal to identify ASR results. The platform may identify: (i) a domain of a voice command within the speech based on the ASR results and based on context information associated with the speech or the user, and (ii) an intent of the voice command. In response to identifying the intent, the platform may perform a corresponding action, such as streaming audio to the device, setting a reminder for the user, purchasing an item on behalf of the user, making a reservation for the user or launching an application for the user. In some instances, the speech recognition platform engages in a back-and-forth dialog with the user in order to properly fulfill the user's request.

Abstract: Techniques for monitoring devices to use ultrasonic signals to detect and track the locations of moving objects in an environment. To determine distance information, the monitoring devices emit a frequency-modulated continuous wave (FMCW) signal at an ultrasound frequency range. Reflections of the FMCW ultrasonic signal are used to generate time-of-arrival (TOA) profiles that indicate distances between the monitoring device and objects in the environment. The reflections can be processed to suppress undesirable interferences, such as reflections off non-mobile objects in the environment (e.g., walls, furniture, etc.), vibrations off the floorings or the ceilings, etc. After processing the reflections, a heatmap can be used to plot the intensity of the reflections for the different TOAs of the reflections, and depict the movement of the user over time. Finally, a Kalman filter is used to smooth the peaks in the intensity values on the plot, and determine the trajectory of the human.

Abstract: A hardware security module (HSM) client processes a request to store data in a set of HSMs. The HSM client determines a property of the data indicative of a sensitivity classification of the data. As a result of determining the data lacks a classification as sensitive, the HSM client transmits the data to a data store outside the set of HSMs and updates a database used by the HSM client to associate an identifier of the data with a reference to a location in the data store.

Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.

Abstract: Devices and techniques are generally described for iterative theme discovery in text. In some examples, first text data that is separated into a plurality of documents may be received. In some examples, a codebook comprising a first topic associated with a first set of keywords and a second topic associated with second set of keywords may be identified. Instructions to modify the codebook to generate a modified codebook may be received. The instructions may be effective to add to, delete from, and/or modify at least one of the keywords of the first set of keywords or the first topic. In some further examples, a first document of the plurality of documents may be tagged with the first topic based at least in part on the first keywords of the modified codebook. In some examples, output data may be generated that indicates that the first document pertains to the first topic.

Abstract: Techniques for classifying and processing physical objects are disclosed. In an example, a computer system may receive first data indicating that a first machine learning model of a robotic system is incapable to classify a physical object according to at least one of a set of predetermined classifications. The computer system may also receive second data corresponding to one or more attributes associated with the physical object. A second machine learning model of the computer system may determine a cluster of physical objects that includes an identifier of the physical object, whereby the identifier is included in the cluster based at least in part on the first data and a common attribute with other physical objects of the cluster. The computer system may then determine data for processing subsequent physical objects that are determined to have the common attribute.

Abstract: Techniques for establishing a data connection are described. In an example, a computer system receives, from a second device of a computer network, first data associated with a first device and second data associated with the second device. The first device is not connected to the computer network. The computer system determines third data generated by one or more devices other than the first device and the second device and associated with at least one of: the first device, the second device, a user account, or the computer network. The computer system generates, based on the first data, the second data, and the third data, a confidence score indicating a likelihood of a user authorization to connect the first device to the computer network. The computer system sends, to the second device based on the confidence score, instructions associated with connecting the first device to the computer network.

Abstract: A method and apparatus for testing and simulating an access control policy are disclosed. Evaluating an access control policy may be performed by utilizing a deny statement that causes the access request to be rejected despite actions indicated in the access request being authorized. Further, an independent simulation environment may be utilized for testing access control policy evaluation.

Abstract: Techniques for predicting a protein sequence are described. An exemplary method includes receiving a request to predict a missing area of a protein's primary sequence and a corresponding three-dimensional position of the missing area; applying a machine learning model to backbone Cartesian coordinates of the protein's primary sequence and a protein vector of a representation of the protein's primary sequence including the missing area to predict a missing area of the protein primary sequence and a corresponding three-dimensional position for the missing area, wherein the machine learning model is selected from the group consisting of: an attention-based machine learning model, a bidirectional long short term memory-based model, and a convolutional neural network-based model; and outputting a result of the machine learning model.