Abstract: A client network implements data locality-aware MapReduce using IoT devices. An IoT service of a provider network receives configuration settings from a user to implement map nodes and reduce nodes at the client network. Each map node is configured to receive its own locality-based partition of data from one or more data sources (e.g., sensors) that are within a map function data locality (e.g., a particular location of the network). Each map node then processes the locality-based partition of the data, generates results, and sends the results to a reduce node. The reduce node may be located at a remote provider network. A coordinator node may also be deployed to one or more devices of the client network. If a map node or a compute node becomes overloaded, the coordinator node may redirect some data to a map node or a reduce node of a remote provider network.

Abstract: A computing environment is disclosed that receives from devices requests directed toward services accessible in the environment, and that forwards communications from services in the environment to devices registered with the environment. During a registration process at the environment, devices are assigned a device identifier that is used to identify and authenticate each particular device and requests communicated from and to the device via the environment. The computing environment maintains state information for each device that has been registered with the system. As the device interacts with the system, the state information is updated to reflect the changes in the device. When requests to perform functions are received from devices, the computing environment determines for the particular device and the particular function requested what processing needs to be performed by the environment in response to the request.

Abstract: A technology is provided for adapting a quorum size of messaging nodes in a service provider environment. An adaptive quorum evaluation is executed to determine a number of messaging nodes for a quorum of messaging nodes. A messaging environment trigger is identified to change the number of messaging nodes used for the quorum of messaging nodes. The number of messaging nodes used for the quorum of messaging nodes is changed based on the messaging environment trigger. Data for the message is synchronized with a quorum of messaging nodes before delivering the message.

Abstract: Systems and methods are described for management of data transmitted between computing devices in a communication network. An administrative component can configure one or more devices in the communication path of messages to be exchanged by devices to interpret codes embedded in the communication messages. A receiving device can review incoming messages and process the message to determine how the communication message will be routed or otherwise processed according to business rules or logic.

Abstract: Systems and methods are described for management of data transmitted between computing devices in a communication network. An administrative component can configure one or more devices in the communication path of messages to be exchanged by devices to interpret codes embedded in the communication messages. A receiving device can review incoming messages for one or more processing codes or instructions that are embedded in the portion of the communication typically utilized solely to identify the subject matter of the communication, generally referred to as the topic portion of the communication. The receiving devices can then process the embedded codes to determine how the communication message will be routed or otherwise processed.

Abstract: A computing environment is disclosed that receives from devices requests directed toward services accessible in the environment, and that forwards communications from services in the environment to devices registered with the environment. During a registration process at the environment, devices are assigned a device identifier that is used to identify and authenticate each particular device and requests communicated from and to the device via the environment. The computing environment maintains state information for each device that has been registered with the system. As the device interacts with the system, the state information is updated to reflect the changes in the device. When requests to perform functions are received from devices, the computing environment determines for the particular device and the particular function requested what processing needs to be performed by the environment in response to the request.

Abstract: A computing device executes an application that is configured to call a sharing service application programming interface (“API”) to create a sharing session via a sharing service. The application can call the sharing service API to utilize one or more methods exposed by the sharing service API to connect to the sharing service and initiated the creation of the sharing session. The computing device can join the sharing session with one or more other computing devices. The computing device can receive data via the sharing session from one or more of the other computing devices. The data can include screen data and/or application data.

Abstract: A computing environment is disclosed that receives from devices requests directed toward services accessible in the environment, and that forwards communications from services in the environment to devices registered with the environment. During a registration process at the environment, devices are assigned a device identifier that is used to identify and authenticate each particular device and requests communicated from and to the device via the environment. The computing environment maintains state information for each device that has been registered with the system. As the device interacts with the system, the state information is updated to reflect the changes in the device. When requests to perform functions are received from devices, the computing environment determines for the particular device and the particular function requested what processing needs to be performed by the environment in response to the request.

Abstract: A connected device at a client network implements a local data classification service for classifying data based on a data classification service of a remote provider network. The local data classification service receives a request to classify data at one or more data sources of the client network. The request is initiated from a client device of the client network according to a management interface for a data classification service of a remote provider network (e.g., using the same API request used by the remote classification service). The local data classification service obtains at least some of the data from the one or more data sources of the client network. The local data classification service classifies the obtained data according to different types of sensitivity using the data classification engine in the execution environment without the data being exposed outside of a data isolation boundary of the client network.

Abstract: A client may send to a provider network a request to classify data at one or more data sources of the client network. The provider network receives the request and transmits the request to a local instance of a network-based data classification service at the client network. The local instance of the network-based data classification service classifies the data at the one or more data sources. The data is not exposed outside of a data isolation boundary associated with the client network during classification of the data by the local instance of the network-based data classification service. The provider network may initially provision the local instance of the network-based data classification service to run on the client network.

Abstract: Technologies are described for creating a function checkpoint for an instance of a program code function located on a first services hub and using the function checkpoint to load the instance of the program code function on a second services hub. An example method may include creating a function checkpoint for an instance of a program code function loaded in memory of a first services hub, where the function checkpoint may contain execution instructions and execution state data for the instance of the program code function. A second services hub included in the local device network may be identified, and the function checkpoint may be sent to the second services hub to allow execution of the instance of the program code function to be loaded on the second services hub using the function checkpoint.

Abstract: Systems and methods are described for implementing a coordinator within a coordinated environment, which environment includes set of coordinated devices managed by the coordinator. The coordinator can be provisioned with a set of tasks, each task corresponding to a segment of code that can be executed by the coordinator, such as to manage the coordinated devices. To assist in execution of the tasks, the coordinator can include a resource manager that generates execution environments corresponding to an individual task execution, which environments may be isolated from other execution environments. The coordinator can further include a scheduler to obtain calls to execute tasks, and implement a queue from which to select tasks for execution. On selecting a task, the scheduler may interact with the resource manager to generate an execution environment for the task, and cause execution of the task within the execution environment.

Abstract: Systems and methods are described for implementing a coordinator within a coordinated environment, which environment includes set of coordinated devices managed by the coordinator. The coordinator can be provisioned with a set of tasks, each task corresponding to a segment of code that can be executed by the coordinator, such as to manage the coordinated devices. To assist in execution of the tasks, the coordinator can include a communications manager that enables communications between tasks. The communications manager can provide a language-independent interface to call for execution of tasks, pass information to a task, and obtain outputs of a task. In some embodiments, the communication manager may utilize a language-independent protocol, such as the hypertext transport protocol, and be configured to respond to requests addressed to uniform resource identifiers associated with the communications manager.

Abstract: A virtual device representation of an Internet of Things (IoT) device in a service provider environment having device state information associated with the virtual device representation may be identified to enable one or more services of the service provider environment and one or more IoT devices to communicate with the virtual representation of the IoT device. Semantic annotations associated with IoT device data for the IoT device may be identified in a device registry of the service provider environment. A request may be received for data using a URL to communicate with the virtual device representation. Canonical data may be obtained from the IoT device data in the virtual representation and the canonical data may be translated according to the semantic annotations to fulfill the request for data.

Abstract: Systems and methods are described for configuring a coordinator within a coordinated environment, which environment includes set of coordinated devices managed by the coordinator. The coordinated devices may include devices configured to be managed remotely, such as thin devices, devices with alternative primary functions (e.g., appliances, household objects, etc.), or devices with limited localized user interfaces. To manage the set of coordinated devices, the coordinator can execute tasks, each task corresponding to a set of portable code executable by the coordinator to implement a desired functionality. A user may generate one or more tasks, and submit them to a service provider environment for deployment to the coordinator. The service provider environment can utilize a device shadow to notify the coordinator of the obtained tasks, and thereafter deliver the tasks to the coordinator, thus modifying a configuration of the coordinator.

Abstract: Technology is described for migrating connections for Internet of Things (IoT) devices. Data packets may be received from an IoT device for forwarding to a first physical host in a computing service environment. A determination to migrate the connection for the IoT device from the first physical host to a second physical host in the computing service environment may be performed when a throughput of the data packets received from the IoT device for the first physical host exceeds a defined threshold. A connection migration procedure may be initiated to migrate the connection for the IoT device from the first physical host to the second physical host. The connection migration procedure may include an exchange of session state information for the IoT device from the first physical host to the second physical host to enable the migration of the connection to the second physical host.

Abstract: A provider network implements a machine learning deployment service for generating and deploying packages to implement machine learning at connected devices. The service may receive from a client an indication of an inference application, a machine learning framework to be used by the inference application, a machine learning model to be used by the inference application, and an edge device to run the inference application. The service may then generate a package based on the inference application, the machine learning framework, the machine learning model, and a hardware platform of the edge device. To generate the package, the service may optimize the model based on the hardware platform of the edge device and/or the machine learning framework. The service may then deploy the package to the edge device. The edge device then installs the inference application and performs actions based on inference data generated by the machine learning model.

Abstract: The data transmission rate (DTR) of a data devices (12) connected to a data transmission service is controlled to be within an authorized collective DTR for the data devices, such as the authorized total DTR for a customer. The data devices transfer data to and/or from a data storage system (20) through front end hosts (16). The front end hosts send messages to a controller (22A) reporting the amount of data transferred and the data devices responsible for the data transfer. The controller determines whether the data devices are exceeding the authorized collective DTR and, if so, directs the front end hosts to increase the latency or delay before a front end host acknowledges receipt of data from the data devices and/or to decrease the buffer size in the front end host with respect to those data devices. This brings the DTR within the authorized collective DTR.

Abstract: A technology is described for operating a device shadowing service that manages device representations for physical devices that are network addressable. An example method may include associating a device representation with a representation type, where the device representation represents a copy of a state of a physical device in network communication with a device shadowing service that maintains the device representation, and the representation type may define a command that can be invoked through the device representation. After the device representation has been associated with the representation type, the command may be invoked through the device representation. Invoking the command may involve identifying the representation type associated with the device representation and determining that the command is supported by the representation type. Thereafter, the command may be executed.

Abstract: A technology is described for operating a device shadowing service that calculates an aggregated group state for a group of device representations. An example method may include receiving device states for devices represented using a group of device representations, where the devices connect over a network to a device shadowing service configured to manage the device states. In response to an event, device representations included in the group of device representations may be identified. Device states indicated by the device representations may be obtained and an aggregated group state for the group of device representations may be calculated using the device states indicated by the device representations.