Abstract: Techniques for a distributed data processing application service in a cloud provider network are described. A virtual machine bundle is obtained, the virtual machine bundle including a copy of a memory and one or more registers of a paused virtual machine executing a distributed data processing application runtime. A request to launch a virtual machine to execute a distributed data processing application runtime is received, the request to launch the virtual machine including a bundle identifier that identifies the virtual machine bundle. The virtual machine is launched based at least in part on the virtual machine bundle. The virtual machine sends a message to register the virtual machine with a cluster of virtual machines.

Abstract: In response to receiving a parallel processing job from a customer, a system operated by a computing resource service provider allocates and configures a cluster of computer systems capable of executing the job. In an embodiment, each computer system is configured with a first network stack that allows access to resources of the computing resource service provider and a second network stack that allows access to resources of the customer. In an embodiment, the state of the cluster is monitored by the system via the first network stack. In an embodiment, the system deploys a set of tasks on the cluster for fulfilling the processing job. In an embodiment, the tasks have access to the second network stack so that each task can access resources of the customer.

Abstract: A system operated by a computing resource service provider maintains a pool of computing resources for use in processing job requests submitted by customers. The system allocates computing resources to the pool in anticipation of future resource needs. In various embodiments, future resource needs can be estimated based on scheduled jobs, or historical job information. In an embodiment, the computing resources are virtual computer systems which may be arranged in a cluster. In response to receiving a parallel processing job from a customer, the system reserves computing resources from the pool for performing the job. In an embodiment, the reserved resources are configured with a network namespace that is able to access to a customer's resources.

Abstract: Achieving resource management within a network processing unit (NPU) can be challenging due to the NPU's fixed and limited instruction set. In the case of large mobile networks, contexts are dynamic, and each subscriber in the network consumes multiple hardware resources, where a central processing unit (CPU) is typically employed to program individual resources even though generally impractical in high-session rates. To avoid programming individual resources, an example embodiment of the present invention creates a group of resources depending on a category, the group being shared dynamically among subscribers when a subscriber is active in the network. The example embodiment may include a network service processor (NSP) located in a forwarding path, such that the NPU may operate in connection with the NSP to allocate NPU resources using a packetized interface. The example embodiment achieves resource management within the NPU without a host CPU's involvement and without statically delaying resources.

Abstract: In current hardware forwarding architectures, in which subscriber profiles are distributed across multiple cards in the network, lack of subscriber knowledge leads to loss of bandwidth on fabric links connecting multiple cards in a chassis, loss of device processing cycles, and loss of quality of service knowledge because the traffic is not classified. An example embodiment of the present invention employs a subscriber-aware switch programmed with a subscriber table that maps subscriber traffic to an “anchor” line card with the subscriber's profile. The subscriber table allows for traffic to reach the anchor line card directly, avoiding unnecessary hops and loss of traffic information. As a result, line card, fabric, and other resources are used efficiently, thereby enabling a gateway or other network node to support high traffic rate (e.g., 100 Gbps) network models.

Abstract: In current systems, a typical way to collect application statistics includes sending requests to a resource manager that can access the resource hardware via a device driver. Current systems require multiple synchronous transactions between the processes, which results in the systems consuming large amounts of central processing unit resources that lead to sub-optimal rates of information retrieval. A method and apparatus configured to use asynchronous messaging across all modules and to return hardware statistics directly from the hardware to an application process, thereby bypassing transactions between the application and the resource manager, and bypassing similar transactions between the resource manager and a device driver. Embodiments of the invention are provided for minimizing the power consumed by the memory and minimizing the amount of dedicated memory necessary to perform.

Abstract: As part of mobility management messaging in current systems, only static quality of service (QoS) profiles and their statically configured classifiers are reported. These classifiers are known a priori and are typically used for hosted traffic. Once advanced application classifiers are matched and mobility messaging is done, the deep packet inspection (DPI) learned subscriber context is lost. An embodiment of the invention is configured to associate DPI-learned dynamic classifiers with the classifier's policy information as payload over mobility management messaging. The embodiment is useful for identifying protocols and applications, for authentication purposes, solving congestion-based issues between elements in a network, guaranteeing QoS without reserving resources statically, attaching traffic packets to a particular subscriber, and creating mobile signaling to provision end-to-end communication in a network.

Abstract: Current subscriber-aware networks provision individual subscriber parameters in a centrally located repository and return the parameters to entities for quality of service (QoS) enforcement on a per-subscriber basis. In other words, there is a one-to-one mapping of each QoS profile for each subscriber. Attaching QoS profiles to each subscriber can result in very high resource requirements, such as a larger memory footprint or multiple policing profiles, resulting in a non-scalable network resource. To resolve resource explosion problem without sacrificing functional requirements, an example embodiment of the present invention allows few service classes with QoS parameters to exist and derives various subscriber plans out of them. The example embodiment is useful to generate subscriber plans dynamically as subscribers join network and thereby helps to reduce QoS resource requirements dramatically, without sacrificing any functional capability.

Abstract: Achieving resource management within a network processing unit (NPU) can be challenging due to the NPU's fixed and limited instruction set. In the case of large mobile networks, contexts are dynamic, and each subscriber in the network consumes multiple hardware resources, where a central processing unit (CPU) is typically employed to program individual resources even though generally impractical in high-session rates. To avoid programming individual resources, an example embodiment of the present invention creates a group of resources depending on a category, the group being shared dynamically among subscribers when a subscriber is active in the network. The example embodiment may include a network service processor (NSP) located in a forwarding path, such that the NPU may operate in connection with the NSP to allocate NPU resources using a packetized interface. The example embodiment achieves resource management within the NPU without a host CPU's involvement and without statically delaying resources.

Abstract: In current systems, a typical way to collect application statistics includes sending requests to a resource manager that can access the resource hardware via a device driver. Current systems require multiple synchronous transactions between the processes, which results in the systems consuming large amounts of central processing unit resources that lead to sub-optimal rates of information retrieval. A method and apparatus configured to use asynchronous messaging across all modules and to return hardware statistics directly from the hardware to an application process, thereby bypassing transactions between the application and the resource manager, and bypassing similar transactions between the resource manager and a device driver. Embodiments of the invention are provided for minimizing the power consumed by the memory and minimizing the amount of dedicated memory necessary to perform.

Abstract: In current hardware forwarding architectures, in which subscriber profiles are distributed across multiple cards in the network, lack of subscriber knowledge leads to loss of bandwidth on fabric links connecting multiple cards in a chassis, loss of device processing cycles, and loss of quality of service knowledge because the traffic is not classified. An example embodiment of the present invention employs a subscriber-aware switch programmed with a subscriber table that maps subscriber traffic to an “anchor” line card with the subscriber's profile. The subscriber table allows for traffic to reach the anchor line card directly, avoiding unnecessary hops and loss of traffic information. As a result, line card, fabric, and other resources are used efficiently, thereby enabling a gateway or other network node to support high traffic rate (e.g., 100 Gbps) network models.

Abstract: As part of mobility management messaging in current systems, only static quality of service (QoS) profiles and their statically configured classifiers are reported. These classifiers are known a priori and are typically used for hosted traffic. Once advanced application classifiers are matched and mobility messaging is done, the deep packet inspection (DPI) learned subscriber context is lost. An embodiment of the invention is configured to associate DPI-learned dynamic classifiers with the classifier's policy information as payload over mobility management messaging. The embodiment is useful for identifying protocols and applications, for authentication purposes, solving congestion—based issues between elements in a network, guaranteeing QoS without reserving resources statically, attaching traffic packets to a particular subscriber, and creating mobile signaling to provision end-to-end communication in a network.