Search Patents
  • Patent number: 11778053
    Abstract: Techniques for fault-tolerant function placement across multiple computing placement locations are described. An application placement service obtains a latency-based placement of functions of an application and utilizes resource information associated with the placement locations to determine error rates for flows of the placement. For flows having an error rate falling outside of an allowable range, the application placement service can modify the placement to improve the error rate, e.g., by adding additional redundancy for functions in higher-error placement locations within those placement location tiers, and/or by adding additional redundancy for functions in higher-error placement locations within different placement location tiers.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: October 3, 2023
    Assignee: Amazon Technologies, Inc.
    Inventor: Nicholas Alexander Allen
  • Publication number: 20140237472
    Abstract: A resource optimization manager monitors resource metrics of a set of virtual machine instance types and determines a set of applications associated with the virtual machine instance types and associates the resource metrics to the set of applications. Thereafter, the resource optimization manager can generate clusters of applications that share one or more similar attributes and store resource optimizations for the clustered applications. The resource optimization manager can obtain a designation of a target application run on a virtual machine instance or otherwise obtain a definition of an application. The resource optimization manager can then associate the target application with one or more of the clustered applications based on a comparison of similarities between the clustered applications and the target applications.
    Type: Application
    Filed: December 20, 2013
    Publication date: August 21, 2014
    Applicant: Amazon Technologies, Inc.
    Inventors: Eden G. Adogla, Awo D. Ashiabor
  • Patent number: 9721295
    Abstract: Disclosed are various embodiments for generating an interface for communication of at least one supply chain associated with an order that comprises forecast completion times for components of the at least one supply chain. The interface includes nodes that are associated with components of the at least one supply chain. The nodes within the interface are linked, wherein each link connects two of the nodes and indicates a relationship between the corresponding components of the at least one supply chain. The nodes and the links are arranged into a rooted tree within the interface, wherein the rooted tree represents the organization of the components of the at least one supply chain.
    Type: Grant
    Filed: March 26, 2012
    Date of Patent: August 1, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: Kevin C. Miller, Jeffrey S. Eakle, Steven S. Armato, Jonathan B. Norwood
  • Patent number: 11416306
    Abstract: Techniques for managing resource utilization across heterogeneous physical hosts are described. Resource utilization of a first plurality of physical hosts in a provider network may be monitored, each physical host comprising a plurality of resources. A future resource utilization can be determined, the future resource utilization including quantities of a plurality of resource types. The future resource utilization can be matched to a plurality of physical host types, each physical host type associated with a different plurality of resources. A second plurality of physical hosts corresponding to the plurality of physical host types can be deployed to the provider network.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: August 16, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Bradley Joseph Gussin, Diwakar Gupta, Michael Phillip Quinn
  • Patent number: 11068355
    Abstract: Generally described, aspects of the present disclosure relate to offload device virtual component checkpointing for fast recovery from virtual component software crashes by storing virtual component state configuration information and input/output (I/O) request identification information in non-volatile memory of a physical computing device physically separate from the offload device. In the event of a software crash of a virtual component, the crashed virtual component may be rebooted and reconfigured in accordance with the virtual component state configuration information and I/O request identification information stored in the non-volatile memory of the physical computing device.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: July 20, 2021
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventor: Anthony Nicholas Liguori
  • Patent number: 10922666
    Abstract: A provider network may implement resource management and billing for logical and physical availability zones. Consolidated billing techniques may be applied to the aggregate usage of multiple linked user accounts. A billing setting may indicate whether consolidated billing is performed according to resource consumption in logical availability zones or physical availability zones. Mappings to physical availability zones may be provided to linked user accounts so that computing resources may be consumed according to either logical or physical availability zones. Capacity reservations for computing resources for a particular physical availability zone may be made available to each of the linked user accounts for consumption.
    Type: Grant
    Filed: June 23, 2014
    Date of Patent: February 16, 2021
    Assignee: Amazon Technologies, Inc.
    Inventor: David John Ward, Jr.
  • Patent number: 10154091
    Abstract: A distributed system may deploy infrastructure units according to resource hosting constraints. Additional infrastructure units, or infrastructure units to be redeployed, may be identified for deployment. State information describing the deployment of infrastructure units currently deployed amongst different infrastructure localities of a distributed system may be evaluated for different possible deployments according to resource hosting constraints. Possible deployments that optimize or increase resource hosting capacity in the distributed system within the resource hosting constraints may be determined. Deployment at those infrastructure localities of the determined possible deployments may be directed.
    Type: Grant
    Filed: December 28, 2015
    Date of Patent: December 11, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Mitchell Gannon Flaherty, Christopher Magee Greenwood, Surya Prakash Dhoolam, Gary Michael Herndon, Jr.
  • Patent number: 8595714
    Abstract: A system and method of deploying operating environments in an enterprise computing environment comprised of managed virtual or hardware servers is disclosed. A library of operating environments, each environment including at least one package including an operating system image and an application, is provided. A user controlling a cluster of servers may request creation of a test environment using an operating environment from the library, and test the environment with applications to ensure the user's needs are met. The user may request all servers within the user's cluster be provisioned with the operating environment through a deployment manager.
    Type: Grant
    Filed: March 4, 2009
    Date of Patent: November 26, 2013
    Assignee: Amazon Technologies, Inc.
    Inventor: Kenneth L. Hamer
  • Patent number: 11023589
    Abstract: A multi-phase boot operation of a virtualization manager at a virtualization host is initiated at an offload card. In a first phase of the boot, a security key stored in a tamper-resistant location of the offload card is used. In a second phase, firmware programs are measured using a security module, and a first version of a virtualization coordinator is instantiated at the offload card. The first version of the virtualization coordinator obtains a different version of the virtualization coordinator and launches the different version at the offload card. Other components of the virtualization manager (such as various hypervisor components that do not run at the offload card) are launched by the different version of the virtualization controller.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: June 1, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Anthony Nicholas Liguori, Barak Wasserstrom
  • Patent number: 11502920
    Abstract: Techniques for dynamic resource movement in heterogeneous computing environments including provider substrate extensions are described. A dynamic resource movement service of a provider network monitor conditions of heterogeneous computing environments, including provider substrate extensions of the cloud provider network, to evaluate customer-provided movement policy conditions governing when to move customer application resources from these environments, where to move the resource to, and/or how to move the customer application resources. The customer-provided movement policy conditions may be based on a variety of factors, such as a latency between end-users of the customer application and the application itself.
    Type: Grant
    Filed: October 7, 2021
    Date of Patent: November 15, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Ishwardutt Parulkar, Georgios Elissaios
  • Patent number: 9996381
    Abstract: Techniques for configuring virtual machine instances are described herein. A virtual machine instance is instantiated and the virtual machine instance is monitored to receive notifications of configuration events associated with that virtual machine instance. Each configuration event, which specifies configuration changes to the virtual machine instance, includes a set of metadata associated with the configuration event. The metadata is extracted from the configuration event and the configuration changes are applied to the virtual machine instance. A new virtual machine image is then produced from the virtual machine instance and the extracted metadata is associated with the new virtual machine image.
    Type: Grant
    Filed: March 29, 2016
    Date of Patent: June 12, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Gurinder Raju, Karmveer Veer Singh, Abhinav Shrivastava, Sheshadri Supreeth Koushik, Deepak Suryanarayanan
  • Patent number: 11113186
    Abstract: This disclosure describes techniques for testing and publishing of resource handlers in a cloud environment. For example, a code-development interface may be utilized to generate initial code for the building of resource handlers. The initial code may be verified and the resource handlers may be built and deployed to a test platform. One or more execution tests may be run on the resource handlers in the test platform to determine if the resource handlers execute successfully. The resource type associated with the resource handlers may be published to a registry service and the resource type may be made available for provisioning.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: September 7, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Amjad Hussain, Diwakar Chakravarthy, Ryan John Lohan, Sayali Suhas Deshpande, Xiaodong Ma, Bharath Swaminathan
  • Patent number: 9417902
    Abstract: Functionality is disclosed herein for managing resource bursting and other operational characteristics of software executing on a virtual machine instance. The mechanism disclosed herein may receive a request to initialize a virtual machine instance. The request might include a virtual machine instance type and a weight value. The virtual machine instance may be instantiated by establishing a virtual machine of the virtual machine instance type and associating the weight value therewith. The utilization of resources by the virtual machine instance may be monitored and the weight value may be adjusted based upon the monitoring. The adjusted weight value might also be utilized when instantiating new virtual machine instances for the same user and/or customer of a service provider network.
    Type: Grant
    Filed: March 24, 2014
    Date of Patent: August 16, 2016
    Assignee: Amazon Technologies, Inc.
    Inventor: Steven Michael Noonan
  • Patent number: 11228516
    Abstract: Technology is described for edge computing management with multiple latency options. An application orchestration service may identify service distribution zones of a service provider environment that provide a connection between a mobile network and computing resources capable of executing portions of distributed applications used by devices connected to the mobile network. The application orchestration service may determine whether a network path latency between the devices and the computing resources satisfy latency constraints for the portions of the distributed applications. The application orchestration service may orchestrate which computing resources in the service distribution zones handle application processing by the portions of the distributed applications for the devices connected to the mobile network.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: January 18, 2022
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventor: Robin Satish Harwani
  • Patent number: 10067801
    Abstract: A system for providing low-latency computational capacity from a virtual compute fleet is provided. The system may be configured to maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprises a first pool comprising a first sub-pool of virtual machine instances and a second sub-pool of virtual machine instances, and a second pool comprising virtual machine instances used for executing one or more program codes thereon. The first sub-pool and/or the second sub-pool may be associated with one or more users of the system. The system may be further configured to process code execution requests and execute program codes on the virtual machine instances of the first or second sub-pool.
    Type: Grant
    Filed: December 21, 2015
    Date of Patent: September 4, 2018
    Assignee: Amazon Technologies, Inc.
    Inventor: Timothy Allen Wagner
  • Patent number: 10397344
    Abstract: A service implemented at a first isolated virtual network of a provider network is added to a database of privately-accessible services. Configuration changes that enable network packets to flow between the first isolated virtual network and a second isolated virtual network without utilizing a network address accessible from the public Internet are implemented. Service requests originating at the second isolated virtual network are transmitted to the first isolated virtual network via private pathways of the provider network. Metrics corresponding to service requests directed from the second isolated network to the service are collected and provided to the respective owners of one or both isolated virtual networks.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: August 27, 2019
    Assignee: Amazon Technologies, Inc.
    Inventors: Kyle Tailor Akers, Michael Siaosi Voegele, Kevin Christopher Miller, Chao Yuan, David Brian Lennon, Patrick Stephenson
  • Patent number: 10592281
    Abstract: A wait optimizer circuit can be coupled to a processor to monitor an entry of a virtual CPU (vCPU) into a wait mode to acquire a ticket lock. The wait optimizer can introduce an amount of delay, while the vCPU is in the wait mode, with an assumption that the spinlock may be resolved before sending a wake up signal to the processor for rescheduling. The wait optimizer can also record a time stamp only for a first entry of the vCPU from a plurality of entries into the wait mode within a window of time. The time stamps for vCPUs contending for the same ticket lock can be used by a hypervisor executing on the processor for rescheduling the vCPUs.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: March 17, 2020
    Assignee: Amazon Technologies, Inc.
    Inventor: Ali Ghassan Saidi
  • Patent number: 9600774
    Abstract: Remote computing resource service providers allow customers to execute virtual computer systems in a virtual environment on hardware provided by the computing resource service provider. The hardware may be distributed between various geographic locations connected by a network. The distributed environment may increase latency of various operations of the virtual computer systems executed by the customer. To reduce latency of various operations predictive modeling is used to predict the occurrence of various operations and initiate the operations before they may occur, thereby reducing the amount of latency perceived by the customer.
    Type: Grant
    Filed: September 25, 2013
    Date of Patent: March 21, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: Sebastian Martin Biemueller, Christopher Richard Jacques de Kadt, Mathew Daniel, Adi Meyers, James Alfred Gordon Greenfield, Thomas Friebel, Jean-Paul Bauer, Benjamin Van Der Merwe
  • Patent number: 10728169
    Abstract: A system comprising a computing node comprising a processor and a non-transitory memory and an application stored in the non-transitory memory. When executed by the processor, the application causes the processor to receive an input requesting that a first compute instance of a first compute instance type be instantiated as a second compute instance of a second compute instance type, where a mix of compute resources associated with the second compute instance type is different from a mix of compute resources associated with the first compute instance type; create the second compute instance of the second compute instance type based on the first compute instance; deactivate the first compute instance; and instantiate the second compute instance.
    Type: Grant
    Filed: June 26, 2015
    Date of Patent: July 28, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Weili Zhong McClenahan, Diwakar Gupta
  • Patent number: 8918785
    Abstract: Systems, methods, and interfaces for the management of virtual machine instances and other programmatically controlled networks are provided. The hosted virtual networks are configured in a manner such that a virtual machine manager of the virtual network may monitor activity such as user requests, network traffic, and the status and execution of various virtual machine instances to determine possible security assessments. Aspects of the virtual network may be assessed for vulnerabilities at varying levels of granularity and sophistication when a suspicious event or triggering activity is detected. Illustrative embodiments of the systems and methods may be implemented on a virtual network overlaid on one or more intermediate physical networks that are used as a substrate network.
    Type: Grant
    Filed: December 29, 2010
    Date of Patent: December 23, 2014
    Assignee: Amazon Technologies, Inc.
    Inventors: Eric Jason Brandwine, Donald L. Bailey, Jr.