Amazon Patent Applications

Patents granted to Amazon by the U.S. Patent and Trademark Office (USPTO).

  • Publication number: 20180302281
    Abstract: The following description is directed to a logic repository service supporting adaptable host logic. In one example, a method of a logic repository service can include receiving a first request to generate configuration data for configurable hardware using a specification for application logic. The method can include selecting a particular host logic shell from a group of host logic shells. The particular host logic shell can be used to encapsulate the application logic when the configurable hardware is configured. Configuration data for the configurable hardware can be generated. The configuration data can include data for implementing the application logic and at least a portion of the particular host logic shell. The method can include receiving a second request to download the configuration data to a host server computer comprising the configurable hardware. The configuration data can be transmitted to the host server computer in response to the second request.
    Type: Application
    Filed: June 27, 2017
    Publication date: October 18, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Asif Khan, Islam Mohamed Hatem Abdulfattah Mohamed Atta, Christopher Joseph Pettey, Kiran Kalkunte Seshadri, Nafea Bshara
  • Publication number: 20180285418
    Abstract: Queries received at a query engine may be executed for structured data and not-structured data. A query execution plan may be generated for the query that includes stateless operations to apply the query to the not-structured data at remote query processing engines. The remote query processing engines may perform the stateless operations and return results to the query engine. The query engine may generate a result for the query based on the results received from the remote query engine as well as results determined as part of applying the query to structured data. The result to the query may be returned.
    Type: Application
    Filed: March 31, 2017
    Publication date: October 4, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Michail Petropoulos, Ippokratis Pandis
  • Publication number: 20180276040
    Abstract: Methods, systems, and computer-readable media for event-driven scheduling using directed acyclic graphs are disclosed. A directed acyclic graph is generated that comprises a plurality of nodes and a plurality of edges. The nodes represent jobs, and the edges represent dependency relationships between individual jobs. Based (at least in part) on one or more events, a job scheduler determines that one of the nodes represents a runnable job. One or more of the dependency relationships for the runnable job are satisfied by the one or more events. An execution schedule is determined for the runnable job. Based (at least in part) on the execution schedule, execution of the runnable job is initiated using one or more computing resources.
    Type: Application
    Filed: March 23, 2017
    Publication date: September 27, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Chetan Hosmani, Dougal Stuart Ballantyne
  • Publication number: 20180278602
    Abstract: A service provider system may include an application fulfillment platform that delivers desktop applications to desktops on physical computing devices or virtual desktop instances. A computing resource instance may be registered with the platform, which generates a unique identifier and a security token for the computing resource instance using multiple authentication mechanisms. An end user of a customer organization may be registered with the platform, which generates a unique identifier and a security token for the end user using multiple authentication mechanisms. An application delivery agent may submit service requests to the platform on behalf of itself or the given user. The identity and security credentials included in the requests may be dependent on the request type and the entities on whose behalf they are submitted. A proxy service on the platform may receive the requests and validate the credentials, then dispatch the requests to other services on the platform.
    Type: Application
    Filed: May 25, 2018
    Publication date: September 27, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Sheshadri Supreeth Koushik, Jaimin Paresh Shah, Yang Lin, Abhinav Shrivastava, Vikram Vijay Sahijwani, Hao Peng, David Pessis
  • Publication number: 20180267735
    Abstract: A leader replica of a replica host group of a distributed storage service is configured to replicate the leader replica and its associated one or more secondary replicas to create a duplicate host group comprising a duplicate leader replica and one or more duplicate secondary replicas. The leader replica may appoint the duplicate leader replica or another host as the leader of the duplicate host group. The leader replica may assign a subset of database keys to be served by the duplicate host group and forward data requests directed a key of the subset of keys assigned to the duplicate host group. The leader replica may further update a global key table of the distributed data storage system to direct data requests associated with the subset of database keys to the duplicate leader replica.
    Type: Application
    Filed: May 24, 2018
    Publication date: September 20, 2018
    Applicant: Amazon Technologies, Inc.
    Inventor: Akhilesh Mritunjai
  • Publication number: 20180270153
    Abstract: Entropy in routing tables may be increase to perform packet forwarding. Hash tables that store forwarding routes may be divided into multiple hash table segments. Forwarding routes may be stored across the hash table segments in different route segments. When looking up route segments to identify a forwarding route for a destination address of a network packet, digest values generated for previous route segments may be used to determine hash key values to identify hash table entries in a different hash table segment. The forwarding route may be identified according to the hash table entries located based on the digest values for previous route segments.
    Type: Application
    Filed: May 18, 2018
    Publication date: September 20, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Bijendra Singh, Kari Ann O'Brien
  • Publication number: 20180260411
    Abstract: A transaction request is received at a journal-based state management system. The transaction request includes a register processing section indicating an operation to be performed at a journal register allocated to the transaction submitter to store state information of an application. Based on the results of a conflict detection operation performed with respect to the transaction request and on the result of the operation on the journal register, the transaction request is accepted for commit. The value of the journal register is stored at a node of the state management system and provided to the transaction submitter.
    Type: Application
    Filed: May 14, 2018
    Publication date: September 13, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Michael Benjamin Deardeuff, Timothy Daniel Cole, Aaron Gifford Freshwater, Allan Henry Vermeulen
  • Publication number: 20180260341
    Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
    Type: Application
    Filed: May 14, 2018
    Publication date: September 13, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Jason G. McHugh, Praveen Kumar Gattu, Michael A. Ten-Pow, Derek Ernest Denny-Brown, II
  • Publication number: 20180262497
    Abstract: Methods, systems, and computer-readable media for batch registration and configuration of devices are disclosed. A plurality of devices are detected over one or more networks. Data indicative of the plurality of devices is provided through a user interface. Through the user interface, user input is received that indicates a selected plurality of the devices. The selected plurality of the devices are registered with a service provider environment. The selected plurality of the devices are authenticated using device-specific credentials and registered for device-specific accounts with the service provider environment. A configuration profile is deployed to the selected plurality of the devices.
    Type: Application
    Filed: March 13, 2017
    Publication date: September 13, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Surabhi Raje, Krishnamurthy Ganesan, Yu-Hsiang Cheng, Ruoyu Fei, Jingyu Ji, Milo Oostergo, Aapo Juhani Laitinen, Collin Charles Davis, Karthik Bellur
  • Publication number: 20180246923
    Abstract: Non-blocking processing of federated transactions may be implemented for distributed data partitions. A transaction may be received that specifies keys at data nodes to lock in order to perform the transaction. Lock requests are generated and sent to the data nodes which identify sibling keys to be locked at other data nodes for the transaction. In response to receiving the lock requests, data nodes may send to lock queues indicating other lock requests for the keys at the data node. An evaluation of the lock queues based, at least in part, on an ordering of the lock requests in the lock queues may be performed to identify a particular transaction to commit. Once identified, a request to commit the identified transaction may be sent to the particular data nodes indicated by the sibling keys in a lock request for the identified transaction.
    Type: Application
    Filed: April 27, 2018
    Publication date: August 30, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Charles Alexander Carman, Claire Elizabeth Suver, Melissa Elaine Davis, Paul Matthew Buddington, Christopher Allen Suver, Lukasz Wojciech Cwik, Chelsea Celest Krueger
  • Publication number: 20180240163
    Abstract: A computer system that provides clients access to pooled resources in order to provide computing or data storage services may receive service requests (which explicitly or implicitly include requests for pooled resources), may service at least some of those requests, and may determine pricing for the serviced requests. The pricing for each request may be dependent on whether it was serviced using a portion of a resource pool that was reserved for the use of the client on whose behalf it was received or using burst capacity (e.g., unreserved or otherwise idle capacity within the resource pool). Pricing for the use of reserved capacity may be fixed, regardless of the amount of reserved capacity used. Pricing for burst capacity may depend on actual use, and may be demand-based (e.g., using a spot-market-based dynamic pricing model). Clients with reserved capacity may optionally request access to burst capacity.
    Type: Application
    Filed: April 20, 2018
    Publication date: August 23, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Swaminathan Sivasubramanian, Stefano Stefani
  • Publication number: 20180232308
    Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node, based at least in part on one or more triggers being met, from the storage of the head node to a set of the mass storage devices of the data storage system. The flushed data is written to a segment of free storage space across the set of the mass storage devices allocated for the given data flush operation. In some embodiments, a head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices.
    Type: Application
    Filed: February 15, 2017
    Publication date: August 16, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Norbert Paul Kusters, Nachiappan Arumugam, Andre Podnozov, Shobha Agrawal, Shreyas Ramalingam, Danny Wei, David R. Richardson, Marc John Brooker, Christopher Nathan Watson, John Luther Guthrie, II, Ravi Nankani
  • Publication number: 20180232165
    Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node to a set of the mass storage devices of the data storage system. A head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices. In some embodiments an index includes a current version reference for a volume or portion of a volume and one or more point-in-time snapshot references.
    Type: Application
    Filed: February 15, 2017
    Publication date: August 16, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Norbert Paul Kusters, Nachiappan Arumugam, Andre Podnozov, Shobha Agrawal, Shreyas Ramalingam, Danny Wei, David R. Richardson, Marc John Brooker, Christopher Nathan Watson, John Luther Guthrie, II, Ravi Nankani
  • Publication number: 20180225464
    Abstract: When a client requests a data import job, a remote storage service provider provisions a shippable storage device that will be used to transfer client data from the client to the service provider for import. The service provider generates security information for the data import job, provisions the shippable storage device with the security information, and sends the shippable storage device to the client. The service provider also sends client-keys to the client, separate from the shippable storage device (e.g., via a network). The client receives the device, encrypts the client data and keys, transfers the encrypted data and keys onto the device, and ships it back to the service provider. The remote storage service provider authenticates the storage device, decrypts client-generated keys using the client-keys stored at the storage service provider, decrypts the data using the decrypted client-side generated keys, and imports the decrypted data.
    Type: Application
    Filed: April 2, 2018
    Publication date: August 9, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Frank Paterra, Firat Basarir
  • Publication number: 20180228057
    Abstract: A system for storing data includes a rack and one or more data storage modules mounted on the rack. The data storage modules may include a chassis, two or more vertically-oriented backplanes coupled to the chassis, two or more mass storage devices coupled to the backplanes, and one or more air passages extending beneath one or more of the backplanes. Each backplane is configured to preclude airflow through the backplane between opposite vertical faces and can couple mass storage devices on one or more of the opposite vertical faces. One or more of the air passages can supply an upwards-directed airflow along one of the opposite vertical faces of a backplane to remove heat from a heat producing component of a mass storage device coupled to the vertical face of the vertically-oriented backplane.
    Type: Application
    Filed: April 2, 2018
    Publication date: August 9, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Christopher Strickland Beall, David Edward Bryan, Darin Lee Frink, Jason Alexander Harland
  • Publication number: 20180225299
    Abstract: Data may be efficiently analyzed and compressed as part of a data compression service. A data compression request may be received from a client indicating data to be compressed. An analysis of the data or metadata associated with the data may be performed. In at least some embodiments, this analysis may be a rules-based analysis. Some embodiments may employ one or more machine learning techniques to historical compression data to update the rules-based analysis. One or more compression techniques may be selected out of a plurality of compression techniques to be applied to the data. Data compression candidates may then be generated according to the selected compression techniques. In some embodiments, a compression service restriction may be enforced. One of the data compression candidates may be selected and sent in a response.
    Type: Application
    Filed: April 2, 2018
    Publication date: August 9, 2018
    Applicant: Amazon Technologies, Inc.
    Inventor: Anurag Windlass Gupta
  • Publication number: 20180212898
    Abstract: A resource stack managed by a resource stack provider is created based on a resource stack template that integrates a custom resource from a second provider into the resource stack using a notification system with the second provider. For example, a customer may create a template that defines a resource stack that comprises resources available from the resource stack provider and one or more custom resources provided by a second provider. When a resource stack is created, resources available from the resource stack provider may be provisioned. Custom resources may be initialized by notifying the provider of the custom resource of the requested integration of the custom resource with the resource stack and requested configuration details. The custom resource provider may respond with an indication of successful integration when the custom resource has been successfully initialized. After initializing the resources, the resource stack may be enabled for use.
    Type: Application
    Filed: March 26, 2018
    Publication date: July 26, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: AVINASH JAISINGHANI, RETO KRAMER, PRASHANT JAYARAMAN, CHRISTOPHER WHITAKER, VENKATES PARAMASIVAM BALAKRISHNAN
  • Publication number: 20180210914
    Abstract: A distributed database management system may comprise a plurality of computing nodes. A request to update an item maintained by the system may be acknowledged as durable and committed once an entry corresponding to the request has been written to a log file and quorum among the computing nodes has been achieved. Improved consistency may be achieved by maintaining snapshots of committed item states within queryable in-memory snapshot data structures. Range queries may be performed by merging a secondary index with the snapshots and applying filters. Projections may be completed by retrieving additional data from an item collection maintain on one or more storage devices.
    Type: Application
    Filed: March 19, 2018
    Publication date: July 26, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Xianglong Huang, David Alan Lutz, Wei Xiao, Maimiliano Maccanti, Somasundaram Perianayagam, Rande A. Blackman, Stuart Henry Seelye Marshall
  • Publication number: 20180209404
    Abstract: A data center includes computing devices, an air handling system, a heat engine, and a generator. Air moved by the air handling system flows across heat-producing components in the computing devices in the data center. Heat from air that has flowed over the heat-producing components heats a hot section of the heat engine. The heat engine generates mechanical work based on a temperature differential between a hot section of the heat engine and a cold section of the heat engine. The generator generates electricity from the mechanical work generated by the heat engine.
    Type: Application
    Filed: March 19, 2018
    Publication date: July 26, 2018
    Applicant: Amazon Technologies, Inc.
    Inventor: Peter George Ross
  • Publication number: 20180210966
    Abstract: Methods, systems, and computer-readable media for query language interoperability in a graph database are disclosed. Data elements are inserted into a graph database using one or more of a plurality of graph database query languages. The graph database query languages comprise a first graph database query language associated with a first data model and a second graph database query language associated with a second data model. The data elements are stored in the graph database using an internal data model that differs from the first and second data models. One or more of the data elements are retrieved from the graph database based at least in part on a query. The query is expressed using a different graph database query language than the graph database query language used to insert the one or more retrieved data elements.
    Type: Application
    Filed: January 20, 2017
    Publication date: July 26, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Kawarjit Bedi, Piyush Gupta, Sainath Chowdary Mallidi, Divij Vaidya, Andi Gutmans
  • Publication number: 20180204301
    Abstract: Methods, systems, and computer-readable media for dynamic and application-specific virtualized graphics processing are disclosed. Execution of an application is initiated on a virtual compute instance. The virtual compute instance is implemented using a server. One or more graphics processing unit (GPU) requirements associated with the execution of the application are determined. A physical GPU resource is selected from a pool of available physical GPU resources based at least in part on the one or more GPU requirements. A virtual GPU is attached to the virtual compute instance based at least in part on initiation of the execution of the application. The virtual GPU is implemented using the physical GPU resource selected from the pool and accessible to the server over a network.
    Type: Application
    Filed: January 18, 2017
    Publication date: July 19, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Malcolm Featonby, Yuxuan Liu, Umesh Chandani, John Merrill Phillips, JR., Nicholas Patrick Wilt, Adithya Bhat, Douglas Cotton Kurtz, Mihir Sadruddin Surani
  • Publication number: 20180196782
    Abstract: Systems and methods for presenting a user interface in a first mode and a second mode based on detection of a touch gesture is described herein. In some embodiments, a first user interface may be presented on an electronic device's display. The first user interface may include a list of items, which may be formatted such that they are optimally viewable from a first distance away from the display. In response to detecting a touch gesture, such as a scrolling gesture, a second user interface may be presented including the list of items, which may be formatted such that they are optimally viewed from a second distance. For example, the first user interface may be optimally viewable from a distance of approximately seven to ten feet from the display. As another example, the second user interface may optimally viewable from a distance of approximately one to three feet.
    Type: Application
    Filed: June 14, 2016
    Publication date: July 12, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Timothy Thomas Gray, Thomas Irvine Nelson, Jae Pum Park, Shilpan Bhagat
  • Publication number: 20180198863
    Abstract: A network-based data store may implement retention-based management techniques for data stored at the network-based data store. When data is received for storage at the network-based data store, a retention time for the data may be determined. Storage locations at persistent storage devices of the network-based data store may be selected according to the retention time. The data may then be placed at the storage locations. When a request to delete data is received, retention times of co-located data may be evaluated to determine whether the deletion may be delayed. Delayed deletions may allow the data to be subsequently deleted with at least some of the co-located data. Repair operations to maintain the data according to a durability policy may be modified according to retention time for a data suffering a loss of redundancy.
    Type: Application
    Filed: March 5, 2018
    Publication date: July 12, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Timothy James Davis, Rajesh Shanker Patel, Bradley Eugene Marshall, Jonathan Robert Collins
  • Publication number: 20180199204
    Abstract: A provisioning device may be shipped to a client and used to automatically provision an IoT device to join a local network to communicate with a remote service provider. In response to a trigger input, the provisioning device creates a wireless hotspot that is recognizable by an IoT device as a provisioning hotspot. The provisioning device receives a signal from the IoT device indicating that the IoT device is available to be provisioned. The provisioning device obtains provisioning data and transmits the provisioning data to the IoT device. The IoT device uses the provisioning data to connect to a local wireless network and to establish a connection to the remote service provider. The IoT device may then use one or more IoT services of the service provider.
    Type: Application
    Filed: March 5, 2018
    Publication date: July 12, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Kyle Michael Roche, James Christopher Sorenson, III
  • Publication number: 20180197122
    Abstract: Methods and apparatus for portable network interfaces to manage authentication and license enforcement. A system may include a plurality of resource instances including a producer instance configured to implement a network-accessible service, and an authentication coordinator. The coordinator may assign an interface record to the service, wherein the interface record comprises an IP address and a set of security properties. The coordinator may configure the security properties to allow a client to request an attachment of the interface record to a selected resource instance, such that the selected resource instance is enabled to transmit network messages from the IP address using one or more physical network interfaces of the selected resource instance. The producer resource instance initiates authentication operations for the service, including at least one authentication operation based on the IP address of the interface record.
    Type: Application
    Filed: March 9, 2018
    Publication date: July 12, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Christopher Richard Jacques de Kadt, James Alfred Gordon Greenfield
  • Publication number: 20180196827
    Abstract: Methods, apparatus, and computer-accessible storage media for controlling export of snapshots to external networks in service provider environments. Methods are described that may be used to prevent customers of a service provider from downloading snapshots of volumes, such as boot images created by the service provider or provided by third parties, to which the customer does not have the appropriate rights. A request may be received from a user to access one or more snapshots, for example a request to export the snapshot or a request for a listing of snapshots. For each snapshot, the service provider may determine if the user has rights to the snapshot, for example by checking a manifest for the snapshot to see if entries in the snapshot manifest belong to an account other than the customer's. If the user has rights to the snapshot, the request is granted; otherwise, the request is not granted.
    Type: Application
    Filed: March 9, 2018
    Publication date: July 12, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Arun Sundaram, Yun Lin, David Carl Salyers
  • Publication number: 20180189336
    Abstract: A distributed storage system may store data object instances in persistent storage and may cache keymap information for those data object instances. The system may cache a latest symbolic key entry for some user keys of the data object instances. When a request is made for the latest version of stored data object instances having a specified user key, the latest version may be determined dependent on whether a latest symbolic key entry exists for the specified user key, and keymap information for the latest version may be returned. When storing keymap information, a flag may be set to indicate that a corresponding latest symbolic key entry should be updated. The system may delete a latest symbolic key entry for a particular user key from the cache in response to determining that no other requests involving the keymap information for data object instances having the particular user key are pending.
    Type: Application
    Filed: January 22, 2018
    Publication date: July 5, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Jason G. McHugh, Praveen Kumar Gattu, Michael A. Ten-Pow, Derek Ernest Denny-Brown, II
  • Publication number: 20180189373
    Abstract: For a given cross-data-store transaction request at a storage service, a coordinator transmits respective voting transition requests to a plurality of log-based transaction managers (LTMs) configured for the respective data stores to which writes are directed in the transaction. The LTMs transmit responses to the coordinator based on data-store-specific conflict detection performed using contents of the voting transition requests and respective data-store-specific state transition logs. The coordinator determines a termination status of the cross-data-store transaction based on the LTMs' responses, and provides an indication of the termination status to the LTMs.
    Type: Application
    Filed: February 26, 2018
    Publication date: July 5, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Uphendra Bhalchandra Shevade, Gregory Rustin Rogers, Christopher Ian Hendrie
  • Publication number: 20180189367
    Abstract: A programmatic interface is implemented, enabling a client of a stream management service to select a data ingestion policy for a data stream. A client request selecting an at-least-once ingestion policy is received. In accordance with the at-least-once policy, a client may transmit an indication of a data record one or more times to the service until a positive acknowledgement is received. In response to receiving a plurality of transmissions indicating a particular data record, respective positive acknowledgements are sent to the client. Based on a persistence policy selected for the stream, copies of the data record are stored at one or more storage locations in response to one particular transmission of the plurality of transmissions.
    Type: Application
    Filed: December 29, 2017
    Publication date: July 5, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Marvin Michael Theimer, Gaurav D. Ghare, John David Dunagan, Greg Burgess, Ying Xiong
  • Publication number: 20180182062
    Abstract: Methods, systems, and computer-readable media for application-specific virtualized graphics processing are disclosed. A virtual compute instance is provisioned from a provider network. The provider network comprises a plurality of computing devices configured to implement a plurality of virtual compute instances with multi-tenancy. A virtual GPU is attached to the virtual compute instance. The virtual GPU is selected based at least in part on requirements of an application. The virtual GPU is implemented using a physical GPU, and the physical GPU is accessible to the virtual compute instance over a network. The application is executed using the virtual GPU on the virtual compute instance.
    Type: Application
    Filed: February 26, 2018
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Nicholas Patrick Wilt, Ashutosh Tambe, Nathan Lee Burns
  • Publication number: 20180183868
    Abstract: A data storage system includes a rack, multiple head nodes, multiple data storage sleds, and at least two networking devices. The at least two network devices are configured to implement at least two redundant networks within the data storage system. Also, each of the head nodes is assigned at least two network addresses for communication with the data storage sleds of the data storage system via the at least two networking devices. The data storage sleds each include multiple mass storage devices and a sled controller that is configured to couple with the at least two network switches. In some embodiments, the data storage system further includes redundant power systems within a rack in which the head nodes, the data storage sleds, and the at least two networking devices are mounted.
    Type: Application
    Filed: December 28, 2016
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: NORBERT P. KUSTERS, NACHIAPPAN ARUMUGAM, CHRISTOPHER NATHAN WATSON, MARC JOHN BROOKER, DAVID R. RICHARDSON, DANNY WEI, JOHN LUTHER GUTHRIE, II
  • Publication number: 20180181470
    Abstract: A system that implements a data storage service may store data on behalf of storage service clients. The system may maintain data in multiple replicas of partitions that are stored on respective computing nodes in the system. A master replica for a replica group may increment a membership version indicator for the group, and may propagate metadata (including the membership version indicator) indicating a membership change for the group to other members of the group. Propagating the metadata may include sending a log record containing the metadata to the other replicas to be appended to their respective logs. Once the membership change becomes durable, it may be committed. A replica attempting to become the master of a replica group may determine that another replica in the group has observed a more recent membership version, in which case logs may be synchronized or snipped, or the attempt may be abandoned.
    Type: Application
    Filed: February 2, 2018
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Timothy Andrew Rath, Jakub Kulesza, David Alan Lutz
  • Publication number: 20180181348
    Abstract: A data storage system includes multiple data storage units and a zonal control plane. The zonal control plane assigns volumes to respective ones of the data storage units. The data storage units include multiple head nodes and data storage sleds. At least one of the head nodes implements a local control plane for the data storage unit. Also, the head nodes of each data storage unit are configured to service read and write requests directed to one or more volumes serviced by the data storage unit independent of the zonal control plane.
    Type: Application
    Filed: December 28, 2016
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: NORBERT P. KUSTERS, NACHIAPPAN ARUMUGAM, CHRISTOPHER NATHAN WATSON, MARC JOHN BROOKER, DAVID R. RICHARDSON, DANNY WEI, JOHN LUTHER GUTHRIE, II
  • Publication number: 20180184548
    Abstract: A data center may include a tape library rack module along with rack computer systems. The rack computer systems may be configured to provide computing capacity within a data center environment. In some embodiments, the tape library rack module may include an enclosure encompassing an interior of the tape library rack module, a rack within the interior, and a tape library unit mounted on the rack. The tape library rack unit may include tape cartridges configured to store data within a tape environment that is different than the data center environment. The tape library rack unit may be within a portion of the interior that is enclosed such that it is environmentally isolated from the data center environment. In some examples, the tape library rack module may include a cooling unit and/or a humidifier unit, which may provide the tape environment to the environmentally isolated portion of the interior of the tape library rack module.
    Type: Application
    Filed: February 2, 2018
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Darin Lee Frink, Kevin Bailey, Peter George Ross, Bryan James Donlan, James Caleb Kirschner, Mary Crys Calansingin, Paul David Franklin, Mastaka Kubo
  • Publication number: 20180181315
    Abstract: A data storage system includes multiple head nodes and multiple data storage sleds mounted in a rack. For a particular volume or volume partition one of the head nodes is designated as a primary head node for the volume or volume partition. The primary head node is configured to store data for the volume in a data storage of the primary head node and cause the data to be replicated to a secondary head node. The primary head node is also configured to cause the data for the volume to be stored in a plurality of respective mass storage devices each in different ones of the plurality of data storage sleds of the data storage system.
    Type: Application
    Filed: December 28, 2016
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: NORBERT P. KUSTERS, NACHIAPPAN ARUMUGAM, CHRISTOPHER NATHAN WATSON, MARC JOHN BROOKER, DAVID R. RICHARDSON, DANNY WEI, JOHN LUTHER GUTHRIE, II
  • Publication number: 20180182061
    Abstract: Methods, systems, and computer-readable media for placement optimization for virtualized graphics processing are disclosed. A provider network comprises a plurality of instance locations for physical compute instances and a plurality of graphics processing unit (GPU) locations for physical GPUs. A GPU location for a physical GPU or an instance location for a physical compute instance is selected in the provider network. The GPU location or instance location is selected based at least in part on one or more placement criteria. A virtual compute instance with attached virtual GPU is provisioned. The virtual compute instance is implemented using the physical compute instance in the instance location, and the virtual GPU is implemented using the physical GPU in the GPU location. The physical GPU is accessible to the physical compute instance over a network. An application is executed using the virtual GPU on the virtual compute instance.
    Type: Application
    Filed: February 26, 2018
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: NICHOLAS PATRICK WILT, ASHUTOSH TAMBE
  • Publication number: 20180181330
    Abstract: A data storage system includes multiple head nodes and data storage sleds. The data storage sleds include multiple mass storage devices and a sled controller. Respective ones of the head nodes are configured to obtain credentials for accessing particular portions of the mass storage devices of the data storage sleds. A sled controller of a data storage sled determines whether a head node attempting to perform a write on a mass storage device of a data storage sled that includes the sled controller is presenting with the write request a valid credential for accessing the mass storage devices of the data storage sled. If the credentials are valid, the sled controller causes the write to be performed and if the credentials are invalid, the sled controller returns a message to the head node indicating that it has been fenced off from the mass storage device.
    Type: Application
    Filed: December 28, 2016
    Publication date: June 28, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: NORBERT P. KUSTERS, NACHIAPPAN ARUMUGAM, CHRISTOPHER NATHAN WATSON, MARC JOHN BROOKER, DAVID R. RICHARDSON, DANNY WEI, JOHN LUTHER GUTHRIE, II, LEAH SHALEV
  • Publication number: 20180173774
    Abstract: History for data objects may be maintained to detect data events. An indication of an Extract, Transform, Load (ETL) process applied to one or more source data objects to generate one or more transformed data objects may be received. History for the source data objects may be updated to include the transformed data objects and the ETL process that generated the transformed data objects. An evaluation of the update may be performed to determine whether an event associated with the data lineage is triggered. If the event is triggered, a notification of the event may be sent to one or more subscribers for the event.
    Type: Application
    Filed: December 20, 2016
    Publication date: June 21, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: GEORGE STEVEN MCPHERSON, MEHUL A. SHAH, PRAJAKTA DATTA DAMLE, GOPINATH DUDDI, ANURAG WINDLASS GUPTA
  • Publication number: 20180174226
    Abstract: Processes for receiving, packaging and/or processing orders for items offered by an electronic marketplace are described, including methods whereby certain products of interest may be identified and subjected to alternative inbound and/or outbound processing that omit certain steps used in similar processes. A first inbound process may include steps related to shelving, or otherwise storing, received products, prior to packaging such products for mailing and delivery to consumers. In some examples, a second inbound process may omit one or more of the shelving/storing steps from the first inbound process, and pre-package the received product for mailing.
    Type: Application
    Filed: September 19, 2013
    Publication date: June 21, 2018
    Applicant: Amazon Technologies, Inc.
    Inventor: Jong Hwa Yoon
  • Publication number: 20180167661
    Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to discover, select, explore, and manipulate objects within the modeled worlds used to generate video content. The RVE system may implement methods that allow users to view and explore in more detail the features, components, and/or accessories of selected objects that are being manipulated and explored. The RVE system may also implement methods that allow users to interact with interfaces of selected objects or interfaces of components of selected objects.
    Type: Application
    Filed: February 9, 2018
    Publication date: June 14, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Gerard Joseph Heinz, II, Michael Schleif Pesce, Collin Charles Davis, Michael Anthony Frazzini, Ashraf Alkarmi, Michael Martin George, David A. Limp, Wiiliam Dugald Carr, JR.
  • Publication number: 20180165340
    Abstract: A distributed data warehouse system maintains data blocks on behalf of clients, and stores primary and secondary copies of data blocks on different disks or nodes in a cluster. The data warehouse system may back up data blocks in a key-value backup storage system. In response to a query targeting a data block previously stored in the cluster, the data warehouse system may determine whether a consistent, uncorrupted copy of the data block is available in the cluster (e.g., by applying a consistency check). If not (e.g., if a disk or node failed), the data warehouse system may automatically initiate an operation to restore the data block from the backup storage system, using a unique identifier of the data block to access a backup copy. The target data may be returned in a query response prior to restoring primary and secondary copies of the data block in the cluster.
    Type: Application
    Filed: February 9, 2018
    Publication date: June 14, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Deepak Agarwal, Anurag Windlass Gupta, Jakub Kulesza
  • Publication number: 20180165876
    Abstract: A real-time video exploration (RVE) system that allows users to pause, step into, and explore 2D or 3D modeled worlds of scenes in a video. The system may leverage network-based computation resources to render and stream new video content from the models to clients with low latency. A user may pause a video, step into a scene, and interactively change viewing positions and angles in the model to move through or explore the scene. The user may resume playback of the recorded video when done exploring the scene. Thus, rather than just viewing a pre-rendered scene in a movie from a pre-determined perspective, a user may step into and explore the scene from different angles, and may wander around the scene at will within the scope of the model to discover parts of the scene that are not visible in the original video.
    Type: Application
    Filed: February 9, 2018
    Publication date: June 14, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Gerard Joseph Heinz, II, Michael Schleif Pesce, Collin Charles Davis, Michael Anthony Frazzini, Ashraf Alkarmi, Michael Martin George, David A. Limp, William Dugald Carr, JR.
  • Publication number: 20180165785
    Abstract: Methods, systems, and computer-readable media for capacity reservation for virtualized graphics processing are disclosed. A request is received to attach a virtual GPU to a virtual compute instance. The request comprises one or more constraints. Availability information is retrieved from a data store that indicates virtual GPUs available in a provider network and matching the one or more constraints. A virtual GPU is selected from among the available virtual GPUs in the availability information. The selected virtual GPU is reserved for attachment to the virtual compute instance. The virtual compute instance is implemented using CPU resources and memory resources of a physical compute instance, the virtual GPU is implemented using a physical GPU in the provider network, and the physical GPU is accessible to the physical compute instance over a network.
    Type: Application
    Filed: December 12, 2016
    Publication date: June 14, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: DOUGLAS COTTON KURTZ, MALCOLM FEATONBY, UMESH CHANDANI, ADITHYA BHAT, YUXUAN LIU, MIHIR SADRUDDIN SURANI
  • Publication number: 20180159717
    Abstract: Dynamic application instance discovery and state management within a distributed system. A distributed system may implement application instances configured to perform one or more application functions within the distributed system, and discovery and failure detection daemon (DFDD) instances, each configured to store an indication of a respective operational state of each member of a respective group of the number of application instances. Each of the DFDD instances may repeatedly execute a gossip-based synchronization protocol with another one of the DFDD instances, where execution of the protocol between DFDD instances includes reconciling differences among membership of the respective groups of application instances. A new application instance may be configured to notify a particular DFDD instance of its availability to perform an application function.
    Type: Application
    Filed: December 4, 2017
    Publication date: June 7, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: JOHN DAVID CORMIE, AMI K. FISCHMAN, ALLAN H. VERMEULEN
  • Publication number: 20180150397
    Abstract: A separate distributed buffer cache system may be implemented for a storage client of a distributed storage system. Storage I/O requests may be sent from a storage client to one or more buffer cache nodes in a distributed buffer cache system that maintain portions of an in-memory buffer cache to which the requests pertain. The distributed buffer cache system may send the write requests on to the distributed storage system to be completed, and in response to receiving acknowledgements from the storage system, sending a completion acknowledgement back to the storage client. Buffer cache nodes may update buffer cache entries for received requests such that they are not available for reads until complete at the distributed storage system. For read requests where the buffer cache entries at the buffer cache node are invalid, valid data may be obtained from the distributed storage system and sent to the storage client.
    Type: Application
    Filed: January 26, 2018
    Publication date: May 31, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: Anurag Windlass Gupta, Matthew David Allen
  • Publication number: 20180150528
    Abstract: Data transformation workflows may be generated to transform data objects. A source data schema for a data object and a target data format or target data schema for a data object may be identified. A comparison of the source data schema and the target data format or schema may be made to determine what transformations can be performed to transform the data object into the target data format or schema. Code to execute the transformation operations may then be generated. The code may be stored for subsequent modification or execution.
    Type: Application
    Filed: December 20, 2016
    Publication date: May 31, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: MEHUL A. SHAH, GEORGE STEVEN MCPHERSON, PRAJAKTA DATTA DAMLE, GOPINATH DUDDI, ANURAG WINDLASS GUPTA, BENJAMIN ALBERT SOWELL, BOHOU LI
  • Publication number: 20180152501
    Abstract: Methods, apparatus, and computer-accessible storage media for remotely managing a gateway that serves as an interface between processes on a customer network and a service provider, for example to store data to a remote data store. The gateway sends a connection request to a gateway control server. The server holds the connection until the server receives information (e.g., information from the customer sent via the service provider) for the gateway. The server sends the information as requests via the gateway-initiated connection, and continues to hold the connection. If a server receives information for a gateway to which it does not hold a connection, the server sends the information to the server that does hold the connection. The server may either discover the appropriate server via a registration service that registers connections to gateways or broadcast the information to peer servers identified through a registration service.
    Type: Application
    Filed: January 8, 2018
    Publication date: May 31, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: James Christopher Sorenson, III, Yun Lin, David Carl Salyers, Ankur Khetrapal, Nishanth Alapati
  • Publication number: 20180152502
    Abstract: In certain embodiments, a computer-implemented method includes accessing, using one or more processing units, application parameters associated with an application. The application parameters define constraints for hosting the application using one or more of a plurality of provisioned computing environments available over a computer network from multiple computing resources vendors. Each vendor is associated with a corresponding vendor-specific provisioned computing environment that includes computing resources available to be provisioned for use by a multiple entities distinct from the vendors. The method includes accessing, using the one or more processing units, vendor-specific data for the vendor-specific provisioned computing environments.
    Type: Application
    Filed: January 25, 2018
    Publication date: May 31, 2018
    Applicant: Amazon Technologies, Inc.
    Inventor: Christopher Paul Kirby
  • Publication number: 20180152503
    Abstract: A control-plane component of a virtual network interface (VNI) multiplexing service assigns one or more VNIs as members of a first interface group. A first VNI of the interface group is attached to a first compute instance. Network traffic directed to a particular endpoint address associated with the first interface group is to be distributed among members of the first interface group by client-side components of the service. The control-plane component propagates membership metadata of the first interface group to the client-side components. In response to a detection of an unhealthy state of the first compute instance, the first VNI is attached to a different compute instance by the control-plane component.
    Type: Application
    Filed: January 26, 2018
    Publication date: May 31, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: TOBIAS LARS-OLOV HOLGERS, KEVIN CHRISTOPHER MILLER, ANDREW BRUCE DICKINSON, DAVID CARL SALYERS, XIAO ZHANG, SHANE ASHLEY HALL, CHRISTOPHER IAN HENDRIE, ANIKET DEEPAK DIVECHA, RALPH WILLIAM FLORA
  • Publication number: 20180150548
    Abstract: Recognizing unknown data objects may be implemented for data objects stored in a data store. Data objects that are identified as unknown may be accessed to retrieve a portion of the data object. Different representations of the data object may be generated for recognizing different data schemas. An analysis of the representations may be performed to identify a data schema for the unknown data object. The data schema may be stored in a metadata store for the unknown data object.
    Type: Application
    Filed: December 20, 2016
    Publication date: May 31, 2018
    Applicant: Amazon Technologies, Inc.
    Inventors: MEHUL A. SHAH, GEORGE STEVEN MCPHERSON, PRAJAKTA DATTA DAMLE, GOPINATH DUDDI, ANURAG WINDLASS GUPTA