Abstract: Static sorted index replication is described. A method may include receiving data to store in a memory tree of a replica in a partitioned distributed data store. The method may also include storing the received data in the respective memory tree of one of a plurality of replicas. The method may further include storing the received data sequentially in a static sorted index.

Abstract: In one aspect, the disclosure teaches a system configured to receive from a device a request for content including an identifier of a first set of dictionaries available locally at the device. The system is also configured to select a second set of dictionaries to compress content requested by the device based at least on the set of dictionaries available at the device, the second set of dictionaries selected from a third set of local system dictionaries available at the system.

Abstract: A system configured to generate a set of compression dictionary snapshots. The system can determine a subset of a set of compression dictionary definitions, the subset having a first subset comprising one or more definitions that have changed since a time of a previous snapshot and a second subset having one or more definitions associated with a predetermined portion of the dictionary. The system can further generate and store snapshots based at least in part on the determined subset of one or more definitions and determine a plurality of active snapshots from the set of snapshots such that the set of one or more definitions is included in the plurality of active snapshots.

Abstract: A system for dictionary generation that can generate a set of candidate dictionaries based at least in part on subsets of content, where candidate dictionaries of the set of candidate dictionaries are generated based at least in part on a different subset of the content. The system can further use candidate dictionaries of the set of candidate dictionaries to compress the content and can identify one or more dictionary quality metrics for candidate dictionaries of the set of candidate dictionaries based at least in part on the respective compression of the content by candidate dictionaries of the set of candidate dictionaries.

Abstract: Systems and methods are provided for efficiently indexing archived objects in an archive data store to allow for efficient and quick access to the archived objects. The systems and methods provided also allow alleviate the strain on a live data store and enable a requester wishing to retrieve updates to do so without knowledge of the location of the stored update on a live or archive data store.

Abstract: In one aspect, the disclosure teaches a system configured to receive from a device a request for content including an identifier of a first set of dictionaries available locally at the device. The system is also configured to select a second set of dictionaries to compress content requested by the device based at least on the set of dictionaries available at the device, the second set of dictionaries selected from a third set of local system dictionaries available at the system.

Abstract: A system configured to generate a set of compression dictionary snapshots. The system can determine a subset of a set of compression dictionary definitions, the subset having a first subset comprising one or more definitions that have changed since a time of a previous snapshot and a second subset having one or more definitions associated with a predetermined portion of the dictionary. The system can further generate and store snapshots based at least in part on the determined subset of one or more definitions and determine a plurality of active snapshots from the set of snapshots such that the set of one or more definitions is included in the plurality of active snapshots.

Abstract: A system for dictionary generation that can generate a set of candidate dictionaries based at least in part on subsets of content, where candidate dictionaries of the set of candidate dictionaries are generated based at least in part on a different subset of the content. The system can further use candidate dictionaries of the set of candidate dictionaries to compress the content and can identify one or more dictionary quality metrics for candidate dictionaries of the set of candidate dictionaries based at least in part on the respective compression of the content by candidate dictionaries of the set of candidate dictionaries.

Abstract: Methods and systems for scalable message aggregation are described. A method may include receiving data to store in a message queue implemented on a partitioned distributed data store. The method may also include storing the data in one or more partitions of the message queue. The method may further include aggregating the stored data into a batch.

Abstract: Systems and methods are provided for archiving and querying data updates received or generated by an update processing system associated with an electronic catalog. In some embodiments, the system may receive a query associated with item data updates in a first format. The system may monitor a status of the query and may store data associated with the status. In some embodiments, the system may translate the query from the first format into a second format that is suitable or appropriate for use by an item data update data store. The update data store may include objects having records associated with one or more items, and the system may access the item update data store to retrieve information in response to the query. The system may further generate and provide query results responsive to the query and may update the status of the query.

Abstract: Systems and methods are provided for archiving and querying data updates received or generated by an update processing system associated with an electronic catalog. In some embodiments, item data updates associated with items represented in an electronic catalog are formed into new objects consisting of collections of records of item data updates. The new objects may have keys and versions associated with each record within them. The use of these objects allows item data updates, which are generally on the order of a few kilobytes, to be efficiently stored in archive storage systems, and to be queried without affecting the performance of the system that hosts the electronic catalog.

Abstract: Systems and methods are provided for efficiently indexing archived objects in an archive data store to allow for efficient and quick access to the archived objects. The systems and methods provided also allow alleviate the strain on a live data store and enable a requester wishing to retrieve updates to do so without knowledge of the location of the stored update on a live or archive data store.

Abstract: Static sorted index replication is described. A method may include receiving data to store in a memory tree of a replica in a partitioned distributed data store. The method may also include storing the received data in the respective memory tree of one of a plurality of replicas. The method may further include storing the received data sequentially in a static sorted index.

Abstract: Systems and methods are provided for efficiently indexing archived objects in an archive data store to allow for efficient and quick access to the archived objects. The systems and methods provided also allow alleviate the strain on a live data store and enable a requester wishing to retrieve updates to do so without knowledge of the location of the stored update on a live or archive data store.

Abstract: Static sorted index replication is described. A method may include receiving data to store in a memory tree of a replica in a partitioned distributed data store. The method may also include storing the received data in the respective memory tree of one of a plurality of replicas. The method may further include storing the received data sequentially in a static sorted index.