Abstract: Automatic object optimization to accelerate machine learning training is disclosed. A request for a machine learning training dataset comprising a plurality of objects is received from a requestor. The plurality of objects includes data for training a machine learning model. A uniqueness characteristic for objects of the plurality of objects is determined, the uniqueness characteristic being indicative of how unique each object is relative to each other object. A group of objects from the plurality of objects is sent to the requestor, the group of objects being selected based at least partially on the uniqueness characteristic or sent in an order based at least partially on the uniqueness characteristic.

Abstract: Scalable object storage with intelligent replication is disclosed. A container image storage system executing on one or more processor devices receives a container image comprising a plurality of objects. For each object, a reference count indicative of how many different container images stored in the container image storage system include the object is determined. For each object, a number of copies of the object to be stored in a storage based on the reference count is determined. For each object, the number of copies of the object are stored in the storage.

Abstract: Automatic object optimization to accelerate machine learning training is disclosed. A request for a machine learning training dataset comprising a plurality of objects is received from a requestor. The plurality of objects includes data for training a machine learning model. A uniqueness characteristic for objects of the plurality of objects is determined, the uniqueness characteristic being indicative of how unique each object is relative to each other object. A group of objects from the plurality of objects is sent to the requestor, the group of objects being selected based at least partially on the uniqueness characteristic or sent in an order based at least partially on the uniqueness characteristic.

Abstract: Scalable object storage with intelligent replication is disclosed. A container image storage system executing on one or more processor devices receives a container image comprising a plurality of objects. For each object, a reference count indicative of how many different container images stored in the container image storage system include the object is determined. For each object, a number of copies of the object to be stored in a storage based on the reference count is determined. For each object, the number of copies of the object are stored in the storage.