Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor and a memory. In some embodiments, the memory includes programmed instructions that, when executed by the processor, cause the apparatus to upload an object to a source bucket in an object store and create a lambda bucket in the object store that is symlinked to the source bucket. In some embodiments, the lambda bucket is associated with a predefined transformation. In some embodiments, the memory includes the programmed instructions that, when executed by the processor, cause the apparatus to receive a request to download the object from the lambda bucket, detect that the object is in the source bucket, fetch the object from the source bucket, transform the object, by compute resources of the object store, using the predefined transformation, and download the transformed object.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor and a memory. In some embodiments, the memory includes programmed instructions that, when executed by the processor, cause the apparatus to upload an object to a source bucket in an object store and create a lambda bucket in the object store that is symlinked to the source bucket. In some embodiments, the lambda bucket is associated with a predefined transformation. In some embodiments, the memory includes the programmed instructions that, when executed by the processor, cause the apparatus to receive a request to download the object from the lambda bucket, detect that the object is in the source bucket, fetch the object from the source bucket, transform the object, by compute resources of the object store, using the predefined transformation, and download the transformed object.

Abstract: An illustrative embodiment disclosed herein is a computer-implemented method. In some embodiments, the method includes uploading, by a processor, an object to a source bucket in an object store and creating, by the processor, a lambda bucket in the object store that is symlinked to the source bucket. In some embodiments, the lambda bucket is associated with a transformation function. In some embodiments, the method includes associating, by the processor, a lambda function with the object in the source bucket, receiving, by the processor, a request to download the object from the lambda bucket, detecting, by the processor, that the object is in the source bucket and associated with the lambda function, fetching, by the processor, the object from the source bucket, generating, by the processor, a transformed object by invoking the lambda function and the transformation function on the object, and downloading, by the processor, the transformed object.

Abstract: An illustrative embodiment disclosed herein is a computer-implemented method. In some embodiments, the method includes uploading, by a processor, an object to a source bucket in an object store and creating, by the processor, a lambda bucket in the object store that is symlinked to the source bucket. In some embodiments, the lambda bucket is associated with a transformation function. In some embodiments, the method includes associating, by the processor, a lambda function with the object in the source bucket, receiving, by the processor, a request to download the object from the lambda bucket, detecting, by the processor, that the object is in the source bucket and associated with the lambda function, fetching, by the processor, the object from the source bucket, generating, by the processor, a transformed object by invoking the lambda function and the transformation function on the object, and downloading, by the processor, the transformed object.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions to maintain an object store including a primary cluster having one or more compute resources and one or more first storage resources, identify a secondary cluster having one or more second storage resources, select the secondary cluster to be added to the object store, allocate an available portion of the one or more second storage resources to the object store, and shard an object across the one or more second storage resources and the available portion of the one or more second storage resources.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions that identify a temporary bucket linked to one or more objects of a main bucket, detect that an object is uploaded to the main bucket, determine whether the object has an object attribute satisfying an object attribute relationship, and responsive to determining that the object has the object attribute that satisfies the object attribute relationship, add, to the temporary bucket, a link to the object.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions that receive a structured query language (SQL) query, identify a bucket, identify metadata relationships specified in the SQL query, and execute the SQL query to generate a list of objects included in the bucket and having metadata satisfying the metadata relationships.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions to maintain an object store including a primary cluster having one or more compute resources and one or more first storage resources, identify a secondary cluster having one or more second storage resources, select the secondary cluster to be added to the object store, allocate an available portion of the one or more second storage resources to the object store, and shard an object across the one or more second storage resources and the available portion of the one or more second storage resources.

Abstract: Systems for distributed computing systems. A topological configuration of computing nodes is selected to manage availability of metadata data in a computing system. A method embodiment commences by accessing a plurality of node topology attributes and using those attributes to map between nodes and availability domains. Resource usage measurements such as computing node load are collected. A plurality of candidate replication configurations are generated, and each candidate replication configuration is scored with respect to several quantitative objectives. Additionally, the candidate replication configurations are given respective resource usage balance scores. One or more candidate replication configurations are selected based on resource usage balance scores and/or a separation skew value. Determination of a selected configuration is dominated by resource usage when there is a tie between best-scoring configurations or when none of the configurations meet a scoring threshold.

Abstract: Systems for distributed computing systems. A topological configuration of computing nodes is selected to manage availability of metadata data in a computing system. A method embodiment commences by accessing a plurality of node topology attributes and using those attributes to map between nodes and availability domains. Resource usage measurements such as computing node load are collected. A plurality of candidate replication configurations are generated, and each candidate replication configuration is scored with respect to several quantitative objectives. Additionally, the candidate replication configurations are given respective resource usage balance scores. One or more candidate replication configurations are selected based on resource usage balance scores and/or a separation skew value. Determination of a selected configuration is dominated by resource usage when there is a tie between best-scoring configurations or when none of the configurations meet a scoring threshold.