Abstract: This application includes a method that is performed store data. The method includes obtaining, by a compliance aware replicator (CAR), a replication request to replicate data; and in response to the replication request: obtaining data chunks, associated with the data, using sequence identifiers of sequencing metadata; replicating the data chunks to obtain replicated data chunks; identifying, using classification metadata associated with the data, a first data cluster of data clusters to store the replicated data chunks; and sending the replicated data chunks to the first data cluster.

Abstract: A method for processing video data is performed by a data processing unit (DPU). The method includes identifying, by the DPU of an edge device, a contextual stitching trigger event; in response to identifying the contextual stitching trigger event: identifying video data chunks, contextual metadata, indexing metadata, and authentication and authorization (AA) metadata associated with the contextual stitching trigger event; generating a virtual blob based on the video data chunks, contextual metadata, indexing metadata, and authentication and authorization AA metadata; making a first determination that a playback request is obtained from a user, wherein the playback request comprises user authentication information; and in response to the first determination: making a second determination that the user authentication information matches the AA metadata; and in response to the second determination; encoding the video data chunks into a single stream and initiating playback for the user.

Abstract: A method that is performed to access data nodes of a data cluster. The method includes obtaining, by a data access gateway (DAG), a first request from a host; and in response to the first request, obtaining first bidding counters from the data nodes; identifying, based on the first bidding counters, a first data node of the data nodes associated with a highest bidding counter of the first bidding counters; sending the first request to the first data node; and making a first determination that the first data node is able to service the first request.

Abstract: A method that is performed to access data nodes of a data cluster. The method includes obtaining, by a data access gateway (DAG), a request from a host; and in response to the request, obtaining bidding counters from the data nodes; obtaining metadata mappings from the data nodes; identifying, based on the bidding counters and metadata mappings, a data node of the data nodes associated with a highest bidding counter of the bidding counters and an appropriate metadata mapping of the metadata mappings; and sending the request to the data node.

Abstract: A method for managing data includes obtaining data from a host, performing an erasure coding procedure to the data to obtain a plurality of slices, wherein each slice in the plurality of slices comprises a plurality of data chunks and at least one parity chunk, generating a plurality of segment entries, wherein each segment entry in the plurality of segment entries specifies a segment, generating metadata slice entries, wherein each metadata slice entry is associated with a slice in the plurality of slices, storing the plurality of segment entries and the metadata slice entries in an accelerator pool in a first data cluster, and storing, across a plurality of fault domains in the first data cluster, the data chunks and the parity chunk of each slice in the plurality of slices based on the plurality of segment entries.

Abstract: A method that is performed to access data nodes of a data cluster. The method includes obtaining, by a data access gateway (DAG), a request from a host, wherein the DAG is not executing on the host; in response to the request, obtaining discovery metadata from each data node of the data nodes in the data cluster; updating, based on the discovery metadata, a discovery metadata repository; identifying a first data node of the data nodes based on the discovery metadata; and sending the request to the first data node of the data nodes.

Abstract: A method that is performed to access data nodes of a data cluster. The method includes obtaining, by a data access gateway (DAG), a first request from a host; and in response to the first request, obtaining first bidding counters from the data nodes; obtaining first metadata mappings from the data nodes; making a first determination that the first request may not be served using any data node in an accelerator pool of the data cluster; and in response to the first determination, identifying, based on the bidding counters and metadata mappings, a data node in a non-accelerator pool of the data cluster associated with a first highest bidding counter of the bidding counters and a first appropriate metadata mapping of the metadata mappings; and sending the first request to the data node in the non-accelerator pool of the data cluster.

Abstract: A networking fabric update system includes a cluster coordination subsystem coupled to servers and switches. The cluster coordination subsystem identifies a networking topology provided by connections between the servers and switches, and forecasts workload operations for the servers based on, for example, current workload operations and historical workload operations of the servers. Based on the networking topology and the workload operations forecast for the servers, the cluster coordination subsystem updates a first subset of the switches and, following the updating of the first subset of the switches, updates a second subset of the switches. The updating of the first subset of the switches may include determining that current workload operations for the servers during a current time period are above a workload threshold for the first subset of the switches, and scheduling and updating the first subset of the switches during a subsequent time period.

Abstract: A method and system for optimizing a learning model post-deployment. Specifically, the disclosed method and system re-optimize—i.e., re-train and/or re-validate—machine learning and/or artificial intelligence algorithms that have already been deployed into a production environment. During post-deployment, the re-optimization process may transpire following the advent of varying model re-adjustment triggers.

Abstract: A method and system for workload aware storage replication. Specifically, the disclosed method and system entail establishing preferential transports for critical workload data targeted for replication from one cluster infrastructure to another. Existing replication solutions fail to prioritize the replication of critical over non-critical workload data, which the disclosed method and system rectify.

Abstract: A method for securing data in a data cluster is performed by a data manager of a data cluster. The method includes receiving, by a data cluster, a write request for a user to write data to the data cluster, wherein the write request comprises an object identifier (OID) associated with data and a user identifier (UID) associated with the user; sending, to a key manager, an intermediate key request, wherein the intermediate key request comprises the UID; receiving, by the data cluster from the key manager, an intermediate key; processing the data to obtain a plurality of chunks and metadata associated with the plurality of chunks; generating an encryption key using the intermediate key and the OID; encrypting the metadata using the encryption key to generate encrypted metadata; deleting, after generating the encrypted metadata, the encryption key; and storing the encrypted metadata and the plurality of chunks in the data cluster.

Abstract: In general, the invention relates to a method for processing data. The method includes receiving a write request from a host, and in response to the write request, obtaining system metadata for a system, selecting, based on the system metadata, a selected component of the system to perform a data processing operation, and initiating the data processing operation on the selected component.

Abstract: A data storage system includes a first region, a second region, and a global enumerator. The first region stores a first copy of data. The second region stores a second copy of the data. The global enumerator performs a data control analysis of the data to identify that the first region is a high regulation region and the second region is a low regulation region; in response to making the identification: updates first metadata associated with the first copy of the data to regulate access to the first copy of the data; and updates second metadata associated with the second copy of the data to deregulate access to the second copy of the data.

Abstract: A method for processing video data is performed by a data processing unit (DPU). The method includes obtaining, by the DPU of an edge device, video data; processing the video data to obtain video data chunks and indexing attributes; generating indexing metadata based on the video data chunks and the indexing attributes; processing the video data chunks and indexing attributes to generate contextual attributes; generating contextual metadata based on the contextual attributes and the video data chunks; associating the indexing metadata and the contextual metadata with the video data chunks; and storing the indexing metadata, contextual metadata, and the video data chunks in storage.

Abstract: A method and system for collaborative workload placement and optimization. Specifically, the disclosed method and system entail implementing metric exchange between hosts in a clustered or non-clustered environment to perform infrastructure workload placement and optimization decisions. The exchange of metrics may be performed through a lightweight service, which would not impact any existing environment resource utilization. Further, resource utilization maps may be used to offer near real-time tracking of resource utilization across the aforementioned hosts, thereby facilitating resource utilization forecasting for the efficient placement and optimization of workloads throughout the environment.

Abstract: A method and system for workload aware storage replication. Specifically, the disclosed method and system entail establishing preferential transports for critical workload data targeted for replication from one cluster infrastructure to another. Existing replication solutions fail to prioritize the replication of critical over non-critical workload data, which the disclosed method and system rectify.

Abstract: A method and system for proximity based workload and data placement. Specifically, the disclosed method and system improve the efficiency and responsiveness of workload and/or workload data access to end-users through dynamic and automated needs detection and replication or migration orchestration between infrastructures (or geographical areas).

Abstract: A method and system for dynamic auto-generation of up-to-date deployment and operations guidance for solutions. Specifically, the method and system disclosed herein entail providing guidance tailored to a combination of components and/or subcomponents constituting a specific solution infrastructure. Further, the guidance accounts for deployment and operations cycle (DOC) stages, as well as configuration dependencies, when sequencing configuration steps relevant to the specific solution infrastructure.

Abstract: In general, the invention relates to a method for managing data. The method includes detecting a failure of a persistent storage device of a plurality of persistent storage devices, and in response to the detecting, initiating a rebuilding of data in a spare persistent storage device using proactive copy metadata, checkpoint metadata, and slice metadata, wherein the data is a copy of data that was stored in the persistent storage device.

Abstract: A method for managing data includes obtaining a workload generation request, wherein the workload generation request specifies a security compliant rule, in response to the workload generation request: selecting a first set of resource devices using a resource allocation master list, initiating a security compliance test on the first set of resource devices to obtain a security compliance result, making a first determination, based on the security compliance result, that the first set of resource devices meet a security compliance criterion, and in response to the first determination: storing a virtual certificate in a security compliance database based on the security compliance result, and allocating the first set of resource devices to a workload based on the workload generation request.