Abstract: A method includes receiving, at a first computing device, a first input/output (IO) command from a first artificial intelligence processing unit (AI PU), the first IO command associated with a first AI model training operation. The method further includes receiving, at the first computing device, a second IO command from a second AI PU, the second IO command associated with a second AI model training operation. The method further includes assigning a first timestamp to the first IO command based on a first bandwidth assigned to the first AI model training operation. The method further includes assigning a second timestamp to the second IO command based on a second bandwidth assigned to the second AI model training operation.

Abstract: A system and method for client and network based erasure code recovery. In some embodiments, the method includes: receiving, by a storage node, a get command; storing, by the storage node, in a memory of a host, using remote direct memory access, data specified by the get command, at a memory address specified by the get command; sending, by the storage node, a response, indicating successful execution of the get command; and performing, by the host, erasure code recovery based on the data.

Abstract: Techniques are described for providing access to anonymized user data derived from external data providers. A persona management system generates a searchable data store containing metadata related to a plurality of users of the persona management system. The metadata includes entries indicating: a first identifier of a user of the plurality of users of the persona management system, a second identifier of an external data provider of a plurality of external data providers that possess data related to users of the persona management system, a third identifier of an algorithm that is used to transform data possessed by the external data provider related to the user of the persona management system into one or more transformed data values, and the one or more transformed data values. In response to requests from various data consumers, the persona management system uses the metadata to identify users matching specified search criteria.

Abstract: A method includes receiving, at a first computing device, a first input/output (TO) command from a first artificial intelligence processing unit (AI PU), the first TO command associated with a first AI model training operation. The method further includes receiving, at the first computing device, a second TO command from a second AI PU, the second TO command associated with a second AI model training operation. The method further includes assigning a first timestamp to the first TO command based on a first bandwidth assigned to the first AI model training operation. The method further includes assigning a second timestamp to the second TO command based on a second bandwidth assigned to the second AI model training operation.

Abstract: A method includes receiving, at a first computing device, a first input/output (IO) command from a first artificial intelligence processing unit (AI PU), the first IO command associated with a first AI model training operation. The method further includes receiving, at the first computing device, a second IO command from a second AI PU, the second IO command associated with a second AI model training operation. The method further includes assigning a first timestamp to the first IO command based on a first bandwidth assigned to the first AI model training operation. The method further includes assigning a second timestamp to the second IO command based on a second bandwidth assigned to the second AI model training operation.

Abstract: A method may include receiving a request for storage resources to access a dataset for a processing session, allocating, based on the dataset, one or more storage nodes for the processing session, and mapping one or more of the storage nodes to one or more compute nodes for the processing session through one or more network paths. The method may further include returning a resource map of the one or more storage nodes and the one or more compute nodes. The method may further include estimating an available storage bandwidth for the processing session. The method may further include estimating an available client bandwidth. The method may further include allocating a bandwidth to a connection between at least one of the one or more storage nodes and at least one of the one or more compute nodes through one of the network paths.

Abstract: A method includes receiving, at a first computing device, a first input/output (IO) command from a first artificial intelligence processing unit (AI PU), the first IO command associated with a first AI model training operation. The method further includes receiving, at the first computing device, a second IO command from a second AI PU, the second IO command associated with a second AI model training operation. The method further includes assigning a first timestamp to the first IO command based on a first bandwidth assigned to the first AI model training operation. The method further includes assigning a second timestamp to the second IO command based on a second bandwidth assigned to the second AI model training operation.

Abstract: Techniques are described for providing access to anonymized user data derived from external data providers. A persona management system generates a searchable data store containing metadata related to a plurality of users of the persona management system. The metadata includes entries indicating: a first identifier of a user of the plurality of users of the persona management system, a second identifier of an external data provider of a plurality of external data providers that possess data related to users of the persona management system, a third identifier of an algorithm that is used to transform data possessed by the external data provider related to the user of the persona management system into one or more transformed data values, and the one or more transformed data values. In response to requests from various data consumers, the persona management system uses the metadata to identify users matching specified search criteria.

Abstract: According to one general aspect, a system may include a data interface circuit configured to receive data access requests, wherein each data access request is associated with a data set. The system may include a plurality of storage devices each storage device configured to store data, and wherein the plurality of storage devices has an amount of available storage space, an amount of used storage space, and an amount of redundant storage space. The system may include a data management circuit configured to: monitor the amount of available storage space in the in the plurality of storage devices, determine, for one or more data set, a level of redundancy to be associated with the respective data set, generate, for a first data set of the data sets, a redundant data portion to be associated with the first data set, and dynamically adjust the level of redundancy associated with the first data set, based, at least in part, upon the amount of available storage space.

Abstract: Techniques are described for providing access to anonymized user data derived from external data providers. A persona management system generates a searchable data store containing metadata related to a plurality of users of the persona management system. The metadata includes entries indicating: a first identifier of a user of the plurality of users of the persona management system, a second identifier of an external data provider of a plurality of external data providers that possess data related to users of the persona management system, a third identifier of an algorithm that is used to transform data possessed by the external data provider related to the user of the persona management system into one or more transformed data values, and the one or more transformed data values. In response to requests from various data consumers, the persona management system uses the metadata to identify users matching specified search criteria.

Abstract: According to one general aspect, a system may include a data interface circuit configured to receive data access requests, wherein each data access request is associated with a data set. The system may include a plurality of storage devices each storage device configured to store data, and wherein the plurality of storage devices has an amount of available storage space, an amount of used storage space, and an amount of redundant storage space. The system may include a data management circuit configured to: monitor the amount of available storage space in the in the plurality of storage devices, determine, for one or more data set, a level of redundancy to be associated with the respective data set, generate, for a first data set of the data sets, a redundant data portion to be associated with the first data set, and dynamically adjust the level of redundancy associated with the first data set, based, at least in part, upon the amount of available storage space.

Abstract: Techniques are described for providing access to anonymized user data derived from external data providers. A persona management system generates a searchable data store containing metadata related to a plurality of users of the persona management system. The metadata includes entries indicating: a first identifier of a user of the plurality of users of the persona management system, a second identifier of an external data provider of a plurality of external data providers that possess data related to users of the persona management system, a third identifier of an algorithm that is used to transform data possessed by the external data provider related to the user of the persona management system into one or more transformed data values, and the one or more transformed data values. In response to requests from various data consumers, the persona management system uses the metadata to identify users matching specified search criteria.

Abstract: Techniques are described for providing access to anonymized user data derived from external data providers. A persona management system generates a searchable data store containing metadata related to a plurality of users of the persona management system. The metadata includes entries indicating: a first identifier of a user of the plurality of users of the persona management system, a second identifier of an external data provider of a plurality of external data providers that possess data related to users of the persona management system, a third identifier of an algorithm that is used to transform data possessed by the external data provider related to the user of the persona management system into one or more transformed data values, and the one or more transformed data values. In response to requests from various data consumers, the persona management system uses the metadata to identify users matching specified search criteria.