Abstract: Techniques for accessing a file involve determining whether a client requests a permission for a target file, the permission allowing the client to cache data associated with the target file. The techniques further involve in response to determining that the client requests the permission, obtaining pattern information related to an access pattern in which the client accesses the target file. The techniques further involve determining availability of the permission to the client by applying the pattern information to a decision model, the decision model being trained based on training pattern information and training permission information. The techniques further involve providing, to the client, an indication on the availability. Accordingly, access conflicts can be reduced, so that the performance of the client and server can be improved.

Abstract: Systems and methods are described for facilitating operation of a plurality of computing devices. Data indicative of enumerated resources of a computing device is collected. The data is collected without dependency on write permissions to a file system of the one computing device. A condition of the computing device is determined based on historical data associated with enumerated resources of other computing devices. The identified condition can be updated as updated historical data becomes available. A communication to the computing device may be sent based on the identified condition.

Abstract: The present disclosure provides a virtual file management method and apparatus, and a computer-readable recording medium thereof, which may comprises obtaining an object identifier for distinguishing objects, wherein the object includes at least one of a virtual file or a virtual folder and obtaining the object based on the obtained object identifier.

Abstract: Disclosed are various approaches for preauthorizing the joining of a client device to a domain managed by a cloud-based directory service. An authorization token can be generated prior to a client device joining the domain. The authorization token can be subsequently installed on a client device at an OEM facility. When a user first logs into the client device, the client device can send the authorization token to the cloud-based directory service in lieu of administrative credentials to prove that the client device has been previously authorized to join the domain.

Abstract: Techniques for load balancing communication sessions in a networked computing environment are described herein. The techniques may include establishing a first communication session between a client device and a first computing resource of a networked computing environment. Additionally, the techniques may include storing, in a data store, data indicating that the first communication session is associated with the first computing resource. The techniques may further include receiving, at a second computing resource of the networked computing environment, traffic associated with a second communication session that was sent by the client device, and based at least in part on accessing the data stored in the data store, establishing a traffic redirect such that the traffic and additional traffic associated with the second communication session is sent from the second computing resource to the first computing resource.

Abstract: A computer-implemented method may comprise receiving proposals to mutate a data stored in a distributed and replicated file system coupled to a network, the distributed and replicated data system comprising a plurality of nodes, each comprising a server. A metadata service maintains and updates a replica of a namespace of the distributed and replicated file system and coordinates updates to the data by generating an ordered set of agreements corresponding to the received proposals, the ordered set of agreements specifying an order in which the nodes are to mutate data stored in data nodes and cause corresponding changes to the state of the namespace. For each agreement in the generated ordered set of agreements, a corresponding writers list may be provided that comprises an ordered list of nodes to execute the agreement and make corresponding changes to the namespace.

Abstract: A computer system including in-memory cache storage may be used to store collections of metadata that provide a semantic layer for a query of a data source. The computer system may provide multiple users access to the metadata collection, using different security policies for the users, without duplicating the metadata collection in the in-memory storage. For instance, the computer system may retrieve the metadata collection and provide the first user access to the metadata collection based on a first security policy of the first user. The computer system may then provide a second user access to the metadata collection based on a second security policy of the second user, without the metadata collection being duplicated in the in-memory cache storage.

Abstract: A method includes: receiving, by a computing device, input defining a custom storage class in a first dispersed storage network; receiving, by the computing device, input defining a data management rule in the first dispersed storage network; determining, by the computing device, a data object in the first dispersed storage network satisfies the data management rule; and moving, by the computing device and in response to the determining, the data object to a second dispersed storage network according to the custom storage class.

Abstract: Systems and methods are described for modifying input and output (I/O) to an object storage service by implementing one or more owner-specified functions to I/O requests. Such functions can include data access control functions, data manipulation functions, and the like. The owner of an object collection maintained by the object storage service can specify code execution environment rules that can give privileges to the execution of such functions such as by allowing the functions to access external services or the requesting user's private resources. In this manner, owners of the object collection are provided with greater control over how the object collection is accessed.

Abstract: A distributed system that implements an online exchange may comprise a plurality of server nodes, each of which being configured to receive exchange transaction proposals from customers of the online exchange over a computer network and each being configured to store a copy of a blockchain distributed ledger of completed exchange transactions. A consensus engine may be coupled, over the computer network, to the plurality of server nodes and may receive a plurality of exchange transaction proposals from the plurality of server nodes. The consensus engine may be being further configured to achieve consensus on the plurality of exchange transaction proposals and to generate, in response, an ordering of agreed-upon exchange transaction proposals that includes the plurality of exchange transaction proposals on which consensus has been reached.

Abstract: Techniques described herein relate to a method for performing data services. The method may include receiving, from a monitor agent, a global name and metadata corresponding to data written to a data structure of storage of a data host; performing a services assessment using the global name, the metadata, and a data service policy rule to obtain at least one data service to perform on the data; and performing the at least one data service based on the services assessment.

Abstract: Methods and systems for dynamically provisioning storage on a blockchain are provided. In one embodiment, a method is provided that includes receiving a request that includes a data unit for storage. The data unit may be buffered in a data stack that stores one or more data units. The data unit may be stored in the data stack until (i) a predetermined amount of time has passed and/or (ii) a size of the data stack exceeds a predetermined threshold. The data units stored in the data stack may then be encrypted and included in one or more storage transactions. The storage transactions may also include encryption keys used to encrypt the data units. The storage transactions may then be transmitted to nodes for storage on a blockchain.

Abstract: Techniques are provided for dependency aware parallel splitting of operations. For example, a count of pending data operations being executed by a first node and replicated in parallel to a second node are tracked. A metadata operation is executed at the first node based upon the count being less than a threshold (e.g., the count being zero). A first list of affected inodes modified by the metadata operation is identified. A dependency of the metadata operation with respect to pending metadata operations replicated to the second node is determined. The metadata operation is dispatched to the second node based upon the dependency indicating that the metadata operation is independent of the pending metadata operations.

Abstract: Systems and methods for migrating file locks in distributed file systems. An example method may comprise: receiving, by a file system server, over a first connection initiated by a file system client, a connection identifier comprising a file identifier; identifying, in view of the connection identifier, a second connection initiated by the file system client, the second connection associated with a file lock with respect to a file identified by the file identifier; and associating the file lock with the first connection.

Abstract: The various implementations described herein include methods and devices for creating and using trust binaries. In one aspect, a method includes obtaining executable code for a program, identifying a plurality of executable functions from the executable code, and for each executable function of the plurality of executable functions, generating a respective function digest based on one or more static parts of the respective executable function. The method further includes constructing a respective trust binary comprising the respective digest for each executable function of the plurality of executable functions, generating a trust binary name by applying a hash function to a header of the executable code, and indexing the trust binary in a trust database utilizing the trust binary name.

Abstract: Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes. For example, by transforming a ZFS file system disk-based storage into ZFS cloud-based storage, the ZFS file system gains the elastic nature of cloud storage.

Abstract: Scalable virtual memory metadata management comprising a plurality of pre-instantiated VM metadata containers representing the entire amount of real physical memory available to a computing system, with additional instantiated VM metadata containers created as needed. Individual and/or groups of VM metadata containers are assigned to metadata container groups, wherein each container group is controlled by an acquired lock assigned to the VM metadata container groups. Virtual memory metadata is managed using a “least used” technique. In response to allocation requests, the allocator scans the container groups/VM containers and fulfills memory object metadata allocation to the least used VM metadata container of the least used container group, filling the individual VM metadata containers and/or the container groups at a nearly equal rate.

Abstract: Various systems facilitate encrypted file storage. A client device may generate an encrypted version of a file. The client device may obtain at least one reference to at least one storage location for the encrypted version of the file. The client device may cause the encrypted version of the file to be store at the at least one storage location using the at least one reference to the at least one storage location.

Abstract: Concepts and technologies directed to distributed load balancing for processing of high-volume data streams in datacenters are disclosed herein. In various aspects, a system can include a processor and memory storing instructions that, upon execution, cause performance of operations. The operations can include receiving raw data items in an incoming queue, and generating, within each of a plurality of worker processing threads, a load hash set that includes a load hash value for each of the raw data items in the incoming queue. The operations can include determining, within each worker processing thread, which of the raw data items to process from the incoming queue based on the load hash set, and processing, via one of the plurality of worker processing threads, each of the raw data items in the incoming queue based on the load hash value for each of the raw data items.

Abstract: Aspects of the present disclosure relate to a unified activity service. In one aspect, different files stored on different storage platforms may be rendered on different user interfaces. Multiple activities associated with each of the different files may be obtained from the activity service. In another aspect, activity metadata corresponding to the multiple activities may be stored in the activity service. Activities associated with the different files may include content changes in a file (e.g., edits and deletions), sharing a file, renaming a file, comments within a file, messaging, and conversations related to a file. The different storage platforms may be independent of the activity service.

Abstract: A method for managing file systems includes receiving, by a unified namespace manager, a first message that indicates a new file system has been created on a first node, performing an update on a top level file system namespace to include a reference to the new file system to generate an updated top level file system namespace, generating, based on the update, a second message that indicates the top level file system namespace has been updated, and sending, to a second node, the second message.

Abstract: A method for managing data includes obtaining, by a database proxy server, a document manifest, wherein the document manifest specifies a plurality of queries, wherein each of the plurality of queries specifies data and a policy to be implemented on the data, wherein the data is stored in a central database, and processing the plurality of queries.

Abstract: Testing is performed to ensure integrity of a file system auditing component and of a file system. A list of file access events is built. This list includes expected events that should be triggered by the file system and found in a log. The events in the list are run on the file system and logged. The log of expected events is then compared with actual events logged by the file system to determine the integrity of the file system auditing component and the file system.

Abstract: A system and method for performing a hash bucketing process on data in motion are presented. The method includes applying a first hash function on an input dataset to map the input dataset to a bucket, wherein the first hash function results with a first hash value; applying a second hash function on the first hash value to map the input dataset to a record in the bucket; generating metadata based on the input dataset, wherein the metadata at least points to the original location of the input dataset; and storing the generated metadata in the record in the bucket.

Abstract: Ransomware attack (RWA) detection is performed during an incremental or differential backup of a system of folders or directories of a computer or network of computers via an electronic network. The RWA detection includes processing incremental or differential backup metadata acquired during the incremental or differential backup to determine whether a RWA alert is issued. RWA remediation is performed at least in part on the RWA alert being issued. The RWA alert may be issued based on processing of the incremental or differential backup metadata to identify candidate new files and candidate deleted files in which the candidate new files are candidates for being encrypted copies of the candidate deleted files. RWA alert criterion may be based on counts of new versus deleted files in a folder or directory, and comparison of file sizes of the new versus deleted files.

Abstract: A personal cloud authentication (PCA) system for authenticating an online user using device data stored on a personal cloud platform of the user is provided. The PCA system configured to build an authentication table using a user profile that includes at least user account information. The PCA system is also configured to receive transaction data associated with the user account information and store the transaction data within a database, wherein the transaction data includes at least an authentication request, a second primary user computing device identifier and a second secondary user computing device identifier. The PCA system is further configured to parse the transaction data, match the first primary user computing device identifier to the second primary user computing device identifier and the first secondary user computing device identifier to the second secondary user computing device identifier, generate an authentication response based on the match, and transmit the authentication response.

Abstract: A distributed system that implements an online exchange may comprise a plurality of server nodes, each of which being configured to receive exchange transaction proposals from customers of the online exchange over a computer network and each being configured to store a copy of a blockchain distributed ledger of completed exchange transactions. A distributed coordination engine may be coupled, over the computer network, to the plurality of server nodes and may receive a plurality of exchange transaction proposals from the plurality of server nodes. The distributed coordination engine may be being further configured to achieve consensus on the plurality of exchange transaction proposals and to generate, in response, an ordering of agreed-upon exchange transaction proposals that includes the plurality of exchange transaction proposals on which consensus has been reached.

Abstract: Systems and methods are disclosed for scalable bucket merging in a data intake and query system. Various components of a bucket manager can be used to monitor recently-created buckets of data in common storage that are associated with a particular tenant and a particular index, apply a comprehensive bucket merge policy to determine groups of buckets that qualify for merging, merge those group of buckets into merged buckets to be stored in the common storage, and update any information associated with the merged buckets and pre-merged buckets. These components may be shared across multiple tenants, and some of these components may be dynamically scalable based on need. This approach may also provide many additional benefits, including improved search performance from merged buckets, efficient resource utilization associated with discriminate merging, and redundancy in case of component failure.

Abstract: Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes. For example, by transforming a ZFS file system disk-based storage into ZFS cloud-based storage, the ZFS file system gains the elastic nature of cloud storage.

Abstract: The Kentik Data Engine (KDE) is an integrated real-time, big data software system able to analyze what exactly is happening on a network at the present moment, and what happened on the network over the a prior period of time. KDE collects live operational data from computer network infrastructure devices (routers and switches) and computer hosts, consisting of multiple data types, categories, and protocols, and correlates them to analyze network activity and health. KDE does this in a lossless manner, meaning that it retains all raw data rather than summarizing or aggregating prior to storage. In this way, KDE provides a combination of precise, actionable information in real-time as well as a complete forensic data store for detailed exploratory analysis.

Abstract: Wireless data communication between two devices is described. In an example implementation, an image frame displayed on a display unit of a transmitting device is captured by a camera of a receiving device, where the image frame comprises text characters converted from binary data bits based on a text mapping table. The text characters in the captured image frame are converted to the binary data bits based on the text mapping table by the receiving device.

Abstract: Various example embodiments relate to partial data transmission. A transmitter may receive at least one dataset for transmission. The dataset may be one of a plurality of datasets known to the transmitter and a receiver or to be signaled to the receiver. The transmitter may determine a first portion of the dataset. The size of the first portion may be determined based on a battery level indicator, a latency level associated with the dataset, a radio condition, or a network load. The receiver may recognize the dataset based on the first portion and/or at least one second portion transmitted by the transmitter. Apparatuses, methods, and computer programs are disclosed.

Abstract: A method for determining to rebuild a namespace. The method includes one or more computer processors identifying a set of storage devices associated with the namespace of the user. The method further includes determining a state of health of a namespace based on information related to the set of storage devices associated with the namespace and further includes identifying a set of criteria related to the state of health of the namespace. The method further includes responding to determining that one or more criteria related to the state of health of namespace attains respective trigger values by replacing a first set of storage devices that store data corresponding to the namespace and are included among one or more storage systems. The method further includes dictating to replace the first set of storage devices that store data corresponding to the namespace and are included among the one or more storage systems.

Abstract: A data management system and method for accelerating shared file checkpointing. Written application data is aggregated in an application data file created in a local burst buffer memory at a compute node, and an associated data mapping built index to maintain information related to the offsets into a shared file at which segments of the application data is to be stored in a parallel file system, and where in the buffer those segments are located. The node asynchronously transfers a data file containing the application data and the associated data mapping index to a file server for shared file storage. The data management system and method further accelerates shared file checkpointing in which a shared file, together with a map file that specifies how the shared file is to be distributed, is asynchronously transferred to local burst buffer memories at the nodes to accelerate reading of the shared file.

Abstract: A method includes creating an application instance that corresponds to a client, creating a partition on the cloud storage device, the partition corresponding to the client, and associating attributes with the partition. The attributes include a client identifier corresponding to the client, a service-level objective corresponding to the client, and an application identifier corresponding to the application instance. The method further includes receiving a request from the application instance to access the partition and accessing, in response to the request, the attributes corresponding to the partition. The method further includes ordering the request in a data structure relative to one or more other requests, the ordering based on at least one attribute of the attributes, an order in which the request was submitted, and a latency sensitivity of the application instance. The method further includes dispatching the request from the data structure in an order corresponding to the ordering.

Abstract: Inventive aspects include a method, apparatus, and system for supporting a native key-value distributed storage system. The system includes a namenode having a KV-SSD and one or more datanodes each including one or more KV-SSDs. The system includes a client device that is communicatively coupled to the namenode and the one or more datanodes. The client device includes a native key-value storage and networking stack. Some embodiments include a hybrid block-based native key-value distributed storage system that supports both block-based files and native key-value tuples.

Abstract: In various embodiments, methods and systems for implementing distributed data object management are provided. The distributed data object management system includes a distributed storage system having a local metadata-consensus information store in and one or more remote metadata-consensus information stores. A metadata-consensus information store is configured to store metadata-consensus information. The metadata-consensus information corresponds to erasure coded fragments of a data object and instruct on how to manage the erasure coded fragments. The distributed storage system further includes a local data store and one or more remote data stores for the erasure coded fragments. The distributed data object management system includes a distributed data object manager for operations including, interface operations, configuration operations, write operations, read operations, delete operations, garbage collection operations and failure recovery operations.

Abstract: A device includes a converged input/output controller that includes a physical target storage media controller, a physical network interface controller and a gateway between the storage media controller and the network interface controller, wherein gateway provides a direct connection for storage traffic and network traffic between the storage media controller and the network interface controller.

Abstract: The retrieval of files can be facilitated in real-time in the general context of backup and recovery. A processor can receive a request to retrieve a particular volume of data from an object storage database. A virtual volume can be presented to an emulator for creation of a virtual machine representing the particular volume of data. A request can be received to access a particular file from the particular volume of data at a specific point in time. In response to the request to access the file, the data stream can be paused, the particular file can be fetched, and the particular file can be transmitted to the emulator.

Abstract: A monitoring system monitors processing of incoming messages and logs data related to performance of an application that processes the messages. The monitoring system temporarily associates reusable identifiers with the messages and logs data upon each message traversing different points in the application. Each of the identifiers is sized such that the storage space necessary to store the identifier is less than the storage space necessary to store an identifier sized to uniquely identify all of the plurality of messages, and the identifiers and the logged data are configured to minimize a performance penalty of monitoring the application. The monitoring system parses the data, e.g., during post-processing, to determine, from a plurality of data entries that refers to the same identifier, a subset of the data entries where the same identifier was associated with the same message.

Abstract: Disclosed are methods, apparatus, systems and computer program products for database system communications with external content management data sources. In some implementations, the data sources are identified in a user interface. An authorization selection enables authorization of a given identified data source, and a customization selection enables customization of one or more search settings for searching content of the data source. Persistent objects representing content objects of the data sources can be stored in one or more databases. A database search can be performed on both native database files and the persistent objects.

Abstract: A shared database platform can interface with a cluster computing platform over a network through a connector. The data transferred over the network can include metadata result packages that can be distributed to worker nodes of the cluster computing platform, which receive the metadata objects and access the result data for further processing on a staging platform, such as a scalable storage platform.

Abstract: A peer node in a blockchain distribution network includes a processor configured to generate a blockchain, where the blockchain includes information regarding a plurality of transactions. The processor is also configured to determine that the peer node is being discriminated against with respect to blockchain transmissions by one or more central servers of the blockchain distribution network. The processor is further configured to determine, based at least in part on the determination that the peer node is being discriminated against, that one or more servers in a sentinel network are to be used for blockchain transmissions instead of the one or more central servers. The peer node further comprises a transceiver operatively coupled to the processor and configured to transmit the blockchain through the sentinel network.

Abstract: One or more computing devices may comprise congestion management circuitry, one or more client file system request buffers, and DESS interface circuitry. The one or more client file system request buffers is/are operable to queue first client file system requests of a first priority level and second client file system requests of a second priority level, where the first priority level is higher priority than the second priority level. The DESS interface circuitry is operable to determine a choking level according to the load on a plurality of DESS resources. Individual load values of the DESS resources are mapped to a composite load value using a first function. The composite load value is mapped to a congestion contribution using a second function. And, the congestion contribution is mapped to a choking level using a third function.

Abstract: An example system and method provides an enhancement to a software editor, enabling a user (e.g., developer) to visualize a REST API (also called a REST service herein) as a list of resources presented in a flat structure, i.e., a simple list of resources containing operations. The software editor may be a fully JS/HTML/CSS (JavaScript, HyperText Markup Language, Cascading Style Sheets) compliant editor that lets the user define connectors to REST API's in an easy and fluid way. Furthermore, the editor facilitates creation of a connector to the REST API in a generic fashion, without requiring user knowledge of any particular interface or description language, such as RAML, YAML, WADL, etc. The user, e.g., developer, may simply define resources and corresponding operations to thereby enable the editor to automatically generate a corresponding connector to the REST API. The enhanced software editor also facilitates creation of business objects from a JSON instance or schema.

Abstract: System and method for writing updated versions of a configuration data file for a distributed file system in a storage system uses a directory renaming operation to write a new updated version of the configuration data file using the latest version of the configuration data file and a target directory. After the latest version of the configuration data file is modified by a particular host computer in the storage system, the modified configuration data file is written to a temporary file. The directory naming operation is then initiated on the temporary file to change the directory for the temporary file to the target directory. If the directory renaming operation has failed, a retry is performed by the particular host computer to write the new updated version of the configuration data file using a new latest version and a new target directory.

Abstract: A distributed metadata cache for a distributed object store includes a plurality of cache entries, an active-cache-entry set and an unreferenced-cache-entry set. Each cache entry includes information relating to whether at least one input/output (IO) thread is referencing the cache entry and information relating to whether the cache entry is no longer referenced by at least one IO thread. Each cache entry in the active-cache-entry set includes information that indicates that at least one IO thread is actively referencing the cache entry. Each cache entry in the unreferenced-cache-entry set is eligible for eviction from the distributed metadata cache by including information that indicates that the cache entry is no longer actively referenced by an IO thread.

Abstract: In a fabric-based infrastructure a flexible scalable server is obtained by physical disaggregation of converged resources to obtain pools of a plurality of operationally independent resource element types such as storage, computing, networking and more. A plurality of computing facilities can be created either dynamically or statically by a resource manager by abstracting instances of resources from such pools of a plurality of resource element types expressed within a single disaggregated logical resource plane.

Abstract: A method for managing contents shared by a Social Network Service (SNS), executed by a cloud server which is associated with an account of the SNS. It is detected whether a first content has been newly uploaded to the SNS or whether a metadata related to the first content previously uploaded to the SNS has been newly added. A second content corresponding to the first content is searched. The cloud storage is updated by linking context information related to the first content to the second content corresponding to the first content. The cloud server interworks with an account of the SNS of each user's individual to link context information of content shared on the SNS with the content stored in the personal cloud storage, thereby enabling easier update of the cloud storage. A user may easily search for desired contents using the context information.

Abstract: A production cluster includes a first plurality of nodes and executes a workload, such that jobs associated with the executed workload are allocated, according to a first configuration, across the first plurality of nodes. A cluster monitor extracts production cluster information from the production cluster, monitors configuration information during execution of the workload, and transmits each to a cluster tuner. The cluster tuner includes a second plurality of nodes that is less than the first plurality of nodes of the production cluster. The cluster tuner receives the information and determines a first recommended configuration for the production cluster. The cluster tuner causes the test cluster to execute a simulated workload according to the first recommended configuration. In response to determining that the first recommended configuration results in a decrease in resource consumption, the cluster tuner causes the production cluster to operate according to the first recommended configuration.