Abstract: In one embodiment, a solid state storage drive comprises a plurality of flash memory devices communicatively coupled to a bus and a channel controller communicatively coupled to the bus, the channel controller comprising an execution time calculator configured to determine an aggregate execution time duration for a sequence of commands in a command execution queue based on a data transfer rate presently assigned for communications over the bus, and a channel execution unit configured to determine when to place a second command in a command execution queue based at least in part on the aggregate execution time duration. In one embodiment, the execution time calculator is further configured to determine the aggregate execution time duration based on the data transfer rate and a data payload quantity associated with at least one command in the sequence of commands.

Abstract: Methods, systems, and apparatus for automatic sharding and load balancing in a distributed data processing system. In one aspect, a method includes determining workload distribution for an application across worker computers and in response to determining a load balancing operation is required: selecting a first worker computer having a highest load measure relative to respective load measure of the other work computers; determining one or more move operations for a partition of data assigned to the first worker computer and a weight for each move operation; and selecting the move operation with a highest weight the selected move operation.

Abstract: A method is used in managing recovery of file systems. A determination is made during recovery of a file system as to whether information required for recovering the file system is missing. Based on the determination, storage for a slice is provisioned. The slice is updated with the information required for recovering the file system. Recovery of the file system is performed.

Abstract: A system and method for responding to a virtual machine (VM) network failure for a host in a network partition in a high availability (HA) cluster. The method includes providing a plurality of network partition response options; and receiving a selection of a first network partition response option from the plurality of network partition response options, the selected first network partition response option causing a processor to transfer execution of a VM on the host to a second host that has VM network connectivity upon detecting a VM network failure for the host.

Abstract: At a carousel origin server, an indication is obtained that at least one of a plurality of consumer premises equipment connected to a video content network requires a software upgrade. Responsive to obtaining the indication, the carousel origin server loads onto a carousel at least one image required for the software upgrade. The at least one image required for the software upgrade is broadcast from the carousel to the at least one of the plurality of consumer premises equipment, for a predetermined period. Subsequent to the predetermined period, the at least one image required for the software upgrade is removed from the carousel.

Abstract: Disclosed is a method and mechanism to implement a communication channel between a web application and a locally running application on a computing system. A local communications server is employed to pass messages between the web application and a local application using a local comm server. The local comm server communicates with the local application over a named pipe that is dedicated to a specific web session and/or application.

Abstract: Memory sharing techniques are provided for offloading an application from a host processor to an integrated sensor hub (ISH). A methodology implementing the techniques according to an embodiment includes allocating a shared region of memory to be accessed by the host processor and by the ISH, in connection with the execution of a location application. The method also includes storing a location database in the shared region of memory. The location database is divided into segments, where each segment is associated with an area, for example, defined by a range of latitudes and longitudes. The method further includes transferring, through a direct memory access (DMA), one or more of the segments between the shared memory region and a second memory associated with the ISH. The method further includes executing at least a portion of the location application on the ISH, based on the data segments stored in the second memory.

Abstract: The current document is directed to a subsystem that is incorporated, in one implementation, within an automated application-release-management system. The subsystem to which the current document is directed determines, based on modifications to the source code for an application or another system that are submitted through a check-in process, a subset of tests within a large set of tests developed to test the application or system that invoke routines or other compilation units affected by the submitted source-code modifications. Only those tests that invoke routines and other compilation units affected by the source-code submissions need then be applied during testing and verification of the revised application or system.

Abstract: Techniques for deleting a snapshot of a data set archived in cloud/object storage are provided. In one set of embodiments, a computer system can identify data blocks that are part of the snapshot and are referred to by an incremental child snapshot of the snapshot. The computer system can further create a new metadata object that includes metadata entries for the identified data blocks, each metadata entry comprising an identifier of the incremental child snapshot, an identifier of a data block, and an identifier of a data object of the incremental child snapshot where the data block is stored. The computer system can then associate the new metadata object with the incremental child snapshot in the cloud/object storage.

Abstract: An application data tracking, auditing and collaboration system and method are provided. The system and method may be used to track and manage spreadsheets, or similar documents, at the internal or grid level and allow for unlimited linking, consolidation, referrals, and lookups, or integration of any number of spreadsheets across any number of users across any level of security and deployment scenarios.

Abstract: Systems and methods for aligning needs of virtual devices with hardware resources. The performance of virtual devices are tested using different groupings to determine mappings or relationships between the virtual devices and the physical devices from which they are drawn. Based on the results of the tests, spindle groups can be optimized.

Abstract: A system, method, and computer readable medium for maintaining mappings between resources inside an isolated environment and outside the isolated environment for one or more applications. The system may include a plurality of lists of resources requested by the one or more applications during installation and while executing, and a corresponding lists of resources inside the isolated environment. The system may also include a list of resource exceptions, wherein the mappings between resources as requested by the applications and their corresponding values in the isolated environment are maintained subject to the list of exceptions.

Abstract: A technique for managing data storage provides multiple physical computing machines and block storage arranged in a NAS (network attached storage) cluster. The physical computing machines run NAS servers, with each NAS server including an FSDB (file system database) that identifies a set of file systems that belong to the NAS server. LUNs (Logical UNits) in the block storage provide backing store for the set of file systems of each NAS server. The NAS cluster performs a NAS server cloning operation in which an existing source NAS server is cloned in its entirety to create a separate clone NAS server, the operation automatically cloning all the separate file systems of the source NAS server and related metadata without a need for user involvement on a per-filesystem basis.

Abstract: Embodiments of the present disclosure relate to methods and apparatuses for caching data. A method comprises writing data into a first cache module on a first processor in response to receiving a first request for caching the data from a client module running on the first processor. The method further comprises transmitting, to the client module, a first indication that the data has been written into the first cache module. The method further comprises, in response to receiving from the client module a second request for synchronizing the data to a second processor, transmitting to the second processor a first command for causing the data to be written into a second cache module on the second processor. In addition, the method further comprises transmitting to the client module a second indication that the data has been synchronized.

Abstract: Methods and apparatus are provided for simulating asynchronous modifications of shared data objects by a number of distributed processes within a distributed application. An exemplary method comprises obtaining a plurality of simulation parameters that define parameters of a simulated distributed application, parameters of a plurality of distributed compute nodes on which the simulated distributed application executes and a storage system employed by the simulated distributed application; and applying the plurality of simulation parameters to a simulation engine, wherein the simulation engine simulates both synchronous and asynchronous modifications of at least one shared data object by a plurality of distributed processes within the simulated distributed application.

Abstract: Techniques for obtaining and providing a portion of content include receiving a request for the portion of the content, requesting and receiving one or more data chunks, processing the one or more data chunks, and providing one or more data blocks as the requested portion of the content. The processing may include validating, decrypting, and/or decompressing the one or more data chunks to create the one or more data blocks. Techniques for providing metadata and one or more data chunks may include receiving content and dividing the content into data blocks. Processing may then be performed on the data blocks to create data chunks, and the metadata may be generated from the processing. The metadata and one or more of the data chunks may be provided to a device.

Abstract: Example apparatus and methods reserve space in a journal using an observation based approach instead of a fixed sized approach or a worst case scenario approach. One example method receives a request to allocate space in a journal to support a file system transaction. The example method reserves an amount of space in the journal based on a pre-existing reservation size estimate. Unlike conventional systems, the estimate is not based on a worst-case scenario. The example method observes the actual amount of storage used in the journal by the file system transaction and then selectively automatically adjusts the pre-existing reservation size estimate. The estimate may slowly shrink if no overflows are encountered but may quickly grow if an overflow is detected.

Abstract: Methods, systems, and articles of manufacture to generate file transfer monitoring criteria are disclosed. An example method obtains a file transfer log file from a first network entity and obtains from the transfer log file file transfer metadata that is associated with file transfer activity between the first network entity and a second network entity. The file transfer metadata is used to generate a file transfer monitoring criterion that is associated with selectively monitoring the file transfer activity between the first network entity and the second network entity. Service level criteria associated with the file transfer event is automatically updated based on the file transfer monitoring criterion.

Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. In order to monitor and debug the operation of the data replication group a chaining mechanism may be utilized during log creation by the set of nodes of the data replication group. The chaining mechanism may cause entries in the log to indicate an operation being performed and an operation performed immediately prior to the operation being performed. In various embodiments, an outside observer receives the logs and checks the logs for errors indicated by the chaining mechanism.

Abstract: Techniques for allocating memory on non-volatile storage mediums, rather than on RAM storage mediums, are provided. In some embodiments, first functions in program code for allocating memory on RAM storage are replaced with corresponding second functions for allocating memory on non-volatile storage. Library files corresponding to the second functions may be stored in programming language libraries, such that the second function may be defined in order to allocate memory on non-volatile storage. In some embodiments, a library file for allocating memory on RAM storage may be modified such that it instead causes allocation of memory on non-volatile storage. Allocating memory, storing data in memory, or retrieving data in memory may, in some embodiments, include providing instructions for a processor to communicate via a bus associated with non-volatile storage rather than a bus associated with RAM storage.

Abstract: In accordance with embodiments, there are provided techniques for managing functionality changes of an on-demand database system. The techniques facilitate implementing changes to the database system while minimizing work flow reductions to users of the database system. To that end, one embodiment of the present invention delays implementation of the changes to provide users of the system an opportunity to adjust behavioral interaction with the database. In accordance with another embodiment of the present invention, users may implement the functional changes to determine any adverse impact on work flow, before the functional changes become permanent. In another embodiment, the user may be afforded an opportunity to selectively enable and disable the functionality changes before the duration expires.

Abstract: One or more techniques and/or computing devices are provided for managing an arbitrary set of storage items using a granset. For example, a storage controller may host a plurality of storage items and/or logical unit numbers (LUNs). A subset of the storage items are grouped into a consistency group. A granset is created for tracking, managing, and/or providing access to the storage items within the consistency group. For example, the granset comprises application programming interfaces (APIs) and/or properties used to provide certain levels of access to the storage items (e.g., read access, write access, no access), redirect operations to access either data of an active file system or to a snapshot, fence certain operations (e.g., rename and delete operations), and/or other properties that apply to each storage item within the consistency group. Thus, the granset provides a persistent on-disk layout used to manage an arbitrary set of storage items.

Abstract: Cloud based identity management is provided by receiving a request from an application by a web gate for a resource, where the request includes an operation on a resource type out of a plurality of resource types and the request specifies a tenant out of a plurality of tenants. Embodiments access a microservice based on the request, resolve the resource type, and validate that the operation is supported by the resource type based on metadata. Embodiments get a data provider associated with the tenant, call the data provider to perform the operation, and then return the resource.

Abstract: Systems and methods of capturing application data locally on a source data management system and performing a high performance, bandwidth optimized replication the data from the source data management system to a remote data management system either (a) in parallel with copying data from an application to the source data management system, or (b) serially by replicating the data to the remote data management system after the data is copied to the source data management system, wherein the determination to operate in parallel or serially is based on at least one of a characteristic of the data and user specified tuning parameters.

Abstract: In a block-based backup system, a technique allows indexing changed files between backups so that files not changed are not re-indexed. Block identifiers specifying backed-up blocks are received. A file table record is accessed to determine a location of a file table zone. Records in the file table store last modified timestamps for files associated with the records. The file table zone location is compared with the block identifiers to select a subset of records. Each record in the subset is associated with a block from the file table zone that corresponds to a block identified by the block identifiers. The subset is parsed to extract timestamps. The timestamps are compared with a next-to-last backup date. If the associated file was modified after the next-to-last backup date, a determination is made that the file blocks were backed up in the last backup and the file should be indexed.

Abstract: Determining the bandwidth required for data replication for disaster recovery. Given a specified recovery point objective (RPO), bandwidth requisitioning and usage is determined according to meet the RPO based on observed factors.

Abstract: When a communication session is established, a primary sequenced application is sequenced into the communication session. At some point, the primary sequenced application fails. Before the communication session has been reestablished, an in-dialog message is received for the first communication session. In response to determining that the primary sequenced application has failed and receiving the in-dialog message for the first communication session, reestablishment of the first communication session is expedited to a backup sequenced application. The communication session is reestablished. This allows a communication session that was normally going to be dropped to stay established, thus providing higher reliability over current systems.

Abstract: The invention relates to a method for storing files in a data storage. The method comprises steps of providing the data storage with a plurality of data files all having the same predetermined size and a step of subsequently storing new data in the data storage by including the new data in a new data file having the predetermined size and overwriting an existing data file with the new data file.

Abstract: A method for determining document compatibility between documents stored locally on a plurality of user devices, while maintaining the confidentiality of each of the respective documents. The method includes requesting and receiving a token from each of the plurality of user devices, the token indicative of the presence or absence of a specific element in each respective document. The method further includes comparing the value of each of the respective tokens. When each of the tokens have a true value, the specific element for each respective document to be compatible and sends a message to each of the plurality of user devices indicating the compatibility of the respective documents. When at least one of the tokens has a false value, the specific element for each respective document to be incompatible and sends a message to each of the plurality of user devices indicating the incompatibility of the respective documents.

Abstract: A RAID system includes a storage enclosure comprising a plurality of independent data storage devices. A processor is associated with the storage enclosure. The processor is configured for processing data for the plurality of storage devices of the storage enclosure. The processor is configured to receive a request to read intermediate XOR data based on data stored in two or more of the plurality of storage devices of the storage enclosure. The processor is further configured to read data from each of the two or more storage devices in response to receiving the request. The processor is configured to determine intermediate XOR data based on the data read from the two or more storage devices of the storage enclosure. The intermediate XOR data may be provided to a RAID storage controller and may be used in an XOR-based recovery process.

Abstract: A certified checkpoint is provided for a ledger comprising a blockchain and a world state. The certified checkpoint enables a third party to recognize and verify that the ledger has integrity, a known starting state, and immutability properties starting at a specific point in time. Certification means that all of the validating peers reached consensus on the state of the ledger at that point in time. Thus, the certified checkpoint state represents an agreed-upon state, and that one or more subsequent operations on the ledger are relative to that agreed-upon state. Preferably, before a checkpoint is certified, it must be consistent, meaning that all validating peers have reached the same value for the checkpoint. Preferably, the checkpoint is a compression of the current blockchain world state into a compact representation (e.g., a hash) of the ledger that based on an agreed-upon consensus protocol is consistent across the (validating) peers. A technique to certify a blockchain checkpoint also is described.

Abstract: A computer device is provided that includes a display and a processor configured to execute an integrated development environment that includes code development tools, output for display on the display an editor window of the integrated development environment configured to present a code file and real-time mark-up of the code file, wherein the editor window includes a difference view mode that causes the editor window to emphasize a difference between the code file and a baseline code file. The processor is further configured to perform a function of one of the code development tools on the code file and present a result of the function in the editor window while in the difference view mode.

Abstract: Techniques are described herein for quick identification of a set of units of data for which recovery operations are to be performed to redo or undo changes made by the failed node. When a lock is requested by an instance, lock information for the lock request is replicated by another instance. If the instance fails, the other instance may use the replicated lock information to determine a set of data blocks for recovery operations. The set of data blocks is available in memory of a recovery instance when a given node fails, and does not have to be completely generated by scanning a redo log.

Abstract: Systems and methods are disclosed for replicating data across data storage devices of a logical volume. A data storage system may create a logical volume by grouping the multiple data storage devices together. The data storage devices may be external standalone data storage devices. The data storage system may also replicate data across the logical volume.

Abstract: The present teaching relates to managing a request in a data system of a plurality of nodes in a network. In one example, a request is received for a transaction of data by a first node in the data system. A second node in the data system is determined based on the request, where the second node is to carry out the transaction. The request is stored into a first request queue at the first node. The request is sent to the second node. A notice is obtained by the first node indicating that information associated with the transaction has been persistently stored. The request is removed from the first request queue in response to the notice being obtained.

Abstract: One or more techniques and/or systems are provided for performing host side deduplication. Host side deduplication may be performed upon writeable data within a write request received at a host computing device configured to access data stored by a storage server. The host side deduplication may be performed at the host computing device to determine whether the writeable data is already stored by the storage server based upon querying a host side cache comprising data stored by a storage server and/or a data structure comprising unique signatures of data stored by the storage server. If the writeable data is stored by the storage server, then a deduplication notification excluding the writeable data may be sent to the storage server, otherwise a write command comprising the writeable data may be sent. Accordingly, unnecessary network traffic of redundant data already stored by the storage server may be reduced.

Abstract: Presented herein are methods, non-transitory computer readable media, and devices for efficiently administering locks for shared resources, such as data blocks, stored on a storage system. Methods for stamping a plurality of computer data objects are disclosed which include: accessing at least one of the plurality of computer data objects by a first data thread; assigning, by the first data thread, a stamp to the at least one of the plurality of computer data objects, to signify the at least one of the plurality of computer data objects is associated with the first data thread; preventing subsequent access by a second data thread to the stamped at least one of the plurality of computer data objects; and determining the stamp is no longer active, upon an event, effectively releasing the at least one of the plurality of computer data objects.

Abstract: In certain systems disclosed herein, a distributed data monitoring and management system is provided that can replicate a distributed storage environment. The distributed data monitoring and management system can intelligently and automatically configure data access nodes to form a structure that matches the distributed storage environment. By matching the structure of the distributed storage environment, the distributed structure of the data may be maintained, enabling the data to be backed up from and/or restored to the distributed storage environment and/or migrated to another distributed storage environment without altering the distribution of the data. Further, embodiments herein enable the transfer of data from a non-distributed environment to a distributed storage environment. Thus, in some cases, an entity can migrate data from a local storage structure to a network-based distributed storage structure.

Abstract: To allow restoration of a backup target device more properly. An automatic backup device comprises: a history information acquisition unit that acquires history information containing a time of a change in setting on a backup target device and a content of the change associated with each other; a restoration request acquisition unit that acquires a restoration request containing a time intended for restoration of the backup target device; a restoration information generation unit that generates restoration information for restoring the backup target device based on the time contained in the restoration request by using the history information acquired by the history information acquisition unit; and a restoration information transmission unit that transmits the restoration information generated by the restoration information generation unit to the backup target device.

Abstract: A computer-implemented method, a computer-readable medium and a system are provided. A transaction master for each of a plurality of transactions of a database is provided. Each transaction master is configured to communicate with at least one transaction slave to manage execution of a transaction in the plurality of transactions. Each transaction master configured to perform generating a transaction token to specify data to be visible for a transaction on the database, the transaction token including a transaction identifier for identifying whether the transaction is a committed transaction or an uncommitted transaction, receiving a request to commit the transaction, initiating, based on the request, a two-phase commit operation to commit the transaction.

Abstract: Methods that copy data from mirrored storage to auxiliary storage arrays co-located with primary storage arrays are provided. One method includes requesting a subset of the data from a backup system mirroring the set of data at a remote location in response to detecting an error in a storage device of an array of primary storage devices storing a set of data. The method further includes receiving the subset of the data from the backup system and storing the subset of the data in an array of auxiliary storage devices co-located with the array of primary storage devices in which the subset of the data can correspond to data stored on the storage device. Systems and computer program products for performing the above method are also provided.

Abstract: A method, system and computer product for performing storage maintenance is described. A training set for storage volume reclamation is received. The training set includes a set of storage parameters, each set of storage parameters corresponds to a respective candidate storage volume of a set of candidate storage volumes. The training set also includes a set of user decisions made whether a respective candidate storage volume is reclaimable. The training set is used to train a machine learning system to recognize common features of reclaimable candidate storage volumes. A set of candidate storage volumes is provided for potential reclamation, each with a set of storage parameters. A graphical user interface presents respective members of the set of candidate storage volumes for reclamation if a confidence level is calculated that the respective candidate storage volume is reclaimable exceeds a threshold.

Abstract: A technique for managing host data in a data storage apparatus having a storage processor (SP) provides virtualized storage processors (VSPs) as substantially self-describing and independent entities. Each VSP has its own namespace, independent of the namespace of any other VSP. Each VSP also has its own network address. Hosts may thus access VSPs directly, without having to include path information relative to the SP on which the VSP is operated. VSPs can thus be moved from one physical SP to another with little or no disruption to hosts, which may continue to access the VSPs on the new SPs using the same paths as were used when the VSPs were running on the original SPs.

Abstract: Embodiments of the disclosure provide a method, apparatus, and system for identifying data tables. The method comprises acquiring a first dependency relationship between a plurality of data tables; collecting statistics on a path length and a path number of the data tables based on the first dependency relationship; acquiring a second dependency relationship between one or more fields in the data tables; determining importance coefficients of the one or more fields based on the second dependency relationship; determining a degree of association between the data tables by using the path length, the path number, and the importance coefficients; and identifying the data tables based on the degree of association.

Abstract: Comparing recurring processes. A method includes automatically identifying a plurality of recurring process instances having one or more commonalities. The method further includes displaying the plurality of recurring process instances having one or more commonalities to a user in a user interface. The method further includes receiving user input at the user interface selecting a first recurring process instance from the plurality of recurring process instances. The method further includes receiving user input at the user interface selecting a second recurring process instance from the plurality of recurring process instances. The method further includes automatically identifying differences in the first and second recurring process instances. The method further includes presenting the differences in the graphical user interface to the user.

Abstract: Improved restore services in data storage environments are provided. In one example, a method includes the following steps. Generation of a point-in-time copy of a set of files associated with a data storage system is requested. The point-in-time copy is useable for restoring data blocks of the set of files onto the data storage system. The point-in-time copy of the set of files is generated at a data protection system operatively coupled to the data storage system in response to the requesting step. The point-in-time copy of the set of files is stored at the data protection system.

Abstract: A system and method for enhancing operability of client-server computing system is herein disclosed. A system includes a first computing device. The first computing device includes a file type association module. The file type association module determines, as part of a remote computing session, whether to associate a file type with an application program on the first computing device or an application program on a second computing device. The file type association module causes the file type to associate with the application program on one of the first and second computing devices.

Abstract: System and method for supporting a user-level file system transaction use cloned files of original existing files specified in the user-level file system transaction to perform file system operations on at least one of the original existing files using the cloned files, which include metadata of the original existing files. After at least one of the cloned files have been modified, a batch rename operation is executed to atomically commit every modified cloned file of the user-level file system transaction.

Abstract: A mechanism is provided for backing up metadata in a data storage system. Given metadata stored on the data storage system is implemented by way of a tree structure operable by fixed mapping. A stream of snapshots is taken of leaves in the metadata tree structure of given metadata stored on persistent data storage. The metadata tree structure of the given metadata stored on the persistent data storage is reconstructed on a basis of the stream of snapshots taken for backing up the given metadata stored on the persistent data storage. A journal over the reconstructed metadata tree structure is then replayed. In response to a given status discrepancy being flagged in respect of any given metadata, the status of a given leaf corresponding thereto in the reconstructed data tree structure is modified for consistency with the corresponding journal entry in the journal for that given metadata.

Abstract: Storage system accelerated techniques to distribute and run containerized applications are disclosed. In various embodiments, an indication to run a container is received. A snapshot identifier comprising an image data associated with the container is used to create a clone based on a snapshot with which the snapshot identifier is associated. The clone is used to store data associated with at least a topmost layer of the container.