Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. The computing devices may push a point in time to a backend for a distributed storage system.

Abstract: A protocol for implementing ACID transactions that provides snapshot isolation in a distributed setting that does not require synchronized clocks is described. The protocol ensures at commit time that transactions touching common objects do not commit out of order. The protocol can be used in the context of a distributed data lake built on an object store in which clients can transactionally add or remove objects from logical tables.

Abstract: Embodiments include systems and methods for performing data migration using database consolidation. Information and parameters about a plurality of source databases from a source system can be stored, the parameters including a location, a security zone, and processor information for the source databases. Each of the plurality of source databases can be classified to one of a plurality of predetermined database sizes based on the stored information and parameters, wherein the classifying is at least based on the processor information. The classified source databases can be mapped to target database hardware based on the classified sizes and the stored parameters, wherein the target database hardware is segmented into containers that are defined by one or more of the parameters. Data from the source databases can be migrated to the target database hardware based on the mappings.

Abstract: A document management system manages documents. The documents are managed such that the documents may be shared with multiple users during an online sharing session. During the online sharing session of a document, the document may be annotated. The appearance and location of the annotation is consistent across the difference devices of the users even though the devices are of different device types.

Abstract: The present disclosure relates to a digital asset synchronization system that provides improved local and remote synchronization of digital assets. In particular, the digital asset synchronization system manages digital assets by separating each digital asset into multiple components stored as a set of distributed individual files. Employing individual components for a digital asset rather than single monolithic file enables the digital asset synchronization system to provide safe concurrent access to the digital asset from multiple applications on the same device and across different devices. In addition, using components for a digital asset provides the digital asset synchronization system with the ability to efficiently store and synchronize multiple versions of the digital asset, both locally and remotely.

Abstract: In some embodiments, a method may be performed by a computing device that involves displaying an identifier indicative of a file, the display of the identifier being readable by a second device, receiving first data from the second device in response to the identifier being read by the second device, and enabling performance of at least one action with respect to the file with use of the first data. In some embodiments, the method may further involve receiving a first encryption fragment associated with the file, receiving, from the second device, a second encryption fragment associated with the file, reconstructing, using at least the first encryption fragment and the second encryption fragment, an encryption key enabling viewing of the file, and viewing the file using the encryption key.

Abstract: The disclosed technology relates to a system configured to receive operations data from a content management system, wherein the operations data comprises a log of operations, execute the log of operations, and update, based on execution of the log of operations, a remote tree representing a server state for content items stored on the content management system.

Abstract: Apparatus, system and method for promoting media apps to an end user of a smart device. The smart device gathers information of apps that have been installed into the smart device and provides this information to a remote server. The remote server compares the information sent by the smart device to an identification of promoted apps received from a remote source to identify apps that are not installed in the smart device that are included in the identification of promoted apps. The remote server then notifies the smart device of which apps in the identification of promoted apps are not installed into the smart device, so that a user of the smart device may choose to have the missing app installed.

Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.

Abstract: Systems, apparatus, methods and computer program products for deleting data of an object within a multi-tenant database via an efficient delete operation are described herein. The new delete operation (or method) may be configured to identify one or more records to be deleted within a data structure such as an object. In order to ensure that the operation is efficient, the mechanism may determine characteristics of a data store and determine whether the information provided within the data structure provides an efficient identification of the data to be deleted. Upon a successful validation, an initial delete request may be translated to an appropriate delete operation for the underlying database.

Abstract: Disclosed embodiments include a method (system and non-transitory computer-readable medium) for backing up updated portions of a plurality files having hierarchical relationships through object storage. In one or more embodiments, a file is segregated into chunks, and objects corresponding to the chunks are generated for storage at an object storage. For a chunk, an object for storing the chunk and additional objects for storing mapping information are generated. The mapping information may include path information identifying a path of the file in a hierarchical structure, a file version list identifying a version of the file, a chunk list describing an association between the file and the chunks, a chunk version list identifying a version of the chunk, etc. When a portion of the file is updated, objects corresponding to the updated portion of the file can be generated, and stored at the object storage.

Abstract: Systems and methods of network telemetry caching and distribution are provided. The system can receive network telemetry data and store it as a plurality of data nodes. The system can maintain a node pointer map and a node pointer queue. If the system receives an update to a data node having a corresponding node pointer not already present in the node pointer map, the system can add the node pointer to the node pointer queue and to the node pointer map with a count of zero. If the node pointer is already present in the node pointer map, the system can increment the node count for the node pointer in the node pointer map and not add the node pointer to the node pointer queue. The system can transmit data values and node counts to the client device for each node pointer in the node pointer queue.

Abstract: According to some aspects, a database system comprising a processor configured to execute a plurality of system components is provided. The plurality of system components may include an interface component configured to receive a write commit command and provide a write commit confirmation, a snapshot component configured to generate a plurality of snapshots of data stored in a data storage node of a plurality of data storage nodes and identify a committed snapshot representative of data that has been replicated on a majority of the plurality of data storage nodes, and a command processing component configured to modify a data element based on the write commit command, determine whether the majority of the plurality of storage nodes have replicated the modification using the committed snapshot, and generate the write commit confirmation responsive to a determination that the majority of the plurality of data storage nodes have replicated the modification.

Abstract: System and methods are provided for rapid provisioning of data management services. A user creates a data management service through a user interface. The creation of the data management services is initiated by the user without any programming by the user in a scalable, rapidly provisioned environment. The data management service natively supports the CRUD model (create, read, update, and delete) for data entities, metadata, references, as well as other features, such as search capabilities and/or data lineage. Once the data management service has been provisioned, the service scales as usage of the service increases. The data management service is an abstraction layer and the organization that created the service can remain unaware of the underlying implementation details of the service.

Abstract: Techniques of transaction support for a database are disclosed herein. One example technique includes generating a new version value for key-value pairs in the database and creating, in the database, a new key-value pair corresponding to a parameter to be updated with a new value using both the generated new version value and a name of the parameter as a key and the new value as the corresponding value for the created new key-value pair. The example technique can then include determining whether creating the new key-value pair is completed successfully in the database, and in response to determining that creating the new key-value pair corresponding to the parameter is not completed successfully, the existing value of the parameter is returned as a current value of the parameter instead of the new value in response to a query for the current value of the parameter.

Abstract: Cloning storage systems in a cloud computing environment, including: receiving a request to create a cloud-based storage system; retrieving, from cloud-based object storage, one or more objects to include in the cloud-based storage system; and creating the cloud-based storage system, including storing, in block storage of the cloud-based storage system, data contained in the one or more objects retrieved from the cloud-based object storage.

Abstract: A computer-implemented method, a computer program product, and a computer system for detecting an inappropriate data type of a column in a database and building a physical access path over a correct data type. The computer system detects in a table a candidate column with a first data type that has a mismatching type definition, using database usage statistics. The computer system determines whether it is possible to build an additional index as an access path over values with a second data type. The computer system, in response to determining that it is possible to build the additional index, converts values in the candidate column to the values with the second data type. The computer system builds the additional index over the values with the second data type in the table. The computer system generates a query plan operator for the additional index.

Abstract: Bugs in container images can be rapidly identified. For example, a computing device can receive first metadata about a first container image that includes a first version of a piece of software and second metadata about a second container image that includes a second version of the piece of software. The computing device can obtain first source code from a first location indicated in the first metadata and second source code from a second location indicated in the second metadata. The computing device can determine a difference between the first container image and the second container image by comparing the first source code to the second source code. The computing device can generate an output for display indicating the difference between the first container image and the second container image.

Abstract: According to a computer-implemented method, an update package that includes update operational files is received at a computing device. At least one update operational file is to replace a corresponding original operational file for the computing device. It is determined which of the original operational files are to be replaced with corresponding update operational files. A delta file is stored at the computing device, which delta file indicates the original operational files that are replaced with corresponding update operational files and the update package is installed at the computing device.

Abstract: Described is a system that provides deduplication management at a virtualization layer allowing virtual machines to store deduplicated data amongst various back-end data storage architectures. For example, the system may be storage-agnostic by operating at a hypervisor layer to fully leverage the benefits provided by virtualization. Accordingly, implementing deduplication by a hypervisor results in “pluggable” software-defined storage management. In addition, such a system may be implemented on any on-demand infrastructure (e.g. Infrastructure as a Service (IaaS)) environment that includes varying types of back-end storage solutions including solutions from various vendors. In addition, by operating within the virtualized layer of an on-demand computing resource environment (e.g. cloud environment), the system may provide deduplication across different resource clusters (e.g. hypervisor clusters) and environments.

Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.

Abstract: Techniques are described that are performed by one or more database management system (DBMS) of the plurality of DBMS nodes comprising one or more database servers performing database operations on one or more databases of the DBMS nodes. The techniques describe receiving, at a QC node, a distributed query that specifying a database of a target DBMS node. Without requesting from the target DBMS node a current logical timestamp of the DBMS node, calculating a synchronization timestamp for the distributed query. In one embodiment, the calculation of the synchronization timestamp for the distributed query is based on a current logical timestamp of the QC node and one or more previous logical timestamps of the target DBMS node that were received prior to the receiving the distributed query. The QC node sends a request to the target DBMS node to execute an operation of the query at the target DBMS node based on the synchronization timestamp.

Abstract: Various embodiments provide for a pre-validation of various aspects of an application deployment before any resources are provisioned in a user account. Pre-validation can perform checks on aspects such as connectivity and credential-based access for instances to be provisioned in a user account. A determination can also be made as to whether a role exists in the user account that has the appropriate policies and permissions to enable these instances, if provisioned, to have access to external services and resources needed to support the application. These checks can be performed through a launch wizard or deployment service that can collect information though a single console, and can ensure that these checks succeed before the requested instances are provisioned in the user account.

Abstract: Systems and methods are disclosed herein for modifying suggestion metadata in an electronic document. A copy request is received to copy a portion of the electronic document. The portion of the electronic document includes a first suggestion having metadata that indicates the suggestion was made by a first user. The copy request is received from a second user. A paste request to paste the copied portion is received from the second user. The metadata of the suggestion is modified based on the paste request to obtain modified metadata.

Abstract: A method for sharing documents between on-demand services is provided. In an embodiment, a user of a first on-demand service may be able to view a list of content that includes content stored at the first on-demand service and content stored at a second on-demand service. The content of the second on-demand service may be associated with information about the content, allowing the content to be shared among multiple users of the first on-demand service. The user wanting to view the content, select or click on an indicator identifying the content, a connection to the second on-demand service is established, and images of the content are sent from the second on-demand service to the first on-demand service.

Abstract: Embodiments include pre-processing work items to be processed by computerized processing elements. Aspects include accessing a performance index, which relates to (dynamic) processing performances of work items as processed by the computerized processing elements. Aspects also include determining a time interval (during which the receiver may group queued work items into a block, according to the accessed performance index. Aspects further includes setting a timer to the determined time interval, to allow the receiver to group work items being queued until that time interval has elapsed, according to the timer set. As a result, a block of grouped work items will be obtained, which can then be passed to a scheduler for subsequent processing by computerized processing elements.

Abstract: Systems and methods are described for load balancing requests in a distributed system using consistent hashing. Specifically, systems and methods are described for using “the power of k choices” when placing new servers on a consistent hash ring used to load balance requests. Rather than placing each new server at a fixed point determined by a hashing algorithm, a load balancer can identify multiple potential points on the hash ring for the new server. The load balancer can then compare these points to determine a preferred location, and place the server at the preferred location. Techniques described herein can substantially improve placement of servers, which in turn results in better load balancing.

Abstract: A System, Computer Program Product, and Computer-executable method for managing an object based storage within a cloud storage provider, the System, Computer Program Product, and Computer-executable method including receiving a data I/O, determining whether the data I/O relates to an existing object within the object based storage, if the data I/O relates to an existing object, updating a stream and existing data object in the object based storage, and creating a new data object and key based on the data I/O and updating the object based storage.

Abstract: In a method for deleting a cascaded snapshot, a storage device includes a logical volume corresponding to a plurality of cascaded snapshots. The plurality of cascaded snapshots comprises at least a first snapshot, a second snapshot, and a third snapshot. The second snapshot is a parent snapshot of the first snapshot, the third snapshot being a child snapshot of the first snapshot. The storage device receives an instruction for deleting the first snapshot. The first snapshot comprises target data. The storage device migrates information of the target data to the second snapshot. Further, the storage device sets a parent snapshot identifier corresponding to the third snapshot to an identifier of the second snapshot, and deletes the first snapshot.

Abstract: The disclosed techniques enable browsing of data items that are stored in a backup storage system in a backup format. A search query from a user is received where the search query is for a data item stored in a data storage system, such as a tape drive, a disk array, or a cloud-based storage system. The system may use an index to look up a data format of the data item. To present the data to the user, the system may perform a restoration operation using two or more staging operations to convert the data format to a format that can be presented to the user.

Abstract: Techniques described herein enhance the durability of cryptographically protected communications sessions. The negotiation of a cryptographically protected communications session results in the negotiation of a primary secret and a secondary secret. The primary secret and secondary secret are stored in separate locations, such as in two locations in RAM, one of which being used as a RAM disk. The primary secret is used to cryptographically protect the communications session. Following the detection of a change of state event, the cryptographically protected communications session switches to the secondary secret in place of the primary secret to cryptographically protect the communications session.

Abstract: A system for discovering and monitoring data movement across the file system on a specific device or across the network, which enables to detect data leakage and locate specific data across the organization. The system tracks files by having devices maintain a record of hash values associated with a file in a tables of hash values. The memory used to maintain the records of each file can be distributed to each device carrying the files. The system can analyze the data leak of a file by receiving a hash value of a file and requesting devices to search and respond with information about files that have the same hash value. Furthermore, based on the table of hash values for all the files, the system can recreate the origination of each file and the number of different versions that exist of the file.

Abstract: A current screen is presented on a display of a user device, which includes an element distinct from a previous element of a previous screen, where the previous element occupied less than an entirety of the previous screen. The user device receives a gesture input that requests that the previous element be presented within the current screen next to a current element of the current screen. The gesture input indicates a location of the current element, wherein the location of the current element is less than an entirety of the current screen and is the same location at which the previous element was presented on the previous screen. The user device presents, on the display of the user device and responsive to receiving the gesture input, a contemporaneous view of the previous element next to the current element at the location of the current element within the current screen.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable storage media for migrating content items from a source user account to a target user account. A user can specify content items in the source user account to be migrated to an existing or new target user account. A new content entry including an account identifier of the target account and a pointer to the content item can be created for each migrated content item. Further, a determination can be made as to whether a sharing link to each content item exists, and if so, the content pointer of the old content entry is modified to forward or redirect to the new content entry. An active flag associated with the old content entry can be set to false or 0 to indicate that the old content entry is no longer active.

Abstract: A server in a blockchain distribution network includes a processor and a transceiver operatively coupled to the processor. The transceiver is configured to receive a transaction from a peer node. The processor is configured to assign a transaction identifier to the transaction. The transceiver is configured to propagate the transaction identifier to one or more additional peer nodes and one or more additional servers in the blockchain distribution network. The transceiver is configured to receive bytes of a blockchain that represents a plurality of transactions. The blockchain includes the transaction identifier corresponding to the transaction. The transceiver is further configured to propagate the bytes of the blockchain to the one or more additional peer nodes and to the one or more additional servers in the blockchain distribution network.

Abstract: Disclosed is a method, apparatus, and system for a method for implementing a mutual-exclusion semantic for target update, the method comprising: receiving a tagset update request for a tagset associated with an object, the tagset update request comprising one or more metadata tags to be updated; determining whether updating the tagset based on the received tagset update request would cause a value of any existing metadata tag in the tagset to change; and in response to determining that updating the tagset based on the received tagset update request would cause a value of at least one existing metadata tag in the tagset to change, rejecting the tagset update request.

Abstract: Methods, systems, and computer program products are described herein for updating big data tables using snapshot isolation. The tables may store data (e.g., as data objects) collected from different users. The tables are stored in a first data store. The data's metadata is stored in a second data store. The metadata comprises version numbers for the objects that correspond to a consistent version thereof. When an update process for the table is initiated, a coordinator locks the metadata, and. the objects are updated. If the update to the objects is successful, the coordinator commits the updates and obtains the new version numbers of the objects. If all the commits are successful, the coordinator atomically updates the metadata with the new version numbers and releases the lock. However, if a commit to an object is unsuccessful, a subsequent process rolls back the committed objects to the version numbers specified by the metadata.

Abstract: Materialized views are maintained for time-series databases, to enable faster analytics over large data sets and to downsample data for storage savings. These materialized views are the result of computations on existing tables, such as aggregation, approximation, sampling, filtering, statistical estimates, and more. A materialized view is created on a base table, and continuously maintained, such that as changes are made to the base table, the materialized view is correspondingly updated, either synchronously or asynchronously. The database system records metadata identifying regions of the base table that have already been materialized. Subsequently, these invalidated regions are rematerialized. Queries ensure up-to-date results by combining data from the materialized view with results calculated at query time on the base table. Invalidation records and completion thresholds are used to determine which results should use records from the materialized table and which from records from the base table.

Abstract: The present technology provides an interface and system for generating a previous version of a directory structure that can be useful in the restoration of a directory or file. The system, methods and non-transitory computer-readable storage media include receiving a request for a previous version of a directory structure at an indicated date, querying a content management system for placeholder content items associated with the previous version of the directory structure at the indicated date, receiving the placeholder content items, and generating a read-only copy of at least a portion of the previous version of the directory structure at the indicated date based on the placeholder content items, wherein the read-only copy of the directory structure is separate from the directory structure at a current date.

Abstract: A method includes receiving a translation request including an application-independent function name and one or more parameters from a user device. The method further includes retrieving a translation record, the translation record including the application-independent function name of the translation request, one or more access mechanism templates, and template rules for generating a completed access mechanism based on the access mechanism templates. Additionally, the method includes generating one or more completed access mechanism based on the one or more parameter values, the access mechanism templates, and the template rules, generating translation results based on the completed access mechanisms, and transmitting the translation results to the user device. The translation results are configured to be displayed as user-selectable links.

Abstract: Embodiments are direct to managing file systems. Alternate data streams (ADSs) of an object in a file system may be modified based on a request from a client and metrics associated with the ADSs may be modified. Values for reconcile fields associated with the object may be set based on the modified metrics such that the object with the modified ADSs may be included in a reconcile list. And, such that an acknowledgment of the request may be provided to the client. A reconcile engine may determine a parent object of the object. The object may be reconciled and the parent object may be placed on the reconcile list for reconciling in turn.

Abstract: Cloning storage systems in a cloud computing environment, including: receiving a request to create a cloud-based storage system; retrieving, from cloud-based object storage, one or more objects to include in the cloud-based storage system; and creating the cloud-based storage system, including storing, in block storage of the cloud-based storage system, data contained in the one or more objects retrieved from the cloud-based object storage.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for linearizing the commit history of a code base. One of the methods includes receiving a request to attribute source code contributions to a particular snapshot in a project having a revision graph with multiple branches. Source code contributions occurring in each non-merge commit on a single path through the revision graph are attributed to a responsible developer entity of the non-merge commit. Each merge commit is processed on the single path including identifying contributions introduced by the merge commit, identifying one or more respective responsible developer entities for the contributions occurring in the one or more feature branch snapshots from one or more feature branches, and attributing source code contributions occurring in the one or more feature branch snapshots from the one or more feature branches to the identified one or more respective responsible developer entities.

Abstract: A computing resource monitoring service receives a request to obtain data for various computing resources. The service obtains, from the various computing resources, one or more data log streams that include the requested data. The service utilizes the one or more data log streams to generate a probabilistic data structure that can be used to indicate that data log streams have been processed. If the one or more data log streams are not completely processed prior to the end of an allotted time period for processing of the request, the service generates a token that specifies partially processed data log streams and the probabilistic data structure. The token can be used to enable resumption of processing of the request.

Abstract: An information handling system includes a persistent storage and a memory controller. The persistent storage includes a volatile memory and a non-volatile memory. The memory controller stores data and metadata for a data file within the volatile memory, and the data file is synchronized within other information handling systems of a storage cluster. The memory controller updates the metadata in response to a change in the data of the data file, stores the data and the metadata for the data file within the non-volatile memory prior to a power loss of the information handling system, and synchronizes the data and the metadata of the data file with current data and current metadata for the data file found in the other information handling systems in response to the information handling system being back online. The data is synchronized with the current metadata based on a transform for the data file being received from the other information handling systems.

Abstract: A recovery site is configured to process a task using a copy of an original file associated with the task. The original file is stored on a production site, and a copy of the original file is stored on a recovery site. The task is determined to be suitable for processing on the recovery site. The original file is determined to match the copy of the original file based on a modification time associated with the original file being earlier than a copy time associated with the copy of the original file. The task is processed on the recovery site using the copy of the original file, and at least one result file is output.

Abstract: The present disclosure provides an advantageous systems and related methods for scalable object storage. In accordance with an embodiment of the invention, a stream session is opened to initiate a retention epoch during which a series of edits to an object by a source may be performed without seeing edits from other stream sessions. Backreferences identifying the stream session (i.e. stream session backreferences) are applied to retained chunks. While a payload chunk has one or more such associated stream session backreferences, the chunk is retained and not expunged. Advantageously, transitory chunks that are put during the retention epoch may be unput promptly so as to release valuable cache resources. In comparison, the prior approach only eventually releases the data storage resources for expunged version manifests. Other embodiments, aspects and features are also disclosed.

Abstract: A system, computer program product, and computer-executable method of scheduling replication on a data storage system, the system, the computer program product, and computer-executable method including receiving a request to replicate a portion of data stored on the data storage system, dividing the portion of data into a plurality of portions, scheduling replication of each of the plurality of portions, and replicating each of the plurality of portions.

Abstract: Disclosed embodiments include a method (system and non-transitory computer-readable medium) for backing up updated portions of a plurality files having hierarchical relationships through object storage. In one or more embodiments, a file is segregated into chunks, and objects corresponding to the chunks are generated for storage at an object storage. For a chunk, an object for storing the chunk and additional objects for storing mapping information are generated. The mapping information may include path information identifying a path of the file in a hierarchical structure, a file version list identifying a version of the file, a chunk list describing an association between the file and the chunks, a chunk version list identifying a version of the chunk, etc. When a portion of the file is updated, objects corresponding to the updated portion of the file can be generated, and stored at the object storage.

Abstract: Techniques for maintaining versioning of data objects as a result of policy-based changes to the data objects are described herein. Metadata associated with a data object is updated as a result of an operation that is specified in a data policy associated with the data object. The metadata associated with the data object is updated based on a version key that is associated with the data object that is an identifier that identifies the data storage object in a plurality of data storage classes.