Abstract: This multi-user processor system for processing information, of the type including a data exchange engine (3) associated with multiple users (1) of shared resources (2), is characterized in that it includes means (4) for controlling data exchange in the processor, associated with each user, the exchange engine and the shared resources, in order to authorize transactions or not and in that the engine includes means (5) for breaking down authorized transactions into elementary sub-transactions, means (6) for interlacing the sub-transactions obtained from the breaking down of the authorized transactions of several users and the means (6) for distributing these interlaced sub-transactions among the different resources.

Abstract: A method includes flushing a write transaction based on byte-ranges within a file system block. It is determined if the write transaction is a first write transaction to the file system block and whether to flush the received write transaction to a recovery log. If it is determined to flush the write transaction to the recovery log and the received write transaction is the first write transaction: the data associated with the write transaction is appended in the recovery log and byte-ranges remaining in the file system block are recorded, and also recording an associated particular bit value or particular bit pattern that the remaining byte-ranges must be set to before the remaining byte-ranges are accessed or when a recovery sequence for recovering data in the recovery log executes due to failure. The write transaction is replicated. The entire file system block byte-range is marked as committed.

Abstract: Various techniques deduplicate common virtual disks during backups of virtual machines. For example, one method involves receiving a request to perform a backup operation to backup one or more virtual machine and then performing the backup operation in response to receiving the request. Performing the backup operation involves detecting whether a virtual disk associated with a virtual machine is already identified in a backup catalog for the backup operation, based upon a globally unique identifier associated with the virtual disk, and selecting to create a reference to a backup copy of the virtual disk instead of creating another copy of the virtual disk, if the backup catalog already identifies the virtual disk. Performing the backup operation can also involve accessing information identifying a hierarchy of virtual disks.

Abstract: A database operation is initiated in an in-memory database that stores persistent data in a secondary storage and has at least one associated log. The database operation involves data having a size above a pre-defined threshold. Thereafter, the data is split into a plurality of chunks and the database operation is executed by parallelizing each chunk over a plurality of hierarchically arranged threads. Related systems, apparatus, methods and computer program products are also described.

Abstract: An M2M platform apparatus 100 includes: data repositories 230, 240 configured to store data transmitted from M2M devices 20A, 20B; a data format processing unit 210 configured to determine in which format to store the data into the data repositories; a data analysis proposal unit 220 configured to analyze the stored data and, based on the data, propose the content of a service to be executed; a service execution-start unit 360 configured to request control on the M2M devices or communication equipment based on the content of the service proposed; and a rule-policy management unit 320 configured to cause the data to be stored into the data repositories based on a rule or a policy for the handling of the data to be stored into the data repositories.

Abstract: Methods, systems, and computer program products are included for deduplicating one or more memory pages. A method of deduplicating one or more memory pages includes receiving, by a hypervisor, a label from a guest running on a virtual machine. The label corresponds to a list of guest memory pages including a first guest memory page allocated to the guest. The method also includes scanning, by the hypervisor, a hypervisor memory for a second memory page that is a duplicate of the first guest memory page and corresponds to the same label as the first guest memory page. The method further includes in response to a determination that the second memory page is stored in the hypervisor memory, deduplicating the first and second memory pages.

Abstract: Systems and methods are disclosed for associating an entity with a risk score that may indicate a security threat associated with the entity's activity. An exemplary method may involve monitoring the activity of a subset of the set of entities (e.g., entities included in a watch list) by executing a search query against events indicating the activity of the subset of entities. The events may be associated with timestamps and may include machine data. Executing the search query may produce search results that pertain to activity of a particular entity from the subset. The search results may be evaluated based on a triggering condition corresponding to the statistical baseline. When the triggering condition is met, a risk score for the particular entity may be updated. The updated risk score may be displayed to a user via a graphical user interface (GUI).

Abstract: Log based replication using parallel scanners is described. An example method includes establishing replication paths from a primary database to a plurality of destination servers. A plurality of scanner threads are spawned to scan a transaction log of the primary database. Specifically, one scanner thread is assigned to each replication path corresponding to each destination server. For each scanner thread, data bound to a replication path associated with the scanner thread is selected from a subset of the transaction log. Accordingly, the data is distributed to a destination server associated with the replication path.

Abstract: An application may store data to a dataset comprising a plurality of volumes stored on a plurality of storage systems. The application may request a dataset image of the dataset, the dataset image comprising a volume image of each volume of the dataset. A dataset image manager operates with a plurality of volume image managers in parallel to produce the dataset image, each volume image manager executing on a storage system. The plurality of volume image managers respond by performing requested operations and sending responses to the dataset image manager in parallel. Each volume image manager on a storage system may manage and produce a volume image for each volume of the dataset stored to the storage system. If a volume image for any volume of the dataset fails, or a timeout period expires, a cleanup procedure is performed to delete any successful volume images.

Abstract: Log records are accessed as part of a database operation in a database. The log records log insert, update, and delete operations in the database and include, for each row, a row position, a fragment identifier (ID), and a row ID. Thereafter, as part of the database operation, rows specified by the log records are located by: using the fragment identifier and the row position within the corresponding record of the log if the fragment with the corresponding fragment identifier is still available, otherwise, using the row identifier within the corresponding record of the log to look up the row position in an index of a corresponding row identifier column. The database operation is then finalized using the located rows. Related apparatus, systems, techniques and articles are also described.

Abstract: An application may store data to a dataset comprising a plurality of volumes stored on a plurality of storage systems. The application may request a dataset image of the dataset, the dataset image comprising a volume image of each volume of the dataset. A dataset image manager operates with a plurality of volume image managers in parallel to produce the dataset image, each volume image manager executing on a storage system. The plurality of volume image managers respond by performing requested operations and sending responses to the dataset image manager in parallel. Each volume image manager on a storage system may manage and produce a volume image for each volume of the dataset stored to the storage system. If a volume image for any volume of the dataset fails, or a timeout period expires, a cleanup procedure is performed to delete any successful volume images.

Abstract: A method and system for data recovery in a parallel database system in which data stored in the database has been corrupted by a transaction or operation. Transaction log files corresponding to each node of the parallel database are scanned to determine an operation that caused the corruption of the stored data. Information corresponding to the corrupted data before the operation causing the corruption is then generated based on the scanned transaction log. The operation responsible for corrupting the data is then rolled back, and the corrupted data is replaced with the original data stored in the database prior to the corruption.

Abstract: Techniques are provided for eager replication of uncommitted transactions. A first plurality of change records is received, corresponding to database changes applied to a source database in a first transaction. First transaction dependency data is computed based on the first transaction. At least a portion of the first plurality of change records is applied to the target database before processing a commit record indicating that has been committed on the source database. Target dependency data is updated after processing the first commit record to reflect completion of the first transaction, the target dependency data including dependency data for a plurality of transactions applied or scheduled to be applied on a target database.

Abstract: Embodiments of methods for asynchronous image repository functionality are presented. In an embodiment, a method includes storing user data in a data storage device that is local to a user interface device, storing a copy of the user data to a storage location that is remote from the user interface device, performing a service for a user of the user interface device using the copy of the user data stored to the storage location, and communicating information associated with the service back to the user interface device. Additionally, the data image may be directly scanned for malicious software. In a further embodiment, the method may include providing a software inventory associated with the user data, such as software, stored in the image.

Abstract: Provided are methods and computer program products for analyzing and tracing the contents of network traffic in a network device and to help identify network performance issues. Methods for analyzing traffic include identifying thread identifiers associated with transactions, determining related events, and associating similar transactions and events into an aggregated list of transactions. Methods of tracing transactions include identifying thread identifiers associated with transactions and related events and serializing events into a serialized list of events to facilitate tracing single transactions.

Abstract: The present invention relates to object storage systems that support hierarchical directories within a namespace manifest stored as an object. The namespace manifest is stored as namespace manifest shards that are determined based on a partial key derived from the full name of the referenced version manifest in each directory entry. Each storage server maintains a local transaction log that keeps track of changes to the namespace manifest in response to put transactions. The namespace manifest can be updated after each put transaction is acknowledged, which minimizes the number of write operations required for a put transaction. Updates to the namespace manifest are batched, distributed, and processed concurrently and in parallel by the storage servers that store the corresponding shards. This reduces the latency that would otherwise exist in the object storage cluster as a result of a put transaction. Updates to namespace manifest shards optionally occur in a batch process using MapReduce techniques.

Abstract: A data repository configured for storing original content and modified content which are addressable for point-in-time retrieval thereof. The data repository comprising one or more digital files which are associated with the original content. A log is provided which records actions implemented on the one or more of the digital files. A versioned repository is generated after an action is implemented on the one or more digital files. The versioned repository comprising one or more modified digital files which are associated with the modified content. A version identifier is associated with the versioned repository for facilitating point in time retrieval thereof.

Abstract: A system for media distribution and rendering over a spatially extended wireless network, comprising a plurality of media rendering devices configured as nodes in a spatially extended wireless network. The media rendering devices dynamically establish a hierarchical arrangement wherein a first media rendering device acts as a root node of the hierarchical arrangement. The first media rendering device receives media content over a network and distributes the media content to the remaining media rendering devices using the hierarchical arrangement. The media content is rendered synchronously by each of the plurality of media rendering devices.

Abstract: Example embodiments of the present invention relate to a method, a system, and a computer program product for performing data replication and backup. The method comprises performing a first data replication of a production site storage to a replication site storage and performing a first backup of the production site storage to a production site backup storage. A second data replication then may be performed from the production site backup storage to a backup site backup storage.

Abstract: A data object is received at a storage compute device in response to a request from a host. A requirement of the data object is determined based on a computation to be performed on the data object. The requirement related to at least speed and capacity of media used to store the data object. A tier is selected from the storage compute device based on speed and capacity characteristics of the selected tier corresponding to the requirement of the data object. The data object is stored in the selected tier.

Abstract: Methods and arrangements for segmenting log records. A log file is received. Candidates for a sequential pattern within the log file are automatically discerned, and, for each candidate, a likelihood is estimated that it represents a boundary within the log file. Other variants and embodiments are broadly contemplated herein.

Abstract: A system method and non-transitory computer readable medium implemented as programming on a suitable computing device, the system for inversion of control of executable extensions including a run-time environment configured to push data to one or a plurality of extensions, wherein said one or plurality of extensions are configured to comprise one or a plurality of signatures. Wherein said one or a plurality of extensions are compilable, designable and testable outside of the run-time environment, and wherein the run-time environment may be configured to accept an extension and to push data to that extension as per said one or a plurality of signatures.

Abstract: Crash recovery with asynchronous consistent snapshots in persistent memory stores of a processing environment. A processing environment includes a user program and infrastructure-maintained data structures. The infrastructure-maintained data structures include a log of updates made to program data structures and a snapshot of the state of the program data structures. The systems and methods include writing log entries in the log to a transient memory. The log entries correspond to store instructions and memory management instructions operating on a nonvolatile memory (NVM), and input/output (I/O) operations executed by program instructions of the user program. Each of the log entries represents an effect of a corresponding operation in the program instructions. The systems and methods also include creating a snapshot in the NVM after a consistent program point based on the log of updates. The snapshot provides a rollback position during restart following a crash.

Abstract: Switching an active metadata node is disclosed. An indication that a standby metadata node of a distributed file system should replace an active metadata node of the distributed file system as a new active metadata node of the distributed file system is received. The standby metadata node is included in a server. A request that indicates that the standby metadata node would like to become an exclusive metadata node writer of a transaction log is sent. A confirmation that the standby metadata node is the exclusive metadata node writer of the transaction log is received. Based at least in part on the confirmation, an update that the standby metadata node has become the new active metadata node of the distributed file system is provided.

Abstract: Techniques are described for migrating data from a first table to a second table while transforming at least one characteristic of the data. Characteristics transformed may include one or more of an encryption key or method, a table schema, a data structure, or a storage infrastructure. Migration may be performed in two or more phases. A first phase may migrate and transform a majority of the data, such as data that is older than a certain threshold age. A second phase may migrate and transform the remaining, newer data. A status table may indicate which tables are active and are to be written to and read from during data writing and data consuming processes. Moreover, embodiments support data replication across multiple regions.

Abstract: Systems for synchronizing data between a first-database and a second-database are presented including: a memory; and a client configured for determining whether a retrieval request requires a synchronization of the second-database before processing the received retrieval request, where the system partially synchronizes the second-database from the first-database with only that portion of the first-database associated with the retrieval request in response to determining whether synchronization is required and for processing the retrieval request from the second-database.

Abstract: Data synchronization requires much time if synchronization is started from an initial state where synchronization between databases is not performed, and when a synchronized record is updated during the synchronization process, synchronization of records must be performed again, so that the amount of communication for synchronization is increased. Therefore, when starting synchronization, data synchronization is performed based on a method using a table indicating the synchronization statuses between databases, and at the final stage of synchronization, data synchronization is performed based on a query transmission method using update logs.

Abstract: Replay of data transactions is initiated in a data storage application. Pages of a log segment directory characterizing metadata for a plurality of log segment are loaded into memory. Thereafter, redundant pages within the log segment directory are removed. It is then determined, based on the log segment directory, which log segments need to be accessed. These log segments are accessed to execute the log replay. Related apparatus, systems, techniques and articles are also described.

Abstract: A method includes receiving a request to save a first file as immutable. The method also includes searching for a second file that is saved and is redundant to the first file. The method further includes determining the second file is one of mutable and immutable. When the second file is mutable, the method includes saving the first file as a master copy, and replacing the second file with a soft link pointing to the master copy. When the second file is immutable, the method includes determining which of the first and second files has a later expiration date and an earlier expiration date, saving the one of the first and second files with the later expiration date as a master copy, and replacing the one of the first and second files with the earlier expiration date with a soft link pointing to the master copy.

Abstract: Aspects of the present disclosure are directed towards managing computing resources. Managing computing resources can include initializing in a computer system, an application that corresponds to one or more commit signatures, each of the one or more commit signatures correspond to a transaction within the application and determining that a commit signature of one or more commit signatures is saved in a commit block (COB). Managing computing resources can include retrieving, from the COB, in response to determining that the commit signature is saved in the COB, a first set of resource data that corresponds to the commit signature, the first set of resource data contains information for resource usage that corresponds to the application and allocating resources accessible to the computer system based on the first set of resource data.

Abstract: Aspects of the present disclosure are directed towards managing computing resources. Managing computing resources can include initializing in a computer system, an application that corresponds to one or more commit signatures, each of the one or more commit signatures correspond to a transaction within the application and determining that a commit signature of one or more commit signatures is saved in a commit block (COB). Managing computing resources can include retrieving, from the COB, in response to determining that the commit signature is saved in the COB, a first set of resource data that corresponds to the commit signature, the first set of resource data contains information for resource usage that corresponds to the application and allocating resources accessible to the computer system based on the first set of resource data.

Abstract: Technologies for providing recovery point review within a continuous data protection system can support a data storage operator in a data recovery procedure. A snapshot image can be chosen that was made prior to a data loss event. A new writable snapshot can be created from this logged snapshot. The new writeable snapshot can become the target for recovering the data volume. Review can be performed in a forward direction by reading a journal of I/O operations that have occurred since the prior snapshot was made. Review can be performed in a backward direction by deriving a dirty data list of changes made to the data volume and then removing the changes as requested. The operator can continue forward and backward review operations to refine the selected recovery point. Upon establishing the desired recovery point, the new writable snapshot can be committed, or rolled back, onto the data storage volume.

Abstract: There is disclosed a method for use in managing databases in data storage systems comprising a plurality of nodes. A request is received to provision storage for a specified application intending to use a database. Based on application-awareness, the storage system is provisioned for storing the database in response to receiving the request. Database tables are distributed across the nodes based on a forecasted first I/O profile between application and database. Information is captured in connection with the activity between the application and database. A second I/O profile is determined based on the captured information. The second I/O profile is an actual in-running I/O profile between application and database. The first I/O profile and second I/O profile are compared. The database tables are re-organized on the nodes based on the comparison identifying a discrepancy between first and second I/O profiles such that storage system is rebalanced.

Abstract: According to an aspect, a method for triggering creation of a checkpoint in a computer system includes executing a task in a processing node of the computer system and determining whether it is time to read a monitor associated with a metric of the task. The monitor is read to determine a value of the metric based on determining that it is time to read the monitor. A threshold for triggering creation of the checkpoint is determined based on the value of the metric. Based on determining that the value of the metric has crossed the threshold, the checkpoint including state data of the task is created to enable restarting execution of the task upon a restart operation.

Abstract: Various technologies and techniques are disclosed for supporting parallel nested transactions in a transactional memory system. Multiple closed nested transactions are created for a single parent transaction, and the closed nested transactions are executed concurrently as parallel nested transactions. Various techniques are used to ensure effects of the parallel nested transactions are hidden from other transactions outside the parent transaction until the parent transaction commits. For example, retry is allowed to work correctly with parallel nested transactions. When a transaction that is a parallel nested transaction or a child transaction of the parallel nested transaction executes a retry, a read set of the transaction is registered for the retry. When a decision is made to propagate the retry past a parallel nested transaction parent of the transaction, keeping the read set registered and making the read set part of a parent read set.

Abstract: A system and method for synchronizing data between two or more servers including replicating at least a portion of an original data set, associated with a first server, to provide a replicated data set, associated with a second server, the replicated data set based upon, at least in part, the original data set. One or more second-server commands executed on the replicated data set by the second server are stored. One or more first-server commands to be executed on the original data set by the first server, are provided in which the one or more first-server commands are based upon, at least in part, the one or more second-server commands. One or more first-server output objects, returned by the first server in response to the one or more first-server commands, are compared to one or more second-server output objects, returned by the second server in response to the one or more second-server commands.

Abstract: A system, a method and a computer readable medium for storing data elements and related data provenance information. The data elements may be represented in a hyper-table having rows and columns which may be indexed. The data-values of the corresponding data-elements in the hyper-cells may be retrieved based on the indices. Snapshots of the indices may be generated at pre-determined time periods. Checkpoints of the hyper-table may be generated at time periods that are based on transactions on the hyper-table. The hyper-table is capable of being queried as the hyper-table existed at certain time-periods, and data-values of the data-elements may be retrieved as the data-elements existed at such time-periods.

Abstract: A computer-implemented method for facilitating fault-tolerant backup jobs may include (1) receiving, at a media server, a backup assignment from a master server, (2) detecting a communication failure that inhibits communication between the media server and the master server, (3) initiating a backup job at the media server based at least in part on the backup assignment received from the master server, (4) caching, due at least in part to the communication failure, a catalog of the backup job at the media server instead of forwarding the catalog of the backup job to the master server in real-time during the backup job, and then (5) transferring the catalog of the backup job to the master server upon determining that communication between the media server and the master server is no longer inhibited. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A method comprising using at least one hardware processor for managing persistent messaging data in a volatile memory, writing the persistent messaging data to a first section of a Fast Persistent Memory (FPM), responsive to the first section of the FPM approaching a full state, offloading the persistent messaging data from the first section of the FPM to a hard disk device (HDD), and erasing the persistent messaging data from the first section of the FPM, recording, in a second section of the FPM, an identifier of said offloading, responsive to receiving a request to erase or modify at least some of the persistent messaging data in the HDD, updating the identifier of the offloading in the second section of the FPM while leaving the persistent messaging data in the HDD intact, and responsive to a server failure, selectively reading at least some of the persistent messaging data from the HDD to the volatile memory, wherein the selective reading is based on the identifier of the offloading in the second section

Abstract: A cache management apparatus, method, and computer readable medium which manages caching of resources. The method includes analyzing a structure of a resource in a system which exposes resources to clients, generating a dependency graph of objects linked to a resource based on the analyzed structure of the resource, and managing caching of resources based on the generated dependency graphs. A generated dependency graph includes hierarchical dependency information with respect to the objects of the resource.

Abstract: A system and method enable an information analyst to use a stand-alone computer-based investigation application to conduct a disconnected investigation on shared database data in a remote location where network access to a shared data repository of the system might be only periodically available, unreliable, or non-existent. In addition, the system and method enable the disconnected investigation to incrementally incorporate ongoing updates made to the shared repository of data, and to periodically publish interim or final results of the disconnected investigation to the shared data repository. A disconnected investigation can be conducted entirely at the disconnected investigation location without having any network connectivity to the shared repository of data.

Abstract: Systems and methods for cache optimization are provided. The method comprises monitoring cache access rate for a plurality of cache tenants sharing same cache mechanism having an amount of data storage space, wherein a first cache tenant having a first cache size is allocated a first cache space within the data storage space, and wherein a second cache tenant having a second cache size is allocated a second cache space within the data storage space. The method further comprises determining cache profiles for at least the first cache tenant and the second cache tenant according to data collected during the monitoring; analyzing the cache profiles for the plurality of cache tenants to determine an expected cache usage model for the cache mechanism; and analyzing the cache usage model and factors related to cache efficiency or performance for the one or more cache tenants to dictate one or more occupancy constraints.

Abstract: A method of storing a preview image of a document shared over a social media service includes receiving at a server a first notification that a document stored on the server is being shared on a post by a first user on the social media service, where the first notification includes information identifying the first user. The method further includes generating a thumbnail image from the document, where the thumbnail image is stored in the document metadata and is a representative image of a first version of the document at the time the user shares the document, associating the thumbnail image with a URL, where the URL has an access control list that includes the first user, and sending the URL from the server to the social media service.

Abstract: Provided are methods and computer program products for analyzing and tracing the contents of network traffic in a network device and to help identify network performance issues. Methods for analyzing traffic include identifying thread identifiers associated with transactions, determining related events, and associating similar transactions and events into an aggregated list of transactions. Methods of tracing transactions include identifying thread identifiers associated with transactions and related events and serializing events into a serialized list of events to facilitate tracing single transactions.

Abstract: A change manager module in communication with a website receives copies of instructions to change the content or configuration of the website. These instructions are formatted into an entry for a log and stored in a log associated with the website. The entry may contain identifiers for the entry, the party that requested the change, and the website, as well as a timestamp of the time of the change, and information identifying a changed feature of the website and a changed state of the changed feature. A copy of the log entry is also transmitted to a central database in a separate memory from the memory containing the website, which stores entries from multiple websites for viewing and organizing. Entries reflecting undesired changes may then be reverted based on the data in the log entries.

Abstract: An application may store data to a dataset comprising a plurality of volumes stored on a plurality of storage systems. The application may request a dataset image of the dataset, the dataset image comprising a volume image of each volume of the dataset. A dataset image manager operates with a plurality of volume image managers in parallel to produce the dataset image, each volume image manager executing on a storage system. The plurality of volume image managers respond by performing requested operations and sending responses to the dataset image manager in parallel. Each volume image manager on a storage system may manage and produce a volume image for each volume of the dataset stored to the storage system. If a volume image for any volume of the dataset fails, or a timeout period expires, a cleanup procedure is performed to delete any successful volume images.

Abstract: An application may store data to a dataset comprising a plurality of volumes stored on a plurality of storage systems. The application may request a dataset image of the dataset, the dataset image comprising a volume image of each volume of the dataset. A dataset image manager operates with a plurality of volume image managers in parallel to produce the dataset image, each volume image manager executing on a storage system. The plurality of volume image managers respond by performing requested operations and sending responses to the dataset image manager in parallel. Each volume image manager on a storage system may manage and produce a volume image for each volume of the dataset stored to the storage system. If a volume image for any volume of the dataset fails, or a timeout period expires, a cleanup procedure is performed to delete any successful volume images.

Abstract: Consolidating a set of tenant log streams from separate user databases into a consolidated log stream. The method includes receiving a plurality of tenant log streams from separate user data bases. The method further includes recording the plurality of tenant log streams as a consolidated log stream. The method further includes maintaining metadata about the consolidated log stream to map log records from the plurality of tenant log streams to their location in the consolidated log stream.

Abstract: High availability and disaster recovery can be achieved within a database management system by detecting which parts of a file have changed and sending the changed parts to secondary servers, without sending the entire file that has experienced the changes. A log cracker reads data from a transaction log that stores records from a database and a separately maintained file system. The log cracker sends mirror commands with some of the transaction log data to the file system to initiate mirroring of the data from the file system to secondary servers. The log data is then subsequently sent to the secondary servers as well, to enable identification of changed data without having to transfer the entire file that has been changed.

Abstract: Methods, systems, and physical computer storage media are now provided that improve backing up data sets. Each database transaction is registered to a central repository prior to starting the database transaction, each database transaction comprising a plurality of writes to be executed for a database application on a database, receiving a first signal indicating a start of a backup application on the database, and quiescing all database transactions registered to the central repository to thereby wait for all ongoing writes of the database transactions registered to the central repository to complete and to release control of the database to the database application.