Abstract: Technology described herein can be employed to automatically recommend a tiering policy for data storage of data at a data storage system, such as a cloud storage system. An example method can comprise determining, by a system comprising a processor, context information defining a data storage attribute applicable to data at a cloud storage system. The method can comprise, in response to determining the context information, generating, by the system, a tiering policy defining an element of tiering storage of data at the cloud storage system, wherein the tiering policy is based on the data storage attribute defined by the context information. The method also can comprise, in response to generating the tiering policy, outputting, by the system, the tiering policy to a storage device associated with a customer. The analysis can be performed using an artificial intelligence process, machine learning process or a combination thereof.

Abstract: A method for managing file based backups (FBBs) includes obtaining, by a backup agent, a FBB generation request for a file system at a point in time, in response to the FBB generation request: identifying a target backup storage system in which to store the FBB, identifying a target exposed application programming interface (API) associated with the target backup storage system, generating a FBB corresponding to the FBB generation request, wherein the FBB comprises a FBB metadata file, wherein the FBB is in a common data streaming format (CDSF), generating an API command based on the FBB and the target exposed API, and initiating storage of the FBB in the target backup storage system using the API command.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. A plurality of failure resilient address spaces are distributed across the plurality of storage devices such that each of the plurality of failure resilient address spaces spans a plurality of the storage devices. The plurality of computing devices maintains metadata that maps each failure resilient address space to one of the plurality of computing devices. Each of the plurality of computing devices is operable to read from and write to a plurality of memory blocks, while maintaining an extent in metadata that maps the plurality of memory blocks to the failure resilient address space.

Abstract: A computing system includes an account associated with a user of the system, and a server. One or more processors are configured to receive user information from a user computing device, wherein the user information is related to a user of the account, determine, based on the user information, one or more user settings preferences related to a second computing device, receive an information request, wherein the information request includes a request to send the one or more user settings preferences to the second computing device, and to send the one or more user settings preferences to the second computing device, wherein the one or more user settings preferences are useable by the second computing device to adjust one or more settings of the second computing device.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices comprises one or more of a plurality of storage devices. A plurality of failure resilient address spaces are distributed across the plurality of storage devices such that each of the plurality of failure resilient address spaces spans a plurality of the storage devices. Each one of the plurality of failure resilient address spaces is organized into a plurality of stripes. Each one or more stripes of the plurality of stripes is part of a respective one of a plurality of forward error correction (FEC) protection domains. Each of the plurality of stripes may comprise a plurality of storage blocks. Each block of a particular one of the plurality of stripes may reside on a different one of the plurality of storage devices.

Abstract: A device searches a file being recorded that includes lines sorted in accordance with keys included in the lines to find a line that matches a pattern. When the device receives a pattern, it initializes upper and lower limits of a search range and calculates a middle position between the limits. It acquires, from the file, a middle line that starts at or before the middle position and ends after it. If the key included in the middle line matches the pattern, it outputs the middle line and re-sets the upper or lower limit based on whether the key included in the middle line is greater or less than the pattern and, if there is a distance greater than a length of a newline between the limits, repeats the procedure starting from the middle position. Otherwise, it outputs a result to the effect that no matching line has been found.

Abstract: Methods and systems for using a hierarchical consistency group (CG) in a storage system are provided. A parent CG is associated with at least a first child CG having a plurality of storage volumes. An atomic application programming interface (API) provisions the parent CG and the first child CG by allocating storage and storing policies for the parent CG and the first CG. A storage service selected from a backup service, a replication service and a cloning service for the parent CG and the first CG is executed based on the stored policies.

Abstract: A system for managing database logging, the comprises a processor; and a user task executing in a database server process and executable by the processor, the user task to: receive in a database management system on a database server, a command to manipulate a portion of a database managed by the database management system; obtain a lock on the portion of the database; create a first log record in a first private log cache associated with the user task, the first log record recording a data manipulation to the portion of the database; enqueue the first log record to a queue; and release the lock on the portion of the database after copying the first log record to the queue.

Abstract: A database receives pages that are piped from backup media with each of the pages having a corresponding savepoint version. At least a portion of the pages are then flagged as being from recovery. The savepoint versions for the pages are maintained if they have a flag. A single checksum is then calculated for each page to confirm integrity. Each page is then loaded into memory of the database after it is confirming the corresponding calculated single checksum. Related apparatus, systems, techniques and articles are also described.

Abstract: Embodiments of the present disclosure relate to a method, device and computer program product for determining a consistency level of a virtual machine snapshot. The method comprises obtaining a backup log file of the virtual machine snapshot generated in a virtual machine backup process, the backup log file comprising log information related to the generation of the virtual machine snapshot. The method further comprises determining the consistency level of the virtual machine snapshot based on the backup log file, the consistency level indicating a matching degree between a state of a virtual machine represented by the virtual machine snapshot and an actual state of the virtual machine when the virtual machine snapshot is generated.

Abstract: In one embodiment, the method includes determining one or more nodes associated with a treatment of a query; generating one or more stimuli associated with the treatment of the query wherein the or each stimulus are likely to perturb one or more resources within a system; measuring data at the or each node relating to the resources to determine the effect of the or each stimuli at the or each node; identifying one or more pairs of nodes which have a correlation in the measured data; transforming the correlation into a causal relationships where the cause is a measuring device measuring the response and the consequences are the other correlated measuring devices; generating a list of causal relationships; and combining different causal relationships into a causal model so that a chain of causal propagations can be built.

Abstract: According to one aspect, a system for managing information objects in dynamic data storage devices including a first data storage device having a plurality of information objects, a second data storage device operatively connectable to an output device for providing at least some of the information objects to at least one user, and at least one processor operatively coupled to the first data storage device and the second data storage device.

Abstract: A method for linking a selected portion of the data stored in a source database to a set of target database(s), determining that a crash of the source database has occurred, and restoring a latest database state of the source database, with the restoration including: triggering a remote recovery process, and restoring data of the selected portion in the source database from: copy(ies) of data entries stored in one, or more, target database(s) of the set of target database(s), and records from a recovery log file of the source database for data entries that have a later timestamp than corresponding copies of the data entry(ies) as stored in the target database(s) of the set of target database(s).

Abstract: Techniques disclosed herein relate to synchronizing a first database with a second database. Embodiments include detecting a write operation modifying properties of a data object in the first database. While the data object is locked, embodiments write object change data to a journal table. Embodiments query the journal table of the recovery database to retrieve a portion of the object change data corresponding to a first window of time and comprising a plurality of entries. The retrieved portion of object change data is processed to create processed object data by collapsing duplicate entries within the plurality of entries. Embodiments retrieve object data from the first database, corresponding to properties of data objects specified in the processed object change data. The retrieved object data is pushed to the second database, whereby the second database is synchronized with the first database.

Abstract: Provided is a file information collection system etc., to determine an appropriate log file for failure analysis in a case that an alert occurs in any server belonging to a system in operation and to generate a list of a file name of the file. In the system includes; information acquisition means that acquires a process ID of each process etc., used by the each process; list generation means that selects a file whose name meets a predetermined condition, generates a list of a record including identification information of a server, and, adds the list at a bottom of an already-generated list; and sequence control means that selects the record from a top of the list, acquires information about an update time of a file, and, changes a server attribute in the selected record and moves the record to a bottom of the list.

Abstract: A computer system may include a storage device and nodes cooperating therewith to define a key value database architecture. A first node of the nodes may be configured to generate a plurality of checkpoints. The computer system may also include a second node of the nodes configured to operate a log feed cache manager based upon the checkpoints generated by the first node.

Abstract: A system and method are provided for pattern discovery in input heterogeneous logs having unstructured text content and one or more fields. The system includes a memory. The system further includes a processor in communication with the memory. The processor runs program code to preprocess the input heterogeneous logs to obtain pre-processed logs by splitting the input heterogeneous logs into tokens. The processor runs program code to generate seed patterns from the preprocessed logs. The processor runs program code to generate final patterns by specializing a selected set of fields in each of the seed patterns to generate a final pattern set.

Abstract: A system generates a command to cause a computing machine to collect information for an issue that occurred with an application. The command is stored in a command list and associated with a computing machine identifier for the computing machine. The system receives a query from the computing machine for the command list. The query includes the computing machine identifier and the system locates the command in the command list based on the command being associated with the computing machine identifier. The system then sends the command to the computing machine where the command dynamically causes the computing machine to collect the information for the issue with the application.

Abstract: A set of logical containers are maintained in a cache, each logical container corresponding to a portion of a main snapshot catalog. First metadata of a first snapshot created by a first snapshot appliance is examined. Based on the first metadata examination, the first snapshot is cataloged into a first logical container. Second metadata of a second snapshot created by a second snapshot appliance is examined. Based on the second metadata examination, the second snapshot is cataloged into a second logical container, separate from the first logical container. A request is received to perform an operation involving one of the first or second snapshots. The request is matched to one of the first or second logical containers. The one of the first or second logical containers is searched to retrieve a snapshot responsive to the request without searching another of the first or second logical containers.

Abstract: Disclosed is a system, method, and computer program product for implementing a log analytics method and system that can configure, collect, and analyze log records in an efficient manner. The log analytics system, method, and computer program product provide target-based configuration of log monitoring metadata. Variable pathnames (e.g., having variables instead of absolute pathnames) may be specified to identify a directory that contains log files to monitor.

Abstract: In some examples, access data for one or more gaming applications accessed by the client device is tracked and the access data for the one or more gaming applications may be sent to a server. A prefetching profile may be received from the server. The prefetching profile may specify a plurality of likelihood values for a plurality of gaming data files that are likely to be accessed by the client device within a specific timeframe. A set of gaming data files may be prefetched from an external source based on the prefetching profile. For example, the set of gaming data files may be selected from the plurality of gaming data files based on the prefetching profile.

Abstract: In the field of forensic analysis of databases, a method of performing database rollback to a previous state of a database using a write-ahead log (WAL) includes: selecting, in the set of frames recorded to the WAL, a specific frame representing a specific revised content of a corresponding specific page; identifying, in the set of frames, a first subset of frames containing the specific frame and zero or more thereto chronologically preceding frames; extracting, from the set of pages of the database, a first subset of pages; extracting, from the corresponding pages of the first subset of frames, a second subset of pages; and performing, based on the contents of the first subset of pages and the revised contents of the second subset of pages, a rollback of the database to a previous state containing the revised content of the specific page.

Abstract: Each of a plurality of events associated with a workspace or stream are stored to a functional data structure. Each of the plurality of events includes at least an indication of when an operation in the workspace or stream occurred and who performed the operation. Nodes of a change set history tree corresponding to the events can be recursively identified until a node corresponding to a change set of interest is identified. Responsive to identifying the node corresponding to the change set of interest, the event corresponding to such node can be identified as an event that added the change set of interest to the workspace or stream. The indication of when the operation represented by the event occurred and who performed the operation can be retrieved from the subject event. The indication of when the operation represented by the event occurred, and who performed the operation, can be output.

Abstract: Each of a plurality of events associated with a workspace or stream are stored to a functional data structure. Each of the plurality of events includes at least an indication of when an operation in the workspace or stream occurred and who performed the operation. Nodes of a change set history tree corresponding to the events can be recursively identified until a node corresponding to a change set of interest is identified. Responsive to identifying the node corresponding to the change set of interest, the event corresponding to such node can be identified as an event that added the change set of interest to the workspace or stream. The indication of when the operation represented by the event occurred and who performed the operation can be retrieved from the subject event. The indication of when the operation represented by the event occurred, and who performed the operation, can be output.

Abstract: Techniques introduced here enable cloud-based file prefetching for gaming applications running on electronic devices. The electronic devices store certain gaming data files on a remote storage server and preload some of the files locally to include file access efficiency. Gaming data file access patterns on the electronic devices are analyzed, individually and collectively, using a cloud service to detect global access patterns and help determine which gaming data files to preload on each of the electronic devices.

Abstract: Data storage optimization techniques determine predicted values for I/O statistics using an ARIMA (auto-regressive integrated moving average) model. The ARIMA model may be used to capture periodic patterns and trends of workload I/O access to predict the future load demand. A current set of I/O statistics is collected for a current time period T. Using the current set and one or more ARIMA models, a predicted set of I/O statistics is determined for a next time period T+1. Each of the ARIMA models is characterized by model parameters including P denoting a number of auto-regressive terms, D denoting a number of nonseasonal difference needed for stationarity, and Q denoting a number of lagged forecast errors of prediction. A data storage optimizer may determine one or more data portions for movement from a current storage tier to a target storage tier using the predicted set of I/O statistics.

Abstract: A flash-optimized, log-structured layer of a file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The log-structured layer of the file system provides sequential storage of data and metadata (i.e., a log-structured layout) on solid state drives (SSDs) of storage arrays in the cluster to reduce write amplification, while leveraging variable compression and variable length data features of the storage I/O stack. The data may be organized as an arbitrary number of variable-length extents of one or more host-visible logical units (LUNs) served by the nodes. The metadata may include mappings from host-visible logical block address ranges (i.e., offset ranges) of a LUN to extent keys, as well as mappings of the extent keys to SSD storage locations of the extents. The storage location of an extent on SSD is effectively “virtualized” by its mapped extent key (i.e.

Abstract: Techniques are described data storage optimization that determine predicted values for I/O statistics using an ARIMA (auto-regressive integrated moving average) model. The ARIMA model may be used to capture periodic patterns and trends of workload I/O access to predict the future load demand. A current set of I/O statistics is collected for a current time period T. Using the current set and one or more ARIMA models, a predicted set of I/O statistics is determined for a next time period T+1. Each of the ARIMA models is characterized by model parameters including P denoting a number of auto-regressive terms, D denoting a number of nonseasonal difference needed for stationarity, and Q denoting a number of lagged forecast errors of prediction. A data storage optimizer may determine one or more data portions for movement from a current storage tier to a target storage tier using the predicted set of I/O statistics.

Abstract: A trusted computing device (TCD) includes an isolated environment, host interface, secure interface, and program instructions. The environment includes an isolated environment processor (IEP), memory (secure and non-secure partition), and an auxiliary processor (AP). Memory and AP are connected for data communication with the IEP, and communicate with a host only through the IEP. The host interface and each secure interface are connected for data communication with the IEP.

Abstract: A system is provided for a mobile device search optimizer. The system includes a storage device, a processor, and an optimizer engine. The optimizer engine, when executed by the processor, stores user input for a mobile device to the storage device. The optimizer engine also identifies a pattern of multiple user inputs entered to select a presentation view of an application on the mobile device during multiple occasions. Additionally, the optimizer engine configures the application to offer a user input option to display the presentation view in response to a selection of the user input option.

Abstract: Embodiments are directed to establishing efficient virtual machine reference points and to specifying a virtual machine reference point to query incremental changes. In one scenario, a computer system accesses a stable virtual machine checkpoint that includes portions of underlying data stored in data storage, where the checkpoint is associated with a specific point in time. The computer system then queries the data storage to determine data storage identifiers that reference the point in time associated with the checkpoint and stores the determined data storage identifiers as a virtual machine reference point, where each subsequent change to the data storage results in an update to the data storage identifier, so that virtual machine reference point is usable to identify incremental changes from specific points in time on.

Abstract: A system and method for managing the storage of data in non-volatile memory is described. In an aspect, the data may be described by metadata and a transaction log file that are checkpointed from a volatile memory into the non-volatile memory. Actions that take place between the last checkpointing of a metadata segment and log file segment are discovered by scanning the non-volatile memory blocks, taking account of a record of the highest sector in each block that is known to have been recorded. Any later transactions are discovered and used to update the recovered metadata so that the metadata correctly represents the stored data.

Abstract: A computer device (2010) with a file system having clusters and meta data. The computer device (2010) includes a processor (1030) and a storage (1025) coupled to the processor and having physical representations of instructions so that the processor is operable to reserve (230) at least one of the clusters and to create a log record when meta data for the file system is to be updated by a write (240) of such meta data beforehand to such a reserved cluster, and then set (250) at least one state entry to substantially represent readiness to write the meta data to the file system.

Abstract: It is determined that a first data block contains the same data as a second data block. The first data block is associated with a first extent and the second data block is associated with a second extent. In response to determining that the first data block contains the same data as the second data block, the second data block is associated with the first extent and the first data block is disassociated with the second extent.

Abstract: A logging system includes an event receiver and a storage manager. The receiver receives log data, processes it, and outputs a data “chunk.” The manager receives data chunks and stores them so that they can be queried. The receiver includes buffers that store events and a metadata structure that stores metadata about the contents of the buffers. The metadata includes a unique identifier associated with the receiver, the number of events in the buffers, and, for each “field of interest,” a minimum value and a maximum value that reflect the range of values of that field over all of the events in the buffers. A chunk includes the metadata structure and a compressed version of the contents of the buffers. The metadata structure acts as a search index when querying event data. The logging system can be used in conjunction with a security information/event management (SIEM) system.

Abstract: A computerized method for sharing removable storage media in a network, the method comprising associating, in an index entry, a first piece of removable storage media in a first storage device with at least a first storage policy copy and a second storage policy copy; copying, to the first piece of removable storage media, data associated with the first storage policy copy; and copying, to the first piece of removable storage media, data associated with the second storage policy copy.

Abstract: Performing data management operations on replicated data in a computer network. Log entries are generated for data management operations of an application executing on a source system. Consistency point entries are used to indicate a time of a known good, or recoverable, state of the application. A destination system is configured to process a copy of the log and consistency point entries to replicate data in a replication volume, the replicated data being a copy of the application data on the source system. When the replicated data represents a known good state of the application, as determined by the consistency point entries, the destination system(s) may perform a storage operation (e.g., snapshot, backup) to copy the replicated data and to logically associate the copied data with a time information (e.g., time stamp) indicative of the source system time when the application was in the known good state.

Abstract: Systems and methods are disclosed for characterizing one or more users accessing a plurality of web pages. In an embodiment, a social sharing graph is generated based on the one or more log records. The one or more log records are indicative of the one or more user activities. A first and a second score are assigned to preferably each of the one or more users in the social sharing graph based on the one or more log records. Finally, the one or more users are categorized in a first category and a second category based on the first score and the second score.

Abstract: Provided are techniques for, in response to a source object being changed by a local transaction, generating log records, wherein each of the log records includes a sequence identifier, a source system entity modification timestamp, a target key, a target partition identifier, and values of source properties, wherein the source properties are identified using a target key indicator. The log records to process are selected based on a phase value of each log record, wherein the phase value is one of submitted, in-flight, and source system entity state change complete. One or more disjoint partitions are assigned to each of multiple processing instances. Under control of each of the multiple processing instances, it is determined whether to transmit a log record in the one or more disjoint partitions assigned to said processing instance and, in response to determining that the log record is to be transmitted, the log record is transmitted.

Abstract: A method for preventing suspension of transactions in a database computing system by monitoring active database logs of the database computing system is provided. The method comprises switching archive units of the database computing system due to full database log condition occurring during system operations of the database computing system. The method further comprises maintaining a database log history table, wherein the database log history table captures a threshold count of the active database logs generated by system threads of the database computing system. The method further comprises defining a temporary location for archiving the active database logs based on the switched archive units of the database computing system, and the maintained threadhold count of active database logs in the database log history table due to full database log condition occurring during system operations of the database computing system.

Abstract: Multi-dimensional logging for enterprise applications is described. A computer executes a logging mechanism. The logging mechanism receives, via a user interface, selections of log detail levels that range from a minimum log detail level to a maximum log detail level, of contexts that include at least two of an analytics context, a security context, a performance context, and a health context, and use cases that include at least two of an export use case, a save use case, an import use case, a check-in use case, and a check-out use case. The logging mechanism creates a multi-dimensional logging artifact based on selections of log detail levels, contexts, and use cases, and utilizes the multi-dimensional logging artifact with log data to create refined log data based on the selections of log detail levels, contexts, and use cases. The refined log data assists a user in evaluating an enterprise application.

Abstract: A system for archiving composite files including metadata and payload data in a file system. In at least one embodiment, the system includes a database for storing, in particular exclusively, a first group of metadata of the archived composite files, corresponding to search criteria usable in a query; at least one information layer in the file system for storing a second group of metadata of the archived composite files in storage files, the second group in particular including the metadata of the first group and/or all metadata; and the archived composite files stored in the file system.

Abstract: This patent application relates to enhanced logical recovery techniques for redo recovery operations of a system with an unbundled storage engine. These techniques can be implemented by utilizing an enhanced logical recovery approach in which a dirty page table (DPT) is constructed based on information logged during normal execution. The unbundled storage engine can include a transaction component (TC) that is architecturally independent of a data component (DC). These techniques can enhance redo recovery operations by mitigating the resources needed to determine whether previously executed operations sent from the TC to the DC are to be repeated in response to a recovery-initiating event. This can include using the DPT to avoid fetching every data page corresponding to every previously executed operation received by the DC during recovery and/or pre-fetching data pages and/or index pages that correspond to PIDs in the DPT.

Abstract: Various systems and methods for cooperative tiering between an application and a storage device. One method can include receiving information from the application where the information identifies a storage object and identifies a location in a storage device. The location identifies one or more tiers of a plurality of tiers included in the storage device, and the storage object is assigned to the one or more tiers. The method also involves detecting whether the storage object is stored in the one or more tiers. If not, the storage device copies the storage object to the identified location. The information can also include an instruction by the application to move the storage object from a first tier to a second tier.

Abstract: A file shard store includes high performance encoding and compaction circuits. An apparatus and its method of operation avoids duplicate storage of file fragments. A plurality of tables control write operations into a plurality of log segments. Shard keys are transferred to uniquely identify fragments of files which may have been previously stored and associated with one or more of client subscribers. An apparatus comprises a plurality of location/subscription tables, a shard transfer circuit, a storage control circuit, an append-to-log circuit coupled to a large storage array, and a log segment compactor circuit.

Abstract: A system and method is disclosed which enables network administrators and the like to quickly analyze the data produced by log-producing devices such as network firewalls and routers. Unlike systems of the prior art, the system disclosed herein automatically parses and summarizes log data before inserting it into one or more databases. This greatly reduces the volume of data stored in the database and permits database queries to be run and reports generated while many types of attempted breaches of network security are still in progress. Database maintenance may also be accomplished automatically by the system to delete or archive old log data.

Abstract: Systems and methods of dynamically processing an event using an extensible data model are disclosed. One embodiment includes, specifying attributes of the event in a data model; the data model being extensible to add properties to the event as the dataset is streamed from the source to the sink.

Abstract: A method is provided to evaluate user interaction with a computer user interface (UI) comprising: receiving a property definition that identifies at least one relationship among prescribed string patterns that correspond to one or more UI events; receiving a log file in a computer readable storage device that includes a plurality of respective chunks of information; determining whether the respective chunks of information within the log file includes a respective string pattern that matches at least one of the prescribed string patterns; configuring a processor to produce an indication of whether the property is satisfied based upon the string pattern matching determinations.

Abstract: Techniques for storage lifecycle policy management. In one particular exemplary embodiment, the techniques may be realized as a method for storage lifecycle policy management comprising creating a version of a storage lifecycle policy, associating a unique version ID with the created version of the storage lifecycle policy, associating the unique version ID with one or more portions of backup data created during a storage management job instantiated under the created version of the storage lifecycle policy, and ensuring that one or more storage management actions performed on the one or more portions of backup data comply with the created version of the storage lifecycle policy associated with unique version ID.

Abstract: Systems and methods of dynamically processing an event using an extensible data model are disclosed. One embodiment includes, specifying attributes of the event in a data model; the data model being extensible to add properties to the event as the dataset is streamed from the source to the sink.