Abstract: Techniques for data management are described. A monotonically increasing time source that indicates an elapsed time since a reference event may be activated. Multiple snapshots of a computing object may be generated in accordance with a schedule for backing up the computing object, where the schedule may include a retention duration for retaining snapshots. Based on generating the snapshots, timestamps for the snapshots may be stored, where the timestamps may indicate respective values of the monotonically increasing time source. As part of an expiration job, a reference value of the monotonically increasing time source may be identified based on the retention duration and a current value indicated by the monotonically increasing time source. Also, a snapshot of the snapshots may be expired based on a timestamp of the snapshot corresponding to a value of the monotonically increasing time source that is less than the reference value.

Abstract: Techniques for performing dynamic profile reconciliation in a communication system. A server computing system may identify two or more user profiles corresponding to a same user that is associated with the communication system. The server computing system may integrate historical data associated with the two or more user profiles into a single user profile (e.g., a destination user profile). The historical data may include messages sent and/or received via the two or more user profiles, files associated with the messages, metadata corresponding to each message, and the like. Responsive to combining the two or more user profiles into the single user profile, the server computing system may delete at least one of the two or more user profiles, storing the combined data in association with the single user profile.

Abstract: The disclosed embodiments relate to a system/apparatus for reducing a data size of a database/data structure stored in a memory of a data transaction processing system, which stores a plurality of data records, each of the plurality of data records being characterized by a record data size and storing data indicative of a position (of one or more portfolios) in one or more financial instruments, such as interest rate swaps, futures contracts, etc. The system/apparatus may be referred to as an architecture which enables post-trade processing of portfolio/position databases/data structures, or subsets thereof, to reduce the data size thereof for storage, communication and/or processing and may further reduce other aspects or characteristics such as gross notional value, total risk, etc.

Abstract: Dynamically selecting a protection duration for locking objects in a storage. A garbage collection deletes objects over time. The objects may not be removed from storage until associated locks have expired. The length of the lock may impact the cost. A new lock extension value is selected each time a lock extension operation is performed. The lock extension value selection process accounts for a garbage collection operation cycle, an amount of deleted objects that are stored because of being locked, and a garbage collection churn. This allows an optimum lock extension value to be selected dynamically and repeatedly to control costs automatically.

Abstract: A system including one or more processors and one or more non-transitory computer-readable media storing computing instructions configured to run on the one or more processors and perform: bundling multiple registered queries of a dataset using a scheduling technique, wherein the dataset is homogenous in schema; running a single table scan of the dataset to process the multiple registered queries of the dataset in parallel; and generating a respective output responsive to each of the multiple registered queries. Other embodiments are disclosed.

Abstract: Described is a system (and method) for providing multiple types of granular delete operations for a cloud-based object storage. The system may include a server that acts as an intermediary between a client device and an object storage that stores client data. The server may allow a client to perform a hard delete (or permanent) delete and a soft delete. The server may perform a specialized processing to synthetically create the soft delete feature using a permanent object delete operation provided by the object storage. The specialized processing may include manipulating retention periods associated with objects depending on whether the object is subject to a hard delete or a soft delete. As a result, the server may provide the ability for clients to perform a soft delete at an object level using existing storage level APIs that do not directly support such a feature.

Abstract: A fully-automated, defensible and highly-scalable system for disposition decisioning and, where applicable deleting previously archived electronic communications. In this regard, the present invention is capable of determining, on an individual e-communication basis, whether an e-communication should be deleted/purged from archive or retained in archive taking into account applicable rules and policies based on the geographic location from which the e-communication was sent, received or posted, as well as, based on the status on the sender/poster and/or recipient.

Abstract: A data center for data backup and replication, including a pool of multiple storage units for storing a journal of I/O write commands issued at respective times, wherein the journal spans a history window of a pre-specified time length, and a journal manager for dynamically allocating more storage units for storing the journal as the journal size increases, and for dynamically releasing storage units as the journal size decreases.

Abstract: A computer-implemented system, method and computer program product for preparing alert reports that includes: receiving an override request to override an insight used to prepare the alert reports; determining, determining one or more execution pipelines used to prepare the alert reports that used the insight that is the subject of the override request; determining one or more impacted pipeline runs that were executed to prepare the alert reports that used the insight that is the subject of the override request; updating the one or more execution pipelines used to prepare the alert reports; and generating new alert reports, wherein generating the new alert reports comprises re-running the one or more impacted pipeline runs using the one or more updated execution pipelines wherein the insight that is the subject of the override request is overridden.

Abstract: A computer-implemented system, platform, computer program product, tool, and/or method for re-running alert reports that includes: identifying an alert report to be rerun; collecting information on the alert report; gathering information on the configuration of a data analytics pipeline that generated the alert report; gathering data used to generate the alert report; recreating a regenerated data analytics pipeline based upon the information gathered on the configuration of the data analytics pipeline that generated the alert report; running the regenerated data analytics pipeline using the gathered data to create a rerun alert report; and optionally comparing the rerun to the original run including optionally generating a visual display of the results including in an aspect creating a side-by-side comparison of the tasks.

Abstract: The disclosed computer-implemented method for consistently applying rules to messages may include (i) identifying a user account on a message server that comprises both unarchived messages to which message rules are applied by default and archived messages to which the message rules are not applied by default, (ii) detecting a new message rule that specifies an action to be performed on relevant messages within the user account on the message server, (iii) locating at least one archived message within the user account on the message server to which the new message rule applies, and (iv) applying the new message rule to the at least one archived message by performing the specified action on the at least one archived message. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: In an example embodiment, using several computerized innovative data anonymization techniques, sensitive and personal data can be anonymized so that it can be used in further analysis without revealing the individuals to which the data applies. More particularly, a privacy view is created for a microdata table by generating one or more transformations, based on an anonymization method. Only once a request for data in the microdata table is received from a data consumer is the privacy view populated or repopulated with the most recent data from the microdata table by transforming it using the one or more transformations.

Abstract: A storage system and an access control method thereof are provided. The storage system receives a first I/O request from at least one hypervisor. The first I/O request is used for accessing a first disk file of disk files. The storage system then operates a first I/O operation of a first virtual disk of virtual disks according to the first I/O request since the disk files correspond to the virtual disks. The storage system reads a QoS data of the first disk file and determines a first delay period according to the QoS data. The storage system transmits a first I/O response to the at least one hypervisor after the first delay period.

Abstract: In some examples, a computing device executing an application may gather data associated with a usage of multiple computing resources (e.g., CPU, GPU, storage, memory, and the like) of the computing device, generate one or more packets to carry the data, and set a priority of each of the one or more packets. The computing device may send the one or more packets to a server, to other computing devices, or both. The server or the other computing devices may send a new profile. The computing device may modify a hardware and software configuration of the computing device based at least in part on the new profile to create a modified configuration and execute the application, resulting in the application having at least one of a reduced latency or an increased throughput using the modified configuration.

Abstract: The packet capture manager uses a multi-tiered storage for storing captured network traffic. Captured packets are stored on a primary storage with a time-to-live according to a retention policy. The packet capture manager receives instructions from one or more network monitoring devices identifying one or more captured packets as packets of interest. The packet capture manager flags the identified packets as packets of interest, moves the flagged packets to a secondary storage, and changes the TTL of the moved packets. A machine learning model analyzes historical data of the instructions received from the one or more network monitoring devices. The packet capture manager uses the machine learning model to identify packets of interest and move identified packets to the secondary storage without specific instructions from a network monitoring device.

Abstract: Logic may pre-populate cache of compute nodes allocated to a user's session. Logic may access an image file of a global filesystem, the image file to comprise a first set of one or more files associated with a user session and a second set of one or more files upon which execution of the first set will depend. Logic may store the image file in local data storage of each compute node of a spanning tree of compute nodes allocated for the user session. Logic may unpack the image file based on the data. Logic may configure the local environment of each compute node in the spanning tree to identify a location in local memory of each of the files. And logic may initiate execution of a local filesystem service in each of the compute nodes of the spanning tree.

Abstract: Apparatuses, systems, methods, and computer program products are disclosed for distributed and/or decentralized data aggregation. A method includes setting a frequency for accessing a server of a third party service provider based on input from a remote device unaffiliated with the third party service provider, such that the remote device determines frequencies for a plurality of different users and different hardware devices accessing the server of the third party service provider. A method includes accessing the server of the third party service provider, from the hardware device of a user, using electronic credentials for the user according to the set frequency. A method includes downloading data associated with the user from the server of the third party service provider to the hardware device of the user.

Abstract: Selective regulation of information transmission from mobile applications to an external system. A privacy policy is configured for and mapped to each of a multiplicity of mobile application concerns, with each privacy policy comprising rules regulating the transmission of information to an external system. Instrumentation instructions can be integrated with a mobile application or mobile operating system. The instrumentation instructions direct the mobile device to submit a privacy policy request comprising an identifier from the mobile device to a third-party privacy compliance system and enable sending information from the mobile device to the external system, subject to the privacy policy. The privacy policy request is received at the third-party privacy compliance system which selects the privacy policy based on an identifier and sends the privacy policy to the mobile device for implementation.

Abstract: An application may store data to a dataset comprising a plurality of volumes stored on a plurality of storage systems. The application may request a dataset image of the dataset, the dataset image comprising a volume image of each volume of the dataset. A dataset image manager operates with a plurality of volume image managers in parallel to produce the dataset image, each volume image manager executing on a storage system. The plurality of volume image managers respond by performing requested operations and sending responses to the dataset image manager in parallel. Each volume image manager on a storage system may manage and produce a volume image for each volume of the dataset stored to the storage system. If a volume image for any volume of the dataset fails, or a timeout period expires, a cleanup procedure is performed to delete any successful volume images.

Abstract: A backup storage for managing backups of clients includes persistent storage and a backup analyzer. The persistent storage includes the backups, protection policies, and an early deletion schedule. The backup analyzer obtains a request to analyze a protection policy of the protection policies; in response to obtaining the request: obtains backup data information associated with the protection policy; makes a determination, based on the backup data information and the protection policy, that a portion of the backups associated with the protection policies overprotect a client of the clients associated with the protection policy; and modifies the early deletion schedule based on the determination to obtain a modified early deletion schedule.

Abstract: An identifying data set is defined including semi-identifying attributes with semi-identifying attribute values corresponding to an entity. Descriptive records corresponding to the semi-identifying attributes are created. Based on the descriptive records, retention records with retention attributes are created. A composed retention attribute is generated based on applying cryptographic hash algorithms to the retention attributes stored in a database. A retention attribute description is generated with a category and payload corresponding to the composed retention attribute. The semi-identifying attributes with corresponding positions are stored in the retention attribute. Hashes corresponding to the retention attributes are computed based on a composing mechanism that includes logic to compute the hashes. The hashes are combined to generate the composed retention attribute. When a request is received to permanently delete the entity from the database, the entity may be permanently deleted from the database.

Abstract: Embodiments relate to ideal age vector based file retention in a software testing system. An aspect includes determining an ideal age vector of historical bug age data corresponding to a software product in the software testing system, wherein the software testing system stores a plurality of version files of the software product. Another aspect includes based on receiving a new version file of the software product, determining a file to delete of the plurality of version files and the new version file based on the ideal age vector. Yet another aspect includes deleting the determined file to delete such that a number of remaining version files is equal to a number of the plurality of version files.

Abstract: According to one aspect of the present disclosure, a telemetry data set, which includes a plurality of data fields associated with application operations, is collected for an application. A request for at least a portion of the telemetry data set is received and processed. Data fields in the telemetry data set that are to be anonymized are identified based on the request, with information in the identified data fields is to be anonymized according to corresponding anonymization rules. The information in each of the identified data fields is masked based on the corresponding anonymization rule for the data field, and an anonymized telemetry data set is generated. The anonymized telemetry data set includes the masked information for the identified data fields and unmasked information for other data fields indicated in the request.

Abstract: The disclosure provides methods and systems for adaptive data retention. According to an embodiment, data backups are acquired from a protected computing device, and stored on a backup computing device. A retention policy is applied to selectively prune the data backups stored on the backup computing device. At least one reliability metric is used to decide to continue pruning according to a nominal schedule or prune according to a less aggressive schedule.

Abstract: Provided are techniques for linked record declaration of related content items. A graph of nodes representing content items is generated with edges connecting the nodes and representing relationships between the content items. A content item represented by a node in the graph of nodes is selected. In response to selection of the content item, the edges of the graph of nodes are traversed starting from the selected content item to identify other content items. A record is declared in a records management system for the selected content item and the identified content items. A lifecycle policy is associated with the record. The lifecycle policy is applied to the selected content item and the identified content items when processing the record.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for accessing a relational database using requests that conform to a non-structure query language syntax. In one aspect, a method includes receiving, from a client, a first access request that conforms to a NoSQL syntax for accessing a wide column store, wherein the first access request comprises a first event feature and a first attribute feature that are related to the wide column store, and the first attribute feature comprises a column family feature of the wide column store; translating the first access request into a second access request that conforms to a SQL syntax, wherein the second access request comprises a second event feature corresponding to the first event feature and a second attribute feature corresponding to the first attribute feature; and forwarding the second access request to a relational database.

Abstract: Techniques relate to managing a document throughout its lifecycle according to configurable metadata associated with the document. A processor may receive the document in association with an operation and may determine suitable metadata, which may be configurable, to associate with the document. After the operation is closed, the processor may suitably handle the document based on the metadata. Handling the document may include moving the document to an associated profile and/or purging the document. Further, with the configurable metadata, the processor may control the document with increased granularity.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for accessing a relational database using requests that conform to a non-structure query language syntax. In one aspect, a method includes receiving, from a client, a first access request that conforms to a NoSQL syntax for accessing a wide column store, wherein the first access request comprises a first event feature and a first attribute feature that are related to the wide column store, and the first attribute feature comprises a column family feature of the wide column store; translating the first access request into a second access request that conforms to a SQL syntax, wherein the second access request comprises a second event feature corresponding to the first event feature and a second attribute feature corresponding to the first attribute feature; and forwarding the second access request to a relational database.

Abstract: A computer-implemented method for storing data in multiple stages may include (1) establishing an initial storage period for regulatory compliance and a subsequent storage period for business reference, (2) storing data during the initial storage period for regulatory compliance, (3) upon expiration of the initial storage period, stripping rich content from the data while preserving text content in the data, and (4) storing the stripped data during the subsequent storage period for business reference. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A storage gateway for providing stored data includes a persistent storage and a processor. The persistent storage includes a stored data map. The processor obtains a data storage access request from a client, identifies a data fragment specified by the data storage access request, identifies storages that each store a copy of the data fragment using the stored data map, selects a storage of the storages based on connection characteristics between the storages and the client when the data storage access request is obtained, and obtains the copy of the data fragment from the selected storage of the storages.

Abstract: Embodiments of the present disclosure include systems and methods to facilitate top down delete or un-synchronization on delete of a synchronization client to a cloud-based platform. The disclosed technology innovates the mechanism the synchronization client processes local deletes so that instead of synchronizing the delete of each individual item across to the cloud-based platform, it can accumulate the individual item deletes into a top-level folder delete and that top-level folder delete can be what is communicated across to the cloud-based platform. Embodiments of the present disclosure also include systems and methods for depicting item synchronization between a local and cloud based platform/service (e.g. the Box service). In some embodiments the system can identify items that cannot be synchronized between the local and cloud based platform/service (e.g., cloud based collaboration or storage platform/service).

Abstract: Apparatuses and methods are disclosed for database scheduling. An exemplary method may include obtaining a performance parameter associated with a database server. The method may also include determining whether the performance parameter matches a preset condition. After it is determined that the performance parameter matches the preset condition, the method may further include selecting a database instance operating on the database server and migrating the database instance to a receiving database server.

Abstract: Selective regulation of information transmission from mobile applications to a third-party privacy compliant target system. A privacy policy is configured for and mapped to each of a multiplicity of mobile application concerns, with each privacy policy comprising rules regulating the transmission of information to a third-party privacy compliant target system. Instrumentation instructions can be integrated with a mobile application and provided to a mobile device. The instrumentation instructions direct the mobile application to submit a privacy policy request comprising a mobile application identifier from the mobile device to a third-party privacy compliance system and enable sending information from the mobile device to the third-party privacy compliant target system, subject to the privacy policy.

Abstract: A database system stores data as hypertables that represent partitioned database tables. Each hypertable comprises chunks of data that may be distributed across multiple locations, each location comprising at least a storage device. The database system provides an interface that allows database queries seamlessly to hypertables as well as standard tables. The database system dynamically creates chunks as records are added to a hypertable. The database system defines a new partitioning strategy if the storage configuration of the database system is changed by adding new locations or removing existing locations. The records added to the hypertable before the storage configuration was changed continue to be stored as chunks distributed according to the previous partitioning policy.

Abstract: A storage tier manager creates different representations of a dataset backup for different retention periods. Each of the representations of the dataset backup is distinctly identifiable despite initially representing a same dataset backup. The representations are structured metadata corresponding to the dataset backup. One representation is a cached backup version of the dataset backup (“cached backup” or “cached representation”) provided for low latency access while residing at a storage tier of the backup appliance for a relatively short retention period according to a lifecycle management policy. The other representation is a cloud backup version of the dataset backup (“cloud backup” or “cloud representation”) provided for persisting into cloud storage for a longer retention period according to the lifecycle management policy.

Abstract: A memory device and associated control method are provided. The memory device includes a memory array and a control circuit, which are electrically connected with each other. The memory array includes a plurality of memory groups. A first memory group among the plurality of memory groups includes at least one first memory unit. The control circuit executes the control method including following steps. Firstly, a first timestamp corresponding to a first time point is recorded when one of the at least one first memory unit is programmed. Then, state of the first memory group is identified based on the first timestamp and an identification rule, and the first memory group is retired when a condition being predefined in the identification rule is satisfied.

Abstract: One or more network devices can be configured to provide a desired network service according to declarative requirements. A specification of an intent that identifies a desired service and a reference architecture is received. For example, one or more network devices are configured to provide a network service desired according to declarative requirements. The desired service is rendered to provide instructions for dispatch to a plurality of devices having roles. For example, the reference architecture identifies a network topology and one or more protocols to be utilized to provide an intended network service. Rendering the desired service includes invoking a service rendering program function based on the reference architecture and a role of a specific device. A new reference architecture may be implemented by specifying a new service rendering program function for the new reference architecture.

Abstract: Described is system for accurate user alignment across multiple online social media platforms. Out of textual messages from multiple user accounts of a first social media platform, the system identifies a set of textual messages from a first user account and a second user account of the first social media platform, each textual message in the set of textual messages comprising a set of specific character strings. The set of specific character strings represents a link to a post on a second social media platform, resulting in linked messages, the post originating from a linked account of the second social media platform. Either the first user account or the second user account is selected as an associated account by determining which originated the greater number of messages in the set of textual messages. A map component associated with a user identity that includes the associated account and the linked account is generated.

Abstract: Data from computing devices is backed-up regularly, storing a snapshot of the data and corresponding metadata in a data store. The backup data are stored for a relatively short period of time before being archived to long-term storage. For snapshots with files with identical data that are not archived together, archive storage space and computing resources may be conserved by not storing duplicates of the data. When the data is added to the archive storage, the archive storage location is added to backup reference entries for other files with identical data. When all files referencing an archive storage location are expired from the backup data store, an archive retention period is initiated, and an entry is added to a time-based archive expiration database indicating the storage location and an expiration time for the archived data. At the expiration time, the archived data is designated for deletion from the archive.

Abstract: Embodiments of the present invention provide computer-implemented methods, computer systems and computer program products. According to one embodiment of the present invention, an index of a database is obtained, where the index includes at least one node associated with index information of at least one old data entry that has been deleted from the database, and the node is marked as invalid. Then, a node included in the index is selected based on a key value in index information of a new data entry in response to the new data entry being inserted into the database. Next, the selected node is updated with the index information of the new data entry.

Abstract: Implementations described and claimed herein provide systems and methods for automatically compiling content for a particular project. In one implementation, a compilation template for the particular project is retrieved. The compilation template has instructions for compiling a plurality of content files. The compilation instructions include a designation for each of the content files including a path to a source of the content file and a target file type. Each of the content files is retrieved from the source, and each of the retrieved content files has a source file type. Each of the retrieved content files is modified from the source file type to the target file type. The modified content files are compiled into a content set based on the compilation instructions. A framework is generated to display the compiled content set. An archive file storing the generated framework for displaying the compiled content set is output.

Abstract: Provided are techniques for movement readiness checking. It is determined whether each content object in a set of content objects is ready for movement. For each content object in the set of content objects that is determined to be ready for movement, an associated movement readiness indicator is set to indicate that the content object is ready to be moved. Then, each content object in the set of content objects is moved that has the associated movement readiness indicator set to indicate that the content object is ready to be moved.

Abstract: A single system merges primary data storage, data protection, and intelligence. Intelligence is provided through in-line data analytics, and data intelligence and analytics are gathered on protected data and prior analytics, and stored in discovery points, all without impacting performance of primary storage. As data is written it is automatically mirrored for data protection as part of a High Availability (HA) process. Real-time analysis is done in-line with the HA processing, enabling a variety of data analytics. Data content can be mined from within files or blocks. The gathered intelligence is used to tag objects with extended metadata, enabling both valuable search options and rapid restore options. Data recovery begins with metadata restoration, followed by near-instantaneous access to “hot” regions of data being restored, allowing site operation to continue or resume while a restore is ongoing.

Abstract: A retention date-time request is received via a web-based filesystem protocol, wherein: a) the retention date-time request is received from an information lifecycle management (“ILM”) component; b) the ILM component comprises a performance requirement to apply a retention date-time to a filesystem object; and c) the retention date-time request is for the filesystem object in a content management system. The retention date-time request is extracted to process a retention date-time within a meta information store associated with a document content server. A records manager is enabled to use the document content server meta information store for policy enforcement processes.

Abstract: Ongoing management for pre-planned handling of digital presence is provided. A service such as a management service monitors continuously monitors digital assets of an asset owner hosted at external resources. A change to the digital assets retrieved from the external resources is analyzed in response to a detection of the change. The change is processed to reclassify the digital assets into asset categories. The digital assets and the asset categories are matched to suggested actions and suggested trigger events. The suggested actions include operations to dispose of the digital assets in case of an incapacitation of the asset owner. A notification is transmitted to an asset manager to prompt the asset manager to review the updates to the digital assets, the asset categories, the suggested actions, and the suggested trigger events.

Abstract: A method for securely removing data from a storage system is disclosed. In one embodiment, such a method includes receiving, by a storage system, instructions to erase logical units from the storage system. In response to receiving the instructions, the storage system maps the logical units to physical extents on the storage system. The storage system then initiates, using at least one of hardware and software embedded in the storage system, a secure data removal process that securely erases data from the physical extents by overwriting the data thereon, while leaving intact data stored on other physical extents of the storage system. The storage system is configured to process I/O to the other physical extents during execution of the secure data removal process. A corresponding system and computer program product are also disclosed.

Abstract: End of retention processing is provided. Included is: creating, using a content manager (CM), an end of retention policy for a content in a database management system (DBMS; and creating, based on the end of retention policy, a stored procedure in the DBMS for managing the end of retention policy.

Abstract: End of retention processing is provided. Included is: creating, using a content manager (CM), an end of retention policy for a content in a database management system (DBMS; and creating, based on the end of retention policy, a stored procedure in the DBMS for managing the end of retention policy.

Abstract: The present invention relates to the field of data storage, and discloses an image storage method and apparatus thereof. In the present invention, the method comprises the following steps: judging if a storage time of a current image reaches a predetermined duration; if the judgment result is yes, then determining a target region containing at least one region of interest in the current image according to the predetermined duration; generating a target region image containing the target region according to the target region, wherein the data size of the target region image is smaller than the data size of the current image; storing the target region image; deleting the current image.

Abstract: A system for dynamic document retention, in a multi-owner environment that includes a document management system, registers, in a retention service, plural different document owners for a same document. The system receives a different owner-defined document retention policy for the document from each of the document owners, and registers, in a plug-in registry, the policies. In response to a scheduler or a document owner, the system triggers an update of a document retention policy, adds/deletes a document owner from the document, and/or deletes the document when there are no remaining document owners. The document management system includes a retention service that tracks the owners of the same document(s), the plug-in registry that tracks the different document retention policies of the different document owners, and an optional scheduler. The event-based retention policies can be responsive to events occurring internal to or external to the document management system.