Abstract: The Variable Data Source Dynamic and Automatic Ingestion and Auditing Platform Apparatuses, Methods and Systems (“DIAP”) transforms file upload request, external data request, and analytics request inputs via DIAP components into clean data, metadata data sets, visualization module output, and audit notification outputs. A data ingest request is obtained via a user interface. A data file to ingest is obtained and processed to generate a clean file. A database table with a unique name is created and data in the clean file loaded into the database table. A metadata data set identifier is generated. Table columns from the database table to include into the metadata data set are determined, and the metadata data set is generated. The metadata data set links columns from the database table to analytics engine UI elements, and columns are associated with audit trail data via the metadata data set identifier.

Abstract: A data compression method includes providing one or more data block sets, where each data block set includes a plurality of data blocks with a same fingerprint; providing one or more compression groups based on a similarity degree between a plurality of data blocks included in each data block set, where one compression group includes a plurality of similar data blocks, the plurality of similar data blocks are a subset of data blocks included in the one or more data block sets, and a similarity degree between the plurality of similar data blocks meets a specific similarity condition; and compressing the plurality of similar data blocks included in the compression group.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selectively creating high frequency data backups. One of the methods includes maintaining configuration data that indicates a backup frequency at which backups are scheduled to be made for a database, and third party data that identifies one or more predicted events in a geographic area in which the database is physically located; determining, using the third party data, whether a predicted likelihood that the database will experience data loss during a future time period satisfies a threshold likelihood; in response to determining whether the predicted likelihood satisfies the threshold likelihood, selectively changing the backup frequency in the configuration data to be a second, different value that is different than a first value or determining to skip updating the backup frequency; and initiating, using the backup frequency, a backup of at least a second portion of the database.

Abstract: A system includes a processing device and memory device configured to access an email message received at a mail server, extract a plurality of correspondence data from the email message, and apply a correspondence classifier to the correspondence data to determine a request type of the email message. The processing device is further configured to extract a plurality of entities from the email message in a free-form format, where extracting is performed based on determining that the request type is supported. The processing device can also determine a confidence level of the extracting of the entities, perform a lookup of the entities in one or more records of a database based on determining that the confidence level is above a confidence threshold, and generate a new processing request including prepopulated data fields populated with the entities based on identifying a match in the one or more records of the database.

Abstract: In one embodiment, a system includes a processor configured to search a datastore to find records including a given field with a given value, the found records defining a dataset for consideration for archive having an aggregate data size, render to a display an indication of the aggregate data size of the dataset for consideration for archive, receive a user selection to archive at least part of the dataset, and purge the at least part of the dataset from the datastore and archive the at least part of the dataset into archive storage responsively to receiving the user selection, and a memory configured to store data used by the processor.

Abstract: Systems and methods are described herein for routing data by transferring a physical storage device for at least part of a route between source and destination locations. In one example, a computing resource service provider, may receive a request to transfer data from a customer center to a data center. The service provider may determine a route, which includes one or more of a physical path or a network path, for the data loaded onto a physical storage device to reach the data center from the customer center. Determining the route may include associating respective cost values to individual physical and network paths between physical stations between the customer and end data centers, and selecting one or more of the paths to reduce a total cost of the route. Route information may then be associated with the physical storage device based on the route.

Abstract: In some implementations, a data processing device may receive, from a data source, a set of delimiter-separated values and may divide the set of delimiter-separated values into a plurality of subsets. Each subset may correspond to at least a portion of a column or correspond to at least a portion of a row. The data processing device may generate a plurality of vectors, corresponding to the plurality of subsets, according to an embedding space. The data processing device may compare the plurality of vectors to each other and may select a row or a column of the set of delimiter-separated values as one or more headers based on comparing the plurality of vectors to each other. Accordingly, the data processing device may output a tabular data structure including the one or more headers distinguished from a remainder of the set of delimiter-separated values.

Abstract: A method, apparatus, device and storage medium for verifying a real store, which belong to the field of data processing. The method includes: acquiring inputted store information of a first store (S101); searching for, based on the store name and the store address of the first store, a first target store name in a first target area in an electronic map (102) searching for, based on the store address of the first store, a real store address database, and the store name of the first store, a second target store name in a second target area in the electronic map (S103) determining, under a condition that the first target store name or the second target store name exists, that the first store is a real store (S104).

Abstract: A method for rendering context based information on a user interface includes receiving a user request to extract the context based information from a database. The database includes a plurality of documents and the request includes at least one search criteria required to determine a context of the user request. The method includes generating a list of documents corresponding to the context of the user request and rendering on a viewing portion of the user interface the list of documents corresponding to the context of the user request.

Abstract: A storage system is provided. The storage system includes a plurality of non-volatile memory units and a processor operatively coupled to a plurality of non-volatile memory units. The processor is to perform a method including receiving a request to read data from the storage system. The method also includes determining whether a storage operation should be delayed, based on the request to read the data from the storage system. The method further includes in response to determining that the storage operation should be delayed, delaying the storage operation. The method further includes performing a read operation for the request to read the data.

Abstract: Disclosed implementations include systems and methods to efficiently determine a block or blocks of a smart file that have changed, without accessing the block or blocks. For example, the disclosed implementations generate and maintain a nested hash value tree that includes block hash values for at least some blocks of a smart file, and element hash values for at least some elements of the blocks of the smart file for which a block hash value is maintained. The nested hash value tree may be traversed to determine elements and/or blocks of the smart file that have changed without having to access or process the smart file. Still further, the elements and/or blocks of the smart file that have changed may be processed without processing other elements and/or blocks of the smart file to determine the actual change(s) to the smart file.

Abstract: A classification method and system for medical conditions based on the concept of subtypes, which are classes of patients whose medical fact patterns as analyzed in an N-dimensional space places them closer to other patients belonging to the same subtype than to patients who belong to different subtypes and, who share similar likelihood of certain specified outcomes. A computer system processes patient data for a plurality of patients from a set of patients called a cohort. The computer system processes the patient data for the cohort to group patients into sub-cohorts of similar patients, i.e., each sub-cohort includes patients who have similar medical fact patterns in their patient data. Patients in different sub-cohorts generally, but not necessarily, have significant differences in their patient data. The computer system generates quantitative definitions, describing the patients in the sub-cohorts.

Abstract: Methods and systems for adaptive mapping for data compression on a storage device is provided. The method includes determining a data request pattern of a workload, determining whether to use at least one of a segment mapping mode or a hash mapping mode for mapping the workload, dividing a space on the storage device into a plurality of defrag units for storing data, and assigning the plurality of defrag units as being at least one of a segment defrag unit or a hash defrag unit. The method also includes when the data request pattern is for the segment mapping mode, storing the data on at least one of the plurality of defrag units assigned as the segment defrag unit, and when the data request pattern is for the hash mapping mode, storing the data on at least one of the plurality of defrag units assigned as the hash defrag unit.

Abstract: In some examples, a data management and storage (DMS) platform comprises peer DMS nodes in a node cluster, a distributed data store comprising local and cloud storage, and at least one processor configured to perform operations in a method of creating a local consolidated patch file from a patch file chain stored in the cloud storage. Example operations comprise, in a first dry-run phase, creating a patch file image of data blocks in one or more cloud patch files stored in the cloud storage; in a second data-transfer phase, downloading at least some of the data blocks from the cloud patch files identified by the patch file image; and creating and storing, in the local storage, the local consolidated patch file using the downloaded data blocks.

Abstract: Systems and methods for cloud federated token just in time authorization are disclosed. A method may include: (1) receiving, by a cloud authentication services computer program, authenticating information for a user from an active directory federation service computer program; (2) querying, by the cloud authentication services computer program, a plurality of backend services to validate the authenticating information; (3) communicating, by the cloud authentication services computer program, validation to the active directory federation service computer program, wherein the active directory federation service computer program is configured to generate a security token comprising one or more assertion, wherein the assertion comprises a limit on a session with the user at a cloud platform, and wherein the cloud platform is configured to receive the security token and a trusted federated endpoint executed by the cloud platform is configured to enforce the limit on the session.

Abstract: A method is disclosed of copy-free, non-disruptive conversion of a storage volume from a first access protocol to a distinct second access protocol. In a preparatory step a destination volume accessible according to the second access protocol is created. A pairing of a token and a handle is created, the token representing data content of the source volume, the handle being associated with the token and usable to represent the source volume according to the second protocol. In response to a subsequent copy-with-handle command, and based on the pairing of the handle with the token, metadata of the destination volume is populated to reference, without copying, the underlying stored data, the destination volume thereafter functioning as the storage volume accessed using the second protocol.

Abstract: Technology for storing legal hold data in the cloud (for example, in containers), where the source of the data stored in the cloud is independent backup copy(ies) that are maintained by an enterprise subject to a legal hold order. Changing the legal hold data as it is stored in the set of backup copy(ies) in a manner will not change the legal hold data as it is stored in the cloud. Mechanism may also be provided for auditing chain of custody and authenticating parties who request legal hold data to be delivered from cloud storage.

Abstract: A system for real-time data synchronization within a database platform may be provided. The system includes a LRM computing device including a processor in communication with one or more data sources and an eCRM platform. The processor may be configured to (i) cause an input page to be displayed on a user computing device; (ii) create in real-time a query including an identifier received using the input page; (iii) initiate in real-time an API call including the query; (iv) cause, in real-time and using the API call, the eCRM platform and the one or more data sources to compare the identifier to lead referral information stored on the one or more data sources and the eCRM platform; and (v) in response to no match being found in the comparison, automatically create and store a lead referral data entry on the one or more data sources and the eCRM platform.

Abstract: Methods, systems and computer program products for configuring microservices platforms in one or more computing clusters. In one of the computing clusters, a request to instantiate a microservice platform is received, wherein the request is received in a computing cluster having a first node and a second node, and wherein the first node and second node comprise a first virtualized storage controller and a second virtualized storage controller, respectively. The storage controllers each manage their respective storage pools comprising local storage devices. A first microservice manager is deployed on the first node and a second microservice manager is deployed on the second node.

Abstract: A method comprises receiving an input specifying one or more rules for archiving a plurality of files from a source storage location to a target storage location, wherein the target storage location comprises a cloud storage platform comprising a plurality of storage classes. In the method, one or more of the plurality of files are retrieved from the source storage location for migration to the target storage location based at least in part on the one or more rules. Assignment of the one or more of the plurality of files to respective ones of the plurality of storage classes is controlled based at least in part on the one or more rules. The one or more rules specify one or more constraints for the assignment of the one or more of the plurality of the files to the respective ones of the plurality of storage classes.

Abstract: Example aspects include techniques for clustering delete targets for vectorized deletion including retrieving, from a set of delete targets in a distributed database system, a file to be deleted, scanning existing clusters of files marked for deletion to identify at least one existing cluster of files having constraints corresponding to the file, based on identifying the at least one existing cluster of files, adding the file to the at least one existing cluster of files to create a new cluster of files, based on failing to identify the at least one existing cluster of files, creating the new cluster of files including the file, and generating, for each file in the new cluster of files and based on a deletion signal, a delta array including multiple bits representing data items in each file and indicating, based on bit value, target data items to be deleted from each file.

Abstract: Embodiments of the invention relate to methods and systems for efficiently restoring a production host. Selected assets are restored from a plurality of slices stored on a plurality of containers in a backup storage system. In order to restore the selected assets, a hierarchical mapping of the slices is produced by analyzing a backup's metadata, from which the assets are to be restored. The hierarchical mapping is then searched for highest level slice containing the assets and then searching the lower-level slices associated with the highest-level slice to efficiently discover the slices containing the selected assets. This invention reduces and/or eliminates the need to crawl the entire slice list once the highest level is discovered; only its children need to be searched for the asset. Once the slices associated with an asset are found, they can be quickly restored from the corresponding containers which hold the assets.

Abstract: In some implementations, a file sharer may receive, from a first user device, a file and an indication of a set of additional users and may perform encryption on the file to generate an encrypted file. The file sharer may transmit the encrypted file to a cloud storage. The file sharer may receive, from a second user device, a request for the file and may contact a single sign on service to authenticate a user of the second user device. The file sharer may verify that the user of the second user device is included in the set of additional users. The file sharer may receive the encrypted file from the cloud storage and may perform decryption on the encrypted file to generate a copy of the file. The file sharer may transmit, to the second user device, the copy of the file.

Abstract: A lightweight filesystem may be provided for remote storage caching. A filesystem may maintain a persistent cache for a data set stored as data files in immutable data objects in a remote data store. Filesystem metadata may be evaluated to determine whether a portion of a data file is stored in the persistent cache according to an offset and length specified in a request. If in the persistent cache, data obtained from a data block in the persistent cache may be returned. If not in the persistent cache, then the remote data store may be accessed and the data file in the immutable data object read to obtain the portion of the data file.

Abstract: Systems, methods and products for performing file retention operations in a system in which a content management system accesses multiple cloud-based data stores that are compliant with a common file transfer protocol, but use different vendor-specific protocols for file retention operations, where a retention framework is coupled between the content management system and the data stores. The content management system performs file access operations by accessing an SDK that generates requests for these operations which follow the common set of protocols. The content management system performs file retention operations by accessing a retention framework that uses the information received from the content management system to identify the targeted file, identify the data store in which the targeted file is stored, and generate a request for a retention operation that is configured according to the data-store-specific retention protocols which correspond to the identified data store.

Abstract: Disclosed herein are a method and apparatus for searching for a video section by using a natural language. The method for searching for a video section includes: extracting keywords from a natural language sentence, when the natural language sentence is input; determining whether or not the extracted keywords are included in predefined context information; and deriving and providing a final search result. In addition, when the extracted keywords are included in the predefined context information, a search result is derived by performing a first method, and when the extracted keywords are not included in the predefined context information, a search result is derived by performing a second method.

Abstract: Systems and methods presented herein provide for adaptive content delivery. In one embodiment, a system includes a repository operable to store a plurality of web components, and a database operable to store identifiers of a plurality of users. The system also includes a machine learning module operable to: generate a model of computing device interactions of the plurality of the users based on the stored identifiers of the plurality of users; monitor a computing device interaction of a first of the plurality of users; process the computing device interaction of the first user through the model; and predict a format of web component delivery desired by the user based on the model. A formatter may be operable to retrieve a portion of the web components from the repository, and to automatically format the retrieved web components for the first user based on the predicted format of web component delivery.

Abstract: A method is provided for determining command-to-process correspondence. The method includes identifying, by the hardware processor, initial processes resulting from executions of container immutability change events for each of multiple initially mutable containers in a cluster, based on an execution time, a process identifier and a process group identifier for each of the container immutability change events. The method also includes designating, by the hardware processor, a particular external command, from among external container commands stored in a database, as having a correspondence to an initial process, responsive to the initial process matching at least one respective process resulting from executing the particular external command.

Abstract: Described herein is a system for syncing asynchronously received sequential data from disparate sources. In an embodiment, a central system may receive data transmissions from disparate sources. Each data transmission includes a timestamp and an identifier of the disparate source. The central system may sort the data from the data transmissions of disparate sources in chronological order based on the timestamps. The central system may group the data based on the identifier of the disparate source and normalize the data of the data transmissions to be in a specified format. The central system may store the normalized data of the data transmission in a data storage facility based on the identifier of the disparate source and the sorted order of the data.

Abstract: A request from a user to access a report associated with one or more content items maintained by an electronic content management system can be received. A query, associated with the request and including one or more attributes of the request to access the report can be executed. A set of user permissions can be set. The requested report can be based on one or more results returned from the executing of the query. The requested report can include information consistent with the set of user permissions and generated to include a link to the one or more content items maintained by the electronic content management system. The analytics engine can be logically separate from the electronic content management system. A request can be received through the query to access the one or more content items. The one or more content items can then be presented to the user.

Abstract: Processing per-use requests for user data is disclosed, including: receiving a use-specific request to read a set of user data; determining whether to grant the use-specific request based at least in part on an access policy associated with an accessor definition associated with the use-specific request; and in response to a determination to grant the use-specific request, transforming the set of user data based at least in part on the accessor definition.

Abstract: An illustrative pseudo-file-system driver uses deduplication functionality and resources in a storage management system to provide an application and/or a virtual machine with access to a locally-stored file system. From the perspective of the application/virtual machine, the file system appears to be of virtually unlimited capacity. The pseudo-file-system driver instantiates the file system in primary storage, e.g., configured on a local disk. The application/virtual machine requires no configured settings or limits for the file system's storage capacity and may thus treat the file system as “infinite.” The pseudo-file-system driver intercepts write requests and may use the deduplication infrastructure in the storage management system to offload excess data from local primary storage to deduplicated secondary storage, based on a deduplication database.

Abstract: Improved computer-implemented methods for evidencing the existence of a digital document, anonymously evidencing the existence of a digital document, database management for systems for evidencing the existence of a digital document, and verifying the data integrity of a digital document provide increased reliability, security and enhance trust from users and third parties.

Abstract: A first set and a second set are identified as operands for a set operation of a similarity analysis task iteration. Using respective minimum hash information arrays and contributor count arrays of the two sets, a minimum hash information array and contributor count array of a derived set resulting from the set operation is generated. An entry in the contributor count array of the derived set indicates the number of child sets of the derived set that meet a criterion with respect to a corresponding entry in the minimum hash information array of the derived set. The generated minimum hash information array and the contributor count array are stored as part of input for a subsequent iteration. After a termination criterion of the task is met, output of the task is stored.

Abstract: In accordance with embodiments, there are provided mechanisms and methods for facilitating prevention of duplicate transactions across multiple transaction entities in database systems according to one embodiment. In one embodiment and by way of example, a method includes receiving a request to facilitate a financial transaction, wherein the request is received from an external computing device and includes an idempotency key that is unique to the request, and verifying, based on the idempotency key, the request as being a valid request or an invalid request, wherein the valid request is registered, and classifying, based on the idempotency key and a gateway log, the valid request as an original request or a duplicate request that is a successful duplicate request or an unsuccessful duplicate request.

Abstract: Provided is a method of synchronizing a distributed object store including a plurality of data stores, the method including bringing a first data store of the data stores online after having been offline, choosing a second data store of the data stores, the second data store being online while the first data store was offline, reading, by the first data store, an entry from a catch-up log, and performing a data modification operation corresponding to the entry on the first data store to synchronize the plurality of data stores.

Abstract: Data moving micro-services are deployed to a public cloud and a cloud vault target (CVT). A first request is issued to the public cloud for a first snapshot of data belonging to a customer tenant. The first snapshot is accessed to write the data to a first cloud volume in the public cloud. Data of the first cloud volume is vaulted to the CVT via the micro-services. The first cloud volume is maintained in the public cloud. A second request is issued to the public cloud for a second snapshot of the data belonging to the customer tenant. The second snapshot is accessed to write the data to a second cloud volume in the public cloud. Data of the second cloud volume is compared against data of the first cloud volume to identify redundant data. Data of the second cloud volume that is not redundant is vaulted to the CVT.

Abstract: Provided in the present disclosure are an electronic device and a control method therefor. An electronic device of the present disclosure comprises a memory in which a kernel and at least one application are stored, and a processor, which generates a first rule for determining a time at which the application calls a system in order to execute a process, determines, on the basis of the first rule, whether the application corresponds to an application for which security is verified, and generates a second rule for skipping an audit on the basis of a plurality of pre-defined rules, if the application corresponds to the application for which security is verified.

Abstract: Methods and systems for transforming data archives are provided. In one embodiment, a method is provided that includes receiving a data archive and selecting a first data item from among a plurality of data items contained within the data archive. A first data format of the first data item may be identified that specifies a first type of data stored in the first data item and a first data transformation may be selected that corresponds to the first data format. The first type of data may be transformed by the first data transformation to generate a first transformed data item. The first data item may be replaced with the first transformed data item in the data archive and an executable item contained within the data archive may be executed.

Abstract: An apparatus may be configured to determine an industry object model based on an industry of a data set of an enterprise; generate an archive package for an archive time point by, for each data source, determining archival data of the data source to be archived and transforming the archival data of the data source into a set of data source objects based on the industry object model, and storing, in the archive package, the data source objects for each data source; identify a subset of the data source objects to be purged based on a purge time point; and remove the subset of the data source objects from the archive package. An apparatus may also be configured to generate and store a set of global objects that are represented in the data set, and to associate the set of data source objects with the set of global objects.

Abstract: A storage system receives data to be stored in its memory. A controller in the storage system allocates a primary block of the memory to store the data and determines the health of the allocated block. If the controller determines that the allocated block is not healthy enough to reliably store the data, the controller allocates a secondary block to redundantly store the data.

Abstract: Embodiments of the inventive concept include solid state drive (SSD) multi-card adapters that can include multiple solid state drive cards, which can be incorporated into existing enterprise servers without major architectural changes, thereby enabling the server industry ecosystem to easily integrate evolving solid state drive technologies into servers. The SSD multi-card adapters can include an interface section between various solid state drive cards and drive connector types. The interface section can perform protocol translation, packet switching and routing, data encryption, data compression, management information aggregation, virtualization, and other functions.

Abstract: A method for managing data includes obtaining data from a host, wherein the data is associated with an object identifier (ID), initiating a classification mapping update to obtain a classification entry, applying an erasure coding procedure to the data to obtain a plurality of data chunks and at least one parity chunk, deduplicating the plurality of data chunks to obtain a plurality of deduplicated data chunks, generating storage metadata associated with the plurality of deduplicated data chunks and the at least one parity chunk, generating an object entry associated with the plurality of data chunks, and the at least one parity chunk, wherein the object entry comprises the object ID and a classification ID, storing the storage metadata and the object entry in an accelerator pool, and storing the plurality of deduplicated data chunks and the at least one parity chunk.

Abstract: Facilitating detection of anomalies of a target entity is provided herein. A system can comprise a processor and a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations. The operations can comprise training a model on a first set of variables that are constrained by a second set of variables. The second set of variables can characterize elements of a defined entity. The first set of variables can define a normality of the defined entity. The operations also can comprise employing the model to identify expected parameters and unexpected parameters associated with the defined entity to at least a defined level of confidence.

Abstract: A computing system can receive contextual data corresponding to a particular user and execute context resolution and constraint evaluation processes with local data acquisition and/or derivation priority to classify the user in one or more groups and reduce network latency. Based on the classified group(s) of the user, the computing system can provide targeted, group-specific content through an executing application of the user's computing device to enhance user experience with the application service.

Abstract: Embodiments of the disclosure provide systems and methods for providing random access to segmented and encrypted or compressed data stored in a repository. Retrieving at least a portion of a file stored in a repository can comprise storing a plurality of files in the repository. A request to retrieve at least a portion of one of the plurality of files can be received and object metadata for the requested one of the plurality of files can be obtained. A determination can be made based on the obtained metadata as to whether the requested one of the plurality of files is a multipart file. In response to determining the requested one of the plurality of files is not a multipart file, a single file retrieval process performing and in response to determining the requested one or the plurality of files is a multipart file, a multipart retrieval process can be performed.

Abstract: The present invention relates to a system and method configured to store and retrieve files and, specifically, to a system and method for encoding files, such as image files or video files, into compressed archive and then later retrieving the files from the compressed archive in response to user requests.

Abstract: Systems and methods are disclosed for efficiently storing information identifying journey instances within unstructured event data of a data intake and processing system. Each journey instance is illustratively associated with a series of events within the unstructured event data occurring over a journey duration. Because the unstructured event data may be constantly updated, any given inspection of the event data may yield both complete and incomplete instances. Storage of instance data over time can require updating of prior incomplete journey instances with complete versions of such instance detected at a later point in time. However, a data store of the unstructured event data may be unsuited for such updating, as the store may maintain version information for deleted data to reduce possibility of data loss. To address this issue, a separate structured data store, such as a columnar time series data store, is provided to efficiently store instance information.

Abstract: A method for storing information includes receiving information to be stored and an information tag from a user computing entity, and storing the information and the information tag. The information to be stored includes a chunk that is divided into a plurality of blocks each comprising one or more elements. The information tag comprises a plurality of tags each having been computed for one of the blocks, wherein the tag for the j-th block of the i-th chunk is based on: an output of a random function using as input: 1) an output of an index function mapping each index j to a certain value, and/or 2) a seed sampled for the i-th chunk; the j-th block; and a representation of a second secret comprising one or more random elements each associated with a respective one of the one or more elements of one of the blocks.

Abstract: A method and system for authenticating a variety of consumer products is provided. The system includes a plurality of near field communication (NFC) tags configured for coupling to a variety of consumer products, the tags programmed to provide identifying data associated with a single consumer product to an NFC-capable mobile computing device, the NFC having a structure that detects opening of the consumer product, a central database for storing said data, a server communicably connected to a communications network and configured to access the database, and a mobile application executing on a mobile computing device, configured to read said identifying data from the NFC tag and communicate said identifying data to the server.